xxq250
/
homework-jianmu
1
0
Fork 0
Code Issues Pull Requests 1 Actions Packages Projects Releases Wiki Activity
59,381 Commits 3 Branches 0 Tags 479 MiB
Commit Graph

12587 Commits

Author SHA1 Message Date
dmchen 0f40e1dbb9 memory leak 2023-10-30 16:59:12 +08:00
dmchen 40c9622df5 memory leak 2023-10-30 08:57:07 +00:00
Haojun Liao ed07486405 fix(tsdb): fix error in decide if data buffer overlaps with stt files/block-files. 2023-10-30 16:40:09 +08:00
Haojun Liao bc1c2a879a fix(tsdb): avoid to read duplicated rows in buf. 2023-10-30 16:12:08 +08:00
dmchen be0a85a0ff memory leak 2023-10-30 15:22:54 +08:00
Minglei Jin 84d2f9c379 tsdb/upload: delay data file uploading 2023-10-30 15:22:34 +08:00
dmchen 6172b820ac memory leak 2023-10-30 07:19:08 +00:00
Haojun Liao fdf3f210ac refactor: do some internal refactor. 2023-10-30 14:39:24 +08:00
Haojun Liao 3275452bce fix(stream): fix the deadlock. 2023-10-30 14:38:51 +08:00
kailixu c77153cb81 enh: use placeholder '-' for interval of 1st retention level 2023-10-30 14:02:31 +08:00
Haojun Liao 15d217fc3e fix(stream): fix memory leak. 2023-10-30 13:29:35 +08:00
Haojun Liao b0700d6095 Merge branch '3.0' into fix/3_liaohj 2023-10-30 11:57:54 +08:00
Haojun Liao 93232a0e14 fix(stream): enable the set of fill-history task to be un-init. 2023-10-30 11:48:51 +08:00
liuyao 1a37f19c82 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898 2023-10-30 11:43:23 +08:00
dapan1121 6f0b634f95 Merge remote-tracking branch 'origin/3.0' into feat/TD-25204 2023-10-30 10:24:16 +08:00
dapan1121 53e9c483c9
Merge pull request #23422 from taosdata/enh/TD-25879-3.0x 
enh: dmodule API dependence and grant process
 2023-10-30 10:13:28 +08:00
dapan1121 1b7a6bccdf
Merge pull request #23430 from taosdata/enh/TD-26641-3.0 
enh: only float/double allowed for sum/avg of rsma
 2023-10-30 10:08:55 +08:00
Minglei Jin 4fede02da4 tsdb/retention: remove s3 evict cache hook 2023-10-30 10:06:42 +08:00
Haojun Liao 1bbad532a7 fix(stream): add more check. 2023-10-30 09:32:40 +08:00
Haojun Liao 91121974d7 fix(stream): do nodeUpdate trans only after check if vnodes are all ready. 2023-10-30 09:32:40 +08:00
Haojun Liao 48202a1e45 fix(stream): set the trans exec sequentially. 2023-10-30 09:32:40 +08:00
Haojun Liao 1a1b9f5ea3 fix(stream): set the trans exec sequentially. 2023-10-30 09:32:40 +08:00
dapan1121 972e10a238 Merge remote-tracking branch 'origin/3.0' into feat/TD-25204 2023-10-30 08:45:29 +08:00
Haojun Liao 790d869494 fix(stream): add more check. 2023-10-29 22:57:33 +08:00
kailixu 22d6b95585 enh: dm init API 2023-10-29 21:13:18 +08:00
Haojun Liao da6e3cb293 fix(stream): do nodeUpdate trans only after check if vnodes are all ready. 2023-10-29 17:37:10 +08:00
Haojun Liao 1e696287d8 fix(stream): set the trans exec sequentially. 2023-10-29 02:45:47 +08:00
kailixu 3f65773222 enh: send grant to dnodes online and in async mode 2023-10-29 02:18:47 +08:00
Haojun Liao 3bf3d00d90 fix(stream): set the trans exec sequentially. 2023-10-27 23:45:50 +08:00
Haojun Liao c7285c0ede fix(stream): add expired epset node list for stream tasks in hb to mnode. 2023-10-27 23:41:57 +08:00
Haojun Liao 4c267b538f fix(stream): add expired epset node list for stream tasks in hb to mnode. 2023-10-27 23:05:41 +08:00
Hongze Cheng a7f3041ff3 more fix 2023-10-27 17:59:27 +08:00
Benguang Zhao 4163a3be7c feat: resend snap replication of data on timeout 2023-10-27 17:58:26 +08:00
Hongze Cheng cdb1d8296d feat: concurrency on fileset 2023-10-27 17:48:19 +08:00
dmchen 43e6dec6c2 TD-26971 2023-10-27 17:39:50 +08:00
dmchen 34c4ffde26 TD-26971 2023-10-27 09:30:30 +00:00
Minglei Jin 8c6f452f09 tsdb/write: make last tier writable to mem 2023-10-27 15:51:52 +08:00
kailixu dc8cb7a99e fix: memory leak 2023-10-27 14:36:01 +08:00
Haojun Liao dcca6b0868 other: merge 3.0. 2023-10-27 11:41:28 +08:00
Haojun Liao 29b3a7a5e9 refactor: do some internal refactor. 2023-10-27 09:59:53 +08:00
Haojun Liao 38eb5d2f89 refactor(stream): do some internal refactor. 2023-10-27 09:59:53 +08:00
Haojun Liao b4992a8506 other: add some logs. 2023-10-27 09:59:52 +08:00
Haojun Liao 9c9d02b181 fix(stream): disable follower nodes exec reset. 2023-10-27 09:59:52 +08:00
Haojun Liao fa670a93f3 fix(stream): set the retrycode for checkpoint source transaction. 2023-10-27 09:59:52 +08:00
Haojun Liao 454624516c fix(stream): handle the repeatly issued nodeUpdate msg from dnode. 2023-10-27 09:59:51 +08:00
Haojun Liao 33dc51cc86 fix(stream): add some logs. 2023-10-27 09:59:44 +08:00
Haojun Liao 1ccbb77981 fix(stream): fix dead lock when shutdown all tasks. 2023-10-27 09:59:37 +08:00
Haojun Liao 2493c21ed3 fix(stream): fix the invalid write in sma 2023-10-27 09:58:52 +08:00
Haojun Liao 7cce53f7e5 fix(stream): ignore the check status when is ready. 2023-10-27 09:58:52 +08:00
Haojun Liao c99f434706 fix(stream): set checkpoint failure when in pause status. 2023-10-27 09:58:52 +08:00
Haojun Liao 2c1af8dad8 refactor: do some internal refactor. 2023-10-27 09:58:52 +08:00
Haojun Liao 1ad2c3029a refactor(stream): do some internal refactor. 2023-10-27 09:58:52 +08:00
Haojun Liao 7311f9d2fe fix(sma): fix bugs in sma and do some internal refactor. 2023-10-27 09:58:51 +08:00
Haojun Liao 3bcffcf1da other: merge stream refactor from main. 2023-10-27 09:56:02 +08:00
Haojun Liao 47d4bac57a fix(stream): remove invalid assert. 2023-10-27 09:55:07 +08:00
Haojun Liao 4845474ea4 refactor: do some internal refactor. 2023-10-27 09:55:06 +08:00
Haojun Liao 5313543a9e refactor: do some internal refactor. 2023-10-27 09:55:05 +08:00
Haojun Liao 48ff521968 fix(stream): update the nodeEp even during checkpoint trans. 2023-10-27 09:55:02 +08:00
Haojun Liao 226b6596d6 fix(stream): fix bugs caused by refactor. 2023-10-27 09:54:58 +08:00
Haojun Liao 091238e7be fix(stream): fix bugs caused by refactor sm. 2023-10-27 09:54:58 +08:00
Haojun Liao e1f6043eed fix(stream): fix bugs caused by refactor sm. 2023-10-27 09:54:57 +08:00
Haojun Liao 8729bdac1e fix(stream): fix bugs caused by refactor. 2023-10-27 09:54:57 +08:00
Haojun Liao 1eac7f44c0 fix(stream): fix error in stream. 2023-10-27 09:54:56 +08:00
Haojun Liao 579dd8e6b2 refactor(stream): do some internal refactor. 2023-10-27 09:54:56 +08:00
Haojun Liao 6f3c0d17cc refactor(stream): add state machine to manage the state of stream tasks. 2023-10-27 09:54:49 +08:00
Haojun Liao 596eb073b7 refactor(stream): do some internal refactor. 2023-10-27 09:54:48 +08:00
Haojun Liao 4badb445c4 refactor: do some internal refactor W.R.T. global configurations. 2023-10-27 09:54:07 +08:00
Haojun Liao 62c58ecd8b fix(stream):add more check for test cases. 2023-10-27 09:54:06 +08:00
Haojun Liao a4f6042966 fix(stream): fix error in creating update node trans. 2023-10-27 09:52:14 +08:00
Haojun Liao ffa798c4fa enh(stream): add some logs. 2023-10-27 09:52:14 +08:00
Haojun Liao f549ce3578 refactor: do some internal refactor. 2023-10-27 09:49:16 +08:00
kailixu 9ae83455e2 chore: code format 2023-10-27 09:48:13 +08:00
liuyao cf3bfe9310 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898 2023-10-27 09:39:00 +08:00
kailixu 96de7b0cf0 chore: update grant/dnode mgmt 2023-10-27 00:02:25 +08:00
Hongze Cheng b8c379a20d
Merge pull request #23413 from taosdata/fix/TD-26669 
fix(tsdb/commmit): make ts big enough to skip row
 2023-10-26 07:17:53 -05:00
wade zhang d1e4e909c3
Merge pull request #23384 from taosdata/fix/TD-26884-3.0 
Fix/td 26884 3.0
 2023-10-26 17:00:00 +08:00
wade zhang 951442e3db
Merge pull request #23381 from taosdata/fix/TD-26884-main 
TD-26884
 2023-10-26 16:59:39 +08:00
Minglei Jin b314758108 tsdb/commit: make ts big enough to skip row 2023-10-26 16:24:06 +08:00
kailixu bb77015998 Merge branch '3.0' into enh/TD-26641-3.0 2023-10-26 10:40:54 +08:00
Hongze Cheng 209ebbde84
Merge pull request #23402 from taosdata/fix/TD-26189-libs3 
cmake/xml2: use sha256 to verify distribution release
 2023-10-25 20:27:29 -05:00
kailixu 64765579e9 enh: check interval and keep for retentions 2023-10-25 22:42:01 +08:00
Haojun Liao c95cd8da8b refactor(stream): do some internal refactor. 2023-10-25 18:14:28 +08:00
liuyao f51c985914 stream event window 2023-10-25 17:50:16 +08:00
Minglei Jin d77ecbbb1b cmake/xml2: use sha256 to verify distribution release 2023-10-25 17:41:55 +08:00
dmchen 14be9c81e2 create table user and clusterid 2023-10-25 14:53:06 +08:00
Haojun Liao 9220731313 other: add some logs. 2023-10-25 14:51:59 +08:00
dmchen 7ef019d105 create table user and clusterid 2023-10-25 06:49:23 +00:00
Haojun Liao f36b24ed24 fix(stream): disable follower nodes exec reset. 2023-10-25 14:16:36 +08:00
Haojun Liao 07e9d56e07 fix(stream): set the retrycode for checkpoint source transaction. 2023-10-25 11:42:46 +08:00
Hongze Cheng 3ff331b8b7
Merge pull request #23391 from taosdata/fix/TD-26189-libs3 
cmake: new option: BUILD_S3
 2023-10-24 22:37:20 -05:00
Haojun Liao 03165d5327 fix(stream): handle the repeatly issued nodeUpdate msg from dnode. 2023-10-25 09:55:02 +08:00
dapan1121 533711a7f2
Merge pull request #23387 from taosdata/fix/3.0/TS-4090 
fix: disable life extending of conn cache obj when show queries/conns
 2023-10-25 09:48:13 +08:00
dapan1121 ba43950bc6
Merge pull request #23294 from taosdata/fix/TD-26474-3.0 
fix: add lock for trans
 2023-10-25 08:46:19 +08:00
Haojun Liao 26aaa4a83c other: merge main. 2023-10-25 00:39:14 +08:00
Haojun Liao 13d979a2ee fix(stream): add some logs. 2023-10-25 00:03:46 +08:00
Haojun Liao 8cde39eebd fix(stream): fix dead lock when shutdown all tasks. 2023-10-24 19:11:24 +08:00
Minglei Jin f9ca8fe962 cmake: new option: BUILD_S3 2023-10-24 16:10:46 +08:00
Haojun Liao f1498f8929 fix(stream): fix the invalid write in sma 2023-10-24 15:24:34 +08:00
dmchen 162066235b create table 2023-10-24 14:31:27 +08:00
dmchen 956aa1742c TD-26884 2023-10-24 14:31:02 +08:00
Hongze Cheng e7e7748e6d
Merge pull request #23366 from taosdata/fix/TD-26669 
tsdb/commit: skip last tier ts data committing
 2023-10-24 01:29:01 -05:00
dmchen ae728ab412 create table 2023-10-24 06:17:13 +00:00
wangjiaming0909 be7791f9cd fix: disable life extending of conn cache obj when show queries/conns 2023-10-24 13:58:30 +08:00
dmchen ecd5f1084c TD-26884 2023-10-24 05:32:48 +00:00
Haojun Liao a6e706ba2d fix(stream): ignore the check status when is ready. 2023-10-24 11:38:14 +08:00
dapan1121 dbbceae061 fix: union all view issue 2023-10-24 11:29:04 +08:00
Haojun Liao e92b276e3e fix(stream): set checkpoint failure when in pause status. 2023-10-24 10:14:29 +08:00
Minglei Jin e826532592 cmake/vnode: specify no default path for ssl & crypto 2023-10-24 10:10:43 +08:00
Haojun Liao 0dae8c3c76 refactor: do some internal refactor. 2023-10-24 09:49:14 +08:00
Haojun Liao f446ff1c36 refactor(stream): do some internal refactor. 2023-10-24 09:48:10 +08:00
Haojun Liao 7a8b046a35 fix(sma): fix bugs in sma and do some internal refactor. 2023-10-24 09:40:38 +08:00
Minglei Jin 7fdf6cc696 cmake: use new dir for libs3 2023-10-24 09:04:24 +08:00
Minglei Jin 80fb38f172 Merge branch '3.0' into fix/TD-26189-libs3 2023-10-23 16:31:21 +08:00
Minglei Jin f630fc38f8 tsdb/commit: skip last tier ts data committing 2023-10-23 15:46:32 +08:00
Haojun Liao 2ee3319611
Merge pull request #23360 from taosdata/fix/liaohj 
fix(tsdb): apply the window range when building blocks from stt files.
 2023-10-23 12:45:42 +08:00
dapan1121 ab98f7623c Merge remote-tracking branch 'origin/3.0' into feat/TD-25204 2023-10-23 08:44:46 +08:00
Haojun Liao a882c639be fix(stream): remove invalid assert. 2023-10-22 16:16:59 +08:00
Haojun Liao 825195b351 refactor: do some internal refactor. 2023-10-21 16:38:46 +08:00
Haojun Liao 74572dd6a7 refactor: do some internal refactor. 2023-10-21 15:21:02 +08:00
Haojun Liao 6dc8fc50bc
Merge pull request #23359 from taosdata/fix/3_liaohj 
fix(tsdb): apply the window range when building blocks from stt files.
 2023-10-21 14:57:14 +08:00
Haojun Liao 49014d4b68 fix(stream): update the nodeEp even during checkpoint trans. 2023-10-21 01:42:43 +08:00
Haojun Liao f667bf3866 fix(tsdb): apply the window range when building blocks from stt files. 2023-10-20 18:19:45 +08:00
Haojun Liao f1207d8d42 fix(tsdb): apply the window range when building blocks from stt files. 2023-10-20 18:18:58 +08:00
Haojun Liao c4268ca395 fix(stream): fix bugs caused by refactor. 2023-10-20 15:54:30 +08:00
Haojun Liao 024bfa0fff
Merge pull request #23353 from taosdata/changeGenFirstTagName_3.0 
gen first tag name
 2023-10-20 15:38:32 +08:00
Minglei Jin 55647f9ce9 cos/put: make chunk small to not block other reqs 2023-10-20 15:15:03 +08:00
Haojun Liao 3b8c85f632 fix(stream): fix bugs caused by refactor sm. 2023-10-20 14:19:57 +08:00
yihaoDeng 1bc7e5eb85 enh gen first tag name 2023-10-20 14:02:13 +08:00
Minglei Jin 74d05c2771 vnode/cos: fix multipart uploading 2023-10-20 13:47:25 +08:00
yihaoDeng e13fb887b8 enh gen first tag name 2023-10-20 10:47:27 +08:00
yihaoDeng e89d1851c8 enh gen first tag name 2023-10-20 10:47:02 +08:00
yihaoDeng 6f21d542cd enh gen first tag name 2023-10-20 10:46:17 +08:00
yihaoDeng f9a027bc7d enh gen first tag name 2023-10-20 10:45:57 +08:00
yihaoDeng c0c6e206d2 enh gen first tag name 2023-10-20 10:44:33 +08:00
yihaoDeng 08fc4814cb enh gen first tag name 2023-10-20 10:43:44 +08:00
Haojun Liao 270a847809 fix(stream): fix bugs caused by refactor sm. 2023-10-20 10:23:48 +08:00
Haojun Liao 9f9fae3b99
Merge pull request #23329 from taosdata/opt/addStatusSend 
Opt/add status send
 2023-10-20 09:52:12 +08:00
yihaoDeng 9f6dd2b405 change gen first tag name 2023-10-20 09:42:11 +08:00
yihaoDeng 8fbea08bba enh gen first tag name 2023-10-20 09:37:43 +08:00
dapan1121 42f440b0fb Merge remote-tracking branch 'origin/3.0' into feat/TD-25204 2023-10-20 08:46:32 +08:00
dapan1121 969b002936 enh: support view privilege 2023-10-20 08:41:49 +08:00
Benguang Zhao 959f8105ee enh: require command to trigger repairing vnodes on replaced disks 2023-10-19 18:55:12 +08:00
Haojun Liao d5059826a8 fix(stream): fix bugs caused by refactor. 2023-10-19 17:59:04 +08:00
Haojun Liao c1cebae6ba fix(stream): fix error in stream. 2023-10-19 16:20:27 +08:00
Haojun Liao 402aefd95d refactor(stream): do some internal refactor. 2023-10-19 15:09:47 +08:00
yihaoDeng 0188289308 statusClientRpc 2023-10-19 14:07:54 +08:00
yihaoDeng b4b742b3fb add rpc sync read timeout 2023-10-19 11:35:29 +08:00
yihaoDeng 27b2d37bde add rpc sync read timeout 2023-10-19 11:27:31 +08:00
Benguang Zhao a2e0480839 refact: rename as SYNC_FSM_STATE_COMPLETE 2023-10-19 11:18:57 +08:00
Benguang Zhao a515f8a94f feat: use vnode config info if existing during vnodeCreate 2023-10-19 11:18:57 +08:00
Benguang Zhao a95f6e6862 feat: support restore dnode with vnodes of replaced disks for primary dirs 2023-10-19 11:18:57 +08:00
Benguang Zhao c4e9069a66 fix: set nextProcessedVer properly in tqProcessTaskScanHistory 2023-10-19 11:18:57 +08:00
Benguang Zhao 5c85525fd0 enh: add tsdbFSCreateRefSnapshotWithoutLock 2023-10-19 11:18:57 +08:00
Benguang Zhao f2bd43c07e fix: set field length properly in tsdbGetSnapDetails 2023-10-19 11:18:57 +08:00
Benguang Zhao 83013e0fe5 enh: return error in case of out of memory for tsdbGetSnapRangeHash 2023-10-19 11:18:57 +08:00
Benguang Zhao 59e8a2104c refact: wrap funcs to handle snapshot info for vnodeSnapReaderOpen and vnodeSnapWriterOpen 2023-10-19 11:18:57 +08:00
Benguang Zhao eb8c4d3e8c enh: use hash table for filtering fset in tsdbSnapReaderOpen and tsdbSnapWriterOpen 2023-10-19 11:18:57 +08:00
Benguang Zhao 4e74533878 enh: avoid _Static_assert 2023-10-19 11:18:57 +08:00
Benguang Zhao 094cf408df enh: prepare vnode dir again in vnodeOpen 2023-10-19 11:18:57 +08:00
Benguang Zhao c1f1709d59 fix: add rsmaSnapWriterPrepareClose 2023-10-19 11:18:57 +08:00
Benguang Zhao 74185b8b9c feat: exchange snapshot info for rsma tsdbs 2023-10-19 11:18:57 +08:00
Benguang Zhao d5d713b1b4 enh: fill snapshot info for rsma tsdbs 2023-10-19 11:04:39 +08:00
Benguang Zhao b80f8201ce feat: detect fs incompleteness of RSMA tsdbs 2023-10-19 11:04:39 +08:00
Benguang Zhao 29bbebc323 enh: refactor a func name as tsdbSnapGetDetails 2023-10-19 11:04:39 +08:00
Benguang Zhao 00aeb031d4 enh: replicate a fset if it is corrupted without valid minVer 2023-10-19 11:04:39 +08:00
Benguang Zhao a6d5deb5d1 fixup: fix tsdbFSDoSanAndFix 2023-10-19 11:04:39 +08:00
Benguang Zhao eb4e2aa58f feat: restore incomplete fsm state with maxVerValid via snapshot replication 2023-10-19 11:04:36 +08:00
Benguang Zhao 0c41fa56dc feat: filter pExclude in tsdbFSCreateCopyRangedSnapshot 2023-10-19 11:00:44 +08:00
Benguang Zhao e1c03118ab enh: extract snapshot info for both of snap reader and writer 2023-10-19 10:51:13 +08:00
Benguang Zhao 410ced8320 feat: use TLV format to encode data of snapshot info 2023-10-19 10:51:13 +08:00
Benguang Zhao f99795d027 enh: use tsdbSnapRangeArrayDestroy 2023-10-19 10:51:13 +08:00
Benguang Zhao c1b2eedd3c feat: impl tsdbSnapGetInfo 2023-10-19 10:51:08 +08:00
yihaoDeng b9b62a9a00 add rpc sync read timeout 2023-10-19 10:38:45 +08:00
Benguang Zhao 4d55488495 feat: use SSnapshotParam as a parameter to vnodeSnapReaderOpen 2023-10-19 10:37:34 +08:00
Benguang Zhao 083dd148be feat: exchange difference of snapshot info for replication 2023-10-19 10:37:34 +08:00
Benguang Zhao b23bcee690 fixup: about to revert this commit 2023-10-19 10:37:34 +08:00
Benguang Zhao 0ddbcd50d0 enh: maintain independent version range of tombs for SDataFileWriter 2023-10-19 10:37:34 +08:00
Benguang Zhao 4540bcb170 fixup: work-around a compiler bug 2023-10-19 10:37:34 +08:00
Benguang Zhao 44a7f5df47 feat: add tsdbSnapDiff 2023-10-19 10:37:34 +08:00
Benguang Zhao 6ae9bd0e9a feat: add tsdbFSToSnapRangeArray 2023-10-19 10:37:34 +08:00
Benguang Zhao 0a67cc8477 refact: use tsdbTFileUpdVerRange in tsdbSttFWriterCloseCommit 2023-10-19 10:37:34 +08:00
Benguang Zhao 54a10154a4 fixup: remove unused minVer and maxVer in ctx of SCommitter2 2023-10-19 10:37:34 +08:00
Benguang Zhao 6b753cc0cd refact: remove unused code is_same_file 2023-10-19 10:37:34 +08:00
Benguang Zhao dc402e21e3 fix: merge old version range of head and tomb files in tsdbDataFileWriterCloseCommit 2023-10-19 10:37:34 +08:00
Benguang Zhao f8c6e8744a refact: change field name of pExclude in SVSnapReader 2023-10-19 10:37:34 +08:00
Benguang Zhao 01d0c1247d enh: record ver range in writer ctx 2023-10-19 10:37:34 +08:00
Benguang Zhao f207b3ddd5 refact: rename func names of tsdbDataWriterUpdVerRange and tsdbSttWriterUpdVerRange 2023-10-19 10:37:34 +08:00
Benguang Zhao 399afe1094 refact: tidy up declarations of funcs in tsdbUpgrade.c 2023-10-19 10:37:25 +08:00
Haojun Liao f4caeca24a refactor(stream): add state machine to manage the state of stream tasks. 2023-10-19 10:34:20 +08:00
Benguang Zhao ed6d7c4c4d refact: relocate declarations and defs of tsdbFileWriteTombBlock and tsdbFileWriteTombBlk 2023-10-19 10:17:34 +08:00
Benguang Zhao 823aad4a5e enh: record version range of STFile for data and stt files 2023-10-19 10:17:34 +08:00
Benguang Zhao 3cd458f5c9 enh: fill minVer and maxVer of nf in STFileObj during migration 2023-10-19 10:17:34 +08:00
Benguang Zhao 1446b44733 fixup: remove minVer and maxVer in FSetWriterConfig 2023-10-19 10:17:34 +08:00
Benguang Zhao c8a46394f1 enh: set default values of minVer and maxVer while upgrading from CURRENT 2023-10-19 10:17:34 +08:00
Benguang Zhao ab7a20c117 enh: write stt and data files with minVer and maxVer 2023-10-19 10:17:34 +08:00
Benguang Zhao da28d490aa enh: filterByVersion with snap ranges 2023-10-19 10:17:34 +08:00
Benguang Zhao 7a13e4b2cf enh: add minVer and maxVer for entries in current.json 2023-10-19 10:17:34 +08:00
Benguang Zhao 1be2835fc1 enh: exclude a list of snap ranges in tsdbSnapReaderOpen 2023-10-19 10:17:34 +08:00
Benguang Zhao 573c28fd06 enh: iterate over a list of snap ranges for STsdbSnapReader 2023-10-19 10:17:28 +08:00
dapan1121 afe963a9d1 enh: support view privilege 2023-10-19 08:31:31 +08:00
Minglei Jin 52c8bc91f9 cos/delete: fix delete object cond and double free 2023-10-18 18:21:45 +08:00
Shungang Li 5b69b584c3 enh: add log for deploy mnode 2023-10-18 16:58:58 +08:00
yihaoDeng ef27c87756 opt status send 2023-10-18 16:37:34 +08:00
yihaoDeng e62f3fa86a opt status send 2023-10-18 16:03:55 +08:00
Haojun Liao 54ec679b58 refactor(stream): do some internal refactor. 2023-10-18 15:34:53 +08:00
Minglei Jin f26ec41b8e vnode/cos: fix get callback buffer 2023-10-18 15:30:02 +08:00
Haojun Liao c6dd73b68b
Merge pull request #23187 from taosdata/feat/TD-26056 
feat:add replay logic
 2023-10-18 11:43:43 +08:00
Haojun Liao df07443379
Merge pull request #23288 from taosdata/fix/liaohj 
fix(stream):add more check for test cases.
 2023-10-18 08:13:15 +08:00
Minglei Jin 11b65e2779 vnode/cos: make dependent lib public 2023-10-17 18:11:13 +08:00
Minglei Jin dd21d8e3ad cos/multipart: first round multipart uploading 2023-10-17 17:24:50 +08:00
Minglei Jin 8fa8c40391 cos/put: simple object putting(< 5 gigabytes) 2023-10-17 14:59:03 +08:00
kailixu 29c6daaff5 fix: trans mutex init 2023-10-17 11:12:52 +08:00
kailixu a30eedafec fix: trans mutex init 2023-10-17 11:06:06 +08:00
Haojun Liao 531f478ade refactor: do some internal refactor W.R.T. global configurations. 2023-10-17 08:17:49 +08:00
yihaoDeng b793c92fed fix stream snap deadlock 2023-10-16 22:00:34 +08:00
kailixu 38c1f7d48d fix: add lock for trans 2023-10-16 20:20:04 +08:00
yihaoDeng b133418d88 fix stream snap deadlock 2023-10-16 20:03:44 +08:00
dapan1121 cdda43cd67 Merge remote-tracking branch 'origin/3.0' into feat/TD-25204 2023-10-16 19:54:21 +08:00
yihaoDeng f1186be19a fix stream snap deadlock 2023-10-16 19:38:55 +08:00
yihaoDeng 0adefd5e59 fix stream snap deadlock 2023-10-16 19:26:33 +08:00
yihaoDeng f5ea3649c5 fix stream snap deadlock 2023-10-16 19:26:08 +08:00
yihaoDeng 0a84d7a8b3 fix stream snap deadlock 2023-10-16 19:20:48 +08:00
yihaoDeng 252b90bfab fix stream snap deadlock 2023-10-16 19:20:09 +08:00
Haojun Liao a1aa2c9e0c fix(stream):add more check for test cases. 2023-10-16 18:47:01 +08:00
Minglei Jin 2479bb343e prefix/delete: delete with prefix 2023-10-16 15:54:51 +08:00
Minglei Jin 4a77a49a3e prefix/list: list bucket with prefix 2023-10-16 15:25:48 +08:00
Haojun Liao f98e454c5d
Merge pull request #23193 from taosdata/fix/3_liaohj 
other: merge stream fix in main branch.
 2023-10-16 15:17:04 +08:00
Haojun Liao 33018a0bdb fix(tsdb): fix syntax error. 2023-10-16 14:07:09 +08:00
Haojun Liao fa6ba6faf8 fix(tdsb): adjust the log level. 2023-10-16 13:26:13 +08:00
Haojun Liao 6b86d050f2 fix(tsdb): record the pinned block iter. 2023-10-16 13:26:13 +08:00
Haojun Liao 5fe7c8de24 fix(stream): fix syntax error. 2023-10-16 13:26:12 +08:00
Haojun Liao fb2172933a fix(tsdb): enable pin stt datablock. 2023-10-16 13:26:06 +08:00
Haojun Liao 8f2c1944c0 fix(tdsb): adjust the log level. 2023-10-16 11:55:57 +08:00
Haojun Liao ccecf05ff8 fix(tsdb): record the pinned block iter. 2023-10-16 11:48:57 +08:00
wangmm0220 473142fab7 fix:conflicts from 3.0 2023-10-16 11:35:56 +08:00
Haojun Liao 18bb27cdff fix(stream): fix syntax error. 2023-10-16 10:16:39 +08:00
Haojun Liao 67bee17e5e other: merge main. 2023-10-16 09:55:41 +08:00
Haojun Liao f751f2bb3d fix(tsdb): enable pin stt datablock. 2023-10-16 09:49:51 +08:00
Haojun Liao f90cf54714 fix(stream): fix error in creating update node trans. 2023-10-15 21:56:49 +08:00
wade zhang 0f9da01c88
Merge pull request #23264 from taosdata/3.0_main_merge.2 
3.0 main merge
 2023-10-14 09:45:49 +08:00
Haojun Liao 6611f216ac enh(stream): add some logs. 2023-10-13 19:45:29 +08:00
Minglei Jin 0a1ff3283e vnode/cos: first round size delte and get 2023-10-13 16:59:05 +08:00
dapan1121 a0699d758c Merge remote-tracking branch 'origin/3.0' into feat/TD-25204 2023-10-13 16:51:38 +08:00
Haojun Liao bd72d080a9
Merge pull request #23242 from taosdata/fix/liaohj 
refactor: do some internal refactor.
 2023-10-13 16:40:14 +08:00
dapan1121 c0a4328803 feat: support view meta updating 2023-10-13 16:29:34 +08:00
dapan1121 a418307570
Merge pull request #23236 from taosdata/fix/TD-26658-3.0 
enh: close stt before untake read snap
 2023-10-13 14:16:47 +08:00
Haojun Liao 0240ae87c3
Merge pull request #23241 from taosdata/3.0_main_merge 
3.0 branch to main merge
 2023-10-13 10:22:48 +08:00
Haojun Liao 33d9f772be other: merge 3.0 2023-10-13 09:06:13 +08:00
Haojun Liao 84c5359d5b other: merge 3.0 2023-10-13 08:58:26 +08:00
Alex Duan 35fced8796
Merge pull request #23234 from taosdata/main_3_merge 
other: merge main into 3.0
 2023-10-12 07:48:20 -05:00
dapan1121 7c67f23469 feat: update view meta 2023-10-12 19:56:17 +08:00
Haojun Liao 506c55001d fix(tsdb): fix race condition. 2023-10-12 17:57:03 +08:00
Haojun Liao b782af2534 fix(stream): avoid double free. 2023-10-12 17:56:42 +08:00
Haojun Liao 90f866352b
Merge pull request #23221 from taosdata/feat/TD-26052 
fix:[TD-26671] judge if pointer is null to avoid core dump
 2023-10-12 17:23:41 +08:00
kailixu 3d32d55ea5 enh: close stt before untake read snap 2023-10-12 16:44:55 +08:00
Haojun Liao eb4449999f other: merge 3.0 2023-10-12 10:33:48 +08:00
Hongze Cheng 11aa9326b9 fix more 2023-10-11 20:15:46 +08:00
dmchen c1e22eff1a fix/pr-23223-ci-core 2023-10-11 10:25:28 +00:00
Hongze Cheng 38b036ff36 fix: possible race condition 2023-10-11 17:39:58 +08:00
Haojun Liao ea6ffac403 refactor: do some internal refactor. 2023-10-11 16:51:27 +08:00
Minglei Jin 8253874398 enh(tsdb/cos): new sdk for s3 2023-10-11 14:47:26 +08:00
wangmm0220 f7d1e0ea82 fix:[TD-26671] judge if pointer is null to avoid core dump 2023-10-11 11:08:14 +08:00
Haojun Liao 15debda7cd refactor: update some logs. 2023-10-11 11:04:57 +08:00
Haojun Liao d58d663a36 refactor: update some logs. 2023-10-11 10:38:15 +08:00
Haojun Liao a03f09c00f refactor: update some logs. 2023-10-11 10:32:31 +08:00
Shungang Li 2c66f44b31 fix(tsdb): ensure sst trigger array size for upgrade 2023-10-10 21:07:08 +08:00
Haojun Liao b4d7e66f19 other: add some logs. 2023-10-10 19:57:17 +08:00
Haojun Liao 56147120b9 fix(tsdb): remove invalid assert, and do some internal refactor. 2023-10-10 17:04:12 +08:00
wangmm0220 440fa77282 fix:merge datablock if data in same wal version 2023-10-10 16:55:36 +08:00
Haojun Liao 05dfadd8f8 fix(stream): set initial version for fill-history task. disable reentry of scan-history task function. 2023-10-10 15:52:48 +08:00
Haojun Liao 5f9b858fc1 other: merge main. 2023-10-10 15:38:46 +08:00
Haojun Liao adf6f65d09 fix(stream): set initial version for fill-history task. disable reentry of scan-history task function. 2023-10-10 14:00:30 +08:00
Alex Duan 9da96ebf63
Merge pull request #23017 from taosdata/case/TD-26408-MAIN 
fix: add case for lost data after  split vgroup (main)
 2023-10-10 00:54:34 -05:00
wangmm0220 9113c3c3b6 fix:rollback removed code 2023-10-10 11:53:54 +08:00
Hongze Cheng 1b559a0254
Merge pull request #23180 from taosdata/fix/TS-4121-main 
fix(tsdb/cache reader): reset current fileset in cache reader
 2023-10-09 20:46:33 -05:00
Hongze Cheng 4224f90661
Merge pull request #23184 from taosdata/enh/TS-4107 
enh: clear files fset by fset
 2023-10-09 20:05:12 -05:00
yihaoDeng 0fc6ffe6b6 change test case 2023-10-09 20:51:26 +08:00
Haojun Liao af4618f958 fix(stream): remove invalid clear of rspmsg list. 2023-10-09 20:10:27 +08:00
Haojun Liao 21fb502690 enh(stream): add trans to reset task status to avoid being frozen in checkpoint status due to doing checkpoint failure of partial tasks. 2023-10-09 20:10:26 +08:00
Haojun Liao c5ee299d01 fix(stream): fix error in fill-history process. 2023-10-09 20:10:26 +08:00
Haojun Liao af2c0c95e9 refactor: do some internal refactor. 2023-10-09 20:10:22 +08:00
Haojun Liao 59e284c332 fix(stream): quit from loop when input queue is full. 2023-10-09 20:10:21 +08:00
Haojun Liao 9d5a3b8d78 other: merge stream fix. 2023-10-09 20:10:13 +08:00
Haojun Liao 11d8c8da39 fix(stream): update the sink data. 2023-10-09 20:09:23 +08:00
Haojun Liao f0c5b5a970 refactor(stream): revised the display info. 2023-10-09 20:09:22 +08:00
Haojun Liao 28008f8263 enh(stream): add more info for sink task. 2023-10-09 20:09:22 +08:00
Haojun Liao 65daf38715 refactor(stream): idle for 100ms when starting next round scan wal. 2023-10-09 20:09:22 +08:00
Haojun Liao cf14772dd9 enh(stream): optimize the scan wal perf 2023-10-09 20:09:21 +08:00
Haojun Liao d2160efa05 refactor: wait for 100ms before scan wal again. 2023-10-09 20:09:21 +08:00
Haojun Liao 932d93ab35 refactor: wait for more time for future data 2023-10-09 20:09:21 +08:00
Haojun Liao 0ab5d4b342 refactor: do some internal refactor. 2023-10-09 20:09:20 +08:00
Haojun Liao c295ec322a refactor: do some internal refactor. 2023-10-09 20:09:20 +08:00
Haojun Liao d5abb21335 fix(stream): fix invalid check. 2023-10-09 20:09:20 +08:00
Haojun Liao 583ac1fc45 refactor: do some internal refactor. 2023-10-09 20:09:20 +08:00
Haojun Liao 19042cdea6 fix(stream): fix invalid param. 2023-10-09 20:09:19 +08:00
Haojun Liao f9113ab7b0 fix(stream): fix invalid param. 2023-10-09 20:09:11 +08:00
Haojun Liao b0a4ed3217 fix(stream): drop related fill-history task when dropping stream tasks. 2023-10-09 20:09:10 +08:00
Haojun Liao 83f84d92bc refactor: do some internal refactor (discard the checkpoint source msg during restoring). 2023-10-09 20:09:10 +08:00
Haojun Liao bb4ba54f28 fix(stream): enable new time range for stream task. 2023-10-09 20:09:09 +08:00
Haojun Liao 6fbcf4b3d7 fix(tsdb): replace destroy with reset. 2023-10-09 20:09:09 +08:00
Haojun Liao c759d90bf6 enh(stream): optimize the stream status when creating without fill-history option. 2023-10-09 20:09:09 +08:00
Haojun Liao db897fb03a fix(stream): opt perf. 2023-10-09 20:09:09 +08:00
Haojun Liao dfe8641c0c refactor: optimize the fill-history task launch policy, and do some other internal refactor. 2023-10-09 20:08:52 +08:00
Haojun Liao a248f3d088 refactor: do some internal refactor. 2023-10-09 20:08:12 +08:00
Haojun Liao 0db357401d fix(stream): add new status for meta. 2023-10-09 20:08:12 +08:00
Haojun Liao 3912d80c02 fix(stream): do some internal refactor. 2023-10-09 20:08:11 +08:00
Haojun Liao feb09c8361 fix(stream): fix error in pause scan-history data. 2023-10-09 20:08:11 +08:00
Haojun Liao 6a98b11bef fix(stream): fix invalid read and memory leak. 2023-10-09 20:08:11 +08:00
Haojun Liao 65f66f0986 fix(stream): transfer state when all downstream rsp already. 2023-10-09 20:08:11 +08:00
Haojun Liao 4af7812f0b fix(stream): fix the invalid counter for ready tasks in vnode, fix an invalid read. 2023-10-09 20:08:10 +08:00
Haojun Liao 4fe1382cd9 fix(stream): adjust nodeUpdate check interval. 2023-10-09 20:08:09 +08:00
Haojun Liao f4f55fcbce fix(stream): record the tasks started info, and do some internal refactor. 2023-10-09 20:08:09 +08:00
Haojun Liao 68b003c804 fix(stream): fix race condition. 2023-10-09 20:08:09 +08:00
Haojun Liao 52763ca2a3 refactor: do some internal refactor. 2023-10-09 20:08:07 +08:00
Haojun Liao 012ddadf25 fix(stream): update logs. 2023-10-09 20:08:07 +08:00
Haojun Liao c05a8de3e8 fix(stream): rsp when checkpoint source failed. 2023-10-09 20:08:06 +08:00
Haojun Liao b4bc4fac98 fix(stream): disable auto rsp for checkpoint source. 2023-10-09 20:08:06 +08:00
Haojun Liao e671e87234 fix(stream): fix invalid assert. 2023-10-09 20:08:06 +08:00
Haojun Liao d1a6b8bd22 refactor: do some internal refactor. 2023-10-09 20:08:06 +08:00
Haojun Liao 46b17aa9f1 fix(stream): fix race condition. 2023-10-09 20:08:06 +08:00
Haojun Liao 5eee76df65 fix(stream): add msg identifier check. 2023-10-09 20:08:05 +08:00
Haojun Liao 2b16976902 refactor(stream): refactor send msg. 2023-10-09 20:08:03 +08:00
Haojun Liao 498519c94d fix(stream): remove invalid node. 2023-10-09 20:08:02 +08:00
Haojun Liao 27e00b1f19 fix(stream): add some logs, and remove invalid assert. 2023-10-09 20:08:02 +08:00
Haojun Liao 124e1ed1ab enh(stream): add stage info for streamt tasks. 2023-10-09 20:08:02 +08:00
Haojun Liao 12687eb287 fix(stream): add check info detailed information. 2023-10-09 20:08:02 +08:00
Haojun Liao ab7c18f604 refactor: do some internal refactor. 2023-10-09 20:08:01 +08:00
Haojun Liao e5535fa1f5 fix(stream): handle dispatch checkpoint-trigger failure. 2023-10-09 20:08:01 +08:00
Haojun Liao 7f4d9b6e41 fix(stream): wait for the task checkpoint before stop. 2023-10-09 20:07:53 +08:00
Haojun Liao 04405b84c5 fix(stream): update logs. 2023-10-09 20:07:53 +08:00
Haojun Liao 118e078f4a log(stream): update log. 2023-10-09 20:07:53 +08:00
Haojun Liao ef9efc8a8e refactor: do refactor the sink task. 2023-10-09 20:07:53 +08:00
Haojun Liao a3d13d6634 fix(stream): remove invalid cached task info in buffer. 2023-10-09 20:07:08 +08:00
Haojun Liao 1f45bd82d2 other: merge stream fix in main. 2023-10-09 20:07:01 +08:00
Haojun Liao 02610f5546 fix(stream): avoid invalid read. 2023-10-09 20:06:11 +08:00
Haojun Liao f5da458c77 fix(stream): unlock when returning. 2023-10-09 20:06:11 +08:00
Haojun Liao 36dcdad1a5 fix(stream): return if failed. 2023-10-09 20:06:10 +08:00
Haojun Liao d76e3ac718 fix(stream): add task status check. 2023-10-09 20:06:10 +08:00
Haojun Liao 29e1efb757 fix(stream): fix obj. 2023-10-09 20:06:10 +08:00
Haojun Liao a997fa5552 fix(stream): fix deadlock caused by streamTaskHalt function. 2023-10-09 20:06:09 +08:00
Haojun Liao dff4bd3c8d log(tsdb): remove some logs. 2023-10-09 20:06:09 +08:00
Haojun Liao 53237c34d1 enh(stream): add info in log. 2023-10-09 20:06:09 +08:00
Haojun Liao 8af76d28c8 log(stream): remove logs. 2023-10-09 20:06:09 +08:00
Haojun Liao e27111ecd1 enh(stream): add node stage check. 2023-10-09 20:06:09 +08:00
Haojun Liao 927f2d896c fix(stream): limit the max scan times. 2023-10-09 20:06:08 +08:00
Haojun Liao 1a86ee6517 refactor: update the log level. 2023-10-09 20:06:06 +08:00
Haojun Liao ff3ea366e2 fix(stream): keep the status entry in hash table, instead entry index. 2023-10-09 20:06:05 +08:00
Haojun Liao b95ad74c7f fix(stream): not handle the check msg for follower tasks. 2023-10-09 20:06:04 +08:00
Haojun Liao 38bf2d24e7 fix(stream): remove stream in buf. 2023-10-09 20:05:39 +08:00
Haojun Liao 636eccc160 fix(stream): add null check 2023-10-09 20:05:37 +08:00