Commit Graph

7463 Commits

Author SHA1 Message Date
Minglei Jin 913cfe43e8 tsdb/cache: remove input[3] 2023-07-19 12:20:54 +08:00
Minglei Jin 7a716d452e tsdb/fs2: fix vnode get primary dir args 2023-07-19 11:36:26 +08:00
Minglei Jin 4b96bc7147
Merge branch '3.0' into enh/tsdb_optimize 2023-07-19 11:15:57 +08:00
Shungang Li 1d88a6a7c6 enh: ttlMgrFlush adjust log level 2023-07-19 11:15:54 +08:00
Minglei Jin 185081a948 tsdb/fsreader: clear last fileset's resources 2023-07-19 11:04:28 +08:00
dm chen 141004bf77
Merge branch '3.0' into feat/TD-22970 2023-07-19 10:57:40 +08:00
yihaoDeng b1f3dfe88f Merge branch 'enh/triggerChpt' into enh/triggerCheckPoint2 2023-07-19 02:17:42 +00:00
yihaoDeng 34c2e6a180 forbidden streamsnapshot reader 2023-07-19 02:15:12 +00:00
Haojun Liao a32c650248 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-07-19 10:05:48 +08:00
Haojun Liao 2ae95217bd fix(stream): open inputQ by default for task deployed on snode. 2023-07-19 10:05:35 +08:00
liuyao fd02b9a71e
Merge branch '3.0' into enh/triggerCheckPoint2 2023-07-19 10:02:06 +08:00
wade zhang c3e5375f15
Merge pull request #22085 from taosdata/FEAT/TS-2699-3.0
feat: distribute vnode primary dirs among disks of level 0
2023-07-19 09:44:43 +08:00
wangmm0220 5c344b0159 fix:conflicts from main 2023-07-19 09:05:05 +08:00
Haojun Liao 9513f76172 fix(stream): set downstream task ready state. 2023-07-18 19:02:24 +08:00
Minglei Jin a127e91534 tsdb/cache skyline: first round implementation of cache skyline 2023-07-18 17:17:06 +08:00
dmchen 3711fdd865 feat/TD-22970 2023-07-18 16:09:38 +08:00
Benguang Zhao 2faa3d2e7b enh: check validity of diskPrimary during vnodeOpen 2023-07-18 15:39:29 +08:00
Minglei Jin 9f9efe9a5e tsdb/cache reader: remove dataf & dataf last readers 2023-07-18 15:30:31 +08:00
Haojun Liao 901b7d8ecc fix(stream): if a source task is set to be non-normal, no data should be put into inputQ anymore. 2023-07-18 15:18:57 +08:00
Benguang Zhao 24fed51137 enh: tfsRename dir on primary disk at last 2023-07-18 13:58:43 +08:00
Benguang Zhao 5624ecc8df fix: prepare vnode dir recursively in vnodeCreate 2023-07-18 11:32:23 +08:00
Benguang Zhao 6b6b7d8d8f enh: alloc disk of vnode primary dir in vmAllocPrimaryDisk 2023-07-18 11:32:23 +08:00
Haojun Liao 92106312d2 fix(stream): not dispatch checkpoint block result to downstream. 2023-07-18 09:43:38 +08:00
Minglei Jin 998fbe574d tsdb/cache reader: move suid into reader's info field 2023-07-17 19:10:33 +08:00
yihaoDeng 40eb50676d add checkpoint 2023-07-17 11:04:19 +00:00
Minglei Jin 463b5b608b tsdb/read2: fix null pointer runtime error 2023-07-17 18:35:56 +08:00
Minglei Jin 62cfda1a88 tsdb/read2: fix UAF 2023-07-17 17:35:08 +08:00
Minglei Jin 832b68e17d tsdb/cache: load mem del data 2023-07-17 15:48:08 +08:00
Minglei Jin a05383e29e tsdb/cache: new load tomb callback from tsdb mergetree 2023-07-17 15:07:10 +08:00
Minglei Jin 27b8671f97 tsdb/cache: new cacheReader field for tsdb & cache reader 2023-07-17 14:27:27 +08:00
Minglei Jin 9b0b4061e0 tsdb/cache: relayout cache row reader 2023-07-17 14:16:54 +08:00
Haojun Liao eaaf306c81 fix(stream): fix syntax error 2023-07-17 12:54:05 +08:00
Haojun Liao d7f7a7d6cf fix(stream): fix syntax error 2023-07-17 12:53:36 +08:00
Haojun Liao b2a905bd91
Merge branch '3.0' into enh/triggerCheckPoint2 2023-07-17 11:50:12 +08:00
Benguang Zhao b21e603481 enh: add the field diskPrimary to vnodeGetPrimaryDir, and entries of vnodes.json 2023-07-17 11:48:48 +08:00
Minglei Jin 8263c49c17 tsdb/cache: fix compilation 2023-07-17 09:00:17 +08:00
Minglei Jin 2b21c5e0f6 tsdb2: adapt cache with tsdb2 API 2023-07-17 08:50:54 +08:00
Haojun Liao a9757637d9 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-07-16 12:47:24 +08:00
Haojun Liao c6a322e0ef refactor(stream): back pressure is active, which is trigger by dispatch rsp. 2023-07-16 12:47:08 +08:00
yihaoDeng e18c9ea672 add checkpoint 2023-07-15 04:26:34 +00:00
yihaoDeng 3c4631ef1f add checkpoint 2023-07-14 10:06:24 +00:00
wade zhang c2b3c2db52
Merge pull request #22066 from taosdata/fix/TD-25215-main
fix/TD-25215: ttlMgrDeleteTtl should ignore ttl 0 tables for main
2023-07-14 17:53:25 +08:00
wade zhang 021fcf2a59
Merge pull request #22059 from taosdata/fix/TD-25215
fix/TD-25215: ttlMgrDeleteTtl should ignore ttl 0 tables
2023-07-14 17:53:06 +08:00
Haojun Liao b16432280e Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-07-14 17:21:37 +08:00
Haojun Liao eb7e6152ae refactor(stream): do some internal refactor. 2023-07-14 17:21:20 +08:00
wangmm0220 6762a01d88 Merge branch 'main' of https://github.com/taosdata/TDengine into mark/tmq 2023-07-14 16:44:00 +08:00
wangmm0220 bbdcbcb75b fix:modify commit version to next validate version 2023-07-14 16:43:28 +08:00
Hongze Cheng 145c43e346 little fix 2023-07-14 16:38:35 +08:00
yihaoDeng 15f5fd19eb fix recover error 2023-07-14 14:47:06 +08:00
yihaoDeng e16a3935a5 fix coverity scan problem 2023-07-14 14:40:32 +08:00
Shungang Li a48d359f8b fix: ttlMgrDeleteTtl should ignore ttl 0 tables 2023-07-14 14:37:17 +08:00
Hongze Cheng 25120cede4 fix sma merge error 2023-07-14 13:46:01 +08:00
Hongze Cheng 5a89b96e91 make compile 2023-07-14 10:21:06 +08:00
Hongze Cheng 1fad69df3b Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-07-14 10:13:15 +08:00
dapan1121 9bf7180074
Merge pull request #21969 from taosdata/enh/TD-23769-3.0
enh: rsma stream state adaption
2023-07-13 19:19:37 +08:00
Haojun Liao e0ea0f2df4
Merge pull request #22020 from taosdata/fix/liaohj
other: merge main
2023-07-13 17:55:28 +08:00
Shungang Li a39a9428af fix: ttlMgrDeleteTtl should ignore ttl 0 tables 2023-07-13 17:43:32 +08:00
Benguang Zhao 81a2cd16e7 enh: unify handling of vnode primary dir in current_fname 2023-07-13 17:37:53 +08:00
kailixu 6ee135cb52 chore: more code 2023-07-13 17:37:31 +08:00
kailixu 67461d92a7 chore: merge 3.0 and solve conflict 2023-07-13 17:35:55 +08:00
Hongze Cheng d81d2790ea Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-07-13 17:20:45 +08:00
Haojun Liao e2ae868377
Merge pull request #22032 from taosdata/mark/tmq
fix:set firset version to reqOffset of response
2023-07-13 16:35:21 +08:00
Haojun Liao 813f4cb363 refactor: do some internal refactor. 2023-07-13 16:32:25 +08:00
wade zhang ec86a68b6f
Merge pull request #22045 from taosdata/FEAT/TS-2699-3.0
enh: unify handling of vnode primary dir for vnd, tsdb and sma
2023-07-13 13:55:46 +08:00
Benguang Zhao dc75f7ce21 enh: use VNODE_RSMA_DIR in tdRSmaGetCurrentFName 2023-07-13 11:27:31 +08:00
Haojun Liao f41bcd73b0 other: merge main. 2023-07-13 11:02:09 +08:00
Benguang Zhao e209b487c6 enh: rename func name vnodeGetPrimaryDir 2023-07-13 10:38:05 +08:00
Haojun Liao 2f90a53548 fix(stream): set checkpoint id when expanding task. 2023-07-13 10:16:57 +08:00
Haojun Liao 08a4fb06ae fix(stream): dispatch checkpoint msg to downstream by puting message into input queue. 2023-07-13 09:17:20 +08:00
kailixu 466f1037b4 Merge branch '3.0' into enh/TD-23769-3.0 2023-07-12 18:50:16 +08:00
Haojun Liao c388802bda
Merge pull request #22024 from taosdata/fix/3_liaohj
fix(stream): fix concurrent bug in save task meta.
2023-07-12 18:17:27 +08:00
kailixu 8f58f9aa5b fix: skip primary key for block sma 2023-07-12 18:07:01 +08:00
Benguang Zhao 05e8af4837 enh: unify handling of vnode primary dir for vnd and tsdb 2023-07-12 17:58:18 +08:00
Benguang Zhao 4c3bf41178 enh: unify handling of vnode primary dir for sma 2023-07-12 17:56:21 +08:00
Benguang Zhao bbf58d2d9d enh: unify handling of vnode primary dir in vnodeCreate and metaOpen 2023-07-12 17:56:21 +08:00
wangmm0220 cf64d4c9c5 fix:set get_assignment offset to first version of response block 2023-07-12 17:22:23 +08:00
Hongze Cheng 3fc282f035 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-07-12 11:57:19 +08:00
Haojun Liao 3ce54423a5 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-07-12 11:38:27 +08:00
Haojun Liao d392bb60ba refactor(stream): set the initial version from the checkpoint. 2023-07-12 11:38:13 +08:00
kailixu 8cb6356b99 chore: more code 2023-07-12 10:47:02 +08:00
Haojun Liao 9484f3da94
Merge branch '3.0' into enh/triggerCheckPoint2 2023-07-12 10:20:18 +08:00
kailixu f282acbc4c chore: rsma refactor 2023-07-12 10:13:50 +08:00
kailixu 8c8bcabdd4 Merge branch '3.0' into enh/TD-23769-3.0 2023-07-12 09:11:34 +08:00
wade zhang 2cfdd234b3
Merge pull request #22034 from taosdata/feat/TS-3239
feat/TS-3239/TS-3596: port 'keepTimeOffset' from 2.6 to 3.0
2023-07-12 08:18:38 +08:00
Haojun Liao fed3803739 fix(stream): fix memory leak. 2023-07-11 19:29:52 +08:00
kailixu ba0bce8092 chore: code revert 2023-07-11 18:52:51 +08:00
kailixu 30f8c9c79e chore: more check 2023-07-11 18:08:48 +08:00
Shungang Li 4886cb4674 feat: port 'keepTimeOffset' from 2.6 to 3.0 2023-07-11 17:40:35 +08:00
kailixu 7c85f7701d chore: more check 2023-07-11 16:32:29 +08:00
wangmm0220 8dd7f36993 fix:set firset version to reqOffset of response 2023-07-11 16:19:38 +08:00
wangmm0220 7bc19df0ef fix:set firset version to reqOffset of response 2023-07-11 15:48:19 +08:00
Haojun Liao 2e386a6fdf fix(stream): check if stream task is in normal state. 2023-07-11 15:23:49 +08:00
wangmm0220 cb62d4cb97 fix:set firset version to reqOffset of response 2023-07-11 14:49:53 +08:00
Haojun Liao 6d78816d22 fix(stream): fix syntax error. 2023-07-11 14:06:25 +08:00
kailixu 314123ef34 chore: add check 2023-07-11 14:05:09 +08:00
Haojun Liao 09b764494d fix(stream): set correct checkpoint version when starting stream tasks. 2023-07-11 14:03:43 +08:00
kailixu d5435926c2 chore: more code 2023-07-11 12:37:01 +08:00
Haojun Liao 3ffdbe923d other: merge 3.0 2023-07-11 09:12:57 +08:00
Haojun Liao 04f5bcd23a fix(stream): remove invalid set of task status . 2023-07-11 08:51:13 +08:00
kailixu 14b438ec64 chore: bug fix 2023-07-11 07:02:36 +08:00
kailixu f391462e34 chore: more code 2023-07-10 20:01:50 +08:00
kailixu 57ceaed535 chore: code revert 2023-07-10 19:55:01 +08:00
kailixu f16fa6d000 enh: exclude tk log from time series check 2023-07-10 19:48:50 +08:00
Haojun Liao 87bedef2cd fix(stream): fix error in checkpointing. 2023-07-10 19:20:05 +08:00
Haojun Liao 385a5c9651 fix(stream): fix error in generating checkpoint. 2023-07-10 18:20:50 +08:00
Hongze Cheng 7014f790a0 optmize table statistic info 2023-07-10 17:35:26 +08:00
liuyao 84f0dfd6d4 stream operator checkpoint 2023-07-10 11:07:08 +08:00
kailixu 802112c00a chore: more code 2023-07-09 21:49:37 +08:00
Haojun Liao 98349a4265 refactor(tsdb): do some internal refactor. 2023-07-09 18:05:24 +08:00
kailixu a7253fc390 Merge branch '3.0' into enh/TD-25083-3.0 2023-07-09 16:04:38 +08:00
wangmm0220 35ba132a29 fix:conflicts from main 2023-07-09 12:52:18 +08:00
wangmm0220 a5363e6e03 fix:test case in tmq 2023-07-09 12:49:50 +08:00
Haojun Liao ba4d726af6 fix(tsdb): fix error in tsdbread. 2023-07-09 01:31:02 +08:00
Haojun Liao b39198a53a refactor: do some internal refactor. 2023-07-08 21:44:58 +08:00
Haojun Liao 1470e51dc1 Merge remote-tracking branch 'origin/enh/tsdb_optimize' into enh/tsdb_optimize 2023-07-08 21:25:24 +08:00
Haojun Liao 14844c7b4b refactor(tsdb): opt tsdb read perf 2023-07-08 21:25:11 +08:00
wangmm0220 f9f656b21a fix:return offset stored if get assignment in init mode 2023-07-08 13:25:39 +08:00
Haojun Liao 4f534ce6e9 fix(stream): fix error in generating checkpoint. 2023-07-08 10:29:09 +08:00
Haojun Liao a5c19427e7 fix(stream): send correct rsp to mnode. 2023-07-08 09:39:44 +08:00
Haojun Liao 9c30abf95b fix(stream): fix error in generating checkpoint. 2023-07-07 21:38:53 +08:00
wangmm0220 4436eb7e0f fix:set commitOffset is send msg success & optimize log & add test cases for TD-25129 2023-07-07 19:12:18 +08:00
kailixu a746d288a1 chore: add debug info 2023-07-07 18:53:01 +08:00
Haojun Liao 128f67784a fix(stream): fix error in parsing checkpoint msg. 2023-07-07 18:17:50 +08:00
Haojun Liao 8298f30e56 fix(stream): fix bug in checkpoint. 2023-07-07 17:16:08 +08:00
wangmm0220 106e273157 fix:bugs in get_assignment 2023-07-07 16:12:15 +08:00
Haojun Liao 47877898d0 enh(stream): generate the checkpoint framework. 2023-07-07 16:07:52 +08:00
wade zhang 0865b1a828
Merge pull request #21973 from luckeverda/fix/TD-25074-main
fix/TD-25074 for main
2023-07-07 11:24:33 +08:00
Hongze Cheng 090ca39132 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-07-07 10:38:04 +08:00
kailixu cb8b10f6a2 Merge branch '3.0' into enh/TD-23769-3.0 2023-07-07 10:19:43 +08:00
kailixu 64ef48e0dd Merge branch '3.0' into enh/TD-23769-3.0 2023-07-07 10:17:25 +08:00
kailixu 06c52af2c2 enh: exclude tk_log from timeseries check 2023-07-07 10:14:37 +08:00
wade zhang 47a7a45d1d
Merge pull request #21978 from taosdata/fix/TD-24962
fix(coverity): fix coverity scan issues
2023-07-07 08:20:07 +08:00
wangmm0220 0928bd5510 fix:send rsp offset to client if unregister push mgr 2023-07-06 19:35:48 +08:00
wangmm0220 b2d41ce907 Merge branch 'main' of https://github.com/taosdata/TDengine into fix/TD-25071 2023-07-06 19:34:22 +08:00
Haojun Liao aad906f2b0 fix(stream): fix syntax error. 2023-07-06 18:26:44 +08:00
Haojun Liao d7101f7109 enh(stream): support dispatch checkpoint msg. 2023-07-06 18:26:22 +08:00
Minglei Jin 09222801c4 fix(coverity): fix coverity scan issues 2023-07-06 17:52:48 +08:00
wangmm0220 f1ce91f600 fix:race condition for pTq->pStore->pHash 2023-07-06 16:49:59 +08:00
wangmm0220 9e6e59adc2 fix:race condition for pTq->pStore->pHash 2023-07-06 16:47:48 +08:00
Shungang Li a31e054146 fix: ttlmgr convert in metaUpgrade 2023-07-06 15:47:32 +08:00
Shungang Li a1a2b8331f fix: ttl fill cache only in initialization 2023-07-06 15:47:32 +08:00
wade zhang 84740e96ee
Merge pull request #21939 from luckeverda/fix/TD-25074
fix/TD-25074
2023-07-06 15:44:22 +08:00
Haojun Liao a94ace4cc8 refactor:do some internal refactor. 2023-07-06 15:10:45 +08:00
wangmm0220 47ae92af93 fix:conflicts from main 2023-07-06 13:40:04 +08:00
wangmm0220 11e6856d3e fix:init char array 2023-07-06 13:37:58 +08:00
kailixu c1393fb2e2 chore: invoke streamStateCommit for rsma 2023-07-06 13:26:25 +08:00
Haojun Liao 5a9461a69a other: merge 3.0 2023-07-06 11:52:21 +08:00
kailixu e8cdf132fb chore: rsma code refactor 2023-07-06 11:32:20 +08:00
Haojun Liao f4a3567935 other: merge 3.0 2023-07-06 11:24:30 +08:00
kailixu 61380b7822 chore: test case adaption 2023-07-06 11:09:44 +08:00
Haojun Liao 851f6df094 enh(tsdb): opt perf. 2023-07-06 09:58:15 +08:00
wangmm0220 34a62c3f38 fix:vginfo assigment not in same time,we should get vginfo by vg,not all vg 2023-07-05 22:55:41 +08:00
kailixu 3f6768d8cf chore: rsma rocksdb adaption 2023-07-05 19:43:29 +08:00
Haojun Liao aeb9473382 enh(tsdb): add some logs. 2023-07-05 19:41:34 +08:00
Haojun Liao a0a116b674 fix(tsdb): fix error in sma extracting and do NOT clear fileDelData when extracting data from stt files. 2023-07-05 19:11:14 +08:00
kailixu df7866e9f6 chore: refactor 2023-07-05 19:08:43 +08:00
kailixu 59e83fca5d chore: build fix 2023-07-05 18:33:09 +08:00
Benguang Zhao 9b477eed81 enh: terminate on failure to recover WAL from writing errors, or to commit vnode 2023-07-05 17:54:56 +08:00
Haojun Liao 74f5b3f80e
Merge pull request #21959 from taosdata/refact/fillhistory
refactor: do some internal refactor.
2023-07-05 17:47:00 +08:00
Shungang Li e6e52c3641 fix: ttlmgr convert in metaUpgrade 2023-07-05 17:44:17 +08:00
Haojun Liao 8f8dfc593b Merge remote-tracking branch 'origin/enh/tsdb_optimize' into enh/tsdb_optimize 2023-07-05 17:43:56 +08:00
Haojun Liao a738b6eba6 fix(tsdb): add empty del skyline check. 2023-07-05 17:43:41 +08:00
Hongze Cheng 21d972938f more fix 2023-07-05 17:43:15 +08:00
Haojun Liao f35db3ba6c fix(tsdb): add none check. 2023-07-05 17:36:55 +08:00
Haojun Liao f0cec22d4f fix(tsdb): fix some error. 2023-07-05 17:20:17 +08:00
kailixu d093b0e20f chore: merge 3.0 2023-07-05 16:45:12 +08:00
Haojun Liao 8c8aa5cd57 fix(tsdb): fix error in extract brinblock. 2023-07-05 16:39:04 +08:00
wangmm0220 bdfeb32923 fix:bugs in tmq_get_topic_assignment 2023-07-05 16:04:34 +08:00
Haojun Liao 03dbcbf055 refactor: do some internal refactor. 2023-07-05 15:55:55 +08:00
Haojun Liao 7d7e12a5e7 fix(tsdb): fix syntax error. 2023-07-05 11:22:58 +08:00
Hongze Cheng 1304c08cdd Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-07-05 10:57:55 +08:00
Haojun Liao 9b3e34d589
Merge pull request #21735 from taosdata/refact/fillhistory
refactor: refactor the fill history operation
2023-07-05 10:48:51 +08:00
Haojun Liao 6e15478c43 fix(tsdb): do some internal refactor. 2023-07-05 10:31:38 +08:00
Haojun Liao 6fb1e716c0 Merge remote-tracking branch 'origin/enh/tsdb_optimize' into enh/tsdb_optimize 2023-07-05 10:31:09 +08:00
Haojun Liao 8ab10a8da1 fix(tsdb): fix error in check tomb record. #TD-25117 2023-07-05 10:30:55 +08:00
Hongze Cheng 23a743fd66 fix snapshot coredump 2023-07-05 10:01:00 +08:00
Haojun Liao 37ff3a419a fix(tsdb): fix error in load tomb from stt files. 2023-07-04 23:35:52 +08:00
wade zhang bc8efd7014
Merge pull request #21949 from taosdata/FIX/TD-25103-3.0
enh: tfsRename in the reverse order of levels with tiered storages
2023-07-04 17:34:49 +08:00
Benguang Zhao 1ca4256927 enh: use var prefixLen instead in vnodeRenameVgroupId 2023-07-04 15:36:42 +08:00
Haojun Liao ff2bf35603 fix(stream): fix error in set the version range for secondary scan. 2023-07-04 15:08:39 +08:00
wade zhang 35a35ad4f9
Merge pull request #21930 from taosdata/fix/TD-24966
fix: coverity scan
2023-07-04 14:55:54 +08:00
Hongze Cheng acde8586e0 ignore file check 2023-07-04 14:16:09 +08:00
Hongze Cheng 2e88ad2c14 fix: upgrade bug 2023-07-04 14:00:44 +08:00
Haojun Liao 82342ebdc7
Merge pull request #21934 from taosdata/feature/TD-20678
feat:subscribe only meta info
2023-07-04 11:28:27 +08:00
Shungang Li dbf47f5fc1 fix: ttl fill cache only in initialization 2023-07-03 21:30:53 -04:00
wangmm0220 dbcd33a402 fix:memory leak 2023-07-03 18:43:12 +08:00
Benguang Zhao ddaba463c0 enh: check failure of tfsMkdirRecurAt 2023-07-03 16:16:27 +08:00
Haojun Liao 200575647c
Merge branch '3.0' into refact/fillhistory 2023-07-03 15:16:18 +08:00
Haojun Liao 20d099dfa6
Merge pull request #21901 from taosdata/fix/liaohj
fix: fix coverity issue.
2023-07-03 15:15:21 +08:00
Hongze Cheng 8384b6ce29 fix CI case 2023-07-03 15:01:05 +08:00
Hongze Cheng 5390732f42 fix: coverity scan 2023-07-03 14:13:01 +08:00
Hongze Cheng 214c92264c Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-07-03 11:27:26 +08:00
wangmm0220 136bc379d1 feat:ignore delete info 2023-07-03 11:02:08 +08:00
Haojun Liao 9e98c64b1e fix(tsdb): set correct stt load info. update the test case. 2023-06-30 22:57:49 +08:00
Haojun Liao 450a9f3ca1 Merge remote-tracking branch 'origin/enh/tsdb_optimize' into enh/tsdb_optimize 2023-06-30 18:22:35 +08:00
Haojun Liao c2a7c37b00 fix(tsdb): opt perf for reading data from stt files. 2023-06-30 18:22:20 +08:00
wade zhang 84c20463f3
Merge pull request #21907 from luckeverda/fix/ttlpresubmit
fix: ttl compatibility for main
2023-06-30 16:47:25 +08:00
wade zhang 617115ba85
Merge pull request #21906 from luckeverda/fix/ttlpresubmit
fix: ttl compatibility for 3.0
2023-06-30 16:45:58 +08:00
Hongze Cheng 9fd453d78a more code 2023-06-30 16:13:48 +08:00
yihaoDeng 93391f73e5 vnode snapshot read 2023-06-30 07:46:56 +00:00
Hongze Cheng 2f57c8439b more fix 2023-06-30 15:04:18 +08:00
Hongze Cheng e79fe91ba0 more code 2023-06-30 14:57:57 +08:00
Shungang Li 8f164a7922 fix: ttl compatibility 2023-06-30 14:57:34 +08:00
Hongze Cheng c714138e9e fix snapshot problem 2023-06-30 14:37:26 +08:00
Hongze Cheng 55840709ed skip dropped table tomb data commit 2023-06-30 13:54:49 +08:00
wangmm0220 58c7011e0e feat:support only meta in tmq subscriptions 2023-06-30 11:42:40 +08:00
yihaoDeng e25df41536 vnode snapshot read 2023-06-30 03:11:55 +00:00
Haojun Liao ee5e3b7cc0 fix(tsdb): fix error in tsdb2 2023-06-30 00:38:53 +08:00
Haojun Liao 9740d1353c fix(tsdb): opt perf for read data in stt files. 2023-06-29 23:16:07 +08:00
Haojun Liao 15487c9c8f fix(tsdb): fix memory leak. 2023-06-29 22:52:07 +08:00
yihaoDeng 60a0b1e1bd vnode snapshot read 2023-06-29 11:52:34 +00:00
Haojun Liao 17c6b9f81b fix(tsdb): fix error in set file reader. 2023-06-29 18:40:14 +08:00
Hongze Cheng eee8007736 fix bug 2023-06-29 17:48:36 +08:00
yihaoDeng 9eb6d8cf1e vnode snapshot read 2023-06-29 09:35:09 +00:00
Haojun Liao 622e1cb608 fix: fix coverity issue. 2023-06-29 15:54:09 +08:00
Haojun Liao 63834713b2 Merge remote-tracking branch 'origin/enh/tsdb_optimize' into enh/tsdb_optimize 2023-06-29 15:09:14 +08:00
Haojun Liao 81eb8523f1 fix(tsdb): fix invalid ptr. 2023-06-29 15:09:01 +08:00
Hongze Cheng 1e5fef9dbe fix retention CI cases 2023-06-29 15:01:54 +08:00
yihaoDeng 5cebd36c1c add checkpoint 2023-06-29 06:56:14 +00:00
dapan1121 c8435de64a
Merge branch '3.0' into fix/m23.0 2023-06-29 14:03:56 +08:00
Hongze Cheng 1556dedb85 fix file remove by edit 2023-06-29 14:03:01 +08:00
Haojun Liao ba38a625cf fix(stream): remove the shared ptr between reader ptr. 2023-06-29 13:42:23 +08:00
dapan1121 3519e9170e Merge remote-tracking branch 'origin/main' into 3.0 2023-06-29 11:13:45 +08:00
Haojun Liao c4a6b85bdf fix(tsdb): support stt and file block overlap. 2023-06-28 22:38:51 +08:00
yihaoDeng 3d532a54a8 add checkpoint 2023-06-28 12:22:27 +00:00
yihaoDeng 6b6e237079 add checkpoint 2023-06-28 09:57:08 +00:00
liuyao 2fc5eeb810 session win range 2023-06-28 17:20:08 +08:00
Hongze Cheng 9be13427f6 fix tomb record loss bug 2023-06-28 17:01:08 +08:00
yihaoDeng 871f66565d add checkpoint 2023-06-28 07:02:20 +00:00
Haojun Liao 8867a57262 fix(stream): fix syntax error. 2023-06-28 14:48:59 +08:00
Haojun Liao 57fcd553f8 refactor: do some internal refactor. 2023-06-28 13:13:13 +08:00
wangmm0220 1fc664693e fix:continue consume if wal is dropped 2023-06-28 11:54:48 +08:00
yihaoDeng f6d5d0c8ca add checkpoint 2023-06-28 02:39:01 +00:00
Haojun Liao 3710ea4aca refactor: do some internal refactor. 2023-06-28 09:41:08 +08:00
Hongze Cheng c3a34f5012 Merge branch 'enh/tsdb_optimize' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-06-28 09:16:48 +08:00
Hongze Cheng b13010c490 fix retention infinit loop 2023-06-28 09:16:43 +08:00
Haojun Liao 9116a4092a fix(tsdb):fix memory leak. 2023-06-28 01:04:58 +08:00
Haojun Liao 15c55508ac fix(stream): fix error in read tombblock in stt files. 2023-06-27 23:37:11 +08:00
Haojun Liao a19e63fd23 fix(stream): fix error in handling fill history. 2023-06-27 23:00:14 +08:00
yihaoDeng 9adccf5715 add checkpoint 2023-06-27 14:31:50 +00:00
yihaoDeng 977d6b7803 add checkpoint 2023-06-27 12:52:27 +00:00
yihaoDeng 74764108fd add checkpoint 2023-06-27 12:46:08 +00:00
yihaoDeng f2b96fb4b3 add checkpoint 2023-06-27 12:28:28 +00:00
yihaoDeng 9d69b284db add checkpoint 2023-06-27 12:03:29 +00:00
Yihao Deng 4de7db06f9
Merge branch '3.0' into enh/triggerCheckPoint2 2023-06-27 17:57:14 +08:00
yihaoDeng 0a0410cd09 add checkpoint 2023-06-27 09:56:14 +00:00
Haojun Liao 4bb78df27c fix(stream): reduce the sleep time. 2023-06-27 16:44:35 +08:00
Haojun Liao 32fddeff18 fix(stream): fix error retrieve data from source task.And optimize the test cases. 2023-06-27 16:24:47 +08:00
yihaoDeng a824db4fd5 add checkpoint 2023-06-27 07:46:30 +00:00
Hongze Cheng d23902877e make it compile on win 2023-06-27 14:33:55 +08:00
Haojun Liao 1ad05a06d6
Merge branch '3.0' into enh/tsdb_optimize 2023-06-27 11:46:37 +08:00
Haojun Liao 3289ad62be other: merge 3.0 2023-06-27 11:33:40 +08:00
Haojun Liao 1073b5e4c2 fix(tsdb): support to read multi-level of stt files. 2023-06-27 11:15:53 +08:00
liuyao 71f4226e15 fix coverity san issues 2023-06-27 10:39:38 +08:00
Haojun Liao b73444b291 fix(stream): start stream task in case of scan history completing. 2023-06-27 09:44:51 +08:00
Hongze Cheng 3edee3fe9f fix memory leak 2023-06-26 22:04:29 +08:00
dapan1121 4dae9f4eff merge main to 3.0 2023-06-26 18:43:00 +08:00
Hongze Cheng 3172306f65 more fix 2023-06-26 16:38:26 +08:00
Hongze Cheng 5a0218d1ca fix memory leak 2023-06-26 16:34:58 +08:00
Hongze Cheng 58ce6a3f26 fix vnode close 2023-06-26 16:28:33 +08:00
Haojun Liao 6a29bce44e Merge remote-tracking branch 'origin/enh/tsdb_optimize' into enh/tsdb_optimize 2023-06-26 15:56:11 +08:00
Haojun Liao 9f664cbf14 fix(tsdb): fix error in extracting block distribution. 2023-06-26 15:54:44 +08:00
Hongze Cheng 5ad9bd938f change default stt trigger as 2 2023-06-26 15:47:36 +08:00
Hongze Cheng e79683a684 fix more 2023-06-26 13:57:18 +08:00
Minglei Jin 020678391c fix(tsdb/cache): refine del locks 2023-06-26 11:19:31 +08:00
Hongze Cheng 27e17048ac fix: retention coredump 2023-06-26 09:06:59 +08:00
Minglei Jin 5eb57f2e6e enh(tsdb/cache): writebatch with rcache locked 2023-06-26 08:41:14 +08:00
yihaoDeng 04ab8e19d0 Merge branch 'enh/dev30' into enh/triggerCheckPoint2 2023-06-25 19:58:45 +08:00
Haojun Liao 402c091df0 fix(stream): fix sma error. 2023-06-25 19:41:44 +08:00
Hongze Cheng b881b87218 more code 2023-06-25 18:02:31 +08:00
liuyao e236bf818c set fill history info 2023-06-25 17:47:10 +08:00
Hongze Cheng cc0727aee3 more code 2023-06-25 17:13:12 +08:00
Hongze Cheng 014bfc4ad4 more code 2023-06-25 16:27:14 +08:00
Hongze Cheng 5b1492cb4b refact code 2023-06-25 15:09:15 +08:00
wangmm0220 7a49d67078 Merge branch '3.0' of https://github.com/taosdata/TDengine into feature/TS-3495 2023-06-25 14:54:16 +08:00
Haojun Liao 7e7feeffdf fix: fix memory leak. 2023-06-25 14:38:31 +08:00
liuyao c950c7379d Merge branch 'refact/fillhistory' of https://github.com/taosdata/TDengine into refact/fillhistory 2023-06-25 10:58:43 +08:00
liuyao e9d3198e05 mem leak 2023-06-25 10:57:10 +08:00
Haojun Liao 6ac179501a fix: fix syntax error. 2023-06-25 10:46:21 +08:00
Haojun Liao 6857881742 Merge branch '3.0' into refact/fillhistory 2023-06-25 10:41:32 +08:00
Hongze Cheng c161943fe0 fix snapshot problem 2023-06-25 10:01:30 +08:00
Hongze Cheng 3582046129 fix coredump 2023-06-25 09:45:58 +08:00
Haojun Liao 3099ec31cb fix(tsdb): fix syntax error. 2023-06-25 09:36:43 +08:00
Haojun Liao dad1854cbb other: merge 3.0 2023-06-25 09:33:37 +08:00
Haojun Liao 7c23630fe4 fix(stream): set correct stream error code. 2023-06-25 09:26:37 +08:00
wade zhang 254a20bdf3
Merge pull request #21660 from luckeverda/feat/TD-23739
feat/TD-23739: enhance ttl, deletetime modified by writing-op
2023-06-25 09:06:57 +08:00
Haojun Liao a8de3694fa Merge branch 'refact/fillhistory' of github.com:taosdata/tdengine into refact/fillhistory 2023-06-24 18:55:03 +08:00
Haojun Liao ceb78fdad2
Merge branch '3.0' into refact/fillhistory 2023-06-24 18:53:48 +08:00
Haojun Liao 4a7698d4ab fix(tsdb): add null ptr check. 2023-06-24 00:41:05 +08:00
Haojun Liao 4ce1614045 fix(tsdb): fix error in retrieve sma. 2023-06-24 00:33:47 +08:00
Haojun Liao 5cac7c7a02 fix(tsdb): fix error in query super table. 2023-06-23 02:06:50 +08:00
yihaoDeng c36d14df77 add compile opt 2023-06-22 13:19:14 +08:00
Hongze Cheng a5049b4861 fix bug 2023-06-21 20:26:52 +08:00
Haojun Liao 0c2273daf2 fix(tsdb): fix memory leak. 2023-06-21 19:38:25 +08:00
Haojun Liao 3ca3dc54ae Merge branch 'enh/tsdb_optimize' of github.com:taosdata/tdengine into enh/tsdb_optimize 2023-06-21 19:22:58 +08:00
Haojun Liao cf02ac7229 fix(tsdb): extract tomb data in stt files. 2023-06-21 18:57:14 +08:00
Haojun Liao 92249d892a
Merge pull request #21717 from taosdata/enh/staticLibMain
Enh/static lib main
2023-06-21 17:46:30 +08:00
Hongze Cheng feda122fdc more code 2023-06-21 17:29:41 +08:00
Haojun Liao f49f96049e Merge branch 'enh/tsdb_optimize' of github.com:taosdata/tdengine into enh/tsdb_optimize 2023-06-21 16:56:11 +08:00
Hongze Cheng 32a256bfee fix commit bug 2023-06-21 16:55:31 +08:00
Haojun Liao e76ae4ffc5 fix(tsdb) : fix memory leak. 2023-06-21 16:53:47 +08:00
Hongze Cheng 1160f53062 more code 2023-06-21 16:35:06 +08:00
Haojun Liao 84bd2fb7a1 Merge branch 'enh/tsdb_optimize' of github.com:taosdata/tdengine into enh/tsdb_optimize 2023-06-21 16:15:04 +08:00
Hongze Cheng 5e9d263e19 fix: infinite loop 2023-06-21 15:08:16 +08:00
Hongze Cheng 0e97340e50 more code 2023-06-21 14:53:36 +08:00
Haojun Liao 6261359efe fix(tsdb): reset the stt reader for new files. 2023-06-21 14:46:35 +08:00
yihaoDeng ff3ad6c65f add static lib to 3.0 2023-06-21 14:38:52 +08:00
Hongze Cheng 4a1010cdec more 2023-06-21 13:39:29 +08:00
wade zhang e95b430e89
Merge pull request #21786 from taosdata/FIX/TD-24817-3.0
enh: make alter-hashrange atomic and idempotent
2023-06-21 13:29:04 +08:00
Haojun Liao ea7b8e91d3 fix(stream): fix memory leak. 2023-06-21 12:03:26 +08:00
Haojun Liao f6e3ad27f0 fix(tsdb): fix memory leak. 2023-06-21 11:38:35 +08:00
Haojun Liao a92d16a508 fix(tsdb): adjust invalid assert. 2023-06-21 00:12:08 +08:00
Hongze Cheng 413d00db9e fix memory leak 2023-06-20 20:10:57 +08:00
yihaoDeng daa3b5238f add static lib 2023-06-20 19:29:43 +08:00
Haojun Liao f8437789f9 Merge remote-tracking branch 'origin/enh/tsdb_optimize' into enh/tsdb_optimize 2023-06-20 18:38:59 +08:00
Haojun Liao a16dce1873 fix(tsdb): set correct callback fp. 2023-06-20 18:38:45 +08:00
Hongze Cheng a3f784a5bc more code 2023-06-20 18:25:24 +08:00
Hongze Cheng ccc8faf3ee Merge branch 'enh/tsdb_optimize' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-06-20 18:24:02 +08:00
Hongze Cheng 8855659534 more code 2023-06-20 18:23:58 +08:00
liuyao 74bea44300 stream op transform 2023-06-20 17:30:59 +08:00
Haojun Liao 2d4eed4234 other: merge other branch. 2023-06-20 17:12:31 +08:00
Hongze Cheng fbc4cc9053 fix commit issue 2023-06-20 16:48:54 +08:00
Haojun Liao 7627035629 fix(tsdb): set the hasVal initial value. 2023-06-20 15:58:22 +08:00
Benguang Zhao 424086e324 enh: restore vgroup id in vmOpenVnodes for vnodeAlterHashRange 2023-06-20 15:40:09 +08:00
Haojun Liao a87c3cfd24 fix(tsdb):check null ptr. 2023-06-20 15:39:53 +08:00
liuyao aafbdcb492 set task status 2023-06-20 15:20:04 +08:00
Haojun Liao a1f2ce389b fix(tsdb): fix memory leak. 2023-06-20 14:46:32 +08:00
Hongze Cheng 09f2858927 fix some coredump 2023-06-20 14:34:52 +08:00
Haojun Liao 976dc322db enh(tsdb): support delete data read. 2023-06-20 14:26:15 +08:00
Hongze Cheng a33ce92e5d more code 2023-06-20 13:33:31 +08:00
liuyao 870d75bf82 fill history pause&resume 2023-06-20 11:34:09 +08:00
Hongze Cheng 927f6861be more code 2023-06-20 10:41:24 +08:00
Hongze Cheng a4ca770449 refact code 2023-06-20 09:33:22 +08:00
Shungang Li aa3dd2bbe8 fix for compile 2023-06-20 09:06:23 +08:00
yihaoDeng 548e439aa2 add checkpoint 2023-06-19 20:48:49 +08:00
Shungang Li b93f653d7e feat: enhance ttl, deletetime modified by writing-ops
new config item: ttlChangeOnWrite (default 0)
ttl delete time changes on last write if true
2023-06-19 19:03:35 +08:00
Haojun Liao 77af819708 Merge branch 'enh/tsdb_optimize' of github.com:taosdata/tdengine into enh/tsdb_optimize 2023-06-19 17:57:00 +08:00
Haojun Liao 524ef6edda fix(tsdb): read data from new storage format. 2023-06-19 17:51:05 +08:00
liuyao 41c193945f fill history pause&resume 2023-06-19 17:28:19 +08:00
Benguang Zhao 090a1a1595 enh: rename dir at the end in vnodeRenameVgroupId 2023-06-19 15:48:32 +08:00
Hongze Cheng 6d2ce5cd39 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-06-19 14:13:08 +08:00
Hongze Cheng 3074ab6541 more code 2023-06-19 14:12:48 +08:00
Hongze Cheng de60e688f6 more fix 2023-06-19 12:52:09 +08:00
Hongze Cheng 9ce58a2d80 refact more code 2023-06-19 11:32:19 +08:00
Hongze Cheng 073a2b8dd3 refact more code 2023-06-19 09:32:29 +08:00
yihaoDeng fd85a8495a Merge branch 'dev30' into enh/triggerCheckPoint2 2023-06-17 14:17:21 +08:00
kailixu b40069c0e1 chore: log optimization 2023-06-17 05:05:43 +08:00
Hongze Cheng aba73614df more code 2023-06-17 00:12:11 +08:00
wangmm0220 c5dfe169a6 fix:error 2023-06-16 19:33:03 +08:00
kailixu 4097b860d3 enh: support delete tsma interval 2023-06-16 19:04:12 +08:00
dapan1121 1329dce320
Merge pull request #21712 from taosdata/fix/TS-3484
fix: fix order by ts desc error
2023-06-16 18:01:16 +08:00
Hongze Cheng a9fcebbdaf more code 2023-06-16 17:12:05 +08:00
Haojun Liao 64365666b7 fix(stream): update the info, and do some internal refactor. 2023-06-16 16:04:43 +08:00
Hongze Cheng d97f34931d Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-06-16 13:54:59 +08:00
Hongze Cheng ec288ade15 change stt from multi seg to one seg 2023-06-16 12:16:53 +08:00
wade zhang 01b1cfe965
Merge pull request #21676 from taosdata/fix/TD-24715
enh(vnd/svr): convert msyType to string
2023-06-16 12:06:47 +08:00
wade zhang d5f37359f4
Merge pull request #21722 from taosdata/fix/TD-24761
fix(tsdb/cache): rewrite cache update to fix cpu usage
2023-06-16 11:52:02 +08:00
Minglei Jin 968e3cf1ea lru/applyF: fix ret value 2023-06-16 10:00:17 +08:00
Haojun Liao 4c82558eab Merge remote-tracking branch 'origin/refact/fillhistory' into refact/fillhistory 2023-06-16 09:55:24 +08:00
Haojun Liao 933801269a fix(stream): fix memory leak and failed to close vnode. 2023-06-16 09:55:11 +08:00
Yihao Deng 97fa74ae2e
Merge branch 'main' into enh/staticLibMain 2023-06-15 21:37:01 +08:00
liuyao 0aa141ec77 use stream task state 2023-06-15 18:24:40 +08:00
Haojun Liao a3e1882fb2 fix: fix dead lock. 2023-06-15 18:17:38 +08:00
Haojun Liao 2ad30e2946 other: add files. 2023-06-15 17:31:59 +08:00
Minglei Jin 2cb6c7af16 cache/commit: use outter lock 2023-06-15 17:16:14 +08:00
Minglei Jin 9d6a22e35e cache/apply: use tsdb's flushState as ud 2023-06-15 17:07:56 +08:00
Minglei Jin c56f29c031 cache/flushState: init flush state when open cache 2023-06-15 17:01:27 +08:00
Minglei Jin 158ae209bf cache/lru: new applyF API for tlrucache 2023-06-15 16:34:51 +08:00
Haojun Liao 74e0138f72 Merge branch '3.0' into refact/fillhistory 2023-06-15 15:25:00 +08:00
wangmm0220 22776e60d5 fix:control memory size if consumer group is too much 2023-06-15 14:51:04 +08:00
Hongze Cheng b6a567f92e more code 2023-06-15 14:43:14 +08:00
Hongze Cheng eacd2ac234 more code 2023-06-15 14:23:12 +08:00
liuyao 693942b821 trans state 2023-06-15 14:13:17 +08:00
Hongze Cheng e34ff2a894 more code 2023-06-15 14:10:35 +08:00
Haojun Liao 5fdfe98696 fix: fix syntax error. 2023-06-15 13:31:30 +08:00
Hongze Cheng 56dfeadd50 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-06-15 13:17:44 +08:00
Haojun Liao 1b9eca5ce0 other: merge main. 2023-06-15 13:03:17 +08:00
Haojun Liao 13028744df refactor: do some internal refactor. 2023-06-15 10:24:21 +08:00
Minglei Jin 6d23ea93ea cache/update: fix memory leak 2023-06-15 08:40:36 +08:00
Haojun Liao 53377c2c1f fix(stream): wait for stream task completed. 2023-06-15 01:14:41 +08:00
Benguang Zhao b86fc3a697 fix: vnodeRenameVgroupId correctly 2023-06-14 21:38:25 +08:00
Yihao Deng 7ded6fc7a2
Merge branch '3.0' into enh/triggerCheckPoint2 2023-06-14 16:30:38 +08:00
Hongze Cheng 33eaeb743c more code 2023-06-14 16:15:40 +08:00
liuyao 9a3708e17b pause&resume fill history 2023-06-14 15:54:07 +08:00
Minglei Jin d04a33f349 fix(tsdb/cache): rewrite cache update to fix cpu usage 2023-06-14 15:35:21 +08:00
Haojun Liao 7c6fbd7772 enh(stream): do some internal refactor and support secondary scan for history data. 2023-06-14 14:10:09 +08:00
Hongze Cheng 4138361839 refact code 2023-06-14 14:05:41 +08:00
Hongze Cheng 5bacfb4f94 refact code 2023-06-14 13:38:51 +08:00
Hongze Cheng 48ea3963e7 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-06-14 13:12:31 +08:00
yihaoDeng 30ea3aa419 add static lib 2023-06-14 12:15:02 +08:00
yihaoDeng ee3017ed3a add static lib 2023-06-14 12:14:49 +08:00
Haojun Liao b44447e6f3 enh(stream): support restore from disk. 2023-06-14 10:19:03 +08:00
Haojun Liao 844a23225a
Merge pull request #21600 from taosdata/mark/tmq
fix:check wal not exist again before register to push & move push log…
2023-06-14 10:18:39 +08:00
Ganlin Zhao 4bd1ae90fa fix: fix order by ts desc error 2023-06-14 09:52:41 +08:00
Hongze Cheng c85c032158 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-06-14 09:14:16 +08:00
wangmm0220 8070223aba fix:lock error 2023-06-13 18:27:06 +08:00
Ganlin Zhao 647ddaad97 fix: fix order by ts desc error 2023-06-13 17:28:31 +08:00
Hongze Cheng e01d598da9 more code 2023-06-13 17:16:06 +08:00
Haojun Liao 97da2a8fac fix(stream): set the fill history status. 2023-06-13 16:10:55 +08:00
wangmm0220 d8d6b6dd21 Merge branch '3.0' of https://github.com/taosdata/TDengine into feature/TD-24749 2023-06-13 15:15:05 +08:00
wangmm0220 8a81278024 fix:load pHandle if necessary wher tq restore 2023-06-13 15:14:11 +08:00
Haojun Liao 933d08b489
Merge pull request #21690 from taosdata/feature/TS-3495
feat:add parameters for consumer & add offset rows for subscription
2023-06-13 14:59:15 +08:00
Hongze Cheng 42a09cc9df more code 2023-06-13 14:30:24 +08:00
Hongze Cheng 7baeabc6b9 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-06-13 13:21:12 +08:00
wangmm0220 fb123d8761 fix:conflict from 3.0 2023-06-13 09:47:08 +08:00
Haojun Liao fb24ed161d enh(stream): set correct task status. 2023-06-12 22:48:23 +08:00
yihaoDeng 83dde6a212 add trigger checkpoint 2023-06-12 14:33:08 +00:00
Hongze Cheng e4840cb5ab fix 2023-06-12 17:48:49 +08:00
Hongze Cheng bd01d08b05 mroe code 2023-06-12 17:19:31 +08:00
Hongze Cheng 71df0a00be more code 2023-06-12 17:17:00 +08:00
Hongze Cheng 438d0caef7 mroe code 2023-06-12 16:55:20 +08:00
Hongze Cheng 9a4f6abe54 more code 2023-06-12 16:12:29 +08:00
Benguang Zhao 16fbcbb67a fix: filter by tbFName in metaFilterTableByHash 2023-06-12 14:19:50 +08:00
Hongze Cheng 5405a967fb refact code 2023-06-12 13:39:25 +08:00
Hongze Cheng 4813af0867 refact code 2023-06-12 13:27:02 +08:00
Haojun Liao 78a240be8f enh(stream): add dispatch msg. 2023-06-12 13:12:45 +08:00
Hongze Cheng 22b80c55bf refact code 2023-06-12 10:27:22 +08:00
Hongze Cheng e6039839f1 refact code 2023-06-12 10:26:18 +08:00
Hongze Cheng b8fb34e6c6 refact 2023-06-12 10:13:15 +08:00
Hongze Cheng 8be0e1710e refact code 2023-06-12 10:08:35 +08:00
wangmm0220 1903b815d4 fix:modify offset description to string 2023-06-12 09:45:06 +08:00
wangmm0220 6657b8d849 fix:modify offset description to string 2023-06-12 09:44:00 +08:00
Benguang Zhao 3689b41f3a Merge branch '3.0' into FIX/TD-24182-3.0 2023-06-12 09:39:49 +08:00
Hongze Cheng 0c6acda102 refact code 2023-06-10 17:16:01 +08:00
yihaoDeng a2030dc378 add trigger checkpoint 2023-06-09 12:12:51 +00:00
Minglei Jin 4884d0af53 vnd/svr: convert msyType to string 2023-06-09 18:00:04 +08:00
Hongze Cheng 9cdaf24113 more code 2023-06-09 17:52:57 +08:00
Hongze Cheng 2c5b5289d0 fix more code 2023-06-09 16:43:09 +08:00
Hongze Cheng cbd5da5dee more code 2023-06-09 16:07:06 +08:00
Hongze Cheng 1ee9f80e1f more code 2023-06-09 15:10:54 +08:00
Haojun Liao 69c9eda7af fix(stream): fix race condition. 2023-06-09 11:37:38 +08:00
Haojun Liao 63ef04593d fix: fix syntax error. 2023-06-09 09:48:18 +08:00
Haojun Liao 53246ed6bb other: merge other branch. 2023-06-09 09:41:10 +08:00
Hongze Cheng 3753c7d602 refact more 2023-06-09 09:23:56 +08:00
Minglei Jin cab07b2736 vnode/svr: fix missing colon post vgId 2023-06-09 08:21:45 +08:00
wangmm0220 3f46a9bbc9 feat:add parameters for consumer & add offset rows for subscription 2023-06-08 18:14:02 +08:00
Haojun Liao 6726edae0c fix(stream): add more logs. 2023-06-08 17:54:22 +08:00
Hongze Cheng cb52b7a747 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-06-08 17:39:01 +08:00
Hongze Cheng e9a0210ea6 more code 2023-06-08 17:31:35 +08:00
Haojun Liao 2b6ace653a refactor: do some internal refactor. 2023-06-08 16:14:27 +08:00
Hongze Cheng ef524f6965 more code 2023-06-08 15:35:43 +08:00
yihaoDeng 8b91617145 Merge branch 'enh/dv3' into enh/triggerCheckpoint 2023-06-08 07:20:41 +00:00
yihaoDeng 77f287d9be add trigger checkpoint 2023-06-08 07:19:59 +00:00
Minglei Jin a6968485a8 enh(vnd/sync): refine invalid message log 2023-06-08 14:45:02 +08:00
Haojun Liao 30eba472c3
Merge pull request #21602 from taosdata/fix/TD-24600-dv3
fix/td-24600-dv3
2023-06-08 13:42:02 +08:00
Hongze Cheng 13229b0ee1 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-06-08 13:38:32 +08:00
Hongze Cheng 9d4a626f42 more code 2023-06-08 13:28:13 +08:00
Hongze Cheng 685c0e5593 more code 2023-06-08 11:41:01 +08:00
Hongze Cheng 0c9b66b574 more code 2023-06-08 10:51:43 +08:00
yihaoDeng 9b749b8faa change link op t 2023-06-08 02:43:44 +00:00
Hongze Cheng 2f5f0b75df refact code 2023-06-08 10:31:19 +08:00
Hongze Cheng 91c8391bff Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-06-08 09:53:57 +08:00
yihaoDeng 1f1f37312d add trigger checkpoint 2023-06-07 14:32:48 +00:00
Haojun Liao 06cf3588da refactor: do some internal refactor. 2023-06-07 15:03:04 +08:00
yihaoDeng 4fa1cc6dd3 change link opt 2023-06-07 05:26:07 +00:00
liuyao 1e9c4d5fac opt stream block dispatch 2023-06-07 10:45:27 +08:00
Haojun Liao 6a3c935b4a fix(stream): fix error in fill history scan. 2023-06-07 09:15:55 +08:00
Hongze Cheng e6fb46c072 more code 2023-06-06 16:42:51 +08:00
Hongze Cheng 89a9e01375 more code 2023-06-06 16:17:29 +08:00
Hongze Cheng 96d29bc93b more code 2023-06-06 11:07:45 +08:00
Minglei Jin 57b0cb84eb fix(cache/binary): fix crash in freeItem 2023-06-06 10:23:50 +08:00
Hongze Cheng d3bf34e92a more code 2023-06-05 22:55:00 +08:00
Hongze Cheng aad386e795 more code 2023-06-05 22:35:06 +08:00
yihaoDeng ae09d1d031 fix:wal error 2023-06-05 19:49:54 +08:00
Hongze Cheng 5d1783f4d4 more code 2023-06-05 18:31:59 +08:00
Hongze Cheng 9caf359ee1 more code 2023-06-05 18:29:05 +08:00
Minglei Jin c4418046e1
Merge branch '3.0' into fix/TS-3247 2023-06-05 18:17:18 +08:00
Haojun Liao 0dd933013c enh(stream): make history task for stream running. 2023-06-05 17:58:00 +08:00
wade zhang 11321aa279
Merge pull request #21386 from taosdata/fix/TD-23549
fix(meta): split meta
2023-06-05 17:47:19 +08:00
wangmm0220 1b9387b683 fix:remove tq lock in write thread 2023-06-05 17:45:46 +08:00
wangmm0220 f2ee657b62 fix:check wal not exist again before register to push & move push logic from write thread to query thread 2023-06-05 17:21:47 +08:00
Hongze Cheng 46aa6d4896 refact code 2023-06-05 16:22:06 +08:00
Hongze Cheng 37ae918114 more code 2023-06-05 16:08:02 +08:00
Hongze Cheng 934a170e64 more code 2023-06-05 16:02:53 +08:00
Haojun Liao fcc706c45c enh(stream): refactor the fill history task. 2023-06-05 15:59:01 +08:00
Hongze Cheng ac62592140 more code 2023-06-05 15:46:35 +08:00
Minglei Jin d02746d86f fix(query/sys): pause/resume with sys scan operator 2023-06-05 15:24:39 +08:00
Haojun Liao 077e1a1ed4 Merge branch '3.0' into refact/fillhistory 2023-06-05 11:41:13 +08:00
Hongze Cheng efff4e77f0 more code 2023-06-05 09:36:26 +08:00
Hongze Cheng 5649401a65 more code 2023-06-05 09:22:20 +08:00
Hongze Cheng 3df9620450 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-06-05 09:10:16 +08:00
Haojun Liao 044e56fc97
Merge branch '3.0' into fix/resume_mem 2023-06-03 12:19:17 +08:00
Haojun Liao 4bb6429249 fix(query): fix syntax error. 2023-06-03 00:20:59 +08:00
Haojun Liao becacbc84b fix(query): fix syntax error. 2023-06-02 23:36:47 +08:00
Haojun Liao b5b4cd2a05 fix(query): load del info with upper version limitation. 2023-06-02 23:15:27 +08:00
Hongze Cheng 53ff6edad7 fix bug 2023-06-02 19:03:34 +08:00
Hongze Cheng 632c6fb4dd more code 2023-06-02 18:42:15 +08:00
Haojun Liao cca69f3038 Merge branch '3.0' into fix/resume_mem 2023-06-02 18:40:48 +08:00
Hongze Cheng a2dafefe03 more code 2023-06-02 17:36:14 +08:00
wangmm0220 56f7a137ee fix:conflict 2023-06-02 15:47:53 +08:00
wangmm0220 b2f0d88639 fix:conflict 2023-06-02 15:43:35 +08:00
Hongze Cheng 33afb08e5c Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-06-02 14:40:01 +08:00
Hongze Cheng da31d92b7e more code 2023-06-02 14:39:54 +08:00
yihaoDeng f4bde33dc3 avoid mem leak 2023-06-02 06:06:05 +00:00
Haojun Liao cce87a036f other: merge 3.0. 2023-06-02 13:34:20 +08:00
Haojun Liao 709e3f5079
Merge pull request #21566 from taosdata/fix/TD-24570
reset ud table name
2023-06-02 13:26:49 +08:00
Haojun Liao d45aa7ef84
Merge pull request #21555 from taosdata/fix/liaohj_main
other: merge main into 3.0.
2023-06-02 13:11:12 +08:00
Haojun Liao f1bd829977 refactor: do some internal refactor. 2023-06-02 13:10:54 +08:00
Haojun Liao 27b7d1ec88 refactor: do some internal refactor. 2023-06-02 11:17:44 +08:00
liuyao 27f791ac7f reset ud table name 2023-06-02 11:05:39 +08:00
Hongze Cheng 884d2cc834 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-06-02 09:31:54 +08:00
yihaoDeng 4d0ce625c4 Merge branch '3.0' of https://github.com/taosdata/TDengine into feature/TD-19042 2023-06-01 22:55:30 +08:00
wangmm0220 a7418d439b Merge branch '3.0' of https://github.com/taosdata/TDengine into feature/TD-19042 2023-06-01 22:50:51 +08:00
Hongze Cheng 5e75fe006c more code 2023-06-01 18:56:40 +08:00
wangmm0220 56782a5d41 fix:open task case & modify mqRebVgReq encode/decode style 2023-06-01 18:29:16 +08:00
Haojun Liao ee8a9856cb
Merge pull request #21557 from taosdata/feature/TD-19042
fix:make version compatible
2023-06-01 18:25:37 +08:00
Hongze Cheng 9d1e90f914 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-06-01 17:20:37 +08:00
Hongze Cheng 65720b80fa more code 2023-06-01 17:12:26 +08:00
Hongze Cheng a3cacfe68b more code 2023-06-01 17:08:46 +08:00
Hongze Cheng e07afeeeaf more code 2023-06-01 17:05:20 +08:00
wangmm0220 69499b9582 fix:make version compatible 2023-06-01 16:09:17 +08:00
wangmm0220 d20e0a06f6 fix:make version compatible 2023-06-01 16:04:45 +08:00
wangmm0220 21920721f3 fix:make version compatible 2023-06-01 15:10:08 +08:00
Hongze Cheng e99b33ede5 more code 2023-06-01 15:08:45 +08:00
Hongze Cheng bdc9fc473c more code 2023-06-01 11:11:02 +08:00
Minglei Jin 9b9bf2de68 meta/tbc: key cannot be null 2023-06-01 10:41:01 +08:00
Hongze Cheng fbc4d649de more code 2023-06-01 10:36:12 +08:00
Haojun Liao 5d98a319c7
Merge pull request #21515 from taosdata/feature/TD-19042
feat: support create topic as stable with conditions
2023-06-01 09:56:55 +08:00
Haojun Liao 5301c5756a other: merge main into 3.0. 2023-06-01 09:29:18 +08:00
Minglei Jin fb2f367aac meta/split: trim invalidated uids 2023-06-01 08:13:32 +08:00
Haojun Liao 6d04c4e2fd refactor: do some internal refactor. 2023-05-31 19:05:40 +08:00
Haojun Liao 9e021087a9 refactor: do some internal refactor. 2023-05-31 19:04:53 +08:00
Haojun Liao a3abe25539 refactor: do some internal refactor. 2023-05-31 19:03:37 +08:00
Hongze Cheng d4f4ac1d89 more code 2023-05-31 17:49:08 +08:00
Haojun Liao fa5c024b3e refactor: do some internal refactor. 2023-05-31 17:22:59 +08:00
Haojun Liao 18b971c666 fix(query): check the version range when dump partial rows of file block to sdata block directly. 2023-05-31 17:06:38 +08:00
Haojun Liao bbb6359ea2 fix(query): add check for version range when dumping partial rows of file block to data block 2023-05-31 17:03:39 +08:00
Hongze Cheng dc8901268e fix code 2023-05-31 16:34:50 +08:00
Hongze Cheng cf0228f87e more code 2023-05-31 15:57:51 +08:00
Minglei Jin 99d6c5cfa0 Merge branch '3.0' into fix/TD-23549 2023-05-31 15:31:20 +08:00
Hongze Cheng 10e6e52670 more code 2023-05-31 15:19:28 +08:00
Hongze Cheng 616a675682 more code 2023-05-31 10:59:47 +08:00
Benguang Zhao 28efd7dcd7 enh: check trans conflicts in mndTransValidate 2023-05-31 10:53:36 +08:00
Haojun Liao e237b4ac39 refactor: do some internal refactor. 2023-05-31 09:19:05 +08:00
Hongze Cheng 938d87f601 more code 2023-05-31 09:02:50 +08:00
Hongze Cheng 838a47cb45 more code 2023-05-30 18:08:32 +08:00
Hongze Cheng 03f7c6533e more code 2023-05-30 18:06:28 +08:00
Haojun Liao eda06081ff enh(stream): refactor and serialize the attributes of history tasks. 2023-05-30 16:55:37 +08:00
wangmm0220 689ee05527 Merge branch '3.0' of https://github.com/taosdata/TDengine into feature/TD-19042 2023-05-30 15:45:46 +08:00
Hongze Cheng e0889b404d more code 2023-05-30 15:31:11 +08:00
Hongze Cheng 9222d9651e Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-05-30 14:21:19 +08:00
Hongze Cheng 29c29871d2 more code 2023-05-30 14:20:15 +08:00
Haojun Liao d122a398b3
Merge pull request #21516 from taosdata/fix/TD-24447
set sched status
2023-05-30 10:59:28 +08:00
Hongze Cheng 8626d3e691 more code 2023-05-30 10:43:44 +08:00
wangmm0220 d490ca753f Merge branch '3.0' of https://github.com/taosdata/TDengine into feature/TD-19042 2023-05-30 09:48:49 +08:00
Haojun Liao 65b1574fbe
Merge pull request #21499 from taosdata/mark/tmq
fix:put poll to push manager if wal not exist when offset is latest
2023-05-30 09:36:53 +08:00
Haojun Liao 20a0054c4a
Merge pull request #21472 from taosdata/enh/addCompileError
change parameter
2023-05-30 09:36:36 +08:00
dapan1121 2d6859d5d6
Merge pull request #21510 from taosdata/szhou/fix-ts3461
fix: if block row num is less than definit min rows, set the bucket index to 0
2023-05-30 08:51:24 +08:00
wade zhang 3a2831a3f4
Merge pull request #21517 from taosdata/fix/TD-24472
fix(rocks/log): set info log level to warn_level
2023-05-30 08:35:00 +08:00
Hongze Cheng b479a0a06b Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-05-29 21:46:26 +08:00
Hongze Cheng 41459a92c0 more code 2023-05-29 18:42:31 +08:00
wangmm0220 41ed0138b4 fix:compile error 2023-05-29 17:25:11 +08:00
wangmm0220 07bdb95b1a fix:compile error 2023-05-29 17:10:11 +08:00
wangmm0220 9eb15e41ef fix:put poll to push manager if wal not exist when offset is latest 2023-05-29 16:44:03 +08:00
Hongze Cheng 6aac0e0c49 more code 2023-05-29 15:58:54 +08:00
Minglei Jin 3a9d55ca35 fix(rocks/log): set info log level to warn_level 2023-05-29 15:56:28 +08:00
wangmm0220 5eb1c559e5 fix:save offset if latest 2023-05-29 15:51:00 +08:00
liuyao b541a0a053 set sched status 2023-05-29 15:42:47 +08:00
wangmm0220 78db3520a6 fix:conflict 2023-05-29 14:57:03 +08:00
wangmm0220 a71878d07f feat: support create topic as stable with conditions 2023-05-29 11:46:59 +08:00
Haojun Liao 8f61e2d6ef refactor: do some internal refactor. 2023-05-29 10:50:50 +08:00
shenglian zhou 43c0656df2 fix: if block row num is less than definit min rows, set the bucket index to 0 2023-05-29 10:45:26 +08:00
yihaoDeng 342ce14c7d Merge branch 'enh/3.0' into fix/shared_link_rocksdb 2023-05-29 02:37:47 +00:00
yihaoDeng 58cc631c22 Merge branch 'enh/3.0' into fix/shared_link_rocksdb 2023-05-29 02:29:56 +00:00
Haojun Liao 953a69a829 refactor: do some internal refactor. 2023-05-29 10:12:27 +08:00
Hongze Cheng 9d6a264e4d more code 2023-05-28 23:33:03 +08:00
Hongze Cheng 9d031f4d7b Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-05-28 11:08:39 +08:00
Hongze Cheng 5bcc9c540a more code 2023-05-27 23:08:08 +08:00
Haojun Liao 1e786624b2
Merge pull request #21501 from taosdata/refact/fillhistory
fix(stream): set the skip offset when resume stream task.
2023-05-27 22:45:54 +08:00
Hongze Cheng 6668da43f8 more code 2023-05-27 20:13:07 +08:00
Hongze Cheng e4b7318ced more code 2023-05-27 19:54:07 +08:00
Hongze Cheng 442586692b more code 2023-05-27 19:01:52 +08:00
Haojun Liao d9de1813da Merge branch '3.0' into refact/fillhistory 2023-05-27 16:31:11 +08:00
Hongze Cheng 2cf70ab0cc more code 2023-05-27 15:29:22 +08:00
Hongze Cheng 880359ddb3 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-05-27 11:50:25 +08:00
Hongze Cheng 62a3c27176 more code 2023-05-27 11:49:59 +08:00
Hongze Cheng b4b0db9a3d more code 2023-05-26 23:51:18 +08:00
Hongze Cheng 0090d02226 more code 2023-05-26 23:42:47 +08:00
Haojun Liao b38e253019 fix(stream): set the skip offset when resume stream task. 2023-05-26 22:51:58 +08:00
Hongze Cheng 9abfe52c4d more code 2023-05-26 19:41:27 +08:00
Hongze Cheng 4cb4c6388c more code 2023-05-26 19:32:02 +08:00
wangmm0220 a3e214b9e8 fix:put poll to push manager if wal not exist when offset is latest 2023-05-26 19:17:04 +08:00
wangmm0220 50487255b3 fix:put poll to push manager if wal not exist when offset is latest 2023-05-26 19:02:40 +08:00
wade zhang 66b7d90849
Merge pull request #21479 from taosdata/fix/TD-24405
fix(cache): fix deleted data
2023-05-26 17:02:33 +08:00
Haojun Liao 87957e2bb0
Merge pull request #21478 from taosdata/fix/TD-23423
fix tsdb read error version
2023-05-26 16:56:09 +08:00
Hongze Cheng f5286359fa more code 2023-05-26 15:57:31 +08:00
Hongze Cheng 7acc124dfc more code 2023-05-26 15:25:29 +08:00
Minglei Jin 34b9b322cd cache/var-data: realloc for cache reading 2023-05-26 15:01:57 +08:00
Hongze Cheng b07ad168c3 more code 2023-05-26 14:49:50 +08:00
Haojun Liao f61f37c936 fix(tmq): set the correct offset rsp when no poll occuring. 2023-05-26 14:20:01 +08:00
Minglei Jin 6e29d7879f cache/var-data: realloc var data 2023-05-26 14:13:01 +08:00
Hongze Cheng 9156b297ae more code 2023-05-26 11:51:08 +08:00
Haojun Liao 1e845acabe fix(tmq): allow seek before get assignment 2023-05-26 11:34:12 +08:00
Minglei Jin bb481c52b6 cache/skyline: fix skyline false condition 2023-05-26 11:26:55 +08:00
Haojun Liao ccbea13012 Merge branch '3.0' into refact/fillhistory 2023-05-26 10:40:53 +08:00
Haojun Liao 974b59c238 fix(query): fix bug in iterating the table list. 2023-05-26 10:10:10 +08:00
Haojun Liao 409656f7b6 fix(query): fix bug in iterating the table list. 2023-05-26 10:05:54 +08:00
Hongze Cheng fa00d0df77 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-05-26 09:55:27 +08:00
Haojun Liao cea8334427
Merge pull request #21449 from taosdata/refact/fillhistory
refactor: remove the module dependency.  TD-24279
2023-05-26 09:01:45 +08:00
liuyao 75eb724c37 fix tsdb read error version 2023-05-26 08:55:23 +08:00