Commit Graph

490 Commits

Author SHA1 Message Date
Haojun Liao 47877898d0 enh(stream): generate the checkpoint framework. 2023-07-07 16:07:52 +08:00
kailixu cb8b10f6a2 Merge branch '3.0' into enh/TD-23769-3.0 2023-07-07 10:19:43 +08:00
kailixu 64ef48e0dd Merge branch '3.0' into enh/TD-23769-3.0 2023-07-07 10:17:25 +08:00
Haojun Liao d7101f7109 enh(stream): support dispatch checkpoint msg. 2023-07-06 18:26:22 +08:00
Shungang Li a31e054146 fix: ttlmgr convert in metaUpgrade 2023-07-06 15:47:32 +08:00
Shungang Li a1a2b8331f fix: ttl fill cache only in initialization 2023-07-06 15:47:32 +08:00
wade zhang 84740e96ee
Merge pull request #21939 from luckeverda/fix/TD-25074
fix/TD-25074
2023-07-06 15:44:22 +08:00
Haojun Liao 5a9461a69a other: merge 3.0 2023-07-06 11:52:21 +08:00
kailixu e8cdf132fb chore: rsma code refactor 2023-07-06 11:32:20 +08:00
Haojun Liao f4a3567935 other: merge 3.0 2023-07-06 11:24:30 +08:00
kailixu df7866e9f6 chore: refactor 2023-07-05 19:08:43 +08:00
Shungang Li e6e52c3641 fix: ttlmgr convert in metaUpgrade 2023-07-05 17:44:17 +08:00
Haojun Liao 03dbcbf055 refactor: do some internal refactor. 2023-07-05 15:55:55 +08:00
Shungang Li dbf47f5fc1 fix: ttl fill cache only in initialization 2023-07-03 21:30:53 -04:00
yihaoDeng 6b6e237079 add checkpoint 2023-06-28 09:57:08 +00:00
yihaoDeng 871f66565d add checkpoint 2023-06-28 07:02:20 +00:00
yihaoDeng f6d5d0c8ca add checkpoint 2023-06-28 02:39:01 +00:00
yihaoDeng a824db4fd5 add checkpoint 2023-06-27 07:46:30 +00:00
yihaoDeng 04ab8e19d0 Merge branch 'enh/dev30' into enh/triggerCheckPoint2 2023-06-25 19:58:45 +08:00
Haojun Liao 6857881742 Merge branch '3.0' into refact/fillhistory 2023-06-25 10:41:32 +08:00
wade zhang 254a20bdf3
Merge pull request #21660 from luckeverda/feat/TD-23739
feat/TD-23739: enhance ttl, deletetime modified by writing-op
2023-06-25 09:06:57 +08:00
Shungang Li b93f653d7e feat: enhance ttl, deletetime modified by writing-ops
new config item: ttlChangeOnWrite (default 0)
ttl delete time changes on last write if true
2023-06-19 19:03:35 +08:00
yihaoDeng fd85a8495a Merge branch 'dev30' into enh/triggerCheckPoint2 2023-06-17 14:17:21 +08:00
Haojun Liao 64365666b7 fix(stream): update the info, and do some internal refactor. 2023-06-16 16:04:43 +08:00
Haojun Liao 74e0138f72 Merge branch '3.0' into refact/fillhistory 2023-06-15 15:25:00 +08:00
Haojun Liao 1b9eca5ce0 other: merge main. 2023-06-15 13:03:17 +08:00
Haojun Liao b44447e6f3 enh(stream): support restore from disk. 2023-06-14 10:19:03 +08:00
Haojun Liao fb24ed161d enh(stream): set correct task status. 2023-06-12 22:48:23 +08:00
Haojun Liao 78a240be8f enh(stream): add dispatch msg. 2023-06-12 13:12:45 +08:00
Haojun Liao 53246ed6bb other: merge other branch. 2023-06-09 09:41:10 +08:00
yihaoDeng 1f1f37312d add trigger checkpoint 2023-06-07 14:32:48 +00:00
Haojun Liao 6a3c935b4a fix(stream): fix error in fill history scan. 2023-06-07 09:15:55 +08:00
Minglei Jin c4418046e1
Merge branch '3.0' into fix/TS-3247 2023-06-05 18:17:18 +08:00
wangmm0220 f2ee657b62 fix:check wal not exist again before register to push & move push logic from write thread to query thread 2023-06-05 17:21:47 +08:00
Minglei Jin d02746d86f fix(query/sys): pause/resume with sys scan operator 2023-06-05 15:24:39 +08:00
Minglei Jin fb2f367aac meta/split: trim invalidated uids 2023-06-01 08:13:32 +08:00
Haojun Liao 8f61e2d6ef refactor: do some internal refactor. 2023-05-29 10:50:50 +08:00
Haojun Liao 953a69a829 refactor: do some internal refactor. 2023-05-29 10:12:27 +08:00
Haojun Liao cea8334427
Merge pull request #21449 from taosdata/refact/fillhistory
refactor: remove the module dependency.  TD-24279
2023-05-26 09:01:45 +08:00
Haojun Liao 1f7f326bed refactor: do some internal refactor and set the api function ptr. 2023-05-24 13:22:05 +08:00
wade zhang 208c9756cf
Merge pull request #21331 from taosdata/fix/TD-24097
enh(cache/batchread): load columns in one trip
2023-05-19 10:20:47 +08:00
Haojun Liao 81f821a6fc refactor: do some internal refactor. 2023-05-18 10:51:43 +08:00
Haojun Liao 041ffa91bd other: merge main. 2023-05-17 15:42:15 +08:00
Minglei Jin b892b1fdfe cache/flag: fix cache flag compiling issue 2023-05-17 15:26:10 +08:00
Haojun Liao 5e16db4e19 fix(stream):extract delete msg from wal. 2023-05-16 08:54:03 +08:00
Haojun Liao 170c603995 other: merge 3.0 2023-05-13 20:16:55 +08:00
Haojun Liao 7ef16e1922 other: merge main. 2023-05-12 11:49:53 +08:00
yihaoDeng 5708fcb5cb Merge branch 'enh/3.0' into enh/rocksdbSstateMerge 2023-05-10 08:02:16 +00:00
Minglei Jin 2eec395720 cache/commit: flush cache when tsdb commits data 2023-05-08 11:14:59 +08:00
yihaoDeng 08c3a63341 Merge branch 'enh/standVer' into enh/rocksdbSstateMerge 2023-05-06 12:37:54 +00:00
Haojun Liao 29fcd1b83a refactor: do some internal refactor. 2023-05-06 10:08:05 +08:00
Haojun Liao 23c49594b7 other: merge main. 2023-05-04 16:41:53 +08:00
Haojun Liao 09a04052ec refactor: do some internal refactor. 2023-05-04 16:15:14 +08:00
wangmm0220 1ee1b0422c fix:change push mgr from SArray to Hash 2023-04-27 23:44:27 +08:00
Minglei Jin f8bf98f6dc Merge branch '3.0' into fix/TD-23623 2023-04-24 14:28:49 +08:00
Haojun Liao 057cc2d30d
Merge pull request #21018 from taosdata/feature/3_liaohj
fix(stream): set the correct start offset for stream task.
2023-04-24 12:02:20 +08:00
wangmm0220 77e03bfd78 opti:change push mgr to consume msg for subscribe 2023-04-23 20:14:49 +08:00
54liuyao 5089528a02 feat:stream pause&resume 2023-04-23 15:08:51 +08:00
yihaoDeng 917b07348c Merge branch 'fix/rocksdbState' into enh/rocksRevert 2023-04-23 02:37:26 +00:00
Haojun Liao 3dbe208712 enh(tmq): fix memory error and add retrieve wal info as required. 2023-04-22 15:34:46 +08:00
Minglei Jin 9918d326cc Merge branch '3.0' into fix/TD-23623 2023-04-21 18:39:07 +08:00
Haojun Liao f9801ba9c5 enh(stream): stop stream asap. 2023-04-20 18:58:07 +08:00
Minglei Jin 1e51b2d781
Merge branch '3.0' into fix/TD-23623 2023-04-20 16:32:43 +08:00
Benguang Zhao a21e0fe75e enh: propose vnode commit synchronously 2023-04-20 14:28:56 +08:00
Haojun Liao c654f1145d enh(stream): add new msg for seek, and do some internal refactor. 2023-04-20 10:59:16 +08:00
Minglei Jin ec4ea9cf5d enh(cache/rocks): base for rocks put/get 2023-04-14 18:28:15 +08:00
Haojun Liao f8b672f09f other: merge main. 2023-04-14 09:07:18 +08:00
Haojun Liao 70b45a4cf0 fix(stream): all data should be extracted from wal. 2023-04-13 23:22:09 +08:00
Haojun Liao 7419c0bfe9 enh(stream): the stream will start after vnode restore being completed. 2023-04-10 16:56:14 +08:00
Xiaoyu Wang e9d7a099cc merge main 2023-04-04 14:50:58 +08:00
Haojun Liao 4fd3064fd9 refactor: do some internal refactor. 2023-03-28 14:43:37 +08:00
dapan1121 5b02af6a91 fix: merge main to 3.0 2023-03-22 16:08:16 +08:00
Haojun Liao 731a2138df fix(tmq): fix error in tmq. 2023-03-13 17:08:17 +08:00
Haojun Liao 564e9bb833 Merge branch 'main' into fix/liaohj 2023-03-12 14:38:38 +08:00
Haojun Liao 03aa391859 fix(tmq): add lock before close the tsdbreader. 2023-03-09 23:03:51 +08:00
Hongze Cheng 89281ee488 compact with time range 2023-03-07 21:46:34 +08:00
Hongze Cheng 424a37fd3a some code 2023-03-07 10:20:48 +08:00
Hongze Cheng 8e3084ecc0 feat: auto retention 2023-02-27 18:09:51 +08:00
Xiaoyu Wang 1ab144609e merge main 2023-02-23 14:58:22 +08:00
Xiaoyu Wang 319dfd8f06 merge 3.0 2023-02-20 17:21:37 +08:00
Xiaoyu Wang c597de099f merge main 2023-02-20 13:41:27 +08:00
dapan1121 ed4e8313e0 fix: add force stop task and rename conflict structer name 2023-02-16 08:55:13 +08:00
Minglei Jin ea81fc0b30 fix(vnd): zero meta in vnode when closing 2023-02-14 10:56:00 +08:00
Yihao Deng 5af1faf916
Merge branch '3.0' into enh/dynamicIdx 2023-02-13 13:36:06 +08:00
yihaoDeng a929aa22d8 merge 3.0 2023-02-12 10:48:18 +08:00
Hongze Cheng 9694933ec8 fix: compact issue 2023-02-10 16:24:29 +08:00
yihaoDeng 9b7d935682 opt index 2023-02-04 21:02:06 +08:00
Hongze Cheng 11bc53bbd7 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/vnode_compact 2023-01-31 14:07:58 +08:00
Hongze Cheng 5e7b6602c5 Merge branch 'main' of https://github.com/taosdata/TDengine into fix/3.0_merge_main 2023-01-29 14:05:15 +08:00
Hongze Cheng d6028bdde1 some code 2023-01-18 14:59:02 +08:00
yihaoDeng 72b43d240d add/delete tag idx 2023-01-12 16:31:55 +08:00
yihaoDeng 3e738363aa add/delete tag index 2023-01-11 13:36:07 +08:00
Hongze Cheng bff8c216cc more code 2023-01-10 11:36:40 +08:00
Hongze Cheng f848324d54 Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/long_query 2023-01-10 09:42:45 +08:00
Hongze Cheng ad9e8a9aa3 more code 2023-01-09 19:03:09 +08:00
Hongze Cheng f8c9ae50b8 more code 2023-01-09 16:06:07 +08:00
Hongze Cheng 2e443c395e more code 2023-01-09 15:51:30 +08:00
Hongze Cheng 15995e7631 more code 2023-01-09 14:54:49 +08:00
Shengliang Guan 398161eb5f Merge branch 'main' into merge/mainto3.0_0108 2023-01-09 10:00:53 +08:00
Hongze Cheng fda6fccac8 more code 2023-01-09 09:24:26 +08:00
yihaoDeng 7e720269e2 update add/del tag index 2023-01-06 21:33:42 +08:00
Hongze Cheng e710802f1f more code 2023-01-05 15:40:15 +08:00
Hongze Cheng fef8976836 fix: little change 2023-01-05 15:00:29 +08:00
Hongze Cheng a046dbb02b Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/vnode_compact 2023-01-05 13:57:55 +08:00
Minglei Jin 625bf9992f
Merge branch '3.0' into fix/long_query 2023-01-04 15:15:51 +08:00
Xiaoyu Wang 9df6f69371 merge 3.0 2023-01-04 15:02:31 +08:00
Liu Jicong eacde27fdb refactor: remove unused code 2023-01-03 11:24:11 +08:00
Minglei Jin 2ed9c19da4 Merge branch 'v3.0' into fix/long_query 2022-12-29 17:43:51 +08:00
Hongze Cheng a0fa31954c Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/vnode_compact 2022-12-28 13:53:59 +08:00
Benguang Zhao 92e05b8ece enh: schedule vnodeCommit uniformly distributed 2022-12-27 16:28:44 +08:00
Benguang Zhao fda2f55fe5 Merge branch main to FIX/TD-21043-main 2022-12-26 14:26:25 +08:00
Haojun Liao 723efba79b
Merge branch '3.0' into refact/submit_req 2022-12-26 13:25:25 +08:00
Hongze Cheng b000fb09ba Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/vnode_compact 2022-12-26 13:17:30 +08:00
Haojun Liao fbc9e77004
Merge branch '3.0' into refact/submit_req 2022-12-26 10:26:17 +08:00
Hongze Cheng 8135efb541 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/vnode_compact 2022-12-26 09:28:00 +08:00
Shengliang Guan 664dcb6b4e Merge branch 'main' into merge/mainto3.0_1226 2022-12-26 09:26:54 +08:00
kailixu 73710da55f chore: rsma sync and assert 2022-12-25 21:54:09 +08:00
kailixu 4f25c0f7d3 Merge branch '3.0' into feature/TD-19148-D 2022-12-24 00:59:35 +08:00
Benguang Zhao 5159d60f56 enh: vnodeCommit on consensus only 2022-12-23 20:16:32 +08:00
Liu Jicong 0d56da7508 fix: skip msg 2022-12-23 19:04:39 +08:00
Minglei Jin e302cb320f fix(meta/malloc): use new aligned buffer pool malloc 2022-12-22 17:29:29 +08:00
Hongze Cheng a8eb32da9f more code 2022-12-21 14:36:12 +08:00
Hongze Cheng 1edb6d5b4d more code 2022-12-19 15:23:12 +08:00
Haojun Liao fdade6d6a3
Merge branch '3.0' into refact/submit_req 2022-12-19 11:24:00 +08:00
Shengliang Guan cb8cd5f733 Merge branch 'main' into fix/td-21029 2022-12-15 19:24:16 +08:00
Shengliang Guan 4db6b043c6 fix: reduce the frequency of retry in sync not ready case while alter db 2022-12-14 19:01:31 +08:00
Shengliang Guan 60bab9ae55 refact: post sem in vnode while sync timeout 2022-12-14 16:09:28 +08:00
Shengliang Guan 2b256542a5 refact: add vnode timer 2022-12-14 09:14:40 +08:00
Minglei Jin 5f2b393c0c meta/snapshot: use nil heap and abort tdb when rollback 2022-12-09 16:23:43 +08:00
Hongze Cheng 7b20c09f34 more code 2022-12-09 16:19:49 +08:00
Hongze Cheng 63cc4e27b1 more code 2022-12-09 15:50:22 +08:00
kailixu 6f377e3234 refact: tsma/rsma data format 2022-12-08 14:39:59 +08:00
Liu Jicong 74a253eac4 refactor 2022-12-08 13:34:42 +08:00
kailixu f9bd3580d4 chore: rsma refact 2022-12-08 00:49:23 +08:00
Liu Jicong b133a56219 refactor: support submitreq2 2022-12-07 15:19:34 +08:00
Hongze Cheng 899d7b0bcc Merge branch '3.0' of https://github.com/taosdata/TDengine into refact/submit_req 2022-12-06 14:37:22 +08:00
kailixu cb9aa7dcef chore: rsmaFS process 2022-12-06 01:59:24 +00:00
kailixu cf4ef434ee Merge branch '3.0' into feature/TD-19148-D 2022-12-05 06:56:27 +08:00
kailixu cf0995f749 feat: async commit for rsma 2022-12-04 20:26:58 +08:00
Minglei Jin a4adcbbe0d vnode/async-commit: adapter vnode-commit to use txn commit 2022-12-04 18:13:51 +08:00
kailixu 8bc95dcb10 Merge branch '3.0' into feature/TD-19148-D 2022-12-04 17:54:17 +08:00
Hongze Cheng 2a20347210 add more code 2022-12-04 15:14:04 +08:00
kailixu 3a59c5381c refact: tsma code optimization 2022-12-03 22:34:29 +08:00
kailixu 42b17760a2 refact: tsma result adaption 2022-12-03 20:06:55 +08:00
kailixu e918982a5a refact: rsma adaption for new SSubmitReq 2022-12-03 14:23:58 +08:00
kailixu d3a88ea517 refactor: row and submit msg of rsma/tsdb 2022-12-03 13:33:30 +08:00
Hongze Cheng e9356fa59d Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/async_commit 2022-12-02 16:28:53 +08:00
Hongze Cheng 129c692f3e more async commit 2022-12-02 15:44:24 +08:00
kailixu 9b4c881106 chore: rsma logic optimization 2022-12-01 21:43:42 +08:00
Hongze Cheng 3700f0dc8e more code 2022-12-01 16:19:21 +08:00