Commit Graph

633 Commits

Author SHA1 Message Date
kailixu 717c4b3d9c chore: restore codes 2024-04-01 14:01:09 +08:00
kailixu 6eaa99bb2d feat: encryption algorithm 2024-04-01 13:58:13 +08:00
dmchen b9deb71fc5 basic function 2024-03-29 02:48:49 +00:00
Shungang Li 3a656c3595 feat: support 2 replica with arbitrator 2024-03-19 09:30:35 +08:00
Haojun Liao 6bc12c8728 refactor: do some internal refactor. 2024-02-27 16:27:59 +08:00
Haojun Liao aee0460daf enh(stream):rsp the checkpoint ready msg. 2024-02-27 11:15:09 +08:00
Haojun Liao dafac591f7 enh(stream): add rsp for req-checkpoint 2024-02-27 10:53:25 +08:00
Haojun Liao b361eb4a7c fix(stream): add hb rsp handle function for vnode and snode. 2024-02-21 15:16:07 +08:00
Haojun Liao ac08f659c3 refactor: remove invalid procedure in fill-history. 2024-01-26 16:20:43 +08:00
Haojun Liao f8d0c52483 fix(stream): remove this unused drop history task msg and corresponding functions. 2024-01-18 14:32:48 +08:00
Haojun Liao 58694c67dd refactor: do some internal refactor. 2024-01-11 11:50:52 +08:00
dmchen 348bef49ec message handle 2023-12-07 11:42:32 +00:00
wangmm0220 06e2fbfb1c fix:conflicts from 3.0 2023-11-27 17:53:53 +08:00
Haojun Liao d5e123db78
Merge pull request #23791 from taosdata/fix/3_liaohj
refactor: do some internal refactor.
2023-11-24 14:42:43 +08:00
wangmm0220 d249892b2a fix:conflicts from 3.0 2023-11-23 20:29:46 +08:00
Haojun Liao 0a90c33b4d fix(stream): drop the related fill-history task & set the task to be ready, if the drop fill-history task msg is missing due to the vnode restarting. 2023-11-23 15:49:07 +08:00
Benguang Zhao d35bf6186f enh: skip restoring a vnode of single replica in failed mode from vmProcessCreateVnodeReq 2023-11-23 13:16:37 +08:00
Benguang Zhao 8d70d023b9 enh: adjust a logging msg in vmRestoreVnodeInThread 2023-11-23 10:12:58 +08:00
Benguang Zhao 917246e236 fix: allow to drop a vnode in failed mode 2023-11-23 10:09:41 +08:00
Benguang Zhao 0a4fac7704 enh: not allow to acquire a vnode in failed mode from vmAcquireVnode 2023-11-23 09:48:42 +08:00
wangmm0220 cfab06239b Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26060 2023-11-22 19:37:44 +08:00
wangmm0220 9a09e318ca opti:common message process logic in vnode and snode 2023-11-22 16:53:33 +08:00
facetosea 845493294d osfile 2023-11-21 16:31:31 +08:00
dmchen 1e50b11374 TD-27311 2023-11-15 01:31:51 +00:00
Benguang Zhao 73f1c55a47 fix: remove vnode obj from hash 2023-11-09 17:24:02 +08:00
Benguang Zhao b80770dea8 fix: close vnode in the failed mode properly in vmCloseVnode 2023-11-09 13:05:52 +08:00
kailixu c77153cb81 enh: use placeholder '-' for interval of 1st retention level 2023-10-30 14:02:31 +08:00
Benguang Zhao 959f8105ee enh: require command to trigger repairing vnodes on replaced disks 2023-10-19 18:55:12 +08:00
Benguang Zhao a95f6e6862 feat: support restore dnode with vnodes of replaced disks for primary dirs 2023-10-19 11:18:57 +08:00
Benguang Zhao 410ced8320 feat: use TLV format to encode data of snapshot info 2023-10-19 10:51:13 +08:00
Haojun Liao eb4449999f other: merge 3.0 2023-10-12 10:33:48 +08:00
Haojun Liao ee6516f3c4 enh(stream): add trans to reset task status to avoid being frozen in checkpoint status due to doing checkpoint failure of partial tasks. 2023-10-09 10:13:53 +08:00
Haojun Liao f2d8431619 fix(stream): enable new time range for stream task. 2023-09-28 18:26:52 +08:00
dapan1121 1088b80a46
Merge pull request #23062 from taosdata/enh/TD-25879-3.0x
enh: update dnode module
2023-09-27 16:18:38 +08:00
wade zhang f6134b42d7
Merge pull request #23036 from taosdata/feat/TS-4011-3.0
feat/TS-4011: adjust config 'keep_time_offset' level from dnode to db
2023-09-26 14:25:54 +08:00
Ping Xiao 4f23ea2a8c enh: dmodule logic 2023-09-26 11:47:53 +08:00
Shungang Li 743a5b0640 feat: add db config item keep_time_offset 2023-09-25 15:46:08 +08:00
kailixu 8f828e052b enh: timeseries calculation optimization 2023-09-22 20:07:51 +08:00
dapan1121 cc17848b78 fix: merge 3.0 to main 2023-09-01 13:24:47 +08:00
yihaoDeng 20b037d9cc Merge branch 'enh/3.0' into enh/triggerCheckPoint2 2023-08-28 10:46:00 +08:00
dapan1121 e24498b0fd enh: add task notify 2023-08-25 14:59:34 +08:00
yihaoDeng 9310d138a6 Merge branch 'enh/3.0' into enh/triggerCheckPoint2 2023-08-24 17:30:35 +08:00
Haojun Liao 230d8c2d80 fix(stream): fix error in stream computing after vnode is transferred to other dnodes. 2023-08-23 17:50:44 +08:00
Haojun Liao af80d94a88 refactor: do some internal refactor. 2023-08-22 15:43:50 +08:00
Haojun Liao def0877980 fix(stream): add timer to check stream task status. 2023-08-22 10:46:49 +08:00
dm chen dda51d8019
Merge branch '3.0' into feat/TD-22970 2023-08-21 10:50:45 +08:00
yihaoDeng 6fe649c458 Merge branch 'enh/3.0' into enh/triggerCheckPoint2 2023-08-21 09:12:40 +08:00
Minglei Jin 7b4bb72392 fix(vnode/destroy): delete objects 2023-08-18 16:38:26 +08:00
dmchen 4448e7d159 revert drop vnode 2023-08-17 11:57:17 +08:00
Haojun Liao ea6574b3c7 other: merge 3.0 2023-08-17 00:07:55 +08:00
dmchen d85d698074 drop vnode 2023-08-16 18:48:12 +08:00
wangmm0220 5c5721571f fix:set terrno = 0 to avoid affect next fetch msg 2023-08-16 17:45:18 +08:00
dm chen e020c4e8c5
Merge pull request #22456 from taosdata/3.0
merge 3.0 to feat/TD-22970
2023-08-16 16:49:43 +08:00
Haojun Liao ad9f3cbc43 other: merge main. 2023-08-16 09:14:10 +08:00
Haojun Liao 0d38f389ab refactor: do some internal refactor. 2023-08-13 16:25:35 +08:00
Haojun Liao f24b22000f enh(stream): stop stream task before redistribute vnodes. 2023-08-11 23:46:53 +08:00
Haojun Liao 6a9826cf6e enh(stream): update the stream task epset. 2023-08-11 10:37:25 +08:00
dm chen dd271bca6d
Merge pull request #22394 from taosdata/3.0
merge 3.0 to feat/TD-22970
2023-08-10 14:14:22 +08:00
Minglei Jin 33967b243b
Merge branch '3.0' into fix/TD-25010-3 2023-08-10 12:14:01 +08:00
Haojun Liao f633c7fe2b other: merge 3.0. 2023-08-10 11:56:30 +08:00
Hui Li 10f5d223bb
Merge pull request #22370 from taosdata/FIX/TD-25605-3.0
enh: check if disk space sufficient at primary dir with tfs
2023-08-09 18:32:07 +08:00
Benguang Zhao e4d16e594c enh: check if disk space sufficient at primary dir with tfs 2023-08-08 17:53:11 +08:00
dm chen 70a598f072
Merge pull request #22355 from taosdata/3.0
merge 3.0 to TD-22970
2023-08-08 09:53:07 +08:00
Haojun Liao f8ee055641 other: merge 3.0 2023-08-08 00:19:08 +08:00
Minglei Jin fac7e521e9 s3/evict: fetch atime from stat file 2023-08-07 15:59:37 +08:00
wangmm0220 5daf38c0d5 fix:ref is not there 2023-08-07 11:29:54 +08:00
wangmm0220 9ecabb30f5 fix:ref is not there 2023-08-07 10:27:44 +08:00
wangmm0220 5f02e2ddfb fix:ref is not there 2023-08-07 09:31:29 +08:00
wangmm0220 d9a1695257 fix:add log 2023-08-04 18:07:44 +08:00
dm chen 5b03ab1705
Merge branch '3.0' into feat/TD-22970 2023-08-03 17:43:51 +08:00
Haojun Liao 8dfef8768a other: merge 3.0 2023-07-29 22:54:16 +08:00
Haojun Liao b145771a1b other: merge 3.0 2023-07-27 16:38:57 +08:00
Haojun Liao 3d403dca5a other: merge main. 2023-07-27 16:23:41 +08:00
Haojun Liao 1e34f84f78 other: merge 3.0 2023-07-24 15:23:03 +08:00
Haojun Liao 16d7707b90 fix(stream): align the scan real time data for stream task. 2023-07-21 19:33:43 +08:00
dmchen 7d480cf3ac compatible old sync config 2023-07-21 10:31:53 +08:00
wangmm0220 5cb35f2fa6 feat:add committed & position & commite_offset interface 2023-07-19 17:29:39 +08:00
dm chen 141004bf77
Merge branch '3.0' into feat/TD-22970 2023-07-19 10:57:40 +08:00
liuyao fd02b9a71e
Merge branch '3.0' into enh/triggerCheckPoint2 2023-07-19 10:02:06 +08:00
Benguang Zhao 224f90761e fix: set wrapperCfg.diskPrimary in vmProcessAlterVnodeTypeReq 2023-07-18 16:57:52 +08:00
dmchen 3711fdd865 feat/TD-22970 2023-07-18 16:09:38 +08:00
Benguang Zhao 02f4613154 enh: report VND_INIT_FAILED on vnodes open failure in vmOpenVnodes 2023-07-18 15:44:51 +08:00
Benguang Zhao 6b6b7d8d8f enh: alloc disk of vnode primary dir in vmAllocPrimaryDisk 2023-07-18 11:32:23 +08:00
Haojun Liao b2a905bd91
Merge branch '3.0' into enh/triggerCheckPoint2 2023-07-17 11:50:12 +08:00
Benguang Zhao b21e603481 enh: add the field diskPrimary to vnodeGetPrimaryDir, and entries of vnodes.json 2023-07-17 11:48:48 +08:00
Haojun Liao eb7e6152ae refactor(stream): do some internal refactor. 2023-07-14 17:21:20 +08:00
Benguang Zhao b7e134af20 enh: remove unused code in vmProcessCreateVnodeReq 2023-07-12 17:58:30 +08:00
wangmm0220 cf64d4c9c5 fix:set get_assignment offset to first version of response block 2023-07-12 17:22:23 +08:00
Haojun Liao 16ee72ab06 fix(stream): free msg after send checkpoint rsp. 2023-07-10 13:57:51 +08:00
Haojun Liao 47877898d0 enh(stream): generate the checkpoint framework. 2023-07-07 16:07:52 +08:00
Haojun Liao f4a3567935 other: merge 3.0 2023-07-06 11:24:30 +08:00
yihaoDeng 04ab8e19d0 Merge branch 'enh/dev30' into enh/triggerCheckPoint2 2023-06-25 19:58:45 +08:00
Haojun Liao ceb78fdad2
Merge branch '3.0' into refact/fillhistory 2023-06-24 18:53:48 +08:00
wade zhang e95b430e89
Merge pull request #21786 from taosdata/FIX/TD-24817-3.0
enh: make alter-hashrange atomic and idempotent
2023-06-21 13:29:04 +08:00
Benguang Zhao 424086e324 enh: restore vgroup id in vmOpenVnodes for vnodeAlterHashRange 2023-06-20 15:40:09 +08:00
Benguang Zhao e1d9e44fcd enh: add a field toVgId in vnodes.json for prepare alter-hashrange 2023-06-19 17:59:42 +08:00
Benguang Zhao 20a55c3412 fix: make vmProcessAlterHashRangeReq idempotent 2023-06-19 15:09:00 +08:00
yihaoDeng fd85a8495a Merge branch 'dev30' into enh/triggerCheckPoint2 2023-06-17 14:17:21 +08:00
wade zhang 72cdca8570
Merge pull request #21750 from taosdata/FIX/TD-24828-3.0
fix: return error from vmPutMsgToQueue while vnode-write is disabled
2023-06-16 16:59:56 +08:00
Haojun Liao 64365666b7 fix(stream): update the info, and do some internal refactor. 2023-06-16 16:04:43 +08:00
Benguang Zhao 8663148d6c fix: return error from vmPutMsgToQueue while vnode-write is disabled 2023-06-16 09:20:34 +08:00
Haojun Liao 74e0138f72 Merge branch '3.0' into refact/fillhistory 2023-06-15 15:25:00 +08:00
Haojun Liao 1b9eca5ce0 other: merge main. 2023-06-15 13:03:17 +08:00
Yihao Deng 7ded6fc7a2
Merge branch '3.0' into enh/triggerCheckPoint2 2023-06-14 16:30:38 +08:00
Benguang Zhao 05393d9053 fix: make vmProcessCreateVnodeReq idempotent 2023-06-14 13:05:47 +08:00
Haojun Liao 78a240be8f enh(stream): add dispatch msg. 2023-06-12 13:12:45 +08:00
yihaoDeng 74797f5ba6 add trigger checkpoint 2023-06-09 11:00:07 +00:00
Haojun Liao 0dd933013c enh(stream): make history task for stream running. 2023-06-05 17:58:00 +08:00
wangmm0220 f2ee657b62 fix:check wal not exist again before register to push & move push logic from write thread to query thread 2023-06-05 17:21:47 +08:00
Haojun Liao 5301c5756a other: merge main into 3.0. 2023-06-01 09:29:18 +08:00
wangmm0220 04858fae22 fix:tsdbreader is free by mistake 2023-05-20 12:20:54 +08:00
Haojun Liao 170c603995 other: merge 3.0 2023-05-13 20:16:55 +08:00
Haojun Liao 99148d6719 other: merge 3.0 2023-05-13 20:02:48 +08:00
Haojun Liao 181f9063e9 other: merge 3.0 2023-05-12 18:13:28 +08:00
dmchen 9ebe710480 invalid message 2023-05-12 15:21:30 +08:00
Haojun Liao 7ef16e1922 other: merge main. 2023-05-12 11:49:53 +08:00
yihaoDeng 5708fcb5cb Merge branch 'enh/3.0' into enh/rocksdbSstateMerge 2023-05-10 08:02:16 +00:00
dmchen 9b29cfe831 fix/restore check 2023-05-10 14:36:52 +08:00
cadem 843d606058 feat/restore dnode 2023-05-09 17:15:37 +08:00
Benguang Zhao 76a20b2221 enh: adjust enum ETrnExec 2023-05-05 18:57:15 +08:00
Haojun Liao 23c49594b7 other: merge main. 2023-05-04 16:41:53 +08:00
liuyao 2984c5a758 merge main 2023-04-28 10:34:46 +08:00
wangmm0220 6a889ae80e Merge branch 'main' of https://github.com/taosdata/TDengine into fix/TS-3222 2023-04-27 09:48:04 +08:00
Haojun Liao 213e8b8920 log: disable some logs. 2023-04-26 17:58:23 +08:00
54liuyao b79313ecd7 pause&resume 2023-04-25 16:59:09 +08:00
Xiaoyu Wang f5a974489e
Merge pull request #21045 from taosdata/fix/block-check-to-async-check
fix/block-check-to-async-check
2023-04-24 15:41:17 +08:00
cadem 470fef6452 fix/block check to async check for mnode 2023-04-24 13:38:55 +08:00
Haojun Liao 057cc2d30d
Merge pull request #21018 from taosdata/feature/3_liaohj
fix(stream): set the correct start offset for stream task.
2023-04-24 12:02:20 +08:00
cadem a781d43577 fix/block-check-to-async-check 2023-04-24 10:23:43 +08:00
Haojun Liao 3dbe208712 enh(tmq): fix memory error and add retrieve wal info as required. 2023-04-22 15:34:46 +08:00
wangmm0220 6efbcfec4b Merge branch 'main' of https://github.com/taosdata/TDengine into fix/TS-3222 2023-04-21 17:46:35 +08:00
cadem bbb467725f message compatible 2023-04-20 21:50:55 +08:00
Haojun Liao f9801ba9c5 enh(stream): stop stream asap. 2023-04-20 18:58:07 +08:00
Haojun Liao c654f1145d enh(stream): add new msg for seek, and do some internal refactor. 2023-04-20 10:59:16 +08:00
cadem ca6ee940f7 typo 2023-04-19 18:59:40 +08:00
wangmm0220 1061eef144 fix:move consumer msg from fetch thread to query thread 2023-04-19 10:49:18 +08:00
cadem 3b78d4382b add learner 2023-04-18 19:03:45 +08:00
Xiaoyu Wang 96d2c5b9e3
Merge pull request #20927 from taosdata/FIX/TD-23552-main
enh: try to propose vnode commit at vnode closing
2023-04-14 09:14:10 +08:00
Benguang Zhao d8386754ee enh: try to propose vnode commit at vnode closing 2023-04-13 19:45:24 +08:00
Xiaoyu Wang 933660ae8d Merge remote-tracking branch 'origin/main' into fix/3.0_merge_main 2023-04-12 14:13:23 +08:00
Xiaoyu Wang 9c0027cb2a
Merge pull request #20880 from taosdata/FIX/TD-23509-main
enh: refactor some sync func names
2023-04-12 14:01:55 +08:00
Xiaoyu Wang 8b8ac0cd77 merge main 2023-04-12 10:43:28 +08:00
Benguang Zhao edc9fe9705 enh: change the error msg of INVALID_VGROUP_ID to Vnode is closed or removed 2023-04-12 10:12:41 +08:00
wangmm0220 c40c695ea7 fix:optimize log & change the length of tag if tag is null in schemaless 2023-04-11 13:49:18 +08:00
Xiaoyu Wang e9d7a099cc merge main 2023-04-04 14:50:58 +08:00
Benguang Zhao 78ab9d3bf9 fix: process appendLog replies in vnode-sync thread 2023-03-28 17:57:08 +08:00
cadem 86ca5ce210 fix/trigger election by sync msg 2023-03-24 09:13:20 +08:00
cadem ea35f0ae11 feat/balance vgroup leader 2023-03-22 09:36:59 +08:00
Benguang Zhao 9f97162ef7 enh: separate election timer events 2023-03-14 21:02:06 +08:00
Benguang Zhao cc76d78673 enh: separate sync read and write events 2023-03-14 20:35:39 +08:00