Commit Graph

297 Commits

Author SHA1 Message Date
Shengliang Guan 3850b58a3d fix: cannot close vnode while transferring snapshot 2022-11-30 11:08:30 +08:00
Shengliang Guan 82bc543ed7 fix: cannot close mnode while transferring snapshot 2022-11-30 11:05:25 +08:00
Shengliang Guan b6d3d2322c fix: cannot close vnode while transferring snapshot 2022-11-30 11:02:07 +08:00
yihaoDeng d463f05b3f change paramter 2022-11-29 10:28:32 +08:00
Benguang Zhao 4edef438ea enh: transfer ownership of msgs while committing sync log entries 2022-11-26 21:57:23 +08:00
Benguang Zhao 68f8ebac9d Merge branch 3.0 to FIX/TD-19334-3.0 2022-11-25 13:10:06 +08:00
Minghao Li 9f38bfeb2c refactor(sync): modify info log to trace log 2022-11-24 16:50:58 +08:00
Minghao Li 7fba711d40 refactor(sync): add info log 2022-11-24 16:03:43 +08:00
Minghao Li e43794c366 fix(sync): if msg commit, put it into apply-queue, do not care return code 2022-11-24 15:51:48 +08:00
Minghao Li e7e17302a4 enh(sync): use TSDB_CODE_SYN_NOT_LEADER instead of TSDB_CODE_RPC_REDIRECT 2022-11-21 15:35:36 +08:00
Benguang Zhao b90ee79623 fix: use syncLogBufferCommit in syncNodeOnLocalCmd 2022-11-21 13:51:01 +08:00
Benguang Zhao 363cbc8985 fix: update cbMeta rsp handle info in syncLogFsmExecute 2022-11-18 09:37:58 +08:00
Benguang Zhao da469149db enh: debug to info 2022-11-17 20:28:18 +08:00
Benguang Zhao 051b73c1ed Merge branch 3.0 to FIX/TD-19334-3.0 2022-11-17 17:28:11 +08:00
Benguang Zhao 6062632722 enh: turn commit-cb logging msg to debug level in vnodeSyncCommitMsg 2022-11-16 19:53:22 +08:00
Minghao Li d672e7a05c refactor(sync): add FpApplyQueueItems in fsm 2022-11-09 16:18:28 +08:00
Minghao Li b6aea6ae17 fix(sync): when apply queue not empty, can not read 2022-11-07 16:40:53 +08:00
Benguang Zhao 5878c9a31a fix: impl ring log buffer 2022-11-07 14:27:22 +08:00
Shengliang Guan 2e6f75107d enh: adjust the number of vnode threads so that one vnode has one write thread 2022-11-04 17:38:35 +08:00
Shengliang Guan fc41f43c9d fix: deadlock while drop db 2022-11-04 16:15:37 +08:00
Shengliang Guan a0983cf8c1 enh: adjust tqueue and tworker log 2022-11-04 10:58:23 +08:00
Shengliang Guan 7a537bba09 refact: adjust sync.h and syncState 2022-11-02 10:24:55 +08:00
Shengliang Guan 64633e3dbb enh: refact syncMsg code 2022-11-01 18:34:09 +08:00
Shengliang Guan ee63b49800 Merge remote-tracking branch 'origin/3.0' into fix/TD-20052 2022-11-01 17:11:27 +08:00
Shengliang Guan a71dbd83d2
Merge pull request #17803 from taosdata/fix/TD-20052
enh: refact syncMsg code
2022-11-01 16:45:56 +08:00
Shengliang Guan d35028ae4a enh: refact sync callback func 2022-11-01 16:10:07 +08:00
Shengliang Guan f4dc7d0766 enh: refact sync callback func 2022-11-01 15:35:10 +08:00
Shengliang Guan e79e50ae36 enh: refact syncMsg code 2022-11-01 13:58:25 +08:00
Shengliang Guan 1724aa5638
Merge pull request #17779 from taosdata/fix/sync
refactor(sync): check msgcb, putToQueueFp NULL
2022-11-01 10:43:56 +08:00
Shengliang Guan 392564cc7d enh: refact syncEnv code 2022-10-31 23:40:43 +08:00
Shengliang Guan 1c446b1bf4 Merge branch '3.0' into fix/sync 2022-10-31 23:30:24 +08:00
Minghao Li d246514da2 refactor(sync): check msgcb, putToQueueFp NULL 2022-10-31 18:16:58 +08:00
Minghao Li 0b20b914bb refactor(sync): add sync local cmd 2022-10-31 14:17:26 +08:00
Minghao Li 7cb3112d77 refactor(sync): modify function name 2022-10-27 15:52:48 +08:00
Shengliang Guan ec786b9d78 fix: alter replica one by one 2022-10-24 11:57:26 +08:00
Shengliang Guan 71ac720ac0 fix: compile error in mac 2022-10-22 08:47:09 +08:00
Shengliang Guan 922436e7d4 fix: lock mem items of tqueue 2022-10-21 19:12:03 +08:00
Minghao Li cc7a393978 refactor(sync): refactor sync 2022-10-20 19:42:22 +08:00
Shengliang Guan 4d318b32da refact: alter db replica 2022-10-20 16:47:03 +08:00
Minghao Li 5965629b2e refactor(sync): refacotr sync 2022-10-20 16:05:14 +08:00
Benguang Zhao 2aa7afe7fa Merge branch '3.0' into FIX/TD-19593-3.0 2022-10-19 16:31:13 +08:00
Minghao Li 28a5a9d7e1 refactor(sync): add log, update quorum first when reconfig 2022-10-19 10:57:50 +08:00
Minghao Li 4c9f10b6f3 refactor(sync): add sync ctrl queue in vnode 2022-10-18 19:12:34 +08:00
Minghao Li e810f2ad64 refactor(sync): delete old code, ok 2022-10-18 13:53:03 +08:00
Minghao Li 8a6eaed6f6 refactor(sync): delete some code 2022-10-17 17:36:51 +08:00
Minghao Li fa30b94c67 refactor(sync): append entries 2022-10-16 12:07:02 +08:00
Minghao Li 4d123c4da6 refactor(sync): add interface in sync 2022-10-14 11:18:48 +08:00
Minghao Li 733440b352 refactor(sync): add double queues in vnode 2022-10-13 14:37:18 +08:00
Hongze Cheng 6ed0634fb7 format more code 2022-10-13 11:56:16 +08:00
Minghao Li 3416ee66d8 fix(sync): enqueue timer msg 2022-10-12 15:35:15 +08:00
Shengliang Guan dfb2b0678f fix: coverity issues 2022-09-30 14:03:46 +08:00
Shengliang Guan 3be4a2ed9c Merge remote-tracking branch 'origin/3.0' into fix/TD-19245 2022-09-29 19:42:09 +08:00
Shengliang Guan e94646ca70 fix: coverity issues 2022-09-29 19:41:54 +08:00
Shengliang Guan c56dd86399 fix: do not process query and fetch msg until vnode restore finished 2022-09-29 14:29:30 +08:00
Shengliang Guan 4df3303514 fix: do not process query and fetch msg until vnode restore finished 2022-09-29 14:24:45 +08:00
Shengliang Guan f14d00a5d6 fix: do not process query and fetch msg until vnode restore finished 2022-09-29 14:19:43 +08:00
Shengliang Guan 7e85a15c31 fix: do not process query and fetch msg until vnode restore finished 2022-09-29 14:18:20 +08:00
Shengliang Guan 4223be379a fix: do not process query and fetch msg until vnode restore finished 2022-09-29 14:15:26 +08:00
Shengliang Guan ee484470f3 fix: do not process query and fetch msg until vnode restore finished 2022-09-29 14:13:44 +08:00
Shengliang Guan 1e5dc921e0 fix: set wal apply version on vnode reopen 2022-09-26 20:32:02 +08:00
Minghao Li dfed091937 fix(sync): wait until apply queue is empty when restore 2022-09-20 18:50:23 +08:00
Minghao Li 22c6d82ded refactor(sync): add syncIsReadyForRead 2022-08-15 14:45:52 +08:00
Minghao Li 6cff4dcfd8 refactor(sync): add syncIsReadyForRead 2022-08-15 14:42:40 +08:00
Liu Jicong b9c9ea5974
Merge pull request #16103 from taosdata/feature/stream
refactor(stream): remove unneccessary param in converting data
2022-08-15 13:26:46 +08:00
Liu Jicong 6f75e03a55 refactor(stream): remove unneccessary param in converting data 2022-08-15 11:06:53 +08:00
Shengliang Guan 65fa1e0164 fix: deadlock of mnode if its state changed 2022-08-12 19:20:31 +08:00
Shengliang Guan 2c28cdcbb5 fix: deadlock of mnode if its state changed 2022-08-12 18:49:41 +08:00
Shengliang Guan 353109cd53 fix: deadlock of vnode if its state changed 2022-08-12 17:25:08 +08:00
Shengliang Guan 4f90578270 fix: deadlock of vnode if its state changed 2022-08-12 16:32:11 +08:00
Minghao Li b4c8685766 refactor(sync): add leader, follower call back 2022-08-10 17:17:30 +08:00
Li Minghao 7722f88093
Merge pull request #15861 from taosdata/feature/3.0_mhli
refactor(sync): speed up replicate
2022-08-08 20:36:49 +08:00
Liu Jicong 87c1656f52
Merge pull request #15859 from taosdata/feature/stream
fix(stream): memory leak
2022-08-08 19:55:13 +08:00
Minghao Li df18cc5f47 refactor(sync): speed up replicate 2022-08-08 19:46:37 +08:00
Liu Jicong 48449e80c3 fix(stream): memory leak 2022-08-08 19:17:28 +08:00
Liu Jicong e30b74ad5a fix(stream): memory leak 2022-08-08 18:53:49 +08:00
Minghao Li 0f63837e69 refactor(sync): make leader life longer 2022-08-08 13:25:02 +08:00
Minghao Li e628b70726 refactor(sync): make leader life longer 2022-08-06 13:17:08 +08:00
Minghao Li 32830ca9c0 refactor(sync): make leader life longer 2022-08-04 20:44:10 +08:00
Minghao Li 9be864a6be refactor(sync): make leader life longer 2022-08-04 20:36:12 +08:00
Shengliang Guan 72b8e0eb20 refactor: adjust logs 2022-08-03 19:17:42 +08:00
Shengliang Guan f7e8341457 fix: adjust logs 2022-08-03 10:56:37 +08:00
Shengliang Guan d5ff7c3207 fix: remove redundant syncNodeReplicate calls 2022-08-02 21:02:26 +08:00
Shengliang Guan efb0127fbf refactor: adjust logs 2022-08-02 16:48:49 +08:00
Shengliang Guan d5aea7dac2 refactor: adjust sync log 2022-08-02 16:39:12 +08:00
Li Minghao b0746d9a0b
Merge pull request #15660 from taosdata/feature/3.0_mhli
feat(sync): set batch-size 1
2022-08-02 09:57:55 +08:00
Minghao Li 2c1846214d feat(sync): set batch-size 1 2022-08-01 20:26:45 +08:00
Shengliang Guan 2b2e1c79c9 fix: write snapshot after apply queue is empty 2022-08-01 19:40:38 +08:00
Minghao Li 5ad0ac9500 refactor(sync): add propose batch 2022-07-28 20:24:31 +08:00
Minghao Li df26c5f21a refactor(sync): add trace log 2022-07-28 10:54:11 +08:00
Minghao Li a93c346f24 refactor(sync): add trace log 2022-07-28 10:49:36 +08:00
Minghao Li d1068ceaf5 refactor(sync): add trace log 2022-07-27 19:37:32 +08:00
Minghao Li 9a540919b9 refactor(sync): pre-commit integration 2022-07-26 17:23:26 +08:00
Minghao Li 0addf09996 refactor(sync): add pre-commit interface 2022-07-26 11:24:39 +08:00
Shengliang Guan bc9a553db0 fix: the message cannot be processed until the vnode recovery is complete 2022-07-25 19:08:08 +08:00
Shengliang Guan 3bceeef439 enh: add batch processing method to vnode 2022-07-25 17:16:26 +08:00
Shengliang Guan 8dacdd57c5 enh: add batch processing method to vnode 2022-07-25 17:10:04 +08:00
Shengliang Guan 993f5fe9ec fix: let certain type of write messages to be executed sequentially 2022-07-18 18:37:58 +08:00
Minghao Li 604e5b750c refactor(sync): add index/term in vnodeSnapWriterClose 2022-07-16 18:19:54 +08:00
Minghao Li fdf7930702 refactor(sync): add index/term in snapshot write 2022-07-16 18:09:36 +08:00
Minghao Li b86ec034db refactor(sync): modify elect/heartbeat timer 2022-07-15 18:05:51 +08:00
Minghao Li 5b6c7bc38d refactor(sync): add leader transfer callback 2022-07-15 14:26:18 +08:00
Minghao Li 473e134f31 refactor(sync): add resp ttl clean 2022-07-12 16:57:19 +08:00
Minghao Li 96f9274fef refactor(sync): add timer routines 2022-07-12 15:04:32 +08:00
Minghao Li 9e4c4c50a0 refactor(sync): update to SYNC_STRATEGY_WAL_FIRST 2022-07-10 19:10:06 +08:00
Minghao Li ee3ceccb0a fix(sync): vnode snapshot sender 2022-07-10 16:05:21 +08:00
Minghao Li 0521bd5afe refactor(sync): add vnodeSnapWriterClose IsApply 2022-07-10 14:28:46 +08:00
Minghao Li 32c3cecf2a refactor(sync): add snapshot writer 2022-07-10 11:33:28 +08:00
Hongze Cheng 668ca4a4fb Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/tsdb_snapshot 2022-07-10 01:51:45 +00:00
Hongze Cheng 0840affc32 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/tsdb_snapshot 2022-07-08 12:33:12 +00:00
Shengliang Guan e4a855e591 Merge remote-tracking branch 'origin/3.0' into fix/valgrind 2022-07-08 19:54:26 +08:00
Li Minghao 94cc3af08f
Merge pull request #14686 from taosdata/feature/3.0_mhli
refactor(sync): add fake syncRestoreFromSnapshot
2022-07-08 19:46:51 +08:00
Shengliang Guan a5e8ddbc56 refactor: adjust logs 2022-07-08 18:00:19 +08:00
Minghao Li 56e65d13d1 refactor(sync): add fake syncRestoreFromSnapshot 2022-07-08 17:37:25 +08:00
Hongze Cheng fdf6d22d1b Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/tsdb_snapshot 2022-07-07 01:17:00 +00:00
Shengliang Guan c1667cdd84
Merge pull request #14600 from taosdata/fix/dnode
refactor: redirect vnode msg
2022-07-06 21:01:57 +08:00
dapan1121 82dbf54719 Merge branch 'fix/dnode' of github.com:taosdata/TDengine into fix/dnode 2022-07-06 20:34:07 +08:00
dapan1121 a3bf5b96c4 fix: fix query redirect issue 2022-07-06 20:33:23 +08:00
Hongze Cheng bf0b37390d Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/tsdb_snapshot 2022-07-06 12:24:27 +00:00
Shengliang Guan 0163ec4d4b Merge remote-tracking branch 'origin/3.0' into fix/dnode 2022-07-06 18:53:26 +08:00
Minghao Li 0e12b29ca9 refactor(sync): add propose batch in no snapshot strategy 2022-07-06 17:51:12 +08:00
Hongze Cheng 0901640ba2 make snapshot compile 2022-07-06 09:46:14 +00:00
Minghao Li b73914fb0d refactor(sync): add term in rpcMsg 2022-07-06 16:52:39 +08:00
Minghao Li fcb2197200 refactor(sync): add vnodeSnapshotStopRead into callback 2022-07-06 16:27:58 +08:00
Shengliang Guan 5e18e07a35 refactor: pre process vnode msg 2022-07-06 16:06:55 +08:00
Minghao Li cc9888837e refactor(sync): add vnodeSnapshotStopRead into callback 2022-07-06 16:05:57 +08:00
Minghao Li 432e1a39b7 refactor(sync): add vnodeSnapshotStopRead into callback 2022-07-06 15:47:24 +08:00
Shengliang Guan efeef24f1c refactor: adjust vnode propose msg 2022-07-05 21:43:55 +08:00
Shengliang Guan 3087208dc9 refactor: adjust vnode propose msg 2022-07-05 21:22:34 +08:00
Shengliang Guan 64b540bef5 refactor: adjust vnode propose msg 2022-07-05 20:04:17 +08:00
Minghao Li 6e59c13cbd refactor(sync): add sync strategy 2022-07-04 15:57:28 +08:00
Minghao Li 0c1a46c26e refactor(sync): add sync strategy 2022-07-04 15:29:55 +08:00
Minghao Li ded4616074 refactor(sync): add sync strategy 2022-07-04 14:55:26 +08:00
Minghao Li a5d3b7033a refactor(sync): add snapshot writer param 2022-07-04 14:18:06 +08:00
Minghao Li 0ffc6c46f3 refactor(sync): add snapshot2 interface 2022-07-01 14:47:12 +08:00
dapan1121 c28c77a099 Merge branch '3.0' into feature/queryredirect 2022-06-30 14:35:15 +08:00
yihaoDeng e389dcedc8 add query epset 2022-06-30 10:30:36 +08:00
dapan1121 f579cc4c15 Merge branch '3.0' into enh/stopquery 2022-06-29 08:57:35 +08:00
Shengliang Guan c0183e1fa8 fix: duplicate response while set standby in vnode 2022-06-28 15:50:47 +08:00
Minghao Li 33d1440e7b refactor(sync): adjust trace log 2022-06-28 14:23:45 +08:00
Minghao Li 6eecbcd1a6 refactor(sync): optimized one replica 2022-06-26 01:16:11 +08:00
Minghao Li a6f33ba01c refactor(sync): optimized one replica 2022-06-25 20:31:42 +08:00
Minghao Li 87defc2790 refactor(sync): add interface: get retry epset 2022-06-24 14:26:31 +08:00
Shengliang Guan 714c599fd7 fix: deadlock while set standby 2022-06-21 11:40:27 +08:00
Minghao Li e441bd266b refactor(sync): add changing state 2022-06-20 17:48:56 +08:00
Minghao Li 5968c6353f refactor(sync): get snapshot and create reader 2022-06-20 10:58:59 +08:00
Yihao Deng 2941254a2b
Merge branch '3.0' into enh/trace1 2022-06-18 18:26:26 +08:00
yihaoDeng 974f56cdf1 add trace base func 2022-06-18 18:12:31 +08:00
Shengliang Guan 94071f4cc7 refactor: add more logs 2022-06-17 16:52:25 +08:00
Shengliang Guan 43f8f34b0f refactor: adjust logs 2022-06-17 14:24:17 +08:00
Shengliang Guan 62f21b528e refactor: remove duplicate conninfo in SRpcMsg 2022-06-17 10:52:45 +08:00