Commit Graph

552 Commits

Author SHA1 Message Date
Minghao Li f47a28fe8a enh(sync): add leader transfer 2022-06-13 15:47:43 +08:00
Xiaoyu Wang 1863bbee9a merge 3.0 2022-06-13 15:01:29 +08:00
Xiaoyu Wang 380a071551 fix: handle the memory leak of parser 2022-06-13 14:54:38 +08:00
Minghao Li b1093b4a79 fix(sync): use fqdn instead of raftId 2022-06-13 12:13:35 +08:00
Shengliang Guan 95e4b79091 feat: redistribute vgroup 2022-06-13 11:55:38 +08:00
Minghao Li 34c906a1e1 refactor(sync): add debug log 2022-06-13 10:39:32 +08:00
Minghao Li aad288ab17 refactor(sync): add debug log 2022-06-12 15:21:56 +08:00
Minghao Li 6a4cdadef6 refactor(sync): add debug log 2022-06-11 21:56:44 +08:00
Minghao Li f92f1bbcc0 fix(sync): snapshot overwrite config change 2022-06-11 16:20:15 +08:00
Minghao Li 104a1bb59b fix(sync): snapshot overwrite config change 2022-06-11 16:11:18 +08:00
Minghao Li dffbec29c7 refactor(sync): add last config index z 2022-06-11 15:31:49 +08:00
Minghao Li fa54663871 refactor(sync): add last config index 2022-06-11 13:52:17 +08:00
Minghao Li 4af9d14457 refactor(sync): add last config index 2022-06-11 13:08:30 +08:00
Minghao Li 6adadc0b26 refactor(sync): add last config index 2022-06-11 13:03:58 +08:00
Minghao Li 6586f78599 refactor(sync): add last config index 2022-06-11 12:44:58 +08:00
Minghao Li ae5219dd6e refactor(sync): add heartbeat log 2022-06-10 22:29:28 +08:00
Minghao Li 972fee7fbc refactor(sync): add rpcMsg to reconfig callback 2022-06-10 17:39:30 +08:00
Minghao Li e9d466ec82 refactor(sync) delete some trace log 2022-06-10 16:51:17 +08:00
Minghao Li 736862541e fix(sync): restart with config change 2022-06-10 15:19:11 +08:00
Minghao Li b351fd8261 refactor(sync): add log 2022-06-10 13:15:43 +08:00
Minghao Li 2c38692258 refactor(sync): add log 2022-06-10 11:28:41 +08:00
Minghao Li 3148df2107 fix(sync): compatibility for both mnode(use snapshot) and vnode(no snapshot) 2022-06-09 17:16:06 +08:00
Shengliang Guan 81e431b16a Merge branch 'feature/sync-refactor' of https://github.com/taosdata/TDengine into feature/sync-refactor 2022-06-09 16:33:43 +08:00
Minghao Li 9a61a567c5 refactor(sync): set gRaftDetailLog false 2022-06-09 16:32:37 +08:00
Shengliang Guan 0beb323653 Merge branch 'feature/sync-refactor' of https://github.com/taosdata/TDengine into feature/sync-refactor 2022-06-09 16:16:13 +08:00
Minghao Li 7ae6d8f77d refactor(sync): set gRaftDetailLog true 2022-06-09 14:18:57 +08:00
Minghao Li ee32302101 refactor(sync): add detail log flag 2022-06-09 14:14:45 +08:00
Shengliang Guan 65f65b53b3 Merge remote-tracking branch 'origin/3.0' into feature/sync-refactor 2022-06-09 13:49:43 +08:00
Minghao Li 4f7dc62433 refactor(sync): add detail log flag 2022-06-09 12:56:52 +08:00
Minghao Li d81f5e9f77 fix(sync): add detail log flag 2022-06-09 11:18:48 +08:00
Minghao Li 89e2c2d47a fix(sync): update sender when become leader 2022-06-09 11:00:28 +08:00
Minghao Li e070657778 refactor(sync): add syncGetSnapshotMeta 2022-06-08 23:20:07 +08:00
Minghao Li 61cc736ca0 fix(sync): create db core due to snapshot 2022-06-08 23:08:40 +08:00
Minghao Li e86ee68f8b refactor(sync): sync snapshot 2022-06-08 22:43:58 +08:00
Minghao Li 98a2451c15 refactor(sync): sync snapshot 2022-06-08 21:55:36 +08:00
Shengliang Guan bc8e6b7fd7 refactor: adjust vnode sync 2022-06-08 21:17:17 +08:00
Minghao Li 29b97fa0ad refactor(sync): syncNodeOnAppendEntriesReplySnapshotCb 2022-06-08 19:53:07 +08:00
Minghao Li aa107d03c3 refactor(sync): SSyncSnapshotReceiver 2022-06-08 18:17:17 +08:00
Minghao Li 76185e1742 refactor(sync): SSyncSnapshotSender 2022-06-08 18:07:50 +08:00
Minghao Li d72d2d698c refactor(sync): SyncAppendEntries 2022-06-08 17:44:32 +08:00
Minghao Li 39d0b652ba refactor(sync): add raft log test 2022-06-08 17:18:26 +08:00
Minghao Li 687caac2bf refactor(sync): add raft log test 2022-06-08 16:45:40 +08:00
Minghao Li f6aed44076 refactor(sync): syncNodeSendMsgById to one line 2022-06-08 13:52:33 +08:00
Minghao Li 77cd6f44f4 refactor(sync): syncUtilJson2Line 2022-06-08 11:25:24 +08:00
Minghao Li 2547e8d02e refactor: sync index 2022-06-08 11:03:28 +08:00
Minghao Li eba8f2b543 fix(sync) send snapshot multi-times 2022-06-07 19:20:05 +08:00
Minghao Li 0e41ab7f99 Merge branch 'feature/sync-refactor' of https://github.com/taosdata/TDengine into feature/sync-refactor 2022-06-07 18:34:07 +08:00
Minghao Li 31b54e7462 enh(sync): add privateTerm into SyncSnapshotRsp, SyncSnapshotSend, SSyncSnapshotReceiver 2022-06-07 18:33:06 +08:00
Shengliang Guan 4e99992cff fix: change quorum on sync reconfig successed 2022-06-07 18:00:50 +08:00
Shengliang Guan 9efa68ab96 Merge branch 'fix/mnode' into feature/sync-refactor 2022-06-07 17:11:52 +08:00
Minghao Li 7852188394 enh(sync): add privateTerm into SSyncSnapshotSender, SyncAppendEntries, SyncAppendEntriesReply 2022-06-07 16:49:07 +08:00
Shengliang Guan a047d4a559 Merge remote-tracking branch 'origin/feature/sync-refactor' into fix/mnode 2022-06-07 16:37:50 +08:00
Minghao Li 305f4a8580 enh(sync): add term into index mgr 2022-06-07 16:33:37 +08:00
Minghao Li 8680da282a fix(sync): snapshot maybe change when sending 2022-06-07 15:36:41 +08:00
Minghao Li 326714a077 fix(sync): snapshot maybe change when sending 2022-06-07 14:35:20 +08:00
Minghao Li 44a893a1c1 fix(sync): snapshot maybe change when sending 2022-06-07 13:48:40 +08:00
Minghao Li a89e455267 fix(sync): delete some assert temporary 2022-06-07 09:55:18 +08:00
Minghao Li 9baaf2cd0c enh(sync): add log index manager 2022-06-06 20:55:59 +08:00
Minghao Li 2071c5a74e fix(sync): sending snapshot 2022-06-06 20:02:27 +08:00
Minghao Li 0d7272a369 fix(sync): sending snapshot 2022-06-06 18:23:37 +08:00
Minghao Li 84a67e850e fix(sync): sending snapshot 2022-06-06 17:23:59 +08:00
Minghao Li 6b329f791b enh(sync): update raft core functions 2022-06-06 16:35:44 +08:00
Minghao Li af27303a4c enh(sync): update raft core functions 2022-06-06 16:02:25 +08:00
Minghao Li 01b04e03d9 enh(sync): forbid elect for this round 2022-06-06 11:46:59 +08:00
Minghao Li 4b87154b0e enh(sync): forbid elect for this round 2022-06-06 11:40:37 +08:00
Minghao Li 9c1e1b2f96 enh(sync): add log index manager 2022-06-06 11:31:59 +08:00
Minghao Li 5009b7822f enh(sync): add log index manager 2022-06-06 11:24:25 +08:00
Minghao Li fb4d372255 enh(sync): add log index manager 2022-06-05 22:51:15 +08:00
Minghao Li 2adc0b8a76 enh(sync): add log index manager 2022-06-05 21:48:50 +08:00
Minghao Li 5908631ec3 enh(sync): add log store2 2022-06-05 19:47:54 +08:00
Minghao Li ba8adb73cb refactor(sync): restart elect timer when vote for 2022-06-04 15:49:42 +08:00
Shengliang Guan 30da7560f8 Merge remote-tracking branch 'origin/3.0' into fix/mnode 2022-06-04 11:50:47 +08:00
Minghao Li eea343c5a6 enh(sync): add syncTestTool 2022-06-04 11:25:03 +08:00
Minghao Li 44994201b6 fix(sync): sending snapshot 2022-06-02 19:47:06 +08:00
Shengliang Guan e35ebdadac refactor: rename LEADER to leader 2022-06-02 14:35:59 +08:00
Minghao Li ac90f61b63 fix(sync): wal write from middle 2022-06-02 13:53:19 +08:00
Minghao Li 1ff40068e7 fix: send snapshot 2022-06-02 11:57:06 +08:00
Minghao Li d04c12713a fix: send snapshot 2022-06-02 11:36:26 +08:00
Minghao Li 48a331fd2c refactor: print msg type 2022-06-02 00:00:27 +08:00
Minghao Li c3bf3cc97c fix: send snapshot 2022-06-01 21:57:30 +08:00
Minghao Li 757a1248dc fix: send snapshot 2022-06-01 21:23:39 +08:00
Minghao Li ae06cc3696 refactor: after review raft 6 cb 2022-06-01 19:11:31 +08:00
Minghao Li df4787eff1 refactor: modify syncNodeAppendEntriesPeersSnapshot 2022-06-01 17:08:03 +08:00
Minghao Li 80c4e77b0b refactor: modify syncNodeAppendEntriesPeersSnapshot 2022-06-01 17:07:14 +08:00
Minghao Li 78db753a64 refactor: review syncNodeAppendEntriesPeersSnapshot 2022-06-01 16:30:04 +08:00
Minghao Li 403f6085d5 refactor: review syncNodeRequestVotePeersSnapshot 2022-06-01 15:52:09 +08:00
Minghao Li 320f21820b add snapshot test 2022-06-01 15:25:06 +08:00
Minghao Li 13b336d569 add snapshot test 2022-06-01 15:03:01 +08:00
Minghao Li 4453ebab3a add snapshot recv log 2022-06-01 14:40:20 +08:00
Minghao Li c706c6d0ce add snapshot recv log 2022-06-01 14:35:20 +08:00
Minghao Li 295caad7c1 refactor: add snapshot send log 2022-06-01 14:12:11 +08:00
Minghao Li 2e840969c8 refactor: snapshotReSend 2022-06-01 13:53:21 +08:00
Minghao Li 56253aedc9 refactor: snapshotReSend 2022-06-01 13:40:43 +08:00
Minghao Li 5f0d23426d refactor: snapshotReSend 2022-06-01 13:35:23 +08:00
Minghao Li 060f8224f4 refactor: snapshotReSend 2022-06-01 13:32:52 +08:00
Minghao Li 71c57d7769 refactor: sender code 2022-06-01 11:28:33 +08:00
Minghao Li 9988e85f85 add test sender, receiver 2022-05-31 21:31:07 +08:00
Minghao Li 7922997806 enh(sync): add test syncSnapshotRspTest.cpp 2022-05-31 20:54:39 +08:00
Minghao Li 995317bf9c enh(sync): add test syncSnapshotSendTest.cpp 2022-05-31 20:38:59 +08:00
Minghao Li 057fda21ce enh(sync): syncNodeOnAppendEntriesSnapshotCb 2022-05-31 19:46:49 +08:00
Minghao Li 7917716b4f enh(sync): syncNodeOnAppendEntriesReplySnapshotCb 2022-05-31 19:06:55 +08:00
Minghao Li fd823c8670 enh(sync): syncNodeOnRequestVoteReplySnapshotCb 2022-05-31 18:12:17 +08:00
Minghao Li a20cac89cc enh(sync): syncNodeOnRequestVoteSnapshotCb 2022-05-31 18:04:49 +08:00
Minghao Li b9472dc386 enh(sync): syncNodeAppendEntriesPeersSnapshot 2022-05-31 17:53:38 +08:00
Minghao Li ba212ce396 enh(sync): syncNodeRequestVotePeersSnapshot 2022-05-31 17:37:57 +08:00
Minghao Li ee9cdb2967 enh(sync): syncNodeOnSnapshotSendCb, syncNodeOnSnapshotRspCb 2022-05-31 17:23:36 +08:00
Minghao Li 21191ae2a8 enh(sync): add SSyncSnapshotReceiver 2022-05-31 16:48:47 +08:00
Minghao Li 6d8733a232 enh(sync): add SSyncSnapshotSender 2022-05-31 16:14:19 +08:00
Minghao Li cdc0dc487f Merge branch '3.0' of https://github.com/taosdata/TDengine into feature/3.0_mhli 2022-05-30 21:24:05 +08:00
Minghao Li b9e4543a40 enh(sync): add SyncSnapshotRsp SyncSnapshotSend 2022-05-30 21:21:51 +08:00
Minghao Li c5526ef915 enh(sync): add SyncSnapshotRsp SyncSnapshotSend 2022-05-30 21:11:14 +08:00
Minghao Li 6be4119fe7 add syncNodeIsIndexInSnapshot syncNodeGetLastIndexTerm syncNodeGetPreIndexTerm 2022-05-30 18:45:09 +08:00
Minghao Li 79ae770a0b enh(sync): add snapshotEnable2 2022-05-30 17:31:55 +08:00
Minghao Li 43c383dcbc enh(sync): add snapshotEnable2 2022-05-30 17:19:31 +08:00
Minghao Li d6c57bd372 enh(sync): add snapshotEnable2 2022-05-30 13:14:48 +08:00
Minghao Li bdc9acbf2e enh(sync): add snapshotEnable 2022-05-30 12:26:15 +08:00
Li Minghao e3068a60ee
Merge pull request #13180 from taosdata/feature/3.0_mhli
enh(sync): add SSnapshot callback: reader, writer
2022-05-29 07:37:54 +08:00
Minghao Li cd2e8fe730 enh(sync): add SSnapshot callback: reader, writer 2022-05-29 07:15:29 +08:00
Cary Xu f2b4cca23d fix: init buffer to avoid invalid write 2022-05-29 01:10:32 +08:00
Cary Xu 890075ef4a fix: init buf to avoid invalid write 2022-05-29 00:59:23 +08:00
Cary Xu 5374680649 fix: init buffer to avoid invalid write 2022-05-29 00:37:18 +08:00
Minghao Li 3327a0692f Merge branch '3.0' of https://github.com/taosdata/TDengine into feature/3.0_mhli 2022-05-27 21:34:54 +08:00
Minghao Li b10f8e4aa2 fix(sync) raftCfgPersist 2022-05-27 21:32:28 +08:00
Li Minghao aa691d137f
Merge pull request #13096 from taosdata/feature/3.0_mhli
enh(sync) snapshot sender, receiver
2022-05-27 18:55:51 +08:00
Minghao Li 3a1be0c58a refactor: make logStore static 2022-05-27 18:00:09 +08:00
Minghao Li 5a754023f5 refactor: make logStore static 2022-05-27 16:36:44 +08:00
Minghao Li 5471792549 refactor: make logStoreGetLastEntry static 2022-05-27 16:13:02 +08:00
Minghao Li d45221c863 enh(sync) logStoreGetEntry -> pLogStore->getEntry 2022-05-27 15:41:19 +08:00
Minghao Li b7be03898c enh(sync) snapshot sender, receiver 2022-05-27 15:35:26 +08:00
Minghao Li 8141c430bc enh(sync) snapshot sender, receiver 2022-05-27 15:09:17 +08:00
Minghao Li 17ed7e0747 fix(sync) delete assert, due to config change 2022-05-27 00:00:24 +08:00
Minghao Li 1a22de765c fix(sync) add multi mnodes 2022-05-26 18:03:38 +08:00
Minghao Li f078f5b300 fix(sync): syncSetStandby 2022-05-26 15:08:20 +08:00
Minghao Li 4e1aa6b5c5 refactor: config change 2022-05-26 14:21:24 +08:00
Minghao Li 9a2eddda4c fix(sync), call FpCommitCb twice when FOLLOWER 2022-05-26 11:02:35 +08:00
Minghao Li 8c5f6b6849 fix(sync): persist isStandby 2022-05-25 18:32:34 +08:00
Minghao Li 104a207579 FpReConfigCb 2022-05-25 14:43:45 +08:00
Minghao Li 81d0798f5f refactor: update config when there's one locally 2022-05-25 14:27:59 +08:00
Minghao Li cb20717ce6 refactor: votesRespondUpdate 2022-05-24 20:23:11 +08:00
Minghao Li 94438de0ec enh(sync): syncStartStandBy 2022-05-24 19:45:09 +08:00
Minghao Li aa85781560 enh(sync): add mndSnapshotRead mndSnapshotApply 2022-05-24 15:28:12 +08:00
Minghao Li 800ef42a26 Merge branch 'feature/sync-mnode-integration' of https://github.com/taosdata/TDengine into feature/sync-mnode-integration 2022-05-24 14:47:11 +08:00
Minghao Li aa1de8b34a enh(sync): add FpSnapshotRead FpSnapshotApply 2022-05-24 14:46:22 +08:00
Shengliang Guan 077ea4a14f fix: avoid memory leak in mnode sync 2022-05-24 11:58:50 +08:00
Shengliang Guan 07fee01d1c fix: avoid memory leak in mnode sync 2022-05-24 11:26:17 +08:00
Shengliang Guan 0e8e04805a fix: avoid memory leak 2022-05-24 09:46:54 +08:00
Minghao Li c7691590be enh(sync) add syncIsRestoreFinish 2022-05-23 23:53:15 +08:00
Minghao Li 1d7bdbc351 fix(sync) sync/mnode integration dead lock 2022-05-23 21:37:13 +08:00
Minghao Li 102a08f44b enh(sync) sync/mnode integration, add log 2022-05-23 20:26:12 +08:00
Shengliang Guan 3ff366cdaf Merge remote-tracking branch 'origin/feature/sync-mnode-integration' into fix/mnode 2022-05-23 18:33:09 +08:00