Commit Graph

435 Commits

Author SHA1 Message Date
Shengliang Guan d5f7f8c398 refact: remove sync apply msg 2022-11-13 16:11:49 +08:00
Shengliang Guan 7bcda46c59 refact: remove sync pre snapshot 2022-11-13 16:03:45 +08:00
Shengliang Guan 973fc99f75
Merge pull request #18094 from taosdata/feature/3.0_mhli
refactor(sync): pre snapshot
2022-11-13 15:38:33 +08:00
Minghao Li ce4f32b8e7 refactor(sync): pre snapshot 2022-11-13 12:21:14 +08:00
Minghao Li 58fd2228d9 refactor(sync): pre snapshot 2022-11-13 10:45:33 +08:00
Shengliang Guan 6681099245 refact: build sync heartbeat reply 2022-11-12 21:31:01 +08:00
Shengliang Guan 55927eaf0d refact: build sync heartbeat msg 2022-11-12 20:37:15 +08:00
Shengliang Guan 94076e5919 refact: adjust sync append entry 2022-11-12 20:29:49 +08:00
Shengliang Guan 54e05aee26 enh: adjust sync append entry reply 2022-11-12 18:21:58 +08:00
Shengliang Guan 2dfc970572 enh: adjust sync append entry msg 2022-11-12 16:40:09 +08:00
Shengliang Guan 5b46cbefe9 enh: adjust request vote reply 2022-11-12 15:24:49 +08:00
Shengliang Guan cd19ff0173 enh: adjust request vote reply 2022-11-12 13:17:56 +08:00
Shengliang Guan 8cca68f29d enh: adjust request vote msg 2022-11-12 12:58:08 +08:00
Shengliang Guan 26cb3c3856 refact: remove sync batch codes 2022-11-12 12:26:56 +08:00
Shengliang Guan 8deb3b83df refact: adjust timeout msg build 2022-11-12 10:54:36 +08:00
Shengliang Guan 2da7eac62d refact: adjust timeout msg build 2022-11-12 10:21:16 +08:00
Benguang Zhao def4058eb1 feat: impl pipelining negotiation 2022-11-11 22:55:21 +08:00
Minghao Li 352c2d8ec0 refactor(sync): pre snapshot 2022-11-11 20:46:30 +08:00
Shengliang Guan a18c731cd0 refact: remove sync ping and pingreply 2022-11-11 17:35:04 +08:00
Shengliang Guan 1336ed11b2 refact: adjust sync ping message handler 2022-11-11 15:06:47 +08:00
Shengliang Guan 57f1b593e4 refact: adjust head file and sync log 2022-11-11 14:40:21 +08:00
Shengliang Guan fd152f00ec refact: adjust head file and sync log 2022-11-11 14:35:16 +08:00
Shengliang Guan b4f8e45401 refact: adjust head file and sync log 2022-11-11 14:25:24 +08:00
Shengliang Guan 5de865992a refact: adjust head file and sync log 2022-11-11 12:19:10 +08:00
Shengliang Guan 4d0c5c9d57 refact: adjust head file and sync log 2022-11-11 11:06:39 +08:00
Shengliang Guan 8a051c001d refact: adjust sync debug codes 2022-11-10 17:05:13 +08:00
Shengliang Guan f7d263862b refact: remove assert and adjust log 2022-11-10 11:26:52 +08:00
Shengliang Guan 98b77fe8b4 refact: adjust head file 2022-11-09 19:02:47 +08:00
Shengliang Guan 15e7e345dc refact: move sync test code to single lib 2022-11-09 14:45:07 +08:00
Shengliang Guan a4e96ca833 refact: adjust sync resp mgr 2022-11-08 22:43:12 +08:00
Shengliang Guan 9914657cb0 refactor: adjust sync hb 2022-11-07 23:31:01 +08:00
Shengliang Guan 4ddd25a29c enh: adjust sync propose 2022-11-07 20:31:26 +08:00
Shengliang Guan 46e55ba9fb refact: remove config change codes 2022-11-07 20:19:55 +08:00
Shengliang Guan e060de7059 refact: remove config change codes 2022-11-07 19:34:48 +08:00
Shengliang Guan 1ddbeb43bb refact: adjust sync log 2022-11-07 19:19:10 +08:00
Shengliang Guan 4baafd3417 refact: adjust sync log 2022-11-07 18:44:29 +08:00
Shengliang Guan a1c8db0f88 refact: adjust sync log 2022-11-07 17:35:24 +08:00
Benguang Zhao 5878c9a31a fix: impl ring log buffer 2022-11-07 14:27:22 +08:00
Minghao Li ddb815ac42 refactor(sync): optimize advance commit index when one replica 2022-11-05 10:54:59 +08:00
Minghao Li 102969086d refactor(sync): add local-cmd:follower-commit 2022-11-03 10:25:38 +08:00
Minghao Li 1a4b7622e4 enh(sync): add sync pre stop 2022-11-03 09:39:20 +08:00
Minghao Li 70aff8451f refactor(sync): add pre snapshot 2022-11-02 15:38:30 +08:00
Minghao Li f7191d2ffd refactor(sync): add pre snapshot 2022-11-02 15:25:14 +08:00
Shengliang Guan 7a537bba09 refact: adjust sync.h and syncState 2022-11-02 10:24:55 +08:00
Shengliang Guan d35028ae4a enh: refact sync callback func 2022-11-01 16:10:07 +08:00
Shengliang Guan e79e50ae36 enh: refact syncMsg code 2022-11-01 13:58:25 +08:00
Minghao Li fd07a611a9 refactor(sync): add some log 2022-11-01 11:30:40 +08:00
Shengliang Guan fbb1fa5303 enh: refact syncEnv code 2022-11-01 09:02:48 +08:00
Shengliang Guan 392564cc7d enh: refact syncEnv code 2022-10-31 23:40:43 +08:00
Minghao Li 77ba900776 refactor(sync): add sync local cmd, step down 2022-10-31 16:12:40 +08:00
Minghao Li 438786501b refactor(sync): adjust elect timer ms 2022-10-28 15:31:34 +08:00
Minghao Li 49af601e19 refactor(sync): add SElectTimer 2022-10-25 19:56:49 +08:00
Minghao Li 64f539cacb refactor(sync): adjust timer 2022-10-25 18:03:22 +08:00
Minghao Li 984af8a877 refactor(sync): if data is null, do not update state mgr 2022-10-21 15:13:51 +08:00
Minghao Li 5965629b2e refactor(sync): refacotr sync 2022-10-20 16:05:14 +08:00
Minghao Li 74b48e6df8 refacotr(sync): modify sync-snapshot 2022-10-20 14:53:03 +08:00
Minghao Li 357951e947 refactor(sync): modify some code 2022-10-19 16:08:42 +08:00
Minghao Li 28a5a9d7e1 refactor(sync): add log, update quorum first when reconfig 2022-10-19 10:57:50 +08:00
Minghao Li 4c9f10b6f3 refactor(sync): add sync ctrl queue in vnode 2022-10-18 19:12:34 +08:00
Minghao Li 1b36ad119c refactor(sync): rename functions 2022-10-18 15:24:00 +08:00
Minghao Li 49c19e13f2 refactor(sync): rename function 2022-10-18 14:16:39 +08:00
Minghao Li e810f2ad64 refactor(sync): delete old code, ok 2022-10-18 13:53:03 +08:00
Minghao Li 8a6eaed6f6 refactor(sync): delete some code 2022-10-17 17:36:51 +08:00
Minghao Li 092a07475d refactor(sync): process hb and appendentries 2022-10-17 16:38:44 +08:00
Minghao Li 5745223bca refactor(sync): add double queues in mnode 2022-10-17 10:33:27 +08:00
Minghao Li fa30b94c67 refactor(sync): append entries 2022-10-16 12:07:02 +08:00
Minghao Li 797d1324c5 refactor(sync): request vote 2022-10-15 09:28:55 +08:00
Shengliang Guan 78fb1911d4 enh: refactor the code to create and delete mnodes 2022-10-14 17:59:09 +08:00
Minghao Li 4d123c4da6 refactor(sync): add interface in sync 2022-10-14 11:18:48 +08:00
Minghao Li 2ae4081a3f refactor(sync): add double queues in vnode 2022-10-13 20:57:36 +08:00
Minghao Li 733440b352 refactor(sync): add double queues in vnode 2022-10-13 14:37:18 +08:00
Hongze Cheng c79cc7e454 more code format 2022-10-13 14:06:27 +08:00
Benguang Zhao b71a9e3483 enh: improve error handling in syncNodeOpen 2022-09-28 13:34:13 +08:00
Minghao Li 8da7950282 refactor(sync): close receiver when become leader 2022-08-22 15:40:28 +08:00
Minghao Li 8a32c0c189 refactor(sync): adjust strategy for dynamic quorum 2022-08-18 14:55:57 +08:00
Minghao Li 2ca5bdc708 refactor(sync): add syncNodeDynamicQuorum 2022-08-17 15:39:38 +08:00
Minghao Li eee4c0853d refactor(sync): add syncNodeAppendEntriesOnePeer 2022-08-17 10:34:53 +08:00
Minghao Li 8f0361bf75 refactor(sync): delete expired config index 2022-08-11 17:42:04 +08:00
Minghao Li 8328aae50f refactor(sync): add raft config index test 2022-08-11 15:22:44 +08:00
Minghao Li dc42544e9e refactor(sync): add leader, follower call back2 2022-08-10 20:45:36 +08:00
Minghao Li df18cc5f47 refactor(sync): speed up replicate 2022-08-08 19:46:37 +08:00
Minghao Li 62b07dbe5d refactor(sync): speed up replicate 2022-08-08 15:10:32 +08:00
Minghao Li f83ca89ea2 refactor(sync): make leader life longer 2022-08-06 19:40:10 +08:00
Minghao Li 327b938cbb refactor(sync): make leader life longer 2022-08-05 15:33:44 +08:00
Minghao Li 9be864a6be refactor(sync): make leader life longer 2022-08-04 20:36:12 +08:00
Minghao Li 4b6b1de91c refactor(sync): restart hb timer when replicate get error term 2022-07-30 17:30:10 +08:00
Minghao Li 64f4325bd7 refactor(sync): modify propose batch interface 2022-07-28 17:55:15 +08:00
Minghao Li 43e2f8bc2b refactor(sync): add pre-commit interface 2022-07-26 10:59:56 +08:00
Minghao Li cedad48a73 refactor(sync): add ref in log entry 2022-07-25 17:47:15 +08:00
Minghao Li 0b494d256f refactor(sync): add ref id in raft entry 2022-07-23 19:18:18 +08:00
Minghao Li 7808fdfccb refactor(sync): add trace log 2022-07-20 17:19:42 +08:00
Minghao Li 7187c87d35 refactor(sync): add restart heartbeat timer 2022-07-18 16:55:24 +08:00
Minghao Li 6f29fd4020 fix(sync): snapshot begin index 2022-07-16 15:34:22 +08:00
Minghao Li 681993884f refactor(sync): add leader transfer callback 2022-07-15 14:55:33 +08:00
Minghao Li 511c39a0cf refactor(sync): add skiplist entry cache 2022-07-13 15:55:38 +08:00
Minghao Li 96f9274fef refactor(sync): add timer routines 2022-07-12 15:04:32 +08:00
Minghao Li ded3224471 refactor(sync): modify log to index 2022-07-12 11:07:07 +08:00
Li Minghao d94680c3c4
Merge pull request #14676 from taosdata/feature/3.0_mhli
fix(sync): append entries batch
2022-07-08 16:07:22 +08:00
Minghao Li a39de34984 refactor(sync): rm syncOnMessage 2022-07-08 15:21:44 +08:00
Li Minghao 1e1e373220
Merge pull request #14654 from taosdata/feature/3.0_mhli
fix(sync): snapshot strategy wal first
2022-07-07 17:45:17 +08:00
Minghao Li 1c3c270307 fix(sync): snapshot strategy wal first 2022-07-07 17:00:01 +08:00
Liu Jicong 1ec57798d2 ci: remove unstable case 2022-07-07 11:45:28 +08:00
Minghao Li 78efbaabe1 refactor(sync): add syncGetSnapshotByIndex 2022-07-06 15:16:52 +08:00
Minghao Li 83b639ae8f refactor(sync): persist batch size 2022-07-06 14:58:38 +08:00
Minghao Li cd4bc6e30b refactor(sync): snapshot strategy 2022-07-06 11:12:45 +08:00
Minghao Li e8160342c3 refactor(sync): snapshot sender, receiver 2022-07-05 14:38:44 +08:00
Minghao Li 6e59c13cbd refactor(sync): add sync strategy 2022-07-04 15:57:28 +08:00
Minghao Li a5d3b7033a refactor(sync): add snapshot writer param 2022-07-04 14:18:06 +08:00
Minghao Li 856806bb22 refactor(sync): add snapshot2 interface 2022-07-04 13:33:49 +08:00
Minghao Li 086ec29ca0 refactor(sync): add SyncClientRequestBatch 2022-07-02 14:41:54 +08:00
Minghao Li d4ab134645 refactor(sync): add snapshot2 interface 2022-07-01 17:30:52 +08:00
Minghao Li 91238e823e refactor(sync): add snapshot2 interface 2022-07-01 14:22:14 +08:00
Minghao Li 4f39cd31b0 refactor(sync): add snapshot2 interface 2022-07-01 09:50:20 +08:00
Minghao Li 24a3c817a4 refactor(sync): add batch propose 2022-06-30 16:44:49 +08:00
Minghao Li 1a8cf049b7 refactor(sync): add syncAppendEntriesBatch 2022-06-30 13:39:13 +08:00
Minghao Li 41f24314d0 refactor(sync): add SYNC_TERM_INVALID 2022-06-29 15:44:30 +08:00
Minghao Li 4c410bd5ec refactor(sync): refactor snapshot code 2022-06-28 11:33:14 +08:00
Minghao Li 2647ec21e0 refactor(sync): add comments in snapshot 2022-06-27 20:23:08 +08:00
Minghao Li 49ff32cda5 refactor(sync): add entries cache 2022-06-27 16:53:02 +08:00
Minghao Li a22814a5a7 refactor(sync): optimized one replica 2022-06-27 10:36:28 +08:00
Minghao Li 6eecbcd1a6 refactor(sync): optimized one replica 2022-06-26 01:16:11 +08:00
Minghao Li a6f33ba01c refactor(sync): optimized one replica 2022-06-25 20:31:42 +08:00
Minghao Li 3d9ffc42e8 refactor(sync): refactor wal abstraction 2022-06-23 21:16:16 +08:00
Minghao Li 00c0926c44 refactor(sync): hold wal handle with log store 2022-06-23 14:58:52 +08:00
Minghao Li cdb6b2429a refactor(sync): update election timer range 2022-06-23 14:37:29 +08:00
Minghao Li e18329ac19 refactor(sync): update election timer range 2022-06-23 14:22:53 +08:00
Minghao Li ecc43b6697 refactor(sync): delete some assert 2022-06-21 16:02:36 +08:00
Minghao Li 0fb64add90 refactor(sync) add trace log 2022-06-21 15:09:23 +08:00
Minghao Li 3573ae1564 refactor(sync): block when changing 2022-06-20 20:07:36 +08:00
Minghao Li e441bd266b refactor(sync): add changing state 2022-06-20 17:48:56 +08:00
Minghao Li 5968c6353f refactor(sync): get snapshot and create reader 2022-06-20 10:58:59 +08:00
Minghao Li b247762931 refactor(sync) refactor trace log 2022-06-18 15:17:58 +08:00
Minghao Li 9ab28e0b88 refactor(sync): add last config index in fsm cbMeta 2022-06-17 14:05:52 +08:00
Minghao Li 455a8da0ad refactor(sync): add config index to json 2022-06-17 13:08:41 +08:00
Minghao Li f5db109e61 fix(sync): get last max snapshot index 2022-06-17 11:37:10 +08:00
Minghao Li 77b03ac821 refactor(sync): add restore finish when become leader again 2022-06-16 14:40:42 +08:00
Minghao Li aad288ab17 refactor(sync): add debug log 2022-06-12 15:21:56 +08:00
Minghao Li fa54663871 refactor(sync): add last config index 2022-06-11 13:52:17 +08:00
Minghao Li 6586f78599 refactor(sync): add last config index 2022-06-11 12:44:58 +08:00
Minghao Li e9d466ec82 refactor(sync) delete some trace log 2022-06-10 16:51:17 +08:00
Minghao Li 736862541e fix(sync): restart with config change 2022-06-10 15:19:11 +08:00
Minghao Li 89e2c2d47a fix(sync): update sender when become leader 2022-06-09 11:00:28 +08:00
Minghao Li e070657778 refactor(sync): add syncGetSnapshotMeta 2022-06-08 23:20:07 +08:00
Minghao Li 29b97fa0ad refactor(sync): syncNodeOnAppendEntriesReplySnapshotCb 2022-06-08 19:53:07 +08:00
Minghao Li aa107d03c3 refactor(sync): SSyncSnapshotReceiver 2022-06-08 18:17:17 +08:00
Minghao Li 76185e1742 refactor(sync): SSyncSnapshotSender 2022-06-08 18:07:50 +08:00
Minghao Li d72d2d698c refactor(sync): SyncAppendEntries 2022-06-08 17:44:32 +08:00
Minghao Li 77cd6f44f4 refactor(sync): syncUtilJson2Line 2022-06-08 11:25:24 +08:00
Minghao Li 2547e8d02e refactor: sync index 2022-06-08 11:03:28 +08:00
Minghao Li eba8f2b543 fix(sync) send snapshot multi-times 2022-06-07 19:20:05 +08:00