Commit Graph

435 Commits

Author SHA1 Message Date
Minghao Li 438786501b refactor(sync): adjust elect timer ms 2022-10-28 15:31:34 +08:00
Minghao Li 49af601e19 refactor(sync): add SElectTimer 2022-10-25 19:56:49 +08:00
Minghao Li 64f539cacb refactor(sync): adjust timer 2022-10-25 18:03:22 +08:00
Minghao Li 984af8a877 refactor(sync): if data is null, do not update state mgr 2022-10-21 15:13:51 +08:00
Minghao Li 5965629b2e refactor(sync): refacotr sync 2022-10-20 16:05:14 +08:00
Minghao Li 74b48e6df8 refacotr(sync): modify sync-snapshot 2022-10-20 14:53:03 +08:00
Minghao Li 357951e947 refactor(sync): modify some code 2022-10-19 16:08:42 +08:00
Minghao Li 28a5a9d7e1 refactor(sync): add log, update quorum first when reconfig 2022-10-19 10:57:50 +08:00
Minghao Li 4c9f10b6f3 refactor(sync): add sync ctrl queue in vnode 2022-10-18 19:12:34 +08:00
Minghao Li 1b36ad119c refactor(sync): rename functions 2022-10-18 15:24:00 +08:00
Minghao Li 49c19e13f2 refactor(sync): rename function 2022-10-18 14:16:39 +08:00
Minghao Li e810f2ad64 refactor(sync): delete old code, ok 2022-10-18 13:53:03 +08:00
Minghao Li 8a6eaed6f6 refactor(sync): delete some code 2022-10-17 17:36:51 +08:00
Minghao Li 092a07475d refactor(sync): process hb and appendentries 2022-10-17 16:38:44 +08:00
Minghao Li 5745223bca refactor(sync): add double queues in mnode 2022-10-17 10:33:27 +08:00
Minghao Li fa30b94c67 refactor(sync): append entries 2022-10-16 12:07:02 +08:00
Minghao Li 797d1324c5 refactor(sync): request vote 2022-10-15 09:28:55 +08:00
Shengliang Guan 78fb1911d4 enh: refactor the code to create and delete mnodes 2022-10-14 17:59:09 +08:00
Minghao Li 4d123c4da6 refactor(sync): add interface in sync 2022-10-14 11:18:48 +08:00
Minghao Li 2ae4081a3f refactor(sync): add double queues in vnode 2022-10-13 20:57:36 +08:00
Minghao Li 733440b352 refactor(sync): add double queues in vnode 2022-10-13 14:37:18 +08:00
Hongze Cheng c79cc7e454 more code format 2022-10-13 14:06:27 +08:00
Benguang Zhao b71a9e3483 enh: improve error handling in syncNodeOpen 2022-09-28 13:34:13 +08:00
Minghao Li 8da7950282 refactor(sync): close receiver when become leader 2022-08-22 15:40:28 +08:00
Minghao Li 8a32c0c189 refactor(sync): adjust strategy for dynamic quorum 2022-08-18 14:55:57 +08:00
Minghao Li 2ca5bdc708 refactor(sync): add syncNodeDynamicQuorum 2022-08-17 15:39:38 +08:00
Minghao Li eee4c0853d refactor(sync): add syncNodeAppendEntriesOnePeer 2022-08-17 10:34:53 +08:00
Minghao Li 8f0361bf75 refactor(sync): delete expired config index 2022-08-11 17:42:04 +08:00
Minghao Li 8328aae50f refactor(sync): add raft config index test 2022-08-11 15:22:44 +08:00
Minghao Li dc42544e9e refactor(sync): add leader, follower call back2 2022-08-10 20:45:36 +08:00
Minghao Li df18cc5f47 refactor(sync): speed up replicate 2022-08-08 19:46:37 +08:00
Minghao Li 62b07dbe5d refactor(sync): speed up replicate 2022-08-08 15:10:32 +08:00
Minghao Li f83ca89ea2 refactor(sync): make leader life longer 2022-08-06 19:40:10 +08:00
Minghao Li 327b938cbb refactor(sync): make leader life longer 2022-08-05 15:33:44 +08:00
Minghao Li 9be864a6be refactor(sync): make leader life longer 2022-08-04 20:36:12 +08:00
Minghao Li 4b6b1de91c refactor(sync): restart hb timer when replicate get error term 2022-07-30 17:30:10 +08:00
Minghao Li 64f4325bd7 refactor(sync): modify propose batch interface 2022-07-28 17:55:15 +08:00
Minghao Li 43e2f8bc2b refactor(sync): add pre-commit interface 2022-07-26 10:59:56 +08:00
Minghao Li cedad48a73 refactor(sync): add ref in log entry 2022-07-25 17:47:15 +08:00
Minghao Li 0b494d256f refactor(sync): add ref id in raft entry 2022-07-23 19:18:18 +08:00
Minghao Li 7808fdfccb refactor(sync): add trace log 2022-07-20 17:19:42 +08:00
Minghao Li 7187c87d35 refactor(sync): add restart heartbeat timer 2022-07-18 16:55:24 +08:00
Minghao Li 6f29fd4020 fix(sync): snapshot begin index 2022-07-16 15:34:22 +08:00
Minghao Li 681993884f refactor(sync): add leader transfer callback 2022-07-15 14:55:33 +08:00
Minghao Li 511c39a0cf refactor(sync): add skiplist entry cache 2022-07-13 15:55:38 +08:00
Minghao Li 96f9274fef refactor(sync): add timer routines 2022-07-12 15:04:32 +08:00
Minghao Li ded3224471 refactor(sync): modify log to index 2022-07-12 11:07:07 +08:00
Li Minghao d94680c3c4
Merge pull request #14676 from taosdata/feature/3.0_mhli
fix(sync): append entries batch
2022-07-08 16:07:22 +08:00
Minghao Li a39de34984 refactor(sync): rm syncOnMessage 2022-07-08 15:21:44 +08:00
Li Minghao 1e1e373220
Merge pull request #14654 from taosdata/feature/3.0_mhli
fix(sync): snapshot strategy wal first
2022-07-07 17:45:17 +08:00
Minghao Li 1c3c270307 fix(sync): snapshot strategy wal first 2022-07-07 17:00:01 +08:00
Liu Jicong 1ec57798d2 ci: remove unstable case 2022-07-07 11:45:28 +08:00
Minghao Li 78efbaabe1 refactor(sync): add syncGetSnapshotByIndex 2022-07-06 15:16:52 +08:00
Minghao Li 83b639ae8f refactor(sync): persist batch size 2022-07-06 14:58:38 +08:00
Minghao Li cd4bc6e30b refactor(sync): snapshot strategy 2022-07-06 11:12:45 +08:00
Minghao Li e8160342c3 refactor(sync): snapshot sender, receiver 2022-07-05 14:38:44 +08:00
Minghao Li 6e59c13cbd refactor(sync): add sync strategy 2022-07-04 15:57:28 +08:00
Minghao Li a5d3b7033a refactor(sync): add snapshot writer param 2022-07-04 14:18:06 +08:00
Minghao Li 856806bb22 refactor(sync): add snapshot2 interface 2022-07-04 13:33:49 +08:00
Minghao Li 086ec29ca0 refactor(sync): add SyncClientRequestBatch 2022-07-02 14:41:54 +08:00
Minghao Li d4ab134645 refactor(sync): add snapshot2 interface 2022-07-01 17:30:52 +08:00
Minghao Li 91238e823e refactor(sync): add snapshot2 interface 2022-07-01 14:22:14 +08:00
Minghao Li 4f39cd31b0 refactor(sync): add snapshot2 interface 2022-07-01 09:50:20 +08:00
Minghao Li 24a3c817a4 refactor(sync): add batch propose 2022-06-30 16:44:49 +08:00
Minghao Li 1a8cf049b7 refactor(sync): add syncAppendEntriesBatch 2022-06-30 13:39:13 +08:00
Minghao Li 41f24314d0 refactor(sync): add SYNC_TERM_INVALID 2022-06-29 15:44:30 +08:00
Minghao Li 4c410bd5ec refactor(sync): refactor snapshot code 2022-06-28 11:33:14 +08:00
Minghao Li 2647ec21e0 refactor(sync): add comments in snapshot 2022-06-27 20:23:08 +08:00
Minghao Li 49ff32cda5 refactor(sync): add entries cache 2022-06-27 16:53:02 +08:00
Minghao Li a22814a5a7 refactor(sync): optimized one replica 2022-06-27 10:36:28 +08:00
Minghao Li 6eecbcd1a6 refactor(sync): optimized one replica 2022-06-26 01:16:11 +08:00
Minghao Li a6f33ba01c refactor(sync): optimized one replica 2022-06-25 20:31:42 +08:00
Minghao Li 3d9ffc42e8 refactor(sync): refactor wal abstraction 2022-06-23 21:16:16 +08:00
Minghao Li 00c0926c44 refactor(sync): hold wal handle with log store 2022-06-23 14:58:52 +08:00
Minghao Li cdb6b2429a refactor(sync): update election timer range 2022-06-23 14:37:29 +08:00
Minghao Li e18329ac19 refactor(sync): update election timer range 2022-06-23 14:22:53 +08:00
Minghao Li ecc43b6697 refactor(sync): delete some assert 2022-06-21 16:02:36 +08:00
Minghao Li 0fb64add90 refactor(sync) add trace log 2022-06-21 15:09:23 +08:00
Minghao Li 3573ae1564 refactor(sync): block when changing 2022-06-20 20:07:36 +08:00
Minghao Li e441bd266b refactor(sync): add changing state 2022-06-20 17:48:56 +08:00
Minghao Li 5968c6353f refactor(sync): get snapshot and create reader 2022-06-20 10:58:59 +08:00
Minghao Li b247762931 refactor(sync) refactor trace log 2022-06-18 15:17:58 +08:00
Minghao Li 9ab28e0b88 refactor(sync): add last config index in fsm cbMeta 2022-06-17 14:05:52 +08:00
Minghao Li 455a8da0ad refactor(sync): add config index to json 2022-06-17 13:08:41 +08:00
Minghao Li f5db109e61 fix(sync): get last max snapshot index 2022-06-17 11:37:10 +08:00
Minghao Li 77b03ac821 refactor(sync): add restore finish when become leader again 2022-06-16 14:40:42 +08:00
Minghao Li aad288ab17 refactor(sync): add debug log 2022-06-12 15:21:56 +08:00
Minghao Li fa54663871 refactor(sync): add last config index 2022-06-11 13:52:17 +08:00
Minghao Li 6586f78599 refactor(sync): add last config index 2022-06-11 12:44:58 +08:00
Minghao Li e9d466ec82 refactor(sync) delete some trace log 2022-06-10 16:51:17 +08:00
Minghao Li 736862541e fix(sync): restart with config change 2022-06-10 15:19:11 +08:00
Minghao Li 89e2c2d47a fix(sync): update sender when become leader 2022-06-09 11:00:28 +08:00
Minghao Li e070657778 refactor(sync): add syncGetSnapshotMeta 2022-06-08 23:20:07 +08:00
Minghao Li 29b97fa0ad refactor(sync): syncNodeOnAppendEntriesReplySnapshotCb 2022-06-08 19:53:07 +08:00
Minghao Li aa107d03c3 refactor(sync): SSyncSnapshotReceiver 2022-06-08 18:17:17 +08:00
Minghao Li 76185e1742 refactor(sync): SSyncSnapshotSender 2022-06-08 18:07:50 +08:00
Minghao Li d72d2d698c refactor(sync): SyncAppendEntries 2022-06-08 17:44:32 +08:00
Minghao Li 77cd6f44f4 refactor(sync): syncUtilJson2Line 2022-06-08 11:25:24 +08:00
Minghao Li 2547e8d02e refactor: sync index 2022-06-08 11:03:28 +08:00
Minghao Li eba8f2b543 fix(sync) send snapshot multi-times 2022-06-07 19:20:05 +08:00
Minghao Li 31b54e7462 enh(sync): add privateTerm into SyncSnapshotRsp, SyncSnapshotSend, SSyncSnapshotReceiver 2022-06-07 18:33:06 +08:00
Minghao Li 7852188394 enh(sync): add privateTerm into SSyncSnapshotSender, SyncAppendEntries, SyncAppendEntriesReply 2022-06-07 16:49:07 +08:00
Minghao Li 305f4a8580 enh(sync): add term into index mgr 2022-06-07 16:33:37 +08:00
Minghao Li 326714a077 fix(sync): snapshot maybe change when sending 2022-06-07 14:35:20 +08:00
Minghao Li a89e455267 fix(sync): delete some assert temporary 2022-06-07 09:55:18 +08:00
Minghao Li 6b329f791b enh(sync): update raft core functions 2022-06-06 16:35:44 +08:00
Minghao Li af27303a4c enh(sync): update raft core functions 2022-06-06 16:02:25 +08:00
Minghao Li 5009b7822f enh(sync): add log index manager 2022-06-06 11:24:25 +08:00
Minghao Li 5908631ec3 enh(sync): add log store2 2022-06-05 19:47:54 +08:00
Minghao Li eea343c5a6 enh(sync): add syncTestTool 2022-06-04 11:25:03 +08:00
Minghao Li 44994201b6 fix(sync): sending snapshot 2022-06-02 19:47:06 +08:00
Minghao Li d04c12713a fix: send snapshot 2022-06-02 11:36:26 +08:00
Minghao Li 757a1248dc fix: send snapshot 2022-06-01 21:23:39 +08:00
Minghao Li 13b336d569 add snapshot test 2022-06-01 15:03:01 +08:00
Minghao Li 060f8224f4 refactor: snapshotReSend 2022-06-01 13:32:52 +08:00
Minghao Li 71c57d7769 refactor: sender code 2022-06-01 11:28:33 +08:00
Minghao Li 9988e85f85 add test sender, receiver 2022-05-31 21:31:07 +08:00
Minghao Li 21191ae2a8 enh(sync): add SSyncSnapshotReceiver 2022-05-31 16:48:47 +08:00
Minghao Li 6d8733a232 enh(sync): add SSyncSnapshotSender 2022-05-31 16:14:19 +08:00
Minghao Li b9e4543a40 enh(sync): add SyncSnapshotRsp SyncSnapshotSend 2022-05-30 21:21:51 +08:00
Minghao Li 6be4119fe7 add syncNodeIsIndexInSnapshot syncNodeGetLastIndexTerm syncNodeGetPreIndexTerm 2022-05-30 18:45:09 +08:00
Minghao Li 79ae770a0b enh(sync): add snapshotEnable2 2022-05-30 17:31:55 +08:00
Minghao Li 43c383dcbc enh(sync): add snapshotEnable2 2022-05-30 17:19:31 +08:00
Minghao Li d6c57bd372 enh(sync): add snapshotEnable2 2022-05-30 13:14:48 +08:00
Minghao Li bdc9acbf2e enh(sync): add snapshotEnable 2022-05-30 12:26:15 +08:00
Minghao Li cd2e8fe730 enh(sync): add SSnapshot callback: reader, writer 2022-05-29 07:15:29 +08:00
Minghao Li b10f8e4aa2 fix(sync) raftCfgPersist 2022-05-27 21:32:28 +08:00
Minghao Li 3a1be0c58a refactor: make logStore static 2022-05-27 18:00:09 +08:00
Minghao Li 5a754023f5 refactor: make logStore static 2022-05-27 16:36:44 +08:00
Minghao Li 5471792549 refactor: make logStoreGetLastEntry static 2022-05-27 16:13:02 +08:00
Minghao Li b7be03898c enh(sync) snapshot sender, receiver 2022-05-27 15:35:26 +08:00
Minghao Li 8141c430bc enh(sync) snapshot sender, receiver 2022-05-27 15:09:17 +08:00
Minghao Li 4e1aa6b5c5 refactor: config change 2022-05-26 14:21:24 +08:00
Minghao Li 8c5f6b6849 fix(sync): persist isStandby 2022-05-25 18:32:34 +08:00
Minghao Li cb20717ce6 refactor: votesRespondUpdate 2022-05-24 20:23:11 +08:00
Minghao Li aa1de8b34a enh(sync): add FpSnapshotRead FpSnapshotApply 2022-05-24 14:46:22 +08:00
Minghao Li 1d7bdbc351 fix(sync) sync/mnode integration dead lock 2022-05-23 21:37:13 +08:00
Minghao Li 4535722957 enh(sync) sync/mnode integration, syncStart async -> sync 2022-05-23 15:41:04 +08:00
Shengliang Guan 0f9cd43027 refactor: adjust sync header file 2022-05-20 10:30:30 +08:00
Shengliang Guan 0161b6456c refactor: adjust msgcb 2022-05-19 19:44:01 +08:00
Minghao Li 956ab45a30 enh(sync): raft config change 2022-05-16 14:10:18 +08:00
Minghao Li a2d43fb96f enh(sync): add syncStartStandBy 2022-05-14 18:12:53 +08:00
Minghao Li f97adf54d3 enh(sync): add syncStartStandBy 2022-05-13 12:12:37 +08:00
Minghao Li b69a26678c enh(sync): raft config change 2022-05-12 15:23:41 +08:00
Li Minghao c5602fbaba add flag in syncEnv, to deal with expired timer 2022-04-25 22:54:04 -07:00
Minghao Li 9a7924049f sync integration 2022-04-19 15:43:24 +08:00
Minghao Li 7066274cc7 add sync format code 2022-04-18 21:50:56 +08:00
Minghao Li e58812aab5 sync refactor 2022-03-24 11:40:36 +08:00
Minghao Li b05706f9cf sync refactor 2022-03-23 18:53:58 +08:00
Minghao Li 996886e726 sync refactor 2022-03-23 17:08:07 +08:00
Minghao Li c5c00d5955 sync refactor 2022-03-22 10:42:02 +08:00
Minghao Li 3139aaef05 sync refactor 2022-03-21 20:06:57 +08:00
Minghao Li 48aace92c5 sync refactor 2022-03-21 19:26:48 +08:00
Minghao Li 0f176a3afc Merge branch '3.0' of https://github.com/taosdata/TDengine into feature/3.0_mhli 2022-03-21 16:51:15 +08:00
Minghao Li 7129645023 sync refactor 2022-03-21 16:28:50 +08:00
afwerar 79057240bd [TD-13759]<fix>: redefine thread api. 2022-03-20 00:47:45 +08:00
Minghao Li 5de67d4256 sync refactor 2022-03-18 15:21:40 +08:00
Minghao Li ef61d3ee94 sync refactor 2022-03-18 11:47:46 +08:00
Minghao Li 6a7f5c5fd2 sync refactor 2022-03-18 11:29:03 +08:00
Minghao Li 9db8804581 sync refactor 2022-03-17 15:53:28 +08:00
Minghao Li 90478b8742 sync refactor 2022-03-16 15:24:11 +08:00
Minghao Li f7cd75544c sync raft store 2022-03-16 15:09:56 +08:00
Minghao Li b5b1417a8b sync append entries (sync-io) 2022-03-16 10:54:06 +08:00
Minghao Li a69330b68d sync append entries (sync-io) 2022-03-15 14:07:45 +08:00
Minghao Li 09e2f36ddd sync append entries 2022-03-15 14:04:16 +08:00
Minghao Li 17e6071033 sync index 2022-03-15 10:47:11 +08:00
Minghao Li f924c1b879 sync index 2022-03-14 20:43:35 +08:00
Minghao Li 7c868aea85 sync index 2022-03-14 18:44:53 +08:00
Minghao Li 8ae9fb6ae1 sync index 2022-03-14 18:22:39 +08:00
Minghao Li 7d897369d5 sync index 2022-03-14 16:27:25 +08:00
Minghao Li 1a78917767 sync index 2022-03-14 14:05:40 +08:00
Minghao Li 81be154e0d sync refactor 2022-03-12 17:02:15 +08:00
Minghao Li be532bd5eb sync refactor 2022-03-12 12:29:44 +08:00
Minghao Li 317f7669d7 sync refactor 2022-03-11 19:52:59 +08:00
Minghao Li 690dabd617 sync refactor 2022-03-11 19:11:38 +08:00
Minghao Li 78b5da0e0f sync refactor 2022-03-11 17:08:27 +08:00
Minghao Li 7469d62fd7 sync refactor 2022-03-11 15:05:10 +08:00
Minghao Li a0a62227c8 sync refactor 2022-03-11 11:47:56 +08:00
Minghao Li 6a3869a3bc sync refactor 2022-03-11 10:50:50 +08:00
Minghao Li 88aef2d1ab sync refactor 2022-03-10 19:21:02 +08:00
Minghao Li 73d768d273 sync refactor 2022-03-10 16:54:26 +08:00
Minghao Li 889d1339e5 sync refactor 2022-03-10 16:18:16 +08:00
Minghao Li ebeb4bb7a6 sync refactor 2022-03-10 14:34:02 +08:00
Minghao Li a51e576126 sync refactor 2022-03-10 11:21:04 +08:00
Minghao Li 30be9d3e31 sync refactor 2022-03-09 20:04:39 +08:00
Minghao Li d083c79744 sync refactor 2022-03-09 19:13:09 +08:00
Minghao Li 3dfb9bb022 sync refactor 2022-03-09 18:56:39 +08:00
Minghao Li 41516e024a sync refactor 2022-03-09 18:33:41 +08:00
Minghao Li d87411116b sync refactor 2022-03-09 16:34:34 +08:00
Minghao Li fa7f441f42 sync refactor 2022-03-09 15:07:43 +08:00
Minghao Li 0c8f62f701 sync refactor 2022-03-09 14:51:02 +08:00
Minghao Li 2fcc970d79 sync refactor 2022-03-09 11:27:22 +08:00
Minghao Li d3b1d5d8f1 sync refactor 2022-03-09 10:58:22 +08:00
Minghao Li 3b4149ba32 sync refactor 2022-03-09 10:15:40 +08:00
Minghao Li d958655dd3 sync refactor 2022-03-08 20:22:31 +08:00
Minghao Li 2ae6f747f9 sync refactor 2022-03-08 17:07:29 +08:00
Minghao Li ffe442301c sync refactor 2022-03-08 14:19:50 +08:00
Minghao Li f556d98159 sync refactor 2022-03-08 13:55:13 +08:00
Minghao Li c9c48e870d sync refactor 2022-03-08 13:43:54 +08:00
Minghao Li 264c30e5db sync refactor 2022-03-08 10:52:18 +08:00