Commit Graph

250 Commits

Author SHA1 Message Date
Minghao Li fa30b94c67 refactor(sync): append entries 2022-10-16 12:07:02 +08:00
Shengliang Guan 78fb1911d4 enh: refactor the code to create and delete mnodes 2022-10-14 17:59:09 +08:00
Minghao Li 4d123c4da6 refactor(sync): add interface in sync 2022-10-14 11:18:48 +08:00
Minghao Li 2ae4081a3f refactor(sync): add double queues in vnode 2022-10-13 20:57:36 +08:00
Minghao Li 733440b352 refactor(sync): add double queues in vnode 2022-10-13 14:37:18 +08:00
Hongze Cheng 4cc94968ee refact: format header file 2022-10-13 11:09:43 +08:00
Shengliang Guan e94646ca70 fix: coverity issues 2022-09-29 19:41:54 +08:00
Minglei Jin 8bc6a6297f enh(sync): log entry cache for sync 2022-09-20 19:57:02 +08:00
Minghao Li c5ec1741bc refactor(sync): add syncHeartbeatReply 2022-09-07 18:02:10 +08:00
Minghao Li d9363214b7 refactor(sync): add syncHeartbeat 2022-09-07 15:29:04 +08:00
Minghao Li 7c2d6571f0 refactor(sync): adjust SYNC_MAX_RECV_TIME_RANGE_MS 2022-08-18 16:30:54 +08:00
Minghao Li 8a32c0c189 refactor(sync): adjust strategy for dynamic quorum 2022-08-18 14:55:57 +08:00
Minghao Li 2ca5bdc708 refactor(sync): add syncNodeDynamicQuorum 2022-08-17 15:39:38 +08:00
Minghao Li eee4c0853d refactor(sync): add syncNodeAppendEntriesOnePeer 2022-08-17 10:34:53 +08:00
Minghao Li 6cff4dcfd8 refactor(sync): add syncIsReadyForRead 2022-08-15 14:42:40 +08:00
Minghao Li b4c8685766 refactor(sync): add leader, follower call back 2022-08-10 17:17:30 +08:00
Minghao Li df18cc5f47 refactor(sync): speed up replicate 2022-08-08 19:46:37 +08:00
Minghao Li af683b1e6c feat(sync): set batch-size 1 2022-08-01 19:45:39 +08:00
Minghao Li 64f4325bd7 refactor(sync): modify propose batch interface 2022-07-28 17:55:15 +08:00
Minghao Li dcdb7144c4 refactor(sync): delete timeout check 2022-07-23 19:54:56 +08:00
Minghao Li fc08a35fbf refactor(sync): update sync-timeout to 10s 2022-07-19 13:52:02 +08:00
Minghao Li fdf7930702 refactor(sync): add index/term in snapshot write 2022-07-16 18:09:36 +08:00
Minghao Li 473e134f31 refactor(sync): add resp ttl clean 2022-07-12 16:57:19 +08:00
Minghao Li 1ee5468411 fix(sync): append entries batch 2022-07-08 14:47:00 +08:00
Minghao Li 78efbaabe1 refactor(sync): add syncGetSnapshotByIndex 2022-07-06 15:16:52 +08:00
Minghao Li 8a4e251be7 fix(sync): batch propose 2022-07-06 10:32:17 +08:00
Minghao Li 59f015a121 refactor(sync): add error code sync-timeout 2022-07-04 16:22:02 +08:00
Minghao Li 6e59c13cbd refactor(sync): add sync strategy 2022-07-04 15:57:28 +08:00
Minghao Li 0c1a46c26e refactor(sync): add sync strategy 2022-07-04 15:29:55 +08:00
Minghao Li ded4616074 refactor(sync): add sync strategy 2022-07-04 14:55:26 +08:00
Minghao Li a5d3b7033a refactor(sync): add snapshot writer param 2022-07-04 14:18:06 +08:00
Minghao Li 856806bb22 refactor(sync): add snapshot2 interface 2022-07-04 13:33:49 +08:00
Minghao Li 4fc500c91c refactor(sync): add SyncAppendEntriesBatch 2022-07-02 16:01:47 +08:00
Minghao Li 086ec29ca0 refactor(sync): add SyncClientRequestBatch 2022-07-02 14:41:54 +08:00
Minghao Li d4ab134645 refactor(sync): add snapshot2 interface 2022-07-01 17:30:52 +08:00
Minghao Li 0ffc6c46f3 refactor(sync): add snapshot2 interface 2022-07-01 14:47:12 +08:00
Minghao Li 91238e823e refactor(sync): add snapshot2 interface 2022-07-01 14:22:14 +08:00
Minghao Li 4f39cd31b0 refactor(sync): add snapshot2 interface 2022-07-01 09:50:20 +08:00
Minghao Li 24a3c817a4 refactor(sync): add batch propose 2022-06-30 16:44:49 +08:00
Minghao Li 376bf46a64 refactor(sync): add SyncClientRequestBatch 2022-06-30 15:28:23 +08:00
Minghao Li 1a8cf049b7 refactor(sync): add syncAppendEntriesBatch 2022-06-30 13:39:13 +08:00
Minghao Li c3b2b98454 refactor(sync): delete some asserts 2022-06-29 19:18:15 +08:00
Minghao Li 6eecbcd1a6 refactor(sync): optimized one replica 2022-06-26 01:16:11 +08:00
Minghao Li a6f33ba01c refactor(sync): optimized one replica 2022-06-25 20:31:42 +08:00
Minghao Li 87defc2790 refactor(sync): add interface: get retry epset 2022-06-24 14:26:31 +08:00
Minghao Li 3d9ffc42e8 refactor(sync): refactor wal abstraction 2022-06-23 21:16:16 +08:00
Minghao Li 9786ba2fbe fix(sync): update nextindex, matchindex when backto nolog 2022-06-23 10:10:57 +08:00
Minghao Li 2f2715aca4 fix(sync): save saveErr 2022-06-22 20:23:49 +08:00
Minghao Li 363c98e9ed refactor(sync): abstract for log store 2022-06-21 17:45:08 +08:00
Minghao Li e441bd266b refactor(sync): add changing state 2022-06-20 17:48:56 +08:00
Minghao Li 5968c6353f refactor(sync): get snapshot and create reader 2022-06-20 10:58:59 +08:00
Minghao Li 9ab28e0b88 refactor(sync): add last config index in fsm cbMeta 2022-06-17 14:05:52 +08:00
Minghao Li f5db109e61 fix(sync): get last max snapshot index 2022-06-17 11:37:10 +08:00
Minghao Li 2f81a41f98 refactor(sync): add syncIsReady 2022-06-16 16:16:40 +08:00
Minghao Li 77b03ac821 refactor(sync): add restore finish when become leader again 2022-06-16 14:40:42 +08:00
Minghao Li 4b18bd718e refactor(sync): adjust errno 2022-06-15 16:14:17 +08:00
Minghao Li f47a28fe8a enh(sync): add leader transfer 2022-06-13 15:47:43 +08:00
Minghao Li aad288ab17 refactor(sync): add debug log 2022-06-12 15:21:56 +08:00
Minghao Li fa54663871 refactor(sync): add last config index 2022-06-11 13:52:17 +08:00
Minghao Li 6586f78599 refactor(sync): add last config index 2022-06-11 12:44:58 +08:00
Minghao Li 972fee7fbc refactor(sync): add rpcMsg to reconfig callback 2022-06-10 17:39:30 +08:00
Shengliang Guan 65f65b53b3 Merge remote-tracking branch 'origin/3.0' into feature/sync-refactor 2022-06-09 13:49:43 +08:00
Minghao Li e070657778 refactor(sync): add syncGetSnapshotMeta 2022-06-08 23:20:07 +08:00
Shengliang Guan bc8e6b7fd7 refactor: adjust vnode sync 2022-06-08 21:17:17 +08:00
Minghao Li 29b97fa0ad refactor(sync): syncNodeOnAppendEntriesReplySnapshotCb 2022-06-08 19:53:07 +08:00
Minghao Li d72d2d698c refactor(sync): SyncAppendEntries 2022-06-08 17:44:32 +08:00
Minghao Li 31b54e7462 enh(sync): add privateTerm into SyncSnapshotRsp, SyncSnapshotSend, SSyncSnapshotReceiver 2022-06-07 18:33:06 +08:00
Minghao Li 7852188394 enh(sync): add privateTerm into SSyncSnapshotSender, SyncAppendEntries, SyncAppendEntriesReply 2022-06-07 16:49:07 +08:00
Minghao Li 84a67e850e fix(sync): sending snapshot 2022-06-06 17:23:59 +08:00
Minghao Li 2adc0b8a76 enh(sync): add log index manager 2022-06-05 21:48:50 +08:00
Minghao Li 5908631ec3 enh(sync): add log store2 2022-06-05 19:47:54 +08:00
Minghao Li 13b336d569 add snapshot test 2022-06-01 15:03:01 +08:00
Minghao Li 71c57d7769 refactor: sender code 2022-06-01 11:28:33 +08:00
Minghao Li ba212ce396 enh(sync): syncNodeRequestVotePeersSnapshot 2022-05-31 17:37:57 +08:00
Minghao Li 6d8733a232 enh(sync): add SSyncSnapshotSender 2022-05-31 16:14:19 +08:00
Minghao Li c5526ef915 enh(sync): add SyncSnapshotRsp SyncSnapshotSend 2022-05-30 21:11:14 +08:00
Minghao Li 43c383dcbc enh(sync): add snapshotEnable2 2022-05-30 17:19:31 +08:00
Minghao Li d6c57bd372 enh(sync): add snapshotEnable2 2022-05-30 13:14:48 +08:00
Minghao Li bdc9acbf2e enh(sync): add snapshotEnable 2022-05-30 12:26:15 +08:00
Minghao Li cd2e8fe730 enh(sync): add SSnapshot callback: reader, writer 2022-05-29 07:15:29 +08:00
Minghao Li f078f5b300 fix(sync): syncSetStandby 2022-05-26 15:08:20 +08:00
Minghao Li 4e1aa6b5c5 refactor: config change 2022-05-26 14:21:24 +08:00
Minghao Li 9a2eddda4c fix(sync), call FpCommitCb twice when FOLLOWER 2022-05-26 11:02:35 +08:00
Minghao Li 8c5f6b6849 fix(sync): persist isStandby 2022-05-25 18:32:34 +08:00
Minghao Li 104a207579 FpReConfigCb 2022-05-25 14:43:45 +08:00
Minghao Li 0a5412f33d refactor: modify FpSnapshotRead, FpSnapshotApply 2022-05-24 21:00:14 +08:00
Minghao Li aa85781560 enh(sync): add mndSnapshotRead mndSnapshotApply 2022-05-24 15:28:12 +08:00
Minghao Li aa1de8b34a enh(sync): add FpSnapshotRead FpSnapshotApply 2022-05-24 14:46:22 +08:00
Minghao Li c7691590be enh(sync) add syncIsRestoreFinish 2022-05-23 23:53:15 +08:00
Minghao Li 4535722957 enh(sync) sync/mnode integration, syncStart async -> sync 2022-05-23 15:41:04 +08:00
Minghao Li 97b1e95ad8 enh(sync) sync/mnode integration, add term, currentTerm in cbMeta 2022-05-23 12:14:53 +08:00
Shengliang Guan 0f9cd43027 refactor: adjust sync header file 2022-05-20 10:30:30 +08:00
Shengliang Guan 0161b6456c refactor: adjust msgcb 2022-05-19 19:44:01 +08:00
Minghao Li f97adf54d3 enh(sync): add syncStartStandBy 2022-05-13 12:12:37 +08:00
Minghao Li 4d40af9929 add redirect 2022-04-28 16:41:13 +08:00
Minghao Li 9a603170b4 add redirect before syncPropose 2022-04-27 19:28:01 +08:00
Minghao Li b96e434ab3 format 2022-04-27 18:10:57 +08:00
Li Minghao c5602fbaba add flag in syncEnv, to deal with expired timer 2022-04-25 22:54:04 -07:00
Minghao Li 64dfc1da1c merge 3.0 code 2022-04-22 17:11:56 +08:00
Minghao Li 9cb2192a87 add SyncApplyMsg and test 2022-04-20 14:30:34 +08:00
Minghao Li 6035f0305d sync integration add SyncApplyMsg 2022-04-20 11:51:00 +08:00
Shengliang Guan b66718a4d8 feat: report service status 2022-04-19 21:39:42 +08:00
Minghao Li 9a7924049f sync integration 2022-04-19 15:43:24 +08:00
Minghao Li 01008939f2 sync snapshot 2022-04-19 11:51:51 +08:00
Minghao Li 7066274cc7 add sync format code 2022-04-18 21:50:56 +08:00
Minghao Li d5188f14f9 sync refactor 2022-03-23 17:56:32 +08:00
Minghao Li e3a3c1386b sync refactor 2022-03-22 17:53:43 +08:00
Minghao Li 7c6fbbfbd1 sync refactor 2022-03-22 16:58:36 +08:00
Minghao Li f7432337fd sync refactor 2022-03-22 16:43:30 +08:00
Minghao Li 1c3113686e sync refactor 2022-03-22 16:17:17 +08:00
Minghao Li 79e8f8e6ea sync refactor 2022-03-21 16:50:13 +08:00
Minghao Li 3c9875e955 sync refactor 2022-03-09 20:24:27 +08:00
Minghao Li d87411116b sync refactor 2022-03-09 16:34:34 +08:00
Minghao Li fa7f441f42 sync refactor 2022-03-09 15:07:43 +08:00
Minghao Li c9c48e870d sync refactor 2022-03-08 13:43:54 +08:00
Minghao Li 29fab2e30a Merge branch '3.0' of https://github.com/taosdata/TDengine into feature/3.0_mhli 2022-03-05 15:06:59 +08:00
Minghao Li 8d789bba31 sync enq 2022-03-04 15:48:09 +08:00
Haojun Liao 92da01a8ba [td-13039] refactor. 2022-03-04 13:25:39 +08:00
Minghao Li 64d224a0d2 syncInt 2022-03-03 17:28:00 +08:00
Minghao Li d57320031f sync ping 2022-03-01 15:16:44 +08:00
Minghao Li eaf6142c79 sync modify timer 2022-02-28 17:47:47 +08:00
Minghao Li 02f0f85aab sync modify timer 2022-02-28 14:10:34 +08:00
Minghao Li 4afcb4387c add sync io 2022-02-27 10:22:15 +08:00
Minghao Li dbe28cd4ff add sync code 2022-02-27 00:02:18 +08:00
Minghao Li b63995287d add raft store 2022-02-25 17:55:20 +08:00
Minghao Li 296d9abe2a add sync code 2022-02-25 15:34:24 +08:00
Minghao Li 51adf7e25e add raft store 2022-02-24 21:03:25 +08:00
Minghao Li 3d9d5240a5 add sync code 2022-02-23 09:54:44 +08:00
Minghao Li be375fa143 add sync code 2022-02-22 11:28:15 +08:00
Minghao Li 324c5742fe TD-13476 add sync.h 2022-02-12 21:11:21 +08:00
Shengliang Guan f5c92c566c rollback for sync 2022-02-09 14:51:23 +08:00
Minghao Li c478fd06f5 rm old sync code 2022-02-09 14:18:49 +08:00
lichuang 8ab1eb642e [TD-10645][raft]<feature>refactor sync interface 2021-11-16 11:42:34 +08:00
lichuang 83a40a7f5a [TD-10645][raft]<feature>refactor sync interface 2021-11-15 11:11:06 +08:00
lichuang f10a91ff03 [TD-10645][raft]<feature>refactor sync interface 2021-11-09 15:30:07 +08:00
lichuang e05e6dba9a [TD-10645][raft]<feature>add raft election message handle 2021-11-04 12:39:45 +08:00
lichuang aab981f667 [TD-10645][raft]<feature>add raft election message handle 2021-11-03 15:30:54 +08:00
lichuang 349a6a4771 [TD-10645][raft]<feature>add raft message handle 2021-11-03 11:47:44 +08:00
lichuang 24a0966da6 [TD-10645][raft]<feature>add raft progress 2021-11-02 15:50:27 +08:00
lichuang c319d1cb12 [TD-10645][raft]<feature>add raft module 2021-10-29 16:05:25 +08:00
lichuang 2dc480adf6 [TD-10645][raft]<feature>sync manager 2021-10-29 14:31:21 +08:00
Shengliang Guan d95e8e1f6c Call wal and sync code in vnode 2021-10-28 16:57:02 +08:00
Shengliang Guan 8ad7c2fd26 add sync interface 2021-10-28 15:50:53 +08:00
lichuang 4845ca7f99 <feeature>[raft]refactor raft interface,add log store methods 2021-10-28 09:56:20 +08:00
Hongze Cheng 2fb89a0209 Merge branch '3.0' into 3.0_refact 2021-10-27 11:27:27 +08:00
lichuang 18cd0c861a [feeature][raft]merge from 3.0 2021-10-26 10:15:13 +08:00
lichuang d5510988c2 [feeature][raft]refactor sync interface 2021-10-26 10:06:37 +08:00
Shengliang Guan 96ff30a55d format code 2021-10-25 17:58:33 +08:00
Hongze Cheng e938d5a29f format 2021-10-25 15:07:41 +08:00
lichuang 048329e95e [feeature][raft]refactor raft interface to sync 2021-10-25 09:29:37 +08:00