Commit Graph

211 Commits

Author SHA1 Message Date
Benguang Zhao 55bae49d56 Merge branch 3.0 to FIX/TD-19334-3.0 2022-11-30 23:47:30 +08:00
Minghao Li f0fdc58c52 refactor(sync): help to display leader** 2022-11-30 20:56:58 +08:00
Shengliang Guan 5556fd0c45 enh: add sync offline state 2022-11-30 12:02:54 +08:00
Minghao Li f87b9fa7fe refactor(sync): add interface syncSnapshotSending, syncSnapshotRecving 2022-11-29 19:41:03 +08:00
Benguang Zhao 470441c541 Merge branch 3.0 to FIX/TD-19334-3.0 2022-11-29 18:24:01 +08:00
Minghao Li 198e18c348 refactor(sync): add trace log for cache hit, cache miss 2022-11-29 14:58:47 +08:00
Benguang Zhao 4edef438ea enh: transfer ownership of msgs while committing sync log entries 2022-11-26 21:57:23 +08:00
Benguang Zhao 68f8ebac9d Merge branch 3.0 to FIX/TD-19334-3.0 2022-11-25 13:10:06 +08:00
Benguang Zhao d5ae1ca18a enh: make the range span of unconfirmed logs sent less than half of the size of log ring buffer 2022-11-25 10:37:56 +08:00
Minghao Li 2b411912d9 refactor(sync): can not propose when heartbeat timeout 2022-11-23 14:17:13 +08:00
Minghao Li 1d48426e94 refactor(sync): del wal in multi-replicas 2022-11-22 12:45:31 +08:00
Benguang Zhao 051b73c1ed Merge branch 3.0 to FIX/TD-19334-3.0 2022-11-17 17:28:11 +08:00
Shengliang Guan 973fc99f75
Merge pull request #18094 from taosdata/feature/3.0_mhli
refactor(sync): pre snapshot
2022-11-13 15:38:33 +08:00
Minghao Li 58fd2228d9 refactor(sync): pre snapshot 2022-11-13 10:45:33 +08:00
Benguang Zhao def4058eb1 feat: impl pipelining negotiation 2022-11-11 22:55:21 +08:00
Minghao Li 352c2d8ec0 refactor(sync): pre snapshot 2022-11-11 20:46:30 +08:00
Shengliang Guan 57f1b593e4 refact: adjust head file and sync log 2022-11-11 14:40:21 +08:00
Minghao Li d672e7a05c refactor(sync): add FpApplyQueueItems in fsm 2022-11-09 16:18:28 +08:00
Minghao Li b6aea6ae17 fix(sync): when apply queue not empty, can not read 2022-11-07 16:40:53 +08:00
Benguang Zhao 5878c9a31a fix: impl ring log buffer 2022-11-07 14:27:22 +08:00
Minghao Li a4b54c4f0e refactor(sync): add syncIsReadyForRead 2022-11-03 13:57:57 +08:00
Minghao Li 1a4b7622e4 enh(sync): add sync pre stop 2022-11-03 09:39:20 +08:00
Minghao Li 70aff8451f refactor(sync): add pre snapshot 2022-11-02 15:38:30 +08:00
Minghao Li 3072afbacb refactor(sync): add pre snapshot 2022-11-02 15:25:26 +08:00
Shengliang Guan 7a537bba09 refact: adjust sync.h and syncState 2022-11-02 10:24:55 +08:00
Shengliang Guan d35028ae4a enh: refact sync callback func 2022-11-01 16:10:07 +08:00
Shengliang Guan f4dc7d0766 enh: refact sync callback func 2022-11-01 15:35:10 +08:00
Shengliang Guan e79e50ae36 enh: refact syncMsg code 2022-11-01 13:58:25 +08:00
Shengliang Guan 392564cc7d enh: refact syncEnv code 2022-10-31 23:40:43 +08:00
Minghao Li 0b20b914bb refactor(sync): add sync local cmd 2022-10-31 14:17:26 +08:00
Minghao Li 169fd67ddb refactor(sync): adjust log retention size 2022-10-26 15:06:54 +08:00
Shengliang Guan 894e75ca65 fix: comment sncReconfig 2022-10-20 18:32:19 +08:00
Minghao Li 5965629b2e refactor(sync): refacotr sync 2022-10-20 16:05:14 +08:00
Minghao Li 74b48e6df8 refacotr(sync): modify sync-snapshot 2022-10-20 14:53:03 +08:00
Minghao Li 1b36ad119c refactor(sync): rename functions 2022-10-18 15:24:00 +08:00
Minghao Li e810f2ad64 refactor(sync): delete old code, ok 2022-10-18 13:53:03 +08:00
Minghao Li 092a07475d refactor(sync): process hb and appendentries 2022-10-17 16:38:44 +08:00
Minghao Li fa30b94c67 refactor(sync): append entries 2022-10-16 12:07:02 +08:00
Shengliang Guan 78fb1911d4 enh: refactor the code to create and delete mnodes 2022-10-14 17:59:09 +08:00
Minghao Li 2ae4081a3f refactor(sync): add double queues in vnode 2022-10-13 20:57:36 +08:00
Minghao Li 733440b352 refactor(sync): add double queues in vnode 2022-10-13 14:37:18 +08:00
Hongze Cheng 4cc94968ee refact: format header file 2022-10-13 11:09:43 +08:00
Shengliang Guan e94646ca70 fix: coverity issues 2022-09-29 19:41:54 +08:00
Minglei Jin 8bc6a6297f enh(sync): log entry cache for sync 2022-09-20 19:57:02 +08:00
Minghao Li 7c2d6571f0 refactor(sync): adjust SYNC_MAX_RECV_TIME_RANGE_MS 2022-08-18 16:30:54 +08:00
Minghao Li 8a32c0c189 refactor(sync): adjust strategy for dynamic quorum 2022-08-18 14:55:57 +08:00
Minghao Li 2ca5bdc708 refactor(sync): add syncNodeDynamicQuorum 2022-08-17 15:39:38 +08:00
Minghao Li eee4c0853d refactor(sync): add syncNodeAppendEntriesOnePeer 2022-08-17 10:34:53 +08:00
Minghao Li 6cff4dcfd8 refactor(sync): add syncIsReadyForRead 2022-08-15 14:42:40 +08:00
Minghao Li b4c8685766 refactor(sync): add leader, follower call back 2022-08-10 17:17:30 +08:00
Minghao Li df18cc5f47 refactor(sync): speed up replicate 2022-08-08 19:46:37 +08:00
Minghao Li af683b1e6c feat(sync): set batch-size 1 2022-08-01 19:45:39 +08:00
Minghao Li 64f4325bd7 refactor(sync): modify propose batch interface 2022-07-28 17:55:15 +08:00
Minghao Li dcdb7144c4 refactor(sync): delete timeout check 2022-07-23 19:54:56 +08:00
Minghao Li fc08a35fbf refactor(sync): update sync-timeout to 10s 2022-07-19 13:52:02 +08:00
Minghao Li fdf7930702 refactor(sync): add index/term in snapshot write 2022-07-16 18:09:36 +08:00
Minghao Li 473e134f31 refactor(sync): add resp ttl clean 2022-07-12 16:57:19 +08:00
Minghao Li 1ee5468411 fix(sync): append entries batch 2022-07-08 14:47:00 +08:00
Minghao Li 78efbaabe1 refactor(sync): add syncGetSnapshotByIndex 2022-07-06 15:16:52 +08:00
Minghao Li 8a4e251be7 fix(sync): batch propose 2022-07-06 10:32:17 +08:00
Minghao Li 59f015a121 refactor(sync): add error code sync-timeout 2022-07-04 16:22:02 +08:00
Minghao Li ded4616074 refactor(sync): add sync strategy 2022-07-04 14:55:26 +08:00
Minghao Li a5d3b7033a refactor(sync): add snapshot writer param 2022-07-04 14:18:06 +08:00
Minghao Li 856806bb22 refactor(sync): add snapshot2 interface 2022-07-04 13:33:49 +08:00
Minghao Li 0ffc6c46f3 refactor(sync): add snapshot2 interface 2022-07-01 14:47:12 +08:00
Minghao Li 91238e823e refactor(sync): add snapshot2 interface 2022-07-01 14:22:14 +08:00
Minghao Li 4f39cd31b0 refactor(sync): add snapshot2 interface 2022-07-01 09:50:20 +08:00
Minghao Li 24a3c817a4 refactor(sync): add batch propose 2022-06-30 16:44:49 +08:00
Minghao Li 376bf46a64 refactor(sync): add SyncClientRequestBatch 2022-06-30 15:28:23 +08:00
Minghao Li 6eecbcd1a6 refactor(sync): optimized one replica 2022-06-26 01:16:11 +08:00
Minghao Li 87defc2790 refactor(sync): add interface: get retry epset 2022-06-24 14:26:31 +08:00
Minghao Li 3d9ffc42e8 refactor(sync): refactor wal abstraction 2022-06-23 21:16:16 +08:00
Minghao Li 9786ba2fbe fix(sync): update nextindex, matchindex when backto nolog 2022-06-23 10:10:57 +08:00
Minghao Li 2f2715aca4 fix(sync): save saveErr 2022-06-22 20:23:49 +08:00
Minghao Li 363c98e9ed refactor(sync): abstract for log store 2022-06-21 17:45:08 +08:00
Minghao Li e441bd266b refactor(sync): add changing state 2022-06-20 17:48:56 +08:00
Minghao Li 5968c6353f refactor(sync): get snapshot and create reader 2022-06-20 10:58:59 +08:00
Minghao Li 9ab28e0b88 refactor(sync): add last config index in fsm cbMeta 2022-06-17 14:05:52 +08:00
Minghao Li f5db109e61 fix(sync): get last max snapshot index 2022-06-17 11:37:10 +08:00
Minghao Li 2f81a41f98 refactor(sync): add syncIsReady 2022-06-16 16:16:40 +08:00
Minghao Li 77b03ac821 refactor(sync): add restore finish when become leader again 2022-06-16 14:40:42 +08:00
Minghao Li 4b18bd718e refactor(sync): adjust errno 2022-06-15 16:14:17 +08:00
Minghao Li f47a28fe8a enh(sync): add leader transfer 2022-06-13 15:47:43 +08:00
Minghao Li aad288ab17 refactor(sync): add debug log 2022-06-12 15:21:56 +08:00
Minghao Li 6586f78599 refactor(sync): add last config index 2022-06-11 12:44:58 +08:00
Minghao Li 972fee7fbc refactor(sync): add rpcMsg to reconfig callback 2022-06-10 17:39:30 +08:00
Minghao Li e070657778 refactor(sync): add syncGetSnapshotMeta 2022-06-08 23:20:07 +08:00
Minghao Li d72d2d698c refactor(sync): SyncAppendEntries 2022-06-08 17:44:32 +08:00
Minghao Li 84a67e850e fix(sync): sending snapshot 2022-06-06 17:23:59 +08:00
Minghao Li 2adc0b8a76 enh(sync): add log index manager 2022-06-05 21:48:50 +08:00
Minghao Li 5908631ec3 enh(sync): add log store2 2022-06-05 19:47:54 +08:00
Minghao Li bdc9acbf2e enh(sync): add snapshotEnable 2022-05-30 12:26:15 +08:00
Minghao Li cd2e8fe730 enh(sync): add SSnapshot callback: reader, writer 2022-05-29 07:15:29 +08:00
Minghao Li f078f5b300 fix(sync): syncSetStandby 2022-05-26 15:08:20 +08:00
Minghao Li 4e1aa6b5c5 refactor: config change 2022-05-26 14:21:24 +08:00
Minghao Li 9a2eddda4c fix(sync), call FpCommitCb twice when FOLLOWER 2022-05-26 11:02:35 +08:00
Minghao Li 8c5f6b6849 fix(sync): persist isStandby 2022-05-25 18:32:34 +08:00
Minghao Li 104a207579 FpReConfigCb 2022-05-25 14:43:45 +08:00
Minghao Li 0a5412f33d refactor: modify FpSnapshotRead, FpSnapshotApply 2022-05-24 21:00:14 +08:00
Minghao Li aa85781560 enh(sync): add mndSnapshotRead mndSnapshotApply 2022-05-24 15:28:12 +08:00