Commit Graph

505 Commits

Author SHA1 Message Date
Minghao Li 326714a077 fix(sync): snapshot maybe change when sending 2022-06-07 14:35:20 +08:00
Minghao Li 44a893a1c1 fix(sync): snapshot maybe change when sending 2022-06-07 13:48:40 +08:00
Minghao Li a89e455267 fix(sync): delete some assert temporary 2022-06-07 09:55:18 +08:00
Minghao Li 9baaf2cd0c enh(sync): add log index manager 2022-06-06 20:55:59 +08:00
Minghao Li 2071c5a74e fix(sync): sending snapshot 2022-06-06 20:02:27 +08:00
Minghao Li 0d7272a369 fix(sync): sending snapshot 2022-06-06 18:23:37 +08:00
Minghao Li 84a67e850e fix(sync): sending snapshot 2022-06-06 17:23:59 +08:00
Minghao Li 6b329f791b enh(sync): update raft core functions 2022-06-06 16:35:44 +08:00
Minghao Li af27303a4c enh(sync): update raft core functions 2022-06-06 16:02:25 +08:00
Minghao Li 01b04e03d9 enh(sync): forbid elect for this round 2022-06-06 11:46:59 +08:00
Minghao Li 4b87154b0e enh(sync): forbid elect for this round 2022-06-06 11:40:37 +08:00
Minghao Li 5009b7822f enh(sync): add log index manager 2022-06-06 11:24:25 +08:00
Minghao Li 2adc0b8a76 enh(sync): add log index manager 2022-06-05 21:48:50 +08:00
Minghao Li 5908631ec3 enh(sync): add log store2 2022-06-05 19:47:54 +08:00
Minghao Li ba8adb73cb refactor(sync): restart elect timer when vote for 2022-06-04 15:49:42 +08:00
Shengliang Guan 30da7560f8 Merge remote-tracking branch 'origin/3.0' into fix/mnode 2022-06-04 11:50:47 +08:00
Minghao Li eea343c5a6 enh(sync): add syncTestTool 2022-06-04 11:25:03 +08:00
Minghao Li 44994201b6 fix(sync): sending snapshot 2022-06-02 19:47:06 +08:00
Shengliang Guan e35ebdadac refactor: rename LEADER to leader 2022-06-02 14:35:59 +08:00
Minghao Li ac90f61b63 fix(sync): wal write from middle 2022-06-02 13:53:19 +08:00
Minghao Li 1ff40068e7 fix: send snapshot 2022-06-02 11:57:06 +08:00
Minghao Li d04c12713a fix: send snapshot 2022-06-02 11:36:26 +08:00
Minghao Li 48a331fd2c refactor: print msg type 2022-06-02 00:00:27 +08:00
Minghao Li c3bf3cc97c fix: send snapshot 2022-06-01 21:57:30 +08:00
Minghao Li 757a1248dc fix: send snapshot 2022-06-01 21:23:39 +08:00
Minghao Li ae06cc3696 refactor: after review raft 6 cb 2022-06-01 19:11:31 +08:00
Minghao Li df4787eff1 refactor: modify syncNodeAppendEntriesPeersSnapshot 2022-06-01 17:08:03 +08:00
Minghao Li 80c4e77b0b refactor: modify syncNodeAppendEntriesPeersSnapshot 2022-06-01 17:07:14 +08:00
Minghao Li 78db753a64 refactor: review syncNodeAppendEntriesPeersSnapshot 2022-06-01 16:30:04 +08:00
Minghao Li 403f6085d5 refactor: review syncNodeRequestVotePeersSnapshot 2022-06-01 15:52:09 +08:00
Minghao Li 13b336d569 add snapshot test 2022-06-01 15:03:01 +08:00
Minghao Li 4453ebab3a add snapshot recv log 2022-06-01 14:40:20 +08:00
Minghao Li c706c6d0ce add snapshot recv log 2022-06-01 14:35:20 +08:00
Minghao Li 295caad7c1 refactor: add snapshot send log 2022-06-01 14:12:11 +08:00
Minghao Li 2e840969c8 refactor: snapshotReSend 2022-06-01 13:53:21 +08:00
Minghao Li 56253aedc9 refactor: snapshotReSend 2022-06-01 13:40:43 +08:00
Minghao Li 5f0d23426d refactor: snapshotReSend 2022-06-01 13:35:23 +08:00
Minghao Li 060f8224f4 refactor: snapshotReSend 2022-06-01 13:32:52 +08:00
Minghao Li 71c57d7769 refactor: sender code 2022-06-01 11:28:33 +08:00
Minghao Li 9988e85f85 add test sender, receiver 2022-05-31 21:31:07 +08:00
Minghao Li 057fda21ce enh(sync): syncNodeOnAppendEntriesSnapshotCb 2022-05-31 19:46:49 +08:00
Minghao Li 7917716b4f enh(sync): syncNodeOnAppendEntriesReplySnapshotCb 2022-05-31 19:06:55 +08:00
Minghao Li fd823c8670 enh(sync): syncNodeOnRequestVoteReplySnapshotCb 2022-05-31 18:12:17 +08:00
Minghao Li a20cac89cc enh(sync): syncNodeOnRequestVoteSnapshotCb 2022-05-31 18:04:49 +08:00
Minghao Li b9472dc386 enh(sync): syncNodeAppendEntriesPeersSnapshot 2022-05-31 17:53:38 +08:00
Minghao Li ba212ce396 enh(sync): syncNodeRequestVotePeersSnapshot 2022-05-31 17:37:57 +08:00
Minghao Li ee9cdb2967 enh(sync): syncNodeOnSnapshotSendCb, syncNodeOnSnapshotRspCb 2022-05-31 17:23:36 +08:00
Minghao Li 21191ae2a8 enh(sync): add SSyncSnapshotReceiver 2022-05-31 16:48:47 +08:00
Minghao Li 6d8733a232 enh(sync): add SSyncSnapshotSender 2022-05-31 16:14:19 +08:00
Minghao Li cdc0dc487f Merge branch '3.0' of https://github.com/taosdata/TDengine into feature/3.0_mhli 2022-05-30 21:24:05 +08:00
Minghao Li b9e4543a40 enh(sync): add SyncSnapshotRsp SyncSnapshotSend 2022-05-30 21:21:51 +08:00
Minghao Li c5526ef915 enh(sync): add SyncSnapshotRsp SyncSnapshotSend 2022-05-30 21:11:14 +08:00
Minghao Li 6be4119fe7 add syncNodeIsIndexInSnapshot syncNodeGetLastIndexTerm syncNodeGetPreIndexTerm 2022-05-30 18:45:09 +08:00
Minghao Li 79ae770a0b enh(sync): add snapshotEnable2 2022-05-30 17:31:55 +08:00
Minghao Li 43c383dcbc enh(sync): add snapshotEnable2 2022-05-30 17:19:31 +08:00
Minghao Li d6c57bd372 enh(sync): add snapshotEnable2 2022-05-30 13:14:48 +08:00
Minghao Li bdc9acbf2e enh(sync): add snapshotEnable 2022-05-30 12:26:15 +08:00
Li Minghao e3068a60ee
Merge pull request #13180 from taosdata/feature/3.0_mhli
enh(sync): add SSnapshot callback: reader, writer
2022-05-29 07:37:54 +08:00
Minghao Li cd2e8fe730 enh(sync): add SSnapshot callback: reader, writer 2022-05-29 07:15:29 +08:00
Cary Xu f2b4cca23d fix: init buffer to avoid invalid write 2022-05-29 01:10:32 +08:00
Cary Xu 890075ef4a fix: init buf to avoid invalid write 2022-05-29 00:59:23 +08:00
Cary Xu 5374680649 fix: init buffer to avoid invalid write 2022-05-29 00:37:18 +08:00
Minghao Li 3327a0692f Merge branch '3.0' of https://github.com/taosdata/TDengine into feature/3.0_mhli 2022-05-27 21:34:54 +08:00
Minghao Li b10f8e4aa2 fix(sync) raftCfgPersist 2022-05-27 21:32:28 +08:00
Li Minghao aa691d137f
Merge pull request #13096 from taosdata/feature/3.0_mhli
enh(sync) snapshot sender, receiver
2022-05-27 18:55:51 +08:00
Minghao Li 3a1be0c58a refactor: make logStore static 2022-05-27 18:00:09 +08:00
Minghao Li 5a754023f5 refactor: make logStore static 2022-05-27 16:36:44 +08:00
Minghao Li 5471792549 refactor: make logStoreGetLastEntry static 2022-05-27 16:13:02 +08:00
Minghao Li d45221c863 enh(sync) logStoreGetEntry -> pLogStore->getEntry 2022-05-27 15:41:19 +08:00
Minghao Li b7be03898c enh(sync) snapshot sender, receiver 2022-05-27 15:35:26 +08:00
Minghao Li 8141c430bc enh(sync) snapshot sender, receiver 2022-05-27 15:09:17 +08:00
Minghao Li 17ed7e0747 fix(sync) delete assert, due to config change 2022-05-27 00:00:24 +08:00
Minghao Li 1a22de765c fix(sync) add multi mnodes 2022-05-26 18:03:38 +08:00
Minghao Li f078f5b300 fix(sync): syncSetStandby 2022-05-26 15:08:20 +08:00
Minghao Li 4e1aa6b5c5 refactor: config change 2022-05-26 14:21:24 +08:00
Minghao Li 9a2eddda4c fix(sync), call FpCommitCb twice when FOLLOWER 2022-05-26 11:02:35 +08:00
Minghao Li 8c5f6b6849 fix(sync): persist isStandby 2022-05-25 18:32:34 +08:00
Minghao Li 104a207579 FpReConfigCb 2022-05-25 14:43:45 +08:00
Minghao Li 81d0798f5f refactor: update config when there's one locally 2022-05-25 14:27:59 +08:00
Minghao Li cb20717ce6 refactor: votesRespondUpdate 2022-05-24 20:23:11 +08:00
Minghao Li 94438de0ec enh(sync): syncStartStandBy 2022-05-24 19:45:09 +08:00
Minghao Li aa85781560 enh(sync): add mndSnapshotRead mndSnapshotApply 2022-05-24 15:28:12 +08:00
Minghao Li 800ef42a26 Merge branch 'feature/sync-mnode-integration' of https://github.com/taosdata/TDengine into feature/sync-mnode-integration 2022-05-24 14:47:11 +08:00
Minghao Li aa1de8b34a enh(sync): add FpSnapshotRead FpSnapshotApply 2022-05-24 14:46:22 +08:00
Shengliang Guan 077ea4a14f fix: avoid memory leak in mnode sync 2022-05-24 11:58:50 +08:00
Shengliang Guan 07fee01d1c fix: avoid memory leak in mnode sync 2022-05-24 11:26:17 +08:00
Shengliang Guan 0e8e04805a fix: avoid memory leak 2022-05-24 09:46:54 +08:00
Minghao Li c7691590be enh(sync) add syncIsRestoreFinish 2022-05-23 23:53:15 +08:00
Minghao Li 1d7bdbc351 fix(sync) sync/mnode integration dead lock 2022-05-23 21:37:13 +08:00
Minghao Li 102a08f44b enh(sync) sync/mnode integration, add log 2022-05-23 20:26:12 +08:00
Shengliang Guan 3ff366cdaf Merge remote-tracking branch 'origin/feature/sync-mnode-integration' into fix/mnode 2022-05-23 18:33:09 +08:00
Minghao Li ee4b694a35 enh(sync) sync/mnode integration, syncStart async -> sync 2022-05-23 18:10:04 +08:00
Shengliang Guan 8bfbc0f315 Merge remote-tracking branch 'origin/3.0' into fix/mnode 2022-05-23 16:40:03 +08:00
Hongze Cheng d784da0da0 feat: discard const when decode 2022-05-23 07:47:49 +00:00
Minghao Li 4535722957 enh(sync) sync/mnode integration, syncStart async -> sync 2022-05-23 15:41:04 +08:00
Minghao Li 97b1e95ad8 enh(sync) sync/mnode integration, add term, currentTerm in cbMeta 2022-05-23 12:14:53 +08:00
Shengliang Guan e06f9fd05c refactor: sync integrate into mnode 2022-05-22 16:04:50 +08:00
Shengliang Guan c4428ba599 Merge remote-tracking branch 'origin/3.0' into fix/mnode 2022-05-22 12:07:39 +08:00
Minghao Li 249aecacda enh(sync) sync/mnode integration 2022-05-21 21:26:27 +08:00
Minghao Li 1a5be99bd4 fix(sync): syncRespMgrGetAndDel 2022-05-21 17:01:18 +08:00
Shengliang Guan f2a84eda09 refactor: adjust vnode header file 2022-05-20 10:45:43 +08:00
Yihao Deng 040292cb80
Merge pull request #12718 from taosdata/enh/deleteDupCode
Enh/delete dup code
2022-05-19 22:12:46 +08:00
yihaoDeng 76b9a5acee fix: avoid invalid read/write 2022-05-19 21:56:39 +08:00
Shengliang Guan 0161b6456c refactor: adjust msgcb 2022-05-19 19:44:01 +08:00
Shengliang Guan 77575d1e70 refactor: shm queue in multi process mode 2022-05-18 14:20:46 +08:00
Shengliang Guan 81e89ec7b6 Merge remote-tracking branch 'origin/3.0' into fix/mnode 2022-05-16 20:13:02 +08:00
Shengliang Guan fc94b71c80 refactor: adjust SRpcMsg 2022-05-16 15:17:11 +08:00
Li Minghao 9bc8307d40
Merge pull request #12530 from taosdata/feature/3.0_mhli
enh(sync): raft config change
2022-05-16 14:59:33 +08:00
Minghao Li 956ab45a30 enh(sync): raft config change 2022-05-16 14:10:18 +08:00
Minghao Li 3e65caccaa enh(sync): add syncStartStandBy 2022-05-14 19:54:18 +08:00
Minghao Li a2d43fb96f enh(sync): add syncStartStandBy 2022-05-14 18:12:53 +08:00
Shengliang Guan 7ad96ac276 enh: control the memory of the rpc queue 2022-05-14 11:53:46 +08:00
Minghao Li f97adf54d3 enh(sync): add syncStartStandBy 2022-05-13 12:12:37 +08:00
Minghao Li 346f9007db Merge branch '3.0' of https://github.com/taosdata/TDengine into feature/3.0_mhli 2022-05-12 15:24:15 +08:00
Minghao Li b69a26678c enh(sync): raft config change 2022-05-12 15:23:41 +08:00
Minghao Li 453d105a08 enh(sync): add error log, linux api error, %X 2022-05-12 07:54:45 +08:00
Minghao Li 7c41d52967 enh(sync): add error log, linux api error 2022-05-11 15:52:31 +08:00
Minghao Li 503de649cb enh(sync): add error log 2022-05-10 12:22:57 +08:00
Minghao Li 8c0d600cdf enh(sync): add error log 2022-05-10 12:20:13 +08:00
Minghao Li 589048e96b fix(sync): fix memory leak, RespMgr 2022-05-09 20:14:31 +08:00
Minghao Li b71b5284ae fix(sync): fix memory leak when break 2022-05-09 17:25:42 +08:00
Minghao Li 39bf90c0da fix(sync): fix memory leak 2022-05-09 15:17:33 +08:00
Hongze Cheng 323ce214b6 refact encode APIs 2022-05-07 10:03:06 +00:00
Hongze Cheng 0c8b7bb094 more refact 2022-05-07 07:29:54 +00:00
Hongze Cheng 5d150204dd more refact 2022-05-07 06:57:31 +00:00
Minghao Li d75b3568a7 enh(sync): add trace log 2022-05-06 23:40:34 +08:00
Minghao Li 2584b034df add syncGetEpSet 2022-04-30 10:29:29 +08:00
Minghao Li 4d40af9929 add redirect 2022-04-28 16:41:13 +08:00
Minghao Li 9a603170b4 add redirect before syncPropose 2022-04-27 19:28:01 +08:00
Minghao Li b96e434ab3 format 2022-04-27 18:10:57 +08:00
Li Minghao 16d60bf313 add flag in syncEnv, to deal with expired timer 2 2022-04-25 23:14:17 -07:00
Li Minghao c5602fbaba add flag in syncEnv, to deal with expired timer 2022-04-25 22:54:04 -07:00
Li Minghao 2fa176a49d when 1 replica, become leader immediately 2022-04-25 07:49:40 -07:00
Shengliang Guan d1ac98fa84 Merge remote-tracking branch 'origin/3.0' into feature/check 2022-04-24 19:21:42 +08:00
Shengliang Guan 4033da4b24 Merge remote-tracking branch 'origin/3.0' into feature/check 2022-04-24 19:03:54 +08:00
yihaoDeng 80ae360e8b Merge branch '3.0' into auth 2022-04-24 15:12:13 +08:00
Li Minghao f2749b4bf0
Merge pull request #11791 from taosdata/feature/sync-vnode-merge-3.0
Feature/sync vnode merge 3.0
2022-04-24 15:09:07 +08:00
Li Minghao 1afda11b9c comment doSyncEnvStart 2 2022-04-23 23:55:01 -07:00
Li Minghao e01cb71cea comment doSyncEnvStart 2022-04-23 23:37:17 -07:00
Liu Jicong 314a92fb76
Merge pull request #11788 from taosdata/feature/tq
refacor(wal): rename len to bodyLen
2022-04-24 14:33:59 +08:00
Liu Jicong 3d972f81a2 refacor(wal): rename len to bodyLen 2022-04-24 13:42:54 +08:00
Li Minghao 9c9d57c961 fix bug, syncEnv free NULL 2022-04-23 22:38:49 -07:00
Shengliang Guan 15ddbe8231 Merge remote-tracking branch 'origin/3.0' into feature/check 2022-04-24 11:25:15 +08:00
yihaoDeng b384167087 enh(rpc): fix hb problem 2022-04-23 18:29:45 +08:00
Minghao Li d53b3a4480 call syncCleanUp taosMemoryFree(pSyncEnv) 2022-04-22 18:41:32 +08:00
Minghao Li 64dfc1da1c merge 3.0 code 2022-04-22 17:11:56 +08:00
Shengliang Guan bc65c92ee3 refactor(tools): adjust client config parameters 2022-04-22 16:04:10 +08:00
afwerar fc24521621 fix(os): windows compile 3.0. 2022-04-22 09:54:27 +08:00
Minghao Li 672be6f4ff del trace log flag 2022-04-21 11:35:22 +08:00
Minghao Li bbe85695cf add syncMaybeAdvanceCommitIndex, maybe only one replica 2022-04-20 20:29:20 +08:00
Minghao Li 9cb2192a87 add SyncApplyMsg and test 2022-04-20 14:30:34 +08:00
Minghao Li 6035f0305d sync integration add SyncApplyMsg 2022-04-20 11:51:00 +08:00
Shengliang Guan b66718a4d8 feat: report service status 2022-04-19 21:39:42 +08:00
Minghao Li 7066274cc7 add sync format code 2022-04-18 21:50:56 +08:00
afwerar c11946fd75 [TD-13756]<fix>: Fix macro name error. 2022-04-11 18:55:43 +08:00
afwerar 222db126bc [TD-13758]<fix>: redefine memory api. 2022-03-26 00:29:53 +08:00
Minghao Li 16b44c9e28 sync refactor 2022-03-25 10:37:26 +08:00
Minghao Li 83ecb8dd30 sync refactor 2022-03-24 19:40:37 +08:00
Minghao Li 61f227816d sync refactor 2022-03-24 18:41:20 +08:00
Minghao Li b3ec7c8261 sync refactor 2022-03-24 17:30:50 +08:00
Minghao Li e58812aab5 sync refactor 2022-03-24 11:40:36 +08:00
Minghao Li b05706f9cf sync refactor 2022-03-23 18:53:58 +08:00
Minghao Li d5188f14f9 sync refactor 2022-03-23 17:56:32 +08:00
Minghao Li 996886e726 sync refactor 2022-03-23 17:08:07 +08:00
Minghao Li 7c6fbbfbd1 sync refactor 2022-03-22 16:58:36 +08:00
Minghao Li f7432337fd sync refactor 2022-03-22 16:43:30 +08:00
Minghao Li 1c3113686e sync refactor 2022-03-22 16:17:17 +08:00
Minghao Li 944bb33156 sync refactor 2022-03-22 15:29:32 +08:00
Minghao Li 559f570ea0 sync refactor 2022-03-22 14:43:58 +08:00
Minghao Li c5c00d5955 sync refactor 2022-03-22 10:42:02 +08:00
Minghao Li 48aace92c5 sync refactor 2022-03-21 19:26:48 +08:00
Minghao Li 0f176a3afc Merge branch '3.0' of https://github.com/taosdata/TDengine into feature/3.0_mhli 2022-03-21 16:51:15 +08:00
Minghao Li 1251d64e81 sync refactor 2022-03-21 16:42:30 +08:00
Minghao Li 7129645023 sync refactor 2022-03-21 16:28:50 +08:00
afwerar 79057240bd [TD-13759]<fix>: redefine thread api. 2022-03-20 00:47:45 +08:00
Minghao Li aea4e0f472 sync refactor 2022-03-18 19:09:22 +08:00
Minghao Li 3ce39eec1c sync refactor 2022-03-18 18:42:49 +08:00
Minghao Li 4ddb1272ad Merge branch '3.0' of https://github.com/taosdata/TDengine into feature/3.0_mhli 2022-03-18 17:48:04 +08:00
Minghao Li 736dfaf064 sync refactor 2022-03-18 17:46:40 +08:00
Minghao Li 21feed915f sync refactor 2022-03-18 17:23:48 +08:00
Li Minghao f0917eeec2
Merge pull request #10822 from taosdata/feature/3.0_mhli
Feature/3.0 mhli
2022-03-18 16:07:16 +08:00
Minghao Li 59ae887e30 sync refactor 2022-03-18 15:24:38 +08:00
Minghao Li 5de67d4256 sync refactor 2022-03-18 15:21:40 +08:00
Minghao Li b5547c7a3d sync refactor 2022-03-18 15:05:56 +08:00
Minghao Li ef61d3ee94 sync refactor 2022-03-18 11:47:46 +08:00
Minghao Li 6a7f5c5fd2 sync refactor 2022-03-18 11:29:03 +08:00
Li Minghao 6a18279dd6
Merge pull request #10801 from taosdata/feature/3.0_mhli
sync refactor
2022-03-18 09:38:55 +08:00
Minghao Li 11c8ac91da sync refactor 2022-03-17 18:55:26 +08:00
Li Minghao d2366f6320
Merge pull request #10796 from taosdata/feature/3.0_mhli
Feature/3.0 mhli
2022-03-17 16:45:08 +08:00
Minghao Li e5b0e1465d sync refactor 2022-03-17 16:33:10 +08:00
Minghao Li 13aa59409d sync refactor 2022-03-17 16:22:51 +08:00
Minghao Li 9db8804581 sync refactor 2022-03-17 15:53:28 +08:00
afwerar 30c10ef8b3 [TD-13063]<fix>: prepare for win compilation. 2022-03-17 14:22:36 +08:00
Minghao Li bc60b00d75 sync refactor 2022-03-16 21:22:56 +08:00
Minghao Li 4d4fabf403 sync refactor 2022-03-16 21:11:20 +08:00
Minghao Li acea32ed41 sync refactor 2022-03-16 20:17:32 +08:00
Minghao Li fda9803c17 sync refactor 2022-03-16 20:03:22 +08:00
Minghao Li f22226a44e sync refactor 2022-03-16 17:16:10 +08:00
Minghao Li 5387e4ff7d sync refactor 2022-03-16 16:54:55 +08:00
Minghao Li b08cdf2f82 sync refactor 2022-03-16 16:20:01 +08:00