Commit Graph

343 Commits

Author SHA1 Message Date
Minghao Li 6f29fd4020 fix(sync): snapshot begin index 2022-07-16 15:34:22 +08:00
Minghao Li 681993884f refactor(sync): add leader transfer callback 2022-07-15 14:55:33 +08:00
Minghao Li 511c39a0cf refactor(sync): add skiplist entry cache 2022-07-13 15:55:38 +08:00
Minghao Li 96f9274fef refactor(sync): add timer routines 2022-07-12 15:04:32 +08:00
Minghao Li ded3224471 refactor(sync): modify log to index 2022-07-12 11:07:07 +08:00
Li Minghao d94680c3c4
Merge pull request #14676 from taosdata/feature/3.0_mhli
fix(sync): append entries batch
2022-07-08 16:07:22 +08:00
Minghao Li a39de34984 refactor(sync): rm syncOnMessage 2022-07-08 15:21:44 +08:00
Li Minghao 1e1e373220
Merge pull request #14654 from taosdata/feature/3.0_mhli
fix(sync): snapshot strategy wal first
2022-07-07 17:45:17 +08:00
Minghao Li 1c3c270307 fix(sync): snapshot strategy wal first 2022-07-07 17:00:01 +08:00
Liu Jicong 1ec57798d2 ci: remove unstable case 2022-07-07 11:45:28 +08:00
Minghao Li 78efbaabe1 refactor(sync): add syncGetSnapshotByIndex 2022-07-06 15:16:52 +08:00
Minghao Li 83b639ae8f refactor(sync): persist batch size 2022-07-06 14:58:38 +08:00
Minghao Li cd4bc6e30b refactor(sync): snapshot strategy 2022-07-06 11:12:45 +08:00
Minghao Li e8160342c3 refactor(sync): snapshot sender, receiver 2022-07-05 14:38:44 +08:00
Minghao Li 6e59c13cbd refactor(sync): add sync strategy 2022-07-04 15:57:28 +08:00
Minghao Li a5d3b7033a refactor(sync): add snapshot writer param 2022-07-04 14:18:06 +08:00
Minghao Li 856806bb22 refactor(sync): add snapshot2 interface 2022-07-04 13:33:49 +08:00
Minghao Li 086ec29ca0 refactor(sync): add SyncClientRequestBatch 2022-07-02 14:41:54 +08:00
Minghao Li d4ab134645 refactor(sync): add snapshot2 interface 2022-07-01 17:30:52 +08:00
Minghao Li 91238e823e refactor(sync): add snapshot2 interface 2022-07-01 14:22:14 +08:00
Minghao Li 4f39cd31b0 refactor(sync): add snapshot2 interface 2022-07-01 09:50:20 +08:00
Minghao Li 24a3c817a4 refactor(sync): add batch propose 2022-06-30 16:44:49 +08:00
Minghao Li 1a8cf049b7 refactor(sync): add syncAppendEntriesBatch 2022-06-30 13:39:13 +08:00
Minghao Li 41f24314d0 refactor(sync): add SYNC_TERM_INVALID 2022-06-29 15:44:30 +08:00
Minghao Li 4c410bd5ec refactor(sync): refactor snapshot code 2022-06-28 11:33:14 +08:00
Minghao Li 2647ec21e0 refactor(sync): add comments in snapshot 2022-06-27 20:23:08 +08:00
Minghao Li 49ff32cda5 refactor(sync): add entries cache 2022-06-27 16:53:02 +08:00
Minghao Li a22814a5a7 refactor(sync): optimized one replica 2022-06-27 10:36:28 +08:00
Minghao Li 6eecbcd1a6 refactor(sync): optimized one replica 2022-06-26 01:16:11 +08:00
Minghao Li a6f33ba01c refactor(sync): optimized one replica 2022-06-25 20:31:42 +08:00
Minghao Li 3d9ffc42e8 refactor(sync): refactor wal abstraction 2022-06-23 21:16:16 +08:00
Minghao Li 00c0926c44 refactor(sync): hold wal handle with log store 2022-06-23 14:58:52 +08:00
Minghao Li cdb6b2429a refactor(sync): update election timer range 2022-06-23 14:37:29 +08:00
Minghao Li e18329ac19 refactor(sync): update election timer range 2022-06-23 14:22:53 +08:00
Minghao Li ecc43b6697 refactor(sync): delete some assert 2022-06-21 16:02:36 +08:00
Minghao Li 0fb64add90 refactor(sync) add trace log 2022-06-21 15:09:23 +08:00
Minghao Li 3573ae1564 refactor(sync): block when changing 2022-06-20 20:07:36 +08:00
Minghao Li e441bd266b refactor(sync): add changing state 2022-06-20 17:48:56 +08:00
Minghao Li 5968c6353f refactor(sync): get snapshot and create reader 2022-06-20 10:58:59 +08:00
Minghao Li b247762931 refactor(sync) refactor trace log 2022-06-18 15:17:58 +08:00
Minghao Li 9ab28e0b88 refactor(sync): add last config index in fsm cbMeta 2022-06-17 14:05:52 +08:00
Minghao Li 455a8da0ad refactor(sync): add config index to json 2022-06-17 13:08:41 +08:00
Minghao Li f5db109e61 fix(sync): get last max snapshot index 2022-06-17 11:37:10 +08:00
Minghao Li 77b03ac821 refactor(sync): add restore finish when become leader again 2022-06-16 14:40:42 +08:00
Minghao Li aad288ab17 refactor(sync): add debug log 2022-06-12 15:21:56 +08:00
Minghao Li fa54663871 refactor(sync): add last config index 2022-06-11 13:52:17 +08:00
Minghao Li 6586f78599 refactor(sync): add last config index 2022-06-11 12:44:58 +08:00
Minghao Li e9d466ec82 refactor(sync) delete some trace log 2022-06-10 16:51:17 +08:00
Minghao Li 736862541e fix(sync): restart with config change 2022-06-10 15:19:11 +08:00
Minghao Li 89e2c2d47a fix(sync): update sender when become leader 2022-06-09 11:00:28 +08:00
Minghao Li e070657778 refactor(sync): add syncGetSnapshotMeta 2022-06-08 23:20:07 +08:00
Minghao Li 29b97fa0ad refactor(sync): syncNodeOnAppendEntriesReplySnapshotCb 2022-06-08 19:53:07 +08:00
Minghao Li aa107d03c3 refactor(sync): SSyncSnapshotReceiver 2022-06-08 18:17:17 +08:00
Minghao Li 76185e1742 refactor(sync): SSyncSnapshotSender 2022-06-08 18:07:50 +08:00
Minghao Li d72d2d698c refactor(sync): SyncAppendEntries 2022-06-08 17:44:32 +08:00
Minghao Li 77cd6f44f4 refactor(sync): syncUtilJson2Line 2022-06-08 11:25:24 +08:00
Minghao Li 2547e8d02e refactor: sync index 2022-06-08 11:03:28 +08:00
Minghao Li eba8f2b543 fix(sync) send snapshot multi-times 2022-06-07 19:20:05 +08:00
Minghao Li 31b54e7462 enh(sync): add privateTerm into SyncSnapshotRsp, SyncSnapshotSend, SSyncSnapshotReceiver 2022-06-07 18:33:06 +08:00
Minghao Li 7852188394 enh(sync): add privateTerm into SSyncSnapshotSender, SyncAppendEntries, SyncAppendEntriesReply 2022-06-07 16:49:07 +08:00
Minghao Li 305f4a8580 enh(sync): add term into index mgr 2022-06-07 16:33:37 +08:00
Minghao Li 326714a077 fix(sync): snapshot maybe change when sending 2022-06-07 14:35:20 +08:00
Minghao Li a89e455267 fix(sync): delete some assert temporary 2022-06-07 09:55:18 +08:00
Minghao Li 6b329f791b enh(sync): update raft core functions 2022-06-06 16:35:44 +08:00
Minghao Li af27303a4c enh(sync): update raft core functions 2022-06-06 16:02:25 +08:00
Minghao Li 5009b7822f enh(sync): add log index manager 2022-06-06 11:24:25 +08:00
Minghao Li 5908631ec3 enh(sync): add log store2 2022-06-05 19:47:54 +08:00
Minghao Li eea343c5a6 enh(sync): add syncTestTool 2022-06-04 11:25:03 +08:00
Minghao Li 44994201b6 fix(sync): sending snapshot 2022-06-02 19:47:06 +08:00
Minghao Li d04c12713a fix: send snapshot 2022-06-02 11:36:26 +08:00
Minghao Li 757a1248dc fix: send snapshot 2022-06-01 21:23:39 +08:00
Minghao Li 13b336d569 add snapshot test 2022-06-01 15:03:01 +08:00
Minghao Li 060f8224f4 refactor: snapshotReSend 2022-06-01 13:32:52 +08:00
Minghao Li 71c57d7769 refactor: sender code 2022-06-01 11:28:33 +08:00
Minghao Li 9988e85f85 add test sender, receiver 2022-05-31 21:31:07 +08:00
Minghao Li 21191ae2a8 enh(sync): add SSyncSnapshotReceiver 2022-05-31 16:48:47 +08:00
Minghao Li 6d8733a232 enh(sync): add SSyncSnapshotSender 2022-05-31 16:14:19 +08:00
Minghao Li b9e4543a40 enh(sync): add SyncSnapshotRsp SyncSnapshotSend 2022-05-30 21:21:51 +08:00
Minghao Li 6be4119fe7 add syncNodeIsIndexInSnapshot syncNodeGetLastIndexTerm syncNodeGetPreIndexTerm 2022-05-30 18:45:09 +08:00
Minghao Li 79ae770a0b enh(sync): add snapshotEnable2 2022-05-30 17:31:55 +08:00
Minghao Li 43c383dcbc enh(sync): add snapshotEnable2 2022-05-30 17:19:31 +08:00
Minghao Li d6c57bd372 enh(sync): add snapshotEnable2 2022-05-30 13:14:48 +08:00
Minghao Li bdc9acbf2e enh(sync): add snapshotEnable 2022-05-30 12:26:15 +08:00
Minghao Li cd2e8fe730 enh(sync): add SSnapshot callback: reader, writer 2022-05-29 07:15:29 +08:00
Minghao Li b10f8e4aa2 fix(sync) raftCfgPersist 2022-05-27 21:32:28 +08:00
Minghao Li 3a1be0c58a refactor: make logStore static 2022-05-27 18:00:09 +08:00
Minghao Li 5a754023f5 refactor: make logStore static 2022-05-27 16:36:44 +08:00
Minghao Li 5471792549 refactor: make logStoreGetLastEntry static 2022-05-27 16:13:02 +08:00
Minghao Li b7be03898c enh(sync) snapshot sender, receiver 2022-05-27 15:35:26 +08:00
Minghao Li 8141c430bc enh(sync) snapshot sender, receiver 2022-05-27 15:09:17 +08:00
Minghao Li 4e1aa6b5c5 refactor: config change 2022-05-26 14:21:24 +08:00
Minghao Li 8c5f6b6849 fix(sync): persist isStandby 2022-05-25 18:32:34 +08:00
Minghao Li cb20717ce6 refactor: votesRespondUpdate 2022-05-24 20:23:11 +08:00
Minghao Li aa1de8b34a enh(sync): add FpSnapshotRead FpSnapshotApply 2022-05-24 14:46:22 +08:00
Minghao Li 1d7bdbc351 fix(sync) sync/mnode integration dead lock 2022-05-23 21:37:13 +08:00
Minghao Li 4535722957 enh(sync) sync/mnode integration, syncStart async -> sync 2022-05-23 15:41:04 +08:00
Shengliang Guan 0f9cd43027 refactor: adjust sync header file 2022-05-20 10:30:30 +08:00
Shengliang Guan 0161b6456c refactor: adjust msgcb 2022-05-19 19:44:01 +08:00
Minghao Li 956ab45a30 enh(sync): raft config change 2022-05-16 14:10:18 +08:00
Minghao Li a2d43fb96f enh(sync): add syncStartStandBy 2022-05-14 18:12:53 +08:00
Minghao Li f97adf54d3 enh(sync): add syncStartStandBy 2022-05-13 12:12:37 +08:00
Minghao Li b69a26678c enh(sync): raft config change 2022-05-12 15:23:41 +08:00
Li Minghao c5602fbaba add flag in syncEnv, to deal with expired timer 2022-04-25 22:54:04 -07:00
Minghao Li 9a7924049f sync integration 2022-04-19 15:43:24 +08:00
Minghao Li 7066274cc7 add sync format code 2022-04-18 21:50:56 +08:00
Minghao Li e58812aab5 sync refactor 2022-03-24 11:40:36 +08:00
Minghao Li b05706f9cf sync refactor 2022-03-23 18:53:58 +08:00
Minghao Li 996886e726 sync refactor 2022-03-23 17:08:07 +08:00
Minghao Li c5c00d5955 sync refactor 2022-03-22 10:42:02 +08:00
Minghao Li 3139aaef05 sync refactor 2022-03-21 20:06:57 +08:00
Minghao Li 48aace92c5 sync refactor 2022-03-21 19:26:48 +08:00
Minghao Li 0f176a3afc Merge branch '3.0' of https://github.com/taosdata/TDengine into feature/3.0_mhli 2022-03-21 16:51:15 +08:00
Minghao Li 7129645023 sync refactor 2022-03-21 16:28:50 +08:00
afwerar 79057240bd [TD-13759]<fix>: redefine thread api. 2022-03-20 00:47:45 +08:00
Minghao Li 5de67d4256 sync refactor 2022-03-18 15:21:40 +08:00
Minghao Li ef61d3ee94 sync refactor 2022-03-18 11:47:46 +08:00
Minghao Li 6a7f5c5fd2 sync refactor 2022-03-18 11:29:03 +08:00
Minghao Li 9db8804581 sync refactor 2022-03-17 15:53:28 +08:00
Minghao Li 90478b8742 sync refactor 2022-03-16 15:24:11 +08:00
Minghao Li f7cd75544c sync raft store 2022-03-16 15:09:56 +08:00
Minghao Li b5b1417a8b sync append entries (sync-io) 2022-03-16 10:54:06 +08:00
Minghao Li a69330b68d sync append entries (sync-io) 2022-03-15 14:07:45 +08:00
Minghao Li 09e2f36ddd sync append entries 2022-03-15 14:04:16 +08:00
Minghao Li 17e6071033 sync index 2022-03-15 10:47:11 +08:00
Minghao Li f924c1b879 sync index 2022-03-14 20:43:35 +08:00
Minghao Li 7c868aea85 sync index 2022-03-14 18:44:53 +08:00
Minghao Li 8ae9fb6ae1 sync index 2022-03-14 18:22:39 +08:00
Minghao Li 7d897369d5 sync index 2022-03-14 16:27:25 +08:00
Minghao Li 1a78917767 sync index 2022-03-14 14:05:40 +08:00
Minghao Li 81be154e0d sync refactor 2022-03-12 17:02:15 +08:00
Minghao Li be532bd5eb sync refactor 2022-03-12 12:29:44 +08:00
Minghao Li 317f7669d7 sync refactor 2022-03-11 19:52:59 +08:00
Minghao Li 690dabd617 sync refactor 2022-03-11 19:11:38 +08:00
Minghao Li 78b5da0e0f sync refactor 2022-03-11 17:08:27 +08:00
Minghao Li 7469d62fd7 sync refactor 2022-03-11 15:05:10 +08:00
Minghao Li a0a62227c8 sync refactor 2022-03-11 11:47:56 +08:00
Minghao Li 6a3869a3bc sync refactor 2022-03-11 10:50:50 +08:00
Minghao Li 88aef2d1ab sync refactor 2022-03-10 19:21:02 +08:00
Minghao Li 73d768d273 sync refactor 2022-03-10 16:54:26 +08:00
Minghao Li 889d1339e5 sync refactor 2022-03-10 16:18:16 +08:00
Minghao Li ebeb4bb7a6 sync refactor 2022-03-10 14:34:02 +08:00
Minghao Li a51e576126 sync refactor 2022-03-10 11:21:04 +08:00
Minghao Li 30be9d3e31 sync refactor 2022-03-09 20:04:39 +08:00
Minghao Li d083c79744 sync refactor 2022-03-09 19:13:09 +08:00
Minghao Li 3dfb9bb022 sync refactor 2022-03-09 18:56:39 +08:00
Minghao Li 41516e024a sync refactor 2022-03-09 18:33:41 +08:00
Minghao Li d87411116b sync refactor 2022-03-09 16:34:34 +08:00
Minghao Li fa7f441f42 sync refactor 2022-03-09 15:07:43 +08:00
Minghao Li 0c8f62f701 sync refactor 2022-03-09 14:51:02 +08:00
Minghao Li 2fcc970d79 sync refactor 2022-03-09 11:27:22 +08:00