Commit Graph

956 Commits

Author SHA1 Message Date
Minghao Li 70aff8451f refactor(sync): add pre snapshot 2022-11-02 15:38:30 +08:00
Minghao Li f7191d2ffd refactor(sync): add pre snapshot 2022-11-02 15:25:14 +08:00
Shengliang Guan 59ae60f223
Merge pull request #17827 from taosdata/fix/sync
fix(sync): delete assert
2022-11-02 13:29:56 +08:00
Minghao Li dccbe25aa9 fix(sync): delete assert 2022-11-02 11:24:42 +08:00
Shengliang Guan 7a537bba09 refact: adjust sync.h and syncState 2022-11-02 10:24:55 +08:00
Shengliang Guan ee63b49800 Merge remote-tracking branch 'origin/3.0' into fix/TD-20052 2022-11-01 17:11:27 +08:00
Shengliang Guan a71dbd83d2
Merge pull request #17803 from taosdata/fix/TD-20052
enh: refact syncMsg code
2022-11-01 16:45:56 +08:00
Shengliang Guan d35028ae4a enh: refact sync callback func 2022-11-01 16:10:07 +08:00
Shengliang Guan f4dc7d0766 enh: refact sync callback func 2022-11-01 15:35:10 +08:00
Minghao Li 59448cd18e refactor(sync): pre snapshot on message 2022-11-01 15:20:08 +08:00
Shengliang Guan e79e50ae36 enh: refact syncMsg code 2022-11-01 13:58:25 +08:00
Minghao Li 21d60cb5be refactor(sync): pre snapshot on message 2022-11-01 11:46:29 +08:00
Minghao Li fd07a611a9 refactor(sync): add some log 2022-11-01 11:30:40 +08:00
Minghao Li 3fbb51346b refactor(sync): modify syncEnvTest 2022-11-01 10:52:25 +08:00
Minghao Li 094c14e272 Merge branch '3.0' of https://github.com/taosdata/TDengine into feature/3.0_mhli 2022-11-01 10:47:42 +08:00
Minghao Li 69af9556db refactor(sync): add PreSnapshotReply 2022-11-01 10:47:19 +08:00
Shengliang Guan 1724aa5638
Merge pull request #17779 from taosdata/fix/sync
refactor(sync): check msgcb, putToQueueFp NULL
2022-11-01 10:43:56 +08:00
Minghao Li 981461ea46 refactor(sync): add PreSnapshotTest 2022-11-01 10:25:31 +08:00
Shengliang Guan fbb1fa5303 enh: refact syncEnv code 2022-11-01 09:02:48 +08:00
Shengliang Guan 91abd170e3 enh: refact syncEnv code 2022-10-31 23:45:17 +08:00
Shengliang Guan 9bc48e2658 Merge remote-tracking branch 'origin/3.0' into fix/TD-20052 2022-10-31 23:42:03 +08:00
Shengliang Guan 392564cc7d enh: refact syncEnv code 2022-10-31 23:40:43 +08:00
Shengliang Guan 1c446b1bf4 Merge branch '3.0' into fix/sync 2022-10-31 23:30:24 +08:00
Shengliang Guan e817e649c6
Merge pull request #17788 from taosdata/enh/TD-19090
enh: force drop dnode
2022-10-31 23:27:54 +08:00
Shengliang Guan 26f1e64f2a enh: force drop dnode 2022-10-31 21:33:06 +08:00
Shengliang Guan 1ad604a5f9 enh: force drop dnode 2022-10-31 19:57:27 +08:00
Minghao Li d246514da2 refactor(sync): check msgcb, putToQueueFp NULL 2022-10-31 18:16:58 +08:00
Minghao Li 6b74412994 refactor(sync): print fatal log when commit error 2022-10-31 16:30:42 +08:00
Minghao Li 77ba900776 refactor(sync): add sync local cmd, step down 2022-10-31 16:12:40 +08:00
Minghao Li 0b20b914bb refactor(sync): add sync local cmd 2022-10-31 14:17:26 +08:00
Shengliang Guan b052766547
Merge pull request #17759 from taosdata/fix/sync
refactor(sync) delete ASSERT
2022-10-30 17:41:31 +08:00
Minghao Li 783a65f827 refactor(sync) delete ASSERT 2022-10-29 10:57:15 +08:00
Minghao Li 438786501b refactor(sync): adjust elect timer ms 2022-10-28 15:31:34 +08:00
Minghao Li d7c866ee12 enh(sync): add test 2022-10-27 17:59:16 +08:00
Minghao Li 54dfc8cd52 enh(sync): add test 2022-10-27 17:38:33 +08:00
Minghao Li 8b5d005db7 refactor(sync): add SyncLocalCmd 2022-10-27 17:16:46 +08:00
Minghao Li bbb624b63e Merge branch '3.0' of https://github.com/taosdata/TDengine into feature/3.0_mhli 2022-10-27 16:22:08 +08:00
Minghao Li 7cb3112d77 refactor(sync): modify function name 2022-10-27 15:52:48 +08:00
Shengliang Guan 8f88339988
Merge pull request #17709 from taosdata/feature/3.0_mhli
refactor(sync): delete some code
2022-10-27 15:39:38 +08:00
Minghao Li a8109b7f37 refactor(sync): delete some code 2022-10-27 14:43:07 +08:00
Shengliang Guan 08aa82295b
Merge pull request #17694 from taosdata/fix/sync
fix(sync): fix coverity issues
2022-10-27 13:20:57 +08:00
Shengliang Guan 14519019f7 enh: balance vgroup 2022-10-27 11:10:54 +08:00
Minghao Li e3c055e0c4 fix(sync): fix coverity issues 2022-10-27 10:08:12 +08:00
Minghao Li 1ae3cab198 refactor(sync): check pSyncTimer NULL 2022-10-26 10:56:50 +08:00
Minghao Li 7723a9ac28 refactor(sync): delete %ld 2022-10-25 23:17:52 +08:00
Minghao Li 16e6273d9d refactor(sync): delete assert 2022-10-25 20:31:20 +08:00
Minghao Li 49af601e19 refactor(sync): add SElectTimer 2022-10-25 19:56:49 +08:00
Minghao Li 9caea0f944 refactor(sync): adjust elect timer 2022-10-25 19:43:07 +08:00
Minghao Li 96a8a80cd7 refactor(sync): add trace log 2022-10-25 19:22:25 +08:00
Minghao Li 01b712fbfd refactor(sync): add trace log 2022-10-25 19:11:28 +08:00
Minghao Li 64f539cacb refactor(sync): adjust timer 2022-10-25 18:03:22 +08:00
Minghao Li eb7b9d3819 fix(sync): fix coverity scan issues 2022-10-25 14:28:34 +08:00
Minghao Li 8082b71cce fix(sync): free pLocalEntry 2022-10-24 18:05:14 +08:00
Minghao Li fddd6657bc fix(sync): add error log when pState is NULL 2022-10-24 14:51:45 +08:00
Minghao Li a228d5ecb9 fix(sync): break when pState is NULL 2022-10-24 14:09:12 +08:00
Shengliang Guan 6d1bf00cee fix: use sync cfg from vnode 2022-10-24 12:42:44 +08:00
Shengliang Guan ec786b9d78 fix: alter replica one by one 2022-10-24 11:57:26 +08:00
Minghao Li e2a157bb02 fix(sync): fix timer bug 2022-10-23 20:14:51 +08:00
Shengliang Guan 0914c02394 fix: compile error in mac 2022-10-22 23:49:49 +08:00
Shengliang Guan 15fade84d8 fix: compile error 2022-10-22 22:21:11 +08:00
Shengliang Guan 71ac720ac0 fix: compile error in mac 2022-10-22 08:47:09 +08:00
Shengliang Guan 2d3f5274b7 fix: compile error in mac 2022-10-22 08:39:58 +08:00
Minghao Li 5ee04e8059 refacotr(sync): free memory 2022-10-21 16:27:14 +08:00
Minghao Li 40ec6ba970 Merge branch 'feature/sync2-merge' of https://github.com/taosdata/TDengine into feature/sync2-merge 2022-10-21 15:47:51 +08:00
Shengliang Guan b8fdafe8ee fix: not reconfig if unchanged 2022-10-21 15:47:26 +08:00
Minghao Li 11a4ef3508 Merge branch 'feature/sync2-merge' of https://github.com/taosdata/TDengine into feature/sync2-merge 2022-10-21 15:46:09 +08:00
Minghao Li cf3d865bae refacotr(sync): delete DynamicQuorum 2022-10-21 15:43:28 +08:00
Shengliang Guan 92584d133f Merge branch 'feature/sync2-merge' of https://github.com/taosdata/TDengine into feature/sync2-merge 2022-10-21 15:38:55 +08:00
Shengliang Guan c6bbd18924 fix: not post sem if transId is 0 2022-10-21 15:33:06 +08:00
Minghao Li b492082ac2 refacotr(sync): delete DynamicQuorum 2022-10-21 15:31:55 +08:00
Minghao Li 3c94d61493 refacotr(sync): judge peer state null 2022-10-21 15:22:34 +08:00
Minghao Li 984af8a877 refactor(sync): if data is null, do not update state mgr 2022-10-21 15:13:51 +08:00
Minghao Li 8bdec5f2f2 refactor(sync): delete standby 2022-10-21 11:53:14 +08:00
Minghao Li c7279cca52 fix(sync): sync reconfig 2022-10-20 19:36:47 +08:00
Shengliang Guan 894e75ca65 fix: comment sncReconfig 2022-10-20 18:32:19 +08:00
Minghao Li 5965629b2e refactor(sync): refacotr sync 2022-10-20 16:05:14 +08:00
Minghao Li 27f690fd0a refacotr(sync): modify sync-snapshot 2022-10-20 14:57:49 +08:00
Minghao Li 74b48e6df8 refacotr(sync): modify sync-snapshot 2022-10-20 14:53:03 +08:00
Minghao Li 3e6d6fe89b refactor(sync): do replicate in timer routine 2022-10-19 19:12:04 +08:00
Benguang Zhao 2aa7afe7fa Merge branch '3.0' into FIX/TD-19593-3.0 2022-10-19 16:31:13 +08:00
Minghao Li 357951e947 refactor(sync): modify some code 2022-10-19 16:08:42 +08:00
Shengliang Guan 881db69feb
Merge pull request #17453 from taosdata/feature/sync2-merge
refactor(sync): add sync ctrl queue in vnode
2022-10-19 15:50:09 +08:00
Minghao Li 28a5a9d7e1 refactor(sync): add log, update quorum first when reconfig 2022-10-19 10:57:50 +08:00
Benguang Zhao 00a066443f Merge branch '3.0' into FIX/TD-19593-3.0 2022-10-19 09:38:36 +08:00
Benguang Zhao 3b0968d7f9 enh: enable the -Wformat=2 compiler option 2022-10-19 09:24:15 +08:00
Minghao Li 4c9f10b6f3 refactor(sync): add sync ctrl queue in vnode 2022-10-18 19:12:34 +08:00
Minghao Li 1df2703c41 refactor(sync): modify strategy for syncBeginSnapshot 2022-10-18 17:15:57 +08:00
Shengliang Guan 9e0feee081 enh: sync propose return at once if replica is 1 2022-10-18 17:06:03 +08:00
Minghao Li e85954276f refactor(sync): rename functions 2022-10-18 16:16:53 +08:00
Minghao Li 1b36ad119c refactor(sync): rename functions 2022-10-18 15:24:00 +08:00
Minghao Li 49c19e13f2 refactor(sync): rename function 2022-10-18 14:16:39 +08:00
Minghao Li e810f2ad64 refactor(sync): delete old code, ok 2022-10-18 13:53:03 +08:00
Shengliang Guan f76261dcb5 fix: become leader if replica num is 1 2022-10-18 12:31:15 +08:00
Minghao Li 94ba0f47f0 refactor(sync): stop elect when not candidate 2022-10-17 20:20:55 +08:00
Minghao Li 45bce6ad49 refactor(sync): add syncBeginSnapshot, syncEndSnapshot 2022-10-17 18:08:35 +08:00
Minghao Li 8a6eaed6f6 refactor(sync): delete some code 2022-10-17 17:36:51 +08:00
Minghao Li 092a07475d refactor(sync): process hb and appendentries 2022-10-17 16:38:44 +08:00
Shengliang Guan 8fe672feab fix: crash whle reconfig mnode will cause taosd reboot failure 2022-10-17 14:34:51 +08:00
Minghao Li a3f8c03a65 refacotr(sync): add case sync2-test.sim 2022-10-17 10:58:55 +08:00
Minghao Li 5745223bca refactor(sync): add double queues in mnode 2022-10-17 10:33:27 +08:00
Minghao Li fa30b94c67 refactor(sync): append entries 2022-10-16 12:07:02 +08:00
Benguang Zhao 616eb5f903 Merge branch '3.0' into FIX/TD-19239-3.0 2022-10-16 00:29:01 +08:00
Benguang Zhao c70d10334c enh: print vgId in error msg within syncNodeCommit 2022-10-15 23:57:37 +08:00
Minghao Li 797d1324c5 refactor(sync): request vote 2022-10-15 09:28:55 +08:00
Benguang Zhao 63b13db10f fix: eliminate asserts on getting and committing log entries 2022-10-14 22:57:27 +08:00
Benguang Zhao 715f53a856 fix: eliminate asserts on errors of appending or getting log entry 2022-10-14 22:46:35 +08:00
Shengliang Guan fc090a1a4a enh: refactor the code to create and delete mnodes 2022-10-14 22:19:10 +08:00
Benguang Zhao 36bf800e15 fix: improve fault tolerance on disk space full with error handling enhanced 2022-10-14 22:02:27 +08:00
Shengliang Guan 78fb1911d4 enh: refactor the code to create and delete mnodes 2022-10-14 17:59:09 +08:00
Minghao Li 4d123c4da6 refactor(sync): add interface in sync 2022-10-14 11:18:48 +08:00
Minghao Li 2ae4081a3f refactor(sync): add double queues in vnode 2022-10-13 20:57:36 +08:00
Minghao Li 733440b352 refactor(sync): add double queues in vnode 2022-10-13 14:37:18 +08:00
Hongze Cheng c79cc7e454 more code format 2022-10-13 14:06:27 +08:00
Shengliang Guan 3be4a2ed9c Merge remote-tracking branch 'origin/3.0' into fix/TD-19245 2022-09-29 19:42:09 +08:00
Shengliang Guan e94646ca70 fix: coverity issues 2022-09-29 19:41:54 +08:00
Shengliang Guan c56dd86399 fix: do not process query and fetch msg until vnode restore finished 2022-09-29 14:29:30 +08:00
Shengliang Guan 4df3303514 fix: do not process query and fetch msg until vnode restore finished 2022-09-29 14:24:45 +08:00
Benguang Zhao b71a9e3483 enh: improve error handling in syncNodeOpen 2022-09-28 13:34:13 +08:00
Shengliang Guan f16029ad78
Merge pull request #17042 from taosdata/FIX/TD-19226-3.0
fix: avoid assertion on changing num of spaces in JSON files raft_config.json and raft_store.json
2022-09-27 09:33:41 +08:00
Shengliang Guan f4cbf6dd75
Merge pull request #17040 from taosdata/fix/ZhiqiangWang/TD-13064-fix-mac-test-error
os: fix Mac test error
2022-09-26 18:53:48 +08:00
afwerar 91b35a0b62 os: fix Mac test error 2022-09-26 11:30:40 +08:00
Benguang Zhao b10bc2ed5b fix: avoid assertion on changing num of spaces in JSON files raft_config.json and raft_store.json 2022-09-23 19:17:39 +08:00
afwerar 5deb0e25d5 build: close default gtest compile and docker 2022-09-23 16:38:20 +08:00
Minglei Jin 8bc6a6297f enh(sync): log entry cache for sync 2022-09-20 19:57:02 +08:00
Minghao Li c5ec1741bc refactor(sync): add syncHeartbeatReply 2022-09-07 18:02:10 +08:00
Minghao Li d9363214b7 refactor(sync): add syncHeartbeat 2022-09-07 15:29:04 +08:00
Minghao Li c151dd3b92 fix(sync): mem leak 2022-09-07 10:35:44 +08:00
Minghao Li 87dd0fc168 refactor(sync): delete ASSERT(0) in snapshotReceiverFinish 2022-09-01 10:54:02 +08:00
Shengliang Guan 4401080328 enh: make cmake .. -DCMAKE_BUILD_TYPE=Release work 2022-08-31 18:06:17 +08:00
Minghao Li 8da7950282 refactor(sync): close receiver when become leader 2022-08-22 15:40:28 +08:00
Minghao Li dd212b5dbb refactor(sync): modify config file len 2022-08-22 14:25:36 +08:00
Minghao Li 8a32c0c189 refactor(sync): adjust strategy for dynamic quorum 2022-08-18 14:55:57 +08:00
Minghao Li 2ca5bdc708 refactor(sync): add syncNodeDynamicQuorum 2022-08-17 15:39:38 +08:00
Minghao Li eee4c0853d refactor(sync): add syncNodeAppendEntriesOnePeer 2022-08-17 10:34:53 +08:00
Minghao Li 4164d14637 refactor(sync): add syncIsReadyForRead 2022-08-15 18:50:14 +08:00
Minghao Li 6cff4dcfd8 refactor(sync): add syncIsReadyForRead 2022-08-15 14:42:40 +08:00
Minghao Li 8f0361bf75 refactor(sync): delete expired config index 2022-08-11 17:42:04 +08:00
Minghao Li 8328aae50f refactor(sync): add raft config index test 2022-08-11 15:22:44 +08:00
Minghao Li dc42544e9e refactor(sync): add leader, follower call back2 2022-08-10 20:45:36 +08:00
Minghao Li b4c8685766 refactor(sync): add leader, follower call back 2022-08-10 17:17:30 +08:00
Minghao Li 6cabe5847e fix(sync): delete memory after optimized 2022-08-10 11:26:23 +08:00
Li Minghao 7722f88093
Merge pull request #15861 from taosdata/feature/3.0_mhli
refactor(sync): speed up replicate
2022-08-08 20:36:49 +08:00
Minghao Li df18cc5f47 refactor(sync): speed up replicate 2022-08-08 19:46:37 +08:00
Li Minghao 4c775b118a
Merge pull request #15843 from taosdata/feature/3.0_mhli
refactor(sync): speed up replicate
2022-08-08 17:26:34 +08:00
Minghao Li 62b07dbe5d refactor(sync): speed up replicate 2022-08-08 15:10:32 +08:00
Li Minghao ad55155897
Merge pull request #15838 from taosdata/feature/3.0_mhli
refactor(sync): make leader life longer
2022-08-08 14:03:33 +08:00
Minghao Li d9b8417d7b refactor(sync): make leader life longer 2022-08-08 14:01:31 +08:00
Minghao Li 0f63837e69 refactor(sync): make leader life longer 2022-08-08 13:25:02 +08:00
Li Minghao 363a4f38e3
Merge pull request #15821 from taosdata/feature/3.0_mhli
refactor(sync): make leader life longer
2022-08-08 10:32:55 +08:00
Minghao Li 2f1bf1eba9 refactor(sync): make leader life longer 2022-08-06 21:41:03 +08:00