Commit Graph

1355 Commits

Author SHA1 Message Date
Shengliang Guan d9c261cd13 refact: remove some error codes 2022-12-03 10:17:02 +08:00
Benguang Zhao 7eca212756 Merge branch '3.0' into FIX/TD-19334-3.0 2022-12-03 10:02:59 +08:00
Benguang Zhao 2ce07c6ec1 fix: get result of tmsPutToQueue for FpCommitCb 2022-12-03 09:05:50 +08:00
Benguang Zhao e97c8f637b enh: logging sync log buffer rollback events 2022-12-03 09:05:39 +08:00
Shengliang Guan 13f36ec20a refact: remove TSDB_CODE_APP_NOT_READY and TSDB_CODE_NODE_NOT_DEPLOYED 2022-12-02 16:06:10 +08:00
Benguang Zhao 03d62e478f fix: get prevLogTerm of index zero as 0 only when firstVer is zero 2022-12-01 22:18:08 +08:00
Shengliang Guan 704885e212 fix: compile error 2022-12-01 15:07:40 +08:00
Shengliang Guan fe759c85f3 Merge remote-tracking branch 'origin/3.0' into FIX/TD-19334-3.0 2022-12-01 15:04:55 +08:00
Shengliang Guan ce768920ef
Merge pull request #18604 from taosdata/feature/3.0_mhli
refactor(sync): add traceId log
2022-12-01 14:11:10 +08:00
Minghao Li f5bebc53f1 refactor(sync): add traceId log 2022-12-01 12:53:38 +08:00
Shengliang Guan b6f1ce2027
Merge pull request #18589 from taosdata/feature/3.0_mhli
refactor(sync): help to display leader**
2022-12-01 11:54:39 +08:00
Benguang Zhao 55bae49d56 Merge branch 3.0 to FIX/TD-19334-3.0 2022-11-30 23:47:30 +08:00
Benguang Zhao 3cbe109e4b fix: initialize vnode state applyTerm with commitTerm in vnodeOpen 2022-11-30 22:41:33 +08:00
Shengliang Guan c0ecd4cebb
Merge pull request #18587 from taosdata/fix/TD-20857
refactor(sync): if already start, force close snapshot receiver
2022-11-30 21:50:29 +08:00
Minghao Li f0fdc58c52 refactor(sync): help to display leader** 2022-11-30 20:56:58 +08:00
Minghao Li 7497eab926 refactor(sync): if already start, force close snapshot receiver 2022-11-30 20:32:43 +08:00
Shengliang Guan d639198be5
Merge pull request #18561 from taosdata/fix/TD-20805
enh: show more info while drop dnode
2022-11-30 16:10:42 +08:00
Minghao Li 76cc7a89fb refacotr(sync), force stop snapshot sender/receiver when stop node 2022-11-30 13:44:22 +08:00
Shengliang Guan 5556fd0c45 enh: add sync offline state 2022-11-30 12:02:54 +08:00
Minghao Li a8832e8814 refactor(sync): modify info log 2022-11-30 11:20:03 +08:00
Benguang Zhao decb17fcb1 fix: use recursive mutex for relocking ring log buffer in syncNodeDoConfigChange 2022-11-29 23:19:32 +08:00
Minghao Li 8ec0b42456 refactor(sync): modify some trace log to info 2022-11-29 20:04:04 +08:00
Minghao Li f87b9fa7fe refactor(sync): add interface syncSnapshotSending, syncSnapshotRecving 2022-11-29 19:41:03 +08:00
Benguang Zhao 470441c541 Merge branch 3.0 to FIX/TD-19334-3.0 2022-11-29 18:24:01 +08:00
Benguang Zhao 4f37947e42 fix: minimum commitTerm as 0 in syncLogBufferInit 2022-11-29 17:15:48 +08:00
Minghao Li 198e18c348 refactor(sync): add trace log for cache hit, cache miss 2022-11-29 14:58:47 +08:00
Minghao Li ebe1103964 refactor(sync): add trace log for elect count, become leader count, config change count 2022-11-29 14:39:42 +08:00
Minghao Li ab40b8190f fix(sync): fix asan error, TD-20801 2022-11-28 18:21:46 +08:00
Benguang Zhao dc2dcea3de Merge branch 3.0 to FIX/TD-19334-3.0 2022-11-28 14:27:10 +08:00
Benguang Zhao 5f4fb90f69 enh: reduce retryBackoff if first timeMs less than last one for half the current retryWaitMs 2022-11-28 13:47:07 +08:00
Benguang Zhao 4edef438ea enh: transfer ownership of msgs while committing sync log entries 2022-11-26 21:57:23 +08:00
Benguang Zhao a01f34fd83 fix: clear sync log buffer in syncLogBufferDestroy 2022-11-26 16:20:23 +08:00
Benguang Zhao 012bcf1a5d enh: adjust logging levels in syncLogBufferAccept, e.g. sInfo to sWarn 2022-11-26 14:27:06 +08:00
Benguang Zhao 082428acab enh: reduce the number of probing msgs under stress in recovery mode 2022-11-26 13:18:52 +08:00
Shengliang Guan b6dbc462c8 fix: compile error 2022-11-26 11:56:13 +08:00
Shengliang Guan 9026a46c6f fix: compile error 2022-11-26 11:54:38 +08:00
Shengliang Guan 35eb754e4a Merge remote-tracking branch 'origin/3.0' into feature/3.0_mhli 2022-11-26 11:52:22 +08:00
Minghao Li 4a25963732 refactor(sync): optimized heartbeat timer 2022-11-26 10:46:57 +08:00
Benguang Zhao 736a1cc017 enh: adjust some info msgs for raft pipelining 2022-11-26 00:37:20 +08:00
Shengliang Guan c890469513 fix: compile error 2022-11-25 23:33:34 +08:00
Benguang Zhao b63afcd52f enh: reset sync log repl mgr on snapshot ending 2022-11-25 23:32:32 +08:00
Shengliang Guan 15d2da13b8 refactor: adjust syncLog 2022-11-25 22:16:15 +08:00
Shengliang Guan a880f22bc6 refactor: adjust syncLog 2022-11-25 22:13:39 +08:00
Shengliang Guan 39ddf9faf8 refactor: adjust syncLogHeartbeat 2022-11-25 21:55:37 +08:00
Benguang Zhao 143a2e8552 feat: start snapshot replication to rollback in recovery mode 2022-11-25 21:22:49 +08:00
Shengliang Guan 5035e5e953
Merge pull request #18463 from taosdata/feature/3.0_mhli
refactor(sync): add trace log
2022-11-25 21:07:11 +08:00
Minghao Li 93efefcbfc refactor(sync): add trace log 2022-11-25 18:19:25 +08:00
Benguang Zhao 68f8ebac9d Merge branch 3.0 to FIX/TD-19334-3.0 2022-11-25 13:10:06 +08:00
Benguang Zhao d5ae1ca18a enh: make the range span of unconfirmed logs sent less than half of the size of log ring buffer 2022-11-25 10:37:56 +08:00
Benguang Zhao ff286e1f1c enh: spool commit sync barrier as info in syncLogBufferCommit 2022-11-24 18:37:31 +08:00
Benguang Zhao 6729c130f8 fix: leave some free space in log buffer during syncLogBufferInit 2022-11-24 16:56:18 +08:00
Minghao Li 9f38bfeb2c refactor(sync): modify info log to trace log 2022-11-24 16:50:58 +08:00
Minghao Li 7fba711d40 refactor(sync): add info log 2022-11-24 16:03:43 +08:00
Benguang Zhao 22d64b9c0b fix: remove syncNodeReplicateOne from syncNodeOnSnapshotReply 2022-11-24 15:55:31 +08:00
Minghao Li 862a51e6ee refactor(sync): add timestamp trace log when elect and heartbeat 2022-11-24 12:03:05 +08:00
Benguang Zhao 2e640e8e68 feat: start snapshot in recovery mode of sync repl mgr with lastMatchTerm in reply msg 2022-11-24 11:01:26 +08:00
Minghao Li f9bf35c2f5 fix(sync): use local timestamp 2022-11-24 09:00:57 +08:00
Benguang Zhao f68e41a40e enh: initialize log buffer again after receiving a complete snapshot 2022-11-23 15:57:40 +08:00
Minghao Li 2b411912d9 refactor(sync): can not propose when heartbeat timeout 2022-11-23 14:17:13 +08:00
Minghao Li fd9a612d50 refactor(sync): fix coverity scan error 2022-11-23 11:15:46 +08:00
Benguang Zhao 006e13e663 enh: validate alignment of WAL and tsdb commit during syncLogBufferInit 2022-11-23 10:24:17 +08:00
Benguang Zhao b80095dc87 enh: snapshot during recovery of SSynclogReplMgr 2022-11-22 22:24:20 +08:00
Minghao Li 1d48426e94 refactor(sync): del wal in multi-replicas 2022-11-22 12:45:31 +08:00
Benguang Zhao 8ef5ca78ee fix: protect syncNodeReplicate with mutex lock 2022-11-22 10:54:32 +08:00
Benguang Zhao b90ee79623 fix: use syncLogBufferCommit in syncNodeOnLocalCmd 2022-11-21 13:51:01 +08:00
Minghao Li ff2a0db9f7 refactor(sync): fix asan error 2022-11-18 18:58:50 +08:00
Minghao Li 788a103132 refactor(sync): optimize leader transfer 2022-11-18 18:42:08 +08:00
Benguang Zhao c9c05761d6 enh: rename syncLogToAppendEntries to syncBuildAppendEntriesFromRaftLog 2022-11-18 12:40:00 +08:00
Benguang Zhao 03b88ff41c enh: rename syncLogBuffer.h|c to syncPipeline.h|c 2022-11-18 12:39:04 +08:00
Shengliang Guan 37580fc4c9
Merge pull request #18254 from taosdata/feature/3.0_mhli
fix(sync): fix elect bug
2022-11-18 12:00:13 +08:00
Minghao Li 3306785e60 fix(sync): fix elect bug 2022-11-18 11:06:35 +08:00
Shengliang Guan 7edde3a780 test: add log and asan case 2022-11-18 10:04:28 +08:00
Benguang Zhao 363cbc8985 fix: update cbMeta rsp handle info in syncLogFsmExecute 2022-11-18 09:37:58 +08:00
Benguang Zhao 4526ff2876 enh: add syncLogBuffer.h and syncLogBuffer.c 2022-11-17 23:37:02 +08:00
Benguang Zhao da469149db enh: debug to info 2022-11-17 20:28:18 +08:00
Benguang Zhao 051b73c1ed Merge branch 3.0 to FIX/TD-19334-3.0 2022-11-17 17:28:11 +08:00
Minghao Li cf76b418f9 refactor(sync): reduce cache size 2022-11-17 17:19:26 +08:00
Minghao Li 9a8895ec5a refactor(sync): use taosLRUCacheErase instead of taosLRUCacheRelease 2022-11-17 17:07:16 +08:00
Minghao Li effc38d217 fix(sync): fix asan error, use rid in hbdata and syncnode 2022-11-17 14:51:32 +08:00
Benguang Zhao 6062632722 enh: turn commit-cb logging msg to debug level in vnodeSyncCommitMsg 2022-11-16 19:53:22 +08:00
Shengliang Guan b7ba43ea5a
Merge pull request #18206 from taosdata/fix/fix-hb-timer
fix(sync): fix hb-timer heap-use-after-free
2022-11-16 18:08:42 +08:00
Shengliang Guan 3fedd9106f
Merge pull request #18204 from taosdata/fix/TD-20480
fix: restore wal info changes
2022-11-16 16:51:26 +08:00
Minghao Li 84c9b79b4d fix(sync): fix hb-timer heap-use-after-free 2022-11-16 16:12:35 +08:00
Shengliang Guan 201ce10fbc fix: restore wal info changes 2022-11-16 15:45:40 +08:00
Shengliang Guan 12f7022789 Merge remote-tracking branch 'origin/3.0' into fix/TD-20439 2022-11-16 14:31:32 +08:00
Shengliang Guan 1114bdefb4 fix: invalid log print 2022-11-16 14:31:17 +08:00
Minghao Li 4c912aa955 fix(sync): fix hb-timer memory leak 2022-11-16 14:28:20 +08:00
Benguang Zhao 3e13cd8280 fix: check if timer triggered ahead of time in syncNodeElect 2022-11-16 14:26:18 +08:00
Minghao Li 81592dfb09 fix(sync): fix hb-timer memory leak 2022-11-16 14:25:21 +08:00
Minghao Li 7bcd13e82a fix(sync): fix elect timer memory leak 2022-11-16 14:05:34 +08:00
Shengliang Guan 9099f5cd10
Merge pull request #18190 from taosdata/fix/TD-20437
fix(sync): fix asan error, TD-20437
2022-11-16 12:31:38 +08:00
Shengliang Guan 3ada61c346 restore some invalid code modify 2022-11-16 11:13:53 +08:00
Minghao Li 023f61ccf5 fix(sync): fix asan error, TD-20437 2022-11-16 10:54:06 +08:00
Minghao Li 475919dd77 refactor(sync): add rtt trace log 2022-11-16 10:10:02 +08:00
Shengliang Guan aab1ec632c fix: heap-use-after-free in syncNodeEqPingTimer 2022-11-15 22:29:59 +08:00
Shengliang Guan 6c0bbe684b fix: heap-use-after-free in syncNodeEqPingTimer 2022-11-15 22:28:03 +08:00
Minghao Li 7d63efd2af refactor(sync): optimize, make LRU Cache hit more 2022-11-15 19:24:43 +08:00
Minghao Li c5aa7e072d refactor(sync): optimize, make LRU Cache hit more 2022-11-15 19:17:28 +08:00
Minghao Li 9e8404f60a refactor(sync): adjust timer 2022-11-15 17:50:15 +08:00
Benguang Zhao bf634a840d enh: check lastVer and commit version during syncNodeOpen 2022-11-15 17:13:31 +08:00
Shengliang Guan a57efc49b4 fix: memory leak of sync timer 2022-11-15 13:43:30 +08:00
Benguang Zhao c0c1cd8211 enh: reset sync log repl mgr if restarting of the peer detected in HeartbeatReply 2022-11-15 10:24:11 +08:00
Minghao Li d381b4da93 fix(sync): fix memory leak 2022-11-14 18:17:14 +08:00
Minghao Li 76628a52e6 fix(sync): do not use SNError 2022-11-14 17:33:48 +08:00
Minghao Li ac8eeb87af refactor(sync): modify error log 2022-11-14 17:19:20 +08:00
Minghao Li 8f55e007f4 refactor(sync): add trace log 2022-11-14 16:23:52 +08:00
Minghao Li 9b58176c58 fix(sync): fix AddressSanitizer error: TD-20372 2022-11-14 15:56:34 +08:00
Minghao Li c20627c1d6 fix(sync): fix AddressSanitizer error: TD-20372 2022-11-14 14:58:21 +08:00
Minghao Li 51861bb82b refactor(sync): delete some code 2022-11-14 14:20:13 +08:00
Shengliang Guan 11c3463814 refact: adjust sync code struct 2022-11-13 18:18:46 +08:00
Shengliang Guan 4940080a1c refact: adjust sync log prints 2022-11-13 18:00:11 +08:00
Shengliang Guan f1a41f5a37 refact: sync message headfile 2022-11-13 17:21:30 +08:00
Shengliang Guan f2191363b4 refact: sync local cmd msg 2022-11-13 17:14:03 +08:00
Shengliang Guan d37d83ee26 refact: adjust sync leadertransfer msg 2022-11-13 17:00:47 +08:00
Shengliang Guan fd7a499946 refact: adjust sync snapshotsend rsp 2022-11-13 16:41:40 +08:00
Shengliang Guan eec0ab8c8d refact: adjust sync snapshotsend msg 2022-11-13 16:39:21 +08:00
Shengliang Guan d5f7f8c398 refact: remove sync apply msg 2022-11-13 16:11:49 +08:00
Shengliang Guan 7bcda46c59 refact: remove sync pre snapshot 2022-11-13 16:03:45 +08:00
Shengliang Guan 973fc99f75
Merge pull request #18094 from taosdata/feature/3.0_mhli
refactor(sync): pre snapshot
2022-11-13 15:38:33 +08:00
Minghao Li ce4f32b8e7 refactor(sync): pre snapshot 2022-11-13 12:21:14 +08:00
Minghao Li 58fd2228d9 refactor(sync): pre snapshot 2022-11-13 10:45:33 +08:00
Shengliang Guan 6681099245 refact: build sync heartbeat reply 2022-11-12 21:31:01 +08:00
Shengliang Guan 55927eaf0d refact: build sync heartbeat msg 2022-11-12 20:37:15 +08:00
Shengliang Guan 94076e5919 refact: adjust sync append entry 2022-11-12 20:29:49 +08:00
Shengliang Guan 152b1ea9a3 enh: adjust sync append entry reply 2022-11-12 20:28:45 +08:00
Shengliang Guan 54e05aee26 enh: adjust sync append entry reply 2022-11-12 18:21:58 +08:00
Shengliang Guan 437daf8c90 enh: adjust sync append entry msg 2022-11-12 16:43:44 +08:00
Shengliang Guan 2dfc970572 enh: adjust sync append entry msg 2022-11-12 16:40:09 +08:00
Shengliang Guan 5b46cbefe9 enh: adjust request vote reply 2022-11-12 15:24:49 +08:00
Shengliang Guan cd19ff0173 enh: adjust request vote reply 2022-11-12 13:17:56 +08:00
Shengliang Guan 8cca68f29d enh: adjust request vote msg 2022-11-12 12:58:08 +08:00
Shengliang Guan 26cb3c3856 refact: remove sync batch codes 2022-11-12 12:26:56 +08:00
Shengliang Guan 8deb3b83df refact: adjust timeout msg build 2022-11-12 10:54:36 +08:00
Shengliang Guan 2da7eac62d refact: adjust timeout msg build 2022-11-12 10:21:16 +08:00
Benguang Zhao def4058eb1 feat: impl pipelining negotiation 2022-11-11 22:55:21 +08:00
Minghao Li 352c2d8ec0 refactor(sync): pre snapshot 2022-11-11 20:46:30 +08:00
Shengliang Guan 278cf9d327 refact: remove sync ping and pingreply 2022-11-11 17:48:15 +08:00
Shengliang Guan a18c731cd0 refact: remove sync ping and pingreply 2022-11-11 17:35:04 +08:00
Shengliang Guan 1336ed11b2 refact: adjust sync ping message handler 2022-11-11 15:06:47 +08:00
Shengliang Guan 57f1b593e4 refact: adjust head file and sync log 2022-11-11 14:40:21 +08:00
Shengliang Guan fd152f00ec refact: adjust head file and sync log 2022-11-11 14:35:16 +08:00
Shengliang Guan b4f8e45401 refact: adjust head file and sync log 2022-11-11 14:25:24 +08:00
Shengliang Guan 5de865992a refact: adjust head file and sync log 2022-11-11 12:19:10 +08:00
Shengliang Guan 4d0c5c9d57 refact: adjust head file and sync log 2022-11-11 11:06:39 +08:00
Minghao Li 1c2892988f refactor(sync): modify CMakeLists.txt in test 2022-11-11 09:30:08 +08:00
Minghao Li a623ec31df refactor(sync): modify CMakeLists.txt in test 2022-11-11 09:25:38 +08:00
Minghao Li 03ca300520 refactor(sync): modify test, syncRespMgrTest.cpp 2022-11-11 09:20:05 +08:00
Shengliang Guan 8a051c001d refact: adjust sync debug codes 2022-11-10 17:05:13 +08:00
Shengliang Guan fba45da225 refact: remove assert and adjust log 2022-11-10 12:43:23 +08:00
Shengliang Guan f7d263862b refact: remove assert and adjust log 2022-11-10 11:26:52 +08:00
Shengliang Guan 69ea49c4c0 Merge branch '3.0' into fix/TD-20052 2022-11-10 09:06:45 +08:00
Shengliang Guan 2103df2907
Merge pull request #18006 from taosdata/feature/3.0_mhli
refactor(sync): if index less than wal.commitVer, do not truncate, otherwise it will print much log
2022-11-09 21:44:18 +08:00
Shengliang Guan efbe9ecbdc
Merge pull request #17999 from taosdata/fix/TD-20052
refact: move sync test code to single lib and reduce the number of memory copies
2022-11-09 19:14:33 +08:00
Shengliang Guan 4646640a11
Merge pull request #18001 from taosdata/fix/sync
fix(sync): fix AddressSanitizer error
2022-11-09 19:13:48 +08:00
Minghao Li fb9e62afe2 refactor(sync): if index less than wal.commitVer, do not truncate, otherwise it will print much log 2022-11-09 19:02:50 +08:00
Shengliang Guan 98b77fe8b4 refact: adjust head file 2022-11-09 19:02:47 +08:00
Shengliang Guan fdad108726 Merge branch '3.0' into fix/TD-20052 2022-11-09 18:02:46 +08:00
Minghao Li 153c01ee73 fix(sync): fix AddressSanitizer error 2022-11-09 17:38:46 +08:00
Shengliang Guan f2fd847414 refact: move sync test code to single lib 2022-11-09 17:35:22 +08:00
Minghao Li fcc50467f4 fix(sync): fix AddressSanitizer error 2022-11-09 17:33:22 +08:00
Shengliang Guan 340bad7e99 Merge branch '3.0' into fix/TD-20052 2022-11-09 17:29:24 +08:00
Minghao Li 2391391621 refactor(sync): save error code in syncPrintNodeLog 2022-11-09 16:44:05 +08:00
Minghao Li 18363f52e5 refactor(sync): add FpApplyQueueItems in fsm 2022-11-09 16:35:26 +08:00
Minghao Li d672e7a05c refactor(sync): add FpApplyQueueItems in fsm 2022-11-09 16:18:28 +08:00
Shengliang Guan 15e7e345dc refact: move sync test code to single lib 2022-11-09 14:45:07 +08:00
Minghao Li 372d26f74b refactor(sync): delete assert, call FpCommitCb when multi replica 2022-11-09 11:24:11 +08:00
Shengliang Guan ebc17283de
Merge pull request #17974 from taosdata/fix/TD-20052
refact: adjust sync resp mgr
2022-11-08 23:56:25 +08:00
Shengliang Guan bf1aca1b9e fix: send response on enqueue msg failed 2022-11-08 23:00:14 +08:00
Shengliang Guan 1c8a2d696d fix: send response on enqueue msg failed 2022-11-08 22:59:05 +08:00
Shengliang Guan a4e96ca833 refact: adjust sync resp mgr 2022-11-08 22:43:12 +08:00
Shengliang Guan 29f8878519 refactor: adjust sync hb 2022-11-07 23:32:04 +08:00
Shengliang Guan 05d0a0fe30 Merge branch 'enh/TD-20043' of https://github.com/taosdata/TDengine into enh/TD-20043 2022-11-07 23:31:09 +08:00
Shengliang Guan 9914657cb0 refactor: adjust sync hb 2022-11-07 23:31:01 +08:00
Shengliang Guan 70d60a764f Merge branch '3.0' into enh/TD-20043 2022-11-07 23:29:53 +08:00
Shengliang Guan 8c97a5c1f2
Merge pull request #17940 from taosdata/feature/3.0_mhli
refactor(sync): delete assert, add error log
2022-11-07 23:26:24 +08:00
Shengliang Guan 848fd58402 enh: adjust sync propose 2022-11-07 21:12:43 +08:00
Shengliang Guan 4ddd25a29c enh: adjust sync propose 2022-11-07 20:31:26 +08:00
Shengliang Guan 46e55ba9fb refact: remove config change codes 2022-11-07 20:19:55 +08:00
Minghao Li d05f9412eb refactor(sync): delete assert, add error log 2022-11-07 19:40:49 +08:00
Shengliang Guan e060de7059 refact: remove config change codes 2022-11-07 19:34:48 +08:00
Shengliang Guan 1ddbeb43bb refact: adjust sync log 2022-11-07 19:19:10 +08:00
Shengliang Guan bc072aa654 Merge branch '3.0' into enh/TD-20043 2022-11-07 18:45:44 +08:00
Shengliang Guan 4baafd3417 refact: adjust sync log 2022-11-07 18:44:29 +08:00
Shengliang Guan b0f469adb1
Merge pull request #17931 from taosdata/feature/3.0_mhli
fix(sync): when apply queue not empty, can not read
2022-11-07 18:29:53 +08:00
Shengliang Guan a1c8db0f88 refact: adjust sync log 2022-11-07 17:35:24 +08:00
Minghao Li b6aea6ae17 fix(sync): when apply queue not empty, can not read 2022-11-07 16:40:53 +08:00
dapan1121 5ab6166efe enh: support grant check in vnode query 2022-11-07 16:23:40 +08:00
Benguang Zhao 5878c9a31a fix: impl ring log buffer 2022-11-07 14:27:22 +08:00
Shengliang Guan adb335467c fix: coverity issues 2022-11-05 19:59:18 +08:00
dapan1121 7081ebe9e6
Merge pull request #17877 from taosdata/enh/TD-19920
enh: add show rewrite mask in query msg
2022-11-05 15:35:51 +08:00
Minghao Li ddb815ac42 refactor(sync): optimize advance commit index when one replica 2022-11-05 10:54:59 +08:00
Minghao Li 47d9fe6422 fix(sync): do not vote when last-index < my cmt index 2022-11-04 15:10:08 +08:00
dapan1121 65636154ea fix: fix msg head issue 2022-11-04 10:47:49 +08:00
Minghao Li 1f329f3025 refactor(sync): delete assert 2022-11-04 10:41:36 +08:00
Minghao Li 0838afaa18 refactor(sync): add syncIsReadyForRead, set error code 2022-11-03 14:35:42 +08:00
Minghao Li a4b54c4f0e refactor(sync): add syncIsReadyForRead 2022-11-03 13:57:57 +08:00
Minghao Li 1fc79e289d refactor(sync): modify leader transfer 2022-11-03 11:50:24 +08:00
Minghao Li 102969086d refactor(sync): add local-cmd:follower-commit 2022-11-03 10:25:38 +08:00
Minghao Li 1a4b7622e4 enh(sync): add sync pre stop 2022-11-03 09:39:20 +08:00
Minghao Li 70aff8451f refactor(sync): add pre snapshot 2022-11-02 15:38:30 +08:00
Minghao Li f7191d2ffd refactor(sync): add pre snapshot 2022-11-02 15:25:14 +08:00
Shengliang Guan 59ae60f223
Merge pull request #17827 from taosdata/fix/sync
fix(sync): delete assert
2022-11-02 13:29:56 +08:00
Minghao Li dccbe25aa9 fix(sync): delete assert 2022-11-02 11:24:42 +08:00
Shengliang Guan 7a537bba09 refact: adjust sync.h and syncState 2022-11-02 10:24:55 +08:00
Shengliang Guan ee63b49800 Merge remote-tracking branch 'origin/3.0' into fix/TD-20052 2022-11-01 17:11:27 +08:00
Shengliang Guan a71dbd83d2
Merge pull request #17803 from taosdata/fix/TD-20052
enh: refact syncMsg code
2022-11-01 16:45:56 +08:00
Shengliang Guan d35028ae4a enh: refact sync callback func 2022-11-01 16:10:07 +08:00
Shengliang Guan f4dc7d0766 enh: refact sync callback func 2022-11-01 15:35:10 +08:00
Minghao Li 59448cd18e refactor(sync): pre snapshot on message 2022-11-01 15:20:08 +08:00
Shengliang Guan e79e50ae36 enh: refact syncMsg code 2022-11-01 13:58:25 +08:00
Minghao Li 21d60cb5be refactor(sync): pre snapshot on message 2022-11-01 11:46:29 +08:00
Minghao Li fd07a611a9 refactor(sync): add some log 2022-11-01 11:30:40 +08:00
Minghao Li 3fbb51346b refactor(sync): modify syncEnvTest 2022-11-01 10:52:25 +08:00
Minghao Li 094c14e272 Merge branch '3.0' of https://github.com/taosdata/TDengine into feature/3.0_mhli 2022-11-01 10:47:42 +08:00
Minghao Li 69af9556db refactor(sync): add PreSnapshotReply 2022-11-01 10:47:19 +08:00
Shengliang Guan 1724aa5638
Merge pull request #17779 from taosdata/fix/sync
refactor(sync): check msgcb, putToQueueFp NULL
2022-11-01 10:43:56 +08:00
Minghao Li 981461ea46 refactor(sync): add PreSnapshotTest 2022-11-01 10:25:31 +08:00
Shengliang Guan fbb1fa5303 enh: refact syncEnv code 2022-11-01 09:02:48 +08:00
Shengliang Guan 91abd170e3 enh: refact syncEnv code 2022-10-31 23:45:17 +08:00
Shengliang Guan 9bc48e2658 Merge remote-tracking branch 'origin/3.0' into fix/TD-20052 2022-10-31 23:42:03 +08:00
Shengliang Guan 392564cc7d enh: refact syncEnv code 2022-10-31 23:40:43 +08:00
Shengliang Guan 1c446b1bf4 Merge branch '3.0' into fix/sync 2022-10-31 23:30:24 +08:00
Shengliang Guan e817e649c6
Merge pull request #17788 from taosdata/enh/TD-19090
enh: force drop dnode
2022-10-31 23:27:54 +08:00
Shengliang Guan 26f1e64f2a enh: force drop dnode 2022-10-31 21:33:06 +08:00
Shengliang Guan 1ad604a5f9 enh: force drop dnode 2022-10-31 19:57:27 +08:00
Minghao Li d246514da2 refactor(sync): check msgcb, putToQueueFp NULL 2022-10-31 18:16:58 +08:00
Minghao Li 6b74412994 refactor(sync): print fatal log when commit error 2022-10-31 16:30:42 +08:00
Minghao Li 77ba900776 refactor(sync): add sync local cmd, step down 2022-10-31 16:12:40 +08:00
Minghao Li 0b20b914bb refactor(sync): add sync local cmd 2022-10-31 14:17:26 +08:00
Shengliang Guan b052766547
Merge pull request #17759 from taosdata/fix/sync
refactor(sync) delete ASSERT
2022-10-30 17:41:31 +08:00
Minghao Li 783a65f827 refactor(sync) delete ASSERT 2022-10-29 10:57:15 +08:00
Minghao Li 438786501b refactor(sync): adjust elect timer ms 2022-10-28 15:31:34 +08:00
Minghao Li d7c866ee12 enh(sync): add test 2022-10-27 17:59:16 +08:00
Minghao Li 54dfc8cd52 enh(sync): add test 2022-10-27 17:38:33 +08:00
Minghao Li 8b5d005db7 refactor(sync): add SyncLocalCmd 2022-10-27 17:16:46 +08:00
Minghao Li bbb624b63e Merge branch '3.0' of https://github.com/taosdata/TDengine into feature/3.0_mhli 2022-10-27 16:22:08 +08:00
Minghao Li 7cb3112d77 refactor(sync): modify function name 2022-10-27 15:52:48 +08:00
Shengliang Guan 8f88339988
Merge pull request #17709 from taosdata/feature/3.0_mhli
refactor(sync): delete some code
2022-10-27 15:39:38 +08:00
Minghao Li a8109b7f37 refactor(sync): delete some code 2022-10-27 14:43:07 +08:00
Shengliang Guan 08aa82295b
Merge pull request #17694 from taosdata/fix/sync
fix(sync): fix coverity issues
2022-10-27 13:20:57 +08:00
Shengliang Guan 14519019f7 enh: balance vgroup 2022-10-27 11:10:54 +08:00
Minghao Li e3c055e0c4 fix(sync): fix coverity issues 2022-10-27 10:08:12 +08:00
Minghao Li 1ae3cab198 refactor(sync): check pSyncTimer NULL 2022-10-26 10:56:50 +08:00
Minghao Li 7723a9ac28 refactor(sync): delete %ld 2022-10-25 23:17:52 +08:00
Minghao Li 16e6273d9d refactor(sync): delete assert 2022-10-25 20:31:20 +08:00
Minghao Li 49af601e19 refactor(sync): add SElectTimer 2022-10-25 19:56:49 +08:00
Minghao Li 9caea0f944 refactor(sync): adjust elect timer 2022-10-25 19:43:07 +08:00
Minghao Li 96a8a80cd7 refactor(sync): add trace log 2022-10-25 19:22:25 +08:00
Minghao Li 01b712fbfd refactor(sync): add trace log 2022-10-25 19:11:28 +08:00
Minghao Li 64f539cacb refactor(sync): adjust timer 2022-10-25 18:03:22 +08:00
Minghao Li eb7b9d3819 fix(sync): fix coverity scan issues 2022-10-25 14:28:34 +08:00
Minghao Li 8082b71cce fix(sync): free pLocalEntry 2022-10-24 18:05:14 +08:00
Minghao Li fddd6657bc fix(sync): add error log when pState is NULL 2022-10-24 14:51:45 +08:00
Minghao Li a228d5ecb9 fix(sync): break when pState is NULL 2022-10-24 14:09:12 +08:00
Shengliang Guan 6d1bf00cee fix: use sync cfg from vnode 2022-10-24 12:42:44 +08:00
Shengliang Guan ec786b9d78 fix: alter replica one by one 2022-10-24 11:57:26 +08:00
Minghao Li e2a157bb02 fix(sync): fix timer bug 2022-10-23 20:14:51 +08:00
Shengliang Guan 0914c02394 fix: compile error in mac 2022-10-22 23:49:49 +08:00
Shengliang Guan 15fade84d8 fix: compile error 2022-10-22 22:21:11 +08:00
Shengliang Guan 71ac720ac0 fix: compile error in mac 2022-10-22 08:47:09 +08:00
Shengliang Guan 2d3f5274b7 fix: compile error in mac 2022-10-22 08:39:58 +08:00
Minghao Li 5ee04e8059 refacotr(sync): free memory 2022-10-21 16:27:14 +08:00
Minghao Li 40ec6ba970 Merge branch 'feature/sync2-merge' of https://github.com/taosdata/TDengine into feature/sync2-merge 2022-10-21 15:47:51 +08:00
Shengliang Guan b8fdafe8ee fix: not reconfig if unchanged 2022-10-21 15:47:26 +08:00
Minghao Li 11a4ef3508 Merge branch 'feature/sync2-merge' of https://github.com/taosdata/TDengine into feature/sync2-merge 2022-10-21 15:46:09 +08:00
Minghao Li cf3d865bae refacotr(sync): delete DynamicQuorum 2022-10-21 15:43:28 +08:00
Shengliang Guan 92584d133f Merge branch 'feature/sync2-merge' of https://github.com/taosdata/TDengine into feature/sync2-merge 2022-10-21 15:38:55 +08:00
Shengliang Guan c6bbd18924 fix: not post sem if transId is 0 2022-10-21 15:33:06 +08:00
Minghao Li b492082ac2 refacotr(sync): delete DynamicQuorum 2022-10-21 15:31:55 +08:00
Minghao Li 3c94d61493 refacotr(sync): judge peer state null 2022-10-21 15:22:34 +08:00
Minghao Li 984af8a877 refactor(sync): if data is null, do not update state mgr 2022-10-21 15:13:51 +08:00
Minghao Li 8bdec5f2f2 refactor(sync): delete standby 2022-10-21 11:53:14 +08:00
Minghao Li c7279cca52 fix(sync): sync reconfig 2022-10-20 19:36:47 +08:00
Shengliang Guan 894e75ca65 fix: comment sncReconfig 2022-10-20 18:32:19 +08:00
Minghao Li 5965629b2e refactor(sync): refacotr sync 2022-10-20 16:05:14 +08:00
Minghao Li 27f690fd0a refacotr(sync): modify sync-snapshot 2022-10-20 14:57:49 +08:00
Minghao Li 74b48e6df8 refacotr(sync): modify sync-snapshot 2022-10-20 14:53:03 +08:00
Minghao Li 3e6d6fe89b refactor(sync): do replicate in timer routine 2022-10-19 19:12:04 +08:00
Benguang Zhao 2aa7afe7fa Merge branch '3.0' into FIX/TD-19593-3.0 2022-10-19 16:31:13 +08:00
Minghao Li 357951e947 refactor(sync): modify some code 2022-10-19 16:08:42 +08:00
Shengliang Guan 881db69feb
Merge pull request #17453 from taosdata/feature/sync2-merge
refactor(sync): add sync ctrl queue in vnode
2022-10-19 15:50:09 +08:00
Minghao Li 28a5a9d7e1 refactor(sync): add log, update quorum first when reconfig 2022-10-19 10:57:50 +08:00
Benguang Zhao 00a066443f Merge branch '3.0' into FIX/TD-19593-3.0 2022-10-19 09:38:36 +08:00
Benguang Zhao 3b0968d7f9 enh: enable the -Wformat=2 compiler option 2022-10-19 09:24:15 +08:00
Minghao Li 4c9f10b6f3 refactor(sync): add sync ctrl queue in vnode 2022-10-18 19:12:34 +08:00
Minghao Li 1df2703c41 refactor(sync): modify strategy for syncBeginSnapshot 2022-10-18 17:15:57 +08:00
Shengliang Guan 9e0feee081 enh: sync propose return at once if replica is 1 2022-10-18 17:06:03 +08:00
Minghao Li e85954276f refactor(sync): rename functions 2022-10-18 16:16:53 +08:00
Minghao Li 1b36ad119c refactor(sync): rename functions 2022-10-18 15:24:00 +08:00
Minghao Li 49c19e13f2 refactor(sync): rename function 2022-10-18 14:16:39 +08:00
Minghao Li e810f2ad64 refactor(sync): delete old code, ok 2022-10-18 13:53:03 +08:00
Shengliang Guan f76261dcb5 fix: become leader if replica num is 1 2022-10-18 12:31:15 +08:00
Minghao Li 94ba0f47f0 refactor(sync): stop elect when not candidate 2022-10-17 20:20:55 +08:00
Minghao Li 45bce6ad49 refactor(sync): add syncBeginSnapshot, syncEndSnapshot 2022-10-17 18:08:35 +08:00
Minghao Li 8a6eaed6f6 refactor(sync): delete some code 2022-10-17 17:36:51 +08:00
Minghao Li 092a07475d refactor(sync): process hb and appendentries 2022-10-17 16:38:44 +08:00
Shengliang Guan 8fe672feab fix: crash whle reconfig mnode will cause taosd reboot failure 2022-10-17 14:34:51 +08:00
Minghao Li a3f8c03a65 refacotr(sync): add case sync2-test.sim 2022-10-17 10:58:55 +08:00
Minghao Li 5745223bca refactor(sync): add double queues in mnode 2022-10-17 10:33:27 +08:00
Minghao Li fa30b94c67 refactor(sync): append entries 2022-10-16 12:07:02 +08:00
Benguang Zhao 616eb5f903 Merge branch '3.0' into FIX/TD-19239-3.0 2022-10-16 00:29:01 +08:00
Benguang Zhao c70d10334c enh: print vgId in error msg within syncNodeCommit 2022-10-15 23:57:37 +08:00
Minghao Li 797d1324c5 refactor(sync): request vote 2022-10-15 09:28:55 +08:00
Benguang Zhao 63b13db10f fix: eliminate asserts on getting and committing log entries 2022-10-14 22:57:27 +08:00
Benguang Zhao 715f53a856 fix: eliminate asserts on errors of appending or getting log entry 2022-10-14 22:46:35 +08:00
Shengliang Guan fc090a1a4a enh: refactor the code to create and delete mnodes 2022-10-14 22:19:10 +08:00
Benguang Zhao 36bf800e15 fix: improve fault tolerance on disk space full with error handling enhanced 2022-10-14 22:02:27 +08:00
Shengliang Guan 78fb1911d4 enh: refactor the code to create and delete mnodes 2022-10-14 17:59:09 +08:00
Minghao Li 4d123c4da6 refactor(sync): add interface in sync 2022-10-14 11:18:48 +08:00
Minghao Li 2ae4081a3f refactor(sync): add double queues in vnode 2022-10-13 20:57:36 +08:00
Minghao Li 733440b352 refactor(sync): add double queues in vnode 2022-10-13 14:37:18 +08:00
Hongze Cheng c79cc7e454 more code format 2022-10-13 14:06:27 +08:00
Shengliang Guan 3be4a2ed9c Merge remote-tracking branch 'origin/3.0' into fix/TD-19245 2022-09-29 19:42:09 +08:00
Shengliang Guan e94646ca70 fix: coverity issues 2022-09-29 19:41:54 +08:00
Shengliang Guan c56dd86399 fix: do not process query and fetch msg until vnode restore finished 2022-09-29 14:29:30 +08:00
Shengliang Guan 4df3303514 fix: do not process query and fetch msg until vnode restore finished 2022-09-29 14:24:45 +08:00
Benguang Zhao b71a9e3483 enh: improve error handling in syncNodeOpen 2022-09-28 13:34:13 +08:00
Shengliang Guan f16029ad78
Merge pull request #17042 from taosdata/FIX/TD-19226-3.0
fix: avoid assertion on changing num of spaces in JSON files raft_config.json and raft_store.json
2022-09-27 09:33:41 +08:00
Shengliang Guan f4cbf6dd75
Merge pull request #17040 from taosdata/fix/ZhiqiangWang/TD-13064-fix-mac-test-error
os: fix Mac test error
2022-09-26 18:53:48 +08:00
afwerar 91b35a0b62 os: fix Mac test error 2022-09-26 11:30:40 +08:00
Benguang Zhao b10bc2ed5b fix: avoid assertion on changing num of spaces in JSON files raft_config.json and raft_store.json 2022-09-23 19:17:39 +08:00
afwerar 5deb0e25d5 build: close default gtest compile and docker 2022-09-23 16:38:20 +08:00
Minglei Jin 8bc6a6297f enh(sync): log entry cache for sync 2022-09-20 19:57:02 +08:00
Minghao Li c5ec1741bc refactor(sync): add syncHeartbeatReply 2022-09-07 18:02:10 +08:00
Minghao Li d9363214b7 refactor(sync): add syncHeartbeat 2022-09-07 15:29:04 +08:00
Minghao Li c151dd3b92 fix(sync): mem leak 2022-09-07 10:35:44 +08:00
Minghao Li 87dd0fc168 refactor(sync): delete ASSERT(0) in snapshotReceiverFinish 2022-09-01 10:54:02 +08:00
Shengliang Guan 4401080328 enh: make cmake .. -DCMAKE_BUILD_TYPE=Release work 2022-08-31 18:06:17 +08:00
Minghao Li 8da7950282 refactor(sync): close receiver when become leader 2022-08-22 15:40:28 +08:00
Minghao Li dd212b5dbb refactor(sync): modify config file len 2022-08-22 14:25:36 +08:00
Minghao Li 8a32c0c189 refactor(sync): adjust strategy for dynamic quorum 2022-08-18 14:55:57 +08:00
Minghao Li 2ca5bdc708 refactor(sync): add syncNodeDynamicQuorum 2022-08-17 15:39:38 +08:00
Minghao Li eee4c0853d refactor(sync): add syncNodeAppendEntriesOnePeer 2022-08-17 10:34:53 +08:00
Minghao Li 4164d14637 refactor(sync): add syncIsReadyForRead 2022-08-15 18:50:14 +08:00
Minghao Li 6cff4dcfd8 refactor(sync): add syncIsReadyForRead 2022-08-15 14:42:40 +08:00
Minghao Li 8f0361bf75 refactor(sync): delete expired config index 2022-08-11 17:42:04 +08:00
Minghao Li 8328aae50f refactor(sync): add raft config index test 2022-08-11 15:22:44 +08:00
Minghao Li dc42544e9e refactor(sync): add leader, follower call back2 2022-08-10 20:45:36 +08:00
Minghao Li b4c8685766 refactor(sync): add leader, follower call back 2022-08-10 17:17:30 +08:00
Minghao Li 6cabe5847e fix(sync): delete memory after optimized 2022-08-10 11:26:23 +08:00
Li Minghao 7722f88093
Merge pull request #15861 from taosdata/feature/3.0_mhli
refactor(sync): speed up replicate
2022-08-08 20:36:49 +08:00
Minghao Li df18cc5f47 refactor(sync): speed up replicate 2022-08-08 19:46:37 +08:00
Li Minghao 4c775b118a
Merge pull request #15843 from taosdata/feature/3.0_mhli
refactor(sync): speed up replicate
2022-08-08 17:26:34 +08:00
Minghao Li 62b07dbe5d refactor(sync): speed up replicate 2022-08-08 15:10:32 +08:00
Li Minghao ad55155897
Merge pull request #15838 from taosdata/feature/3.0_mhli
refactor(sync): make leader life longer
2022-08-08 14:03:33 +08:00
Minghao Li d9b8417d7b refactor(sync): make leader life longer 2022-08-08 14:01:31 +08:00
Minghao Li 0f63837e69 refactor(sync): make leader life longer 2022-08-08 13:25:02 +08:00
Li Minghao 363a4f38e3
Merge pull request #15821 from taosdata/feature/3.0_mhli
refactor(sync): make leader life longer
2022-08-08 10:32:55 +08:00
Minghao Li 2f1bf1eba9 refactor(sync): make leader life longer 2022-08-06 21:41:03 +08:00
Minghao Li f8b0c98a71 refactor(sync): make leader life longer 2022-08-06 20:44:14 +08:00