Commit Graph

1085 Commits

Author SHA1 Message Date
Benguang Zhao decb17fcb1 fix: use recursive mutex for relocking ring log buffer in syncNodeDoConfigChange 2022-11-29 23:19:32 +08:00
Minghao Li 8ec0b42456 refactor(sync): modify some trace log to info 2022-11-29 20:04:04 +08:00
Minghao Li f87b9fa7fe refactor(sync): add interface syncSnapshotSending, syncSnapshotRecving 2022-11-29 19:41:03 +08:00
Benguang Zhao 470441c541 Merge branch 3.0 to FIX/TD-19334-3.0 2022-11-29 18:24:01 +08:00
Benguang Zhao 4f37947e42 fix: minimum commitTerm as 0 in syncLogBufferInit 2022-11-29 17:15:48 +08:00
Minghao Li 198e18c348 refactor(sync): add trace log for cache hit, cache miss 2022-11-29 14:58:47 +08:00
Minghao Li ebe1103964 refactor(sync): add trace log for elect count, become leader count, config change count 2022-11-29 14:39:42 +08:00
Minghao Li ab40b8190f fix(sync): fix asan error, TD-20801 2022-11-28 18:21:46 +08:00
Benguang Zhao dc2dcea3de Merge branch 3.0 to FIX/TD-19334-3.0 2022-11-28 14:27:10 +08:00
Benguang Zhao 5f4fb90f69 enh: reduce retryBackoff if first timeMs less than last one for half the current retryWaitMs 2022-11-28 13:47:07 +08:00
Benguang Zhao 4edef438ea enh: transfer ownership of msgs while committing sync log entries 2022-11-26 21:57:23 +08:00
Benguang Zhao a01f34fd83 fix: clear sync log buffer in syncLogBufferDestroy 2022-11-26 16:20:23 +08:00
Benguang Zhao 012bcf1a5d enh: adjust logging levels in syncLogBufferAccept, e.g. sInfo to sWarn 2022-11-26 14:27:06 +08:00
Benguang Zhao 082428acab enh: reduce the number of probing msgs under stress in recovery mode 2022-11-26 13:18:52 +08:00
Shengliang Guan b6dbc462c8 fix: compile error 2022-11-26 11:56:13 +08:00
Shengliang Guan 9026a46c6f fix: compile error 2022-11-26 11:54:38 +08:00
Shengliang Guan 35eb754e4a Merge remote-tracking branch 'origin/3.0' into feature/3.0_mhli 2022-11-26 11:52:22 +08:00
Minghao Li 4a25963732 refactor(sync): optimized heartbeat timer 2022-11-26 10:46:57 +08:00
Benguang Zhao 736a1cc017 enh: adjust some info msgs for raft pipelining 2022-11-26 00:37:20 +08:00
Shengliang Guan c890469513 fix: compile error 2022-11-25 23:33:34 +08:00
Benguang Zhao b63afcd52f enh: reset sync log repl mgr on snapshot ending 2022-11-25 23:32:32 +08:00
Shengliang Guan 15d2da13b8 refactor: adjust syncLog 2022-11-25 22:16:15 +08:00
Shengliang Guan a880f22bc6 refactor: adjust syncLog 2022-11-25 22:13:39 +08:00
Shengliang Guan 39ddf9faf8 refactor: adjust syncLogHeartbeat 2022-11-25 21:55:37 +08:00
Benguang Zhao 143a2e8552 feat: start snapshot replication to rollback in recovery mode 2022-11-25 21:22:49 +08:00
Shengliang Guan 5035e5e953
Merge pull request #18463 from taosdata/feature/3.0_mhli
refactor(sync): add trace log
2022-11-25 21:07:11 +08:00
Minghao Li 93efefcbfc refactor(sync): add trace log 2022-11-25 18:19:25 +08:00
Benguang Zhao 68f8ebac9d Merge branch 3.0 to FIX/TD-19334-3.0 2022-11-25 13:10:06 +08:00
Benguang Zhao d5ae1ca18a enh: make the range span of unconfirmed logs sent less than half of the size of log ring buffer 2022-11-25 10:37:56 +08:00
Benguang Zhao ff286e1f1c enh: spool commit sync barrier as info in syncLogBufferCommit 2022-11-24 18:37:31 +08:00
Benguang Zhao 6729c130f8 fix: leave some free space in log buffer during syncLogBufferInit 2022-11-24 16:56:18 +08:00
Minghao Li 9f38bfeb2c refactor(sync): modify info log to trace log 2022-11-24 16:50:58 +08:00
Minghao Li 7fba711d40 refactor(sync): add info log 2022-11-24 16:03:43 +08:00
Benguang Zhao 22d64b9c0b fix: remove syncNodeReplicateOne from syncNodeOnSnapshotReply 2022-11-24 15:55:31 +08:00
Minghao Li 862a51e6ee refactor(sync): add timestamp trace log when elect and heartbeat 2022-11-24 12:03:05 +08:00
Benguang Zhao 2e640e8e68 feat: start snapshot in recovery mode of sync repl mgr with lastMatchTerm in reply msg 2022-11-24 11:01:26 +08:00
Minghao Li f9bf35c2f5 fix(sync): use local timestamp 2022-11-24 09:00:57 +08:00
Benguang Zhao f68e41a40e enh: initialize log buffer again after receiving a complete snapshot 2022-11-23 15:57:40 +08:00
Minghao Li 2b411912d9 refactor(sync): can not propose when heartbeat timeout 2022-11-23 14:17:13 +08:00
Minghao Li fd9a612d50 refactor(sync): fix coverity scan error 2022-11-23 11:15:46 +08:00
Benguang Zhao 006e13e663 enh: validate alignment of WAL and tsdb commit during syncLogBufferInit 2022-11-23 10:24:17 +08:00
Benguang Zhao b80095dc87 enh: snapshot during recovery of SSynclogReplMgr 2022-11-22 22:24:20 +08:00
Minghao Li 1d48426e94 refactor(sync): del wal in multi-replicas 2022-11-22 12:45:31 +08:00
Benguang Zhao 8ef5ca78ee fix: protect syncNodeReplicate with mutex lock 2022-11-22 10:54:32 +08:00
Benguang Zhao b90ee79623 fix: use syncLogBufferCommit in syncNodeOnLocalCmd 2022-11-21 13:51:01 +08:00
Minghao Li ff2a0db9f7 refactor(sync): fix asan error 2022-11-18 18:58:50 +08:00
Minghao Li 788a103132 refactor(sync): optimize leader transfer 2022-11-18 18:42:08 +08:00
Benguang Zhao c9c05761d6 enh: rename syncLogToAppendEntries to syncBuildAppendEntriesFromRaftLog 2022-11-18 12:40:00 +08:00
Benguang Zhao 03b88ff41c enh: rename syncLogBuffer.h|c to syncPipeline.h|c 2022-11-18 12:39:04 +08:00
Shengliang Guan 37580fc4c9
Merge pull request #18254 from taosdata/feature/3.0_mhli
fix(sync): fix elect bug
2022-11-18 12:00:13 +08:00
Minghao Li 3306785e60 fix(sync): fix elect bug 2022-11-18 11:06:35 +08:00
Shengliang Guan 7edde3a780 test: add log and asan case 2022-11-18 10:04:28 +08:00
Benguang Zhao 363cbc8985 fix: update cbMeta rsp handle info in syncLogFsmExecute 2022-11-18 09:37:58 +08:00
Benguang Zhao 4526ff2876 enh: add syncLogBuffer.h and syncLogBuffer.c 2022-11-17 23:37:02 +08:00
Benguang Zhao da469149db enh: debug to info 2022-11-17 20:28:18 +08:00
Benguang Zhao 051b73c1ed Merge branch 3.0 to FIX/TD-19334-3.0 2022-11-17 17:28:11 +08:00
Minghao Li cf76b418f9 refactor(sync): reduce cache size 2022-11-17 17:19:26 +08:00
Minghao Li 9a8895ec5a refactor(sync): use taosLRUCacheErase instead of taosLRUCacheRelease 2022-11-17 17:07:16 +08:00
Minghao Li effc38d217 fix(sync): fix asan error, use rid in hbdata and syncnode 2022-11-17 14:51:32 +08:00
Benguang Zhao 6062632722 enh: turn commit-cb logging msg to debug level in vnodeSyncCommitMsg 2022-11-16 19:53:22 +08:00
Shengliang Guan b7ba43ea5a
Merge pull request #18206 from taosdata/fix/fix-hb-timer
fix(sync): fix hb-timer heap-use-after-free
2022-11-16 18:08:42 +08:00
Shengliang Guan 3fedd9106f
Merge pull request #18204 from taosdata/fix/TD-20480
fix: restore wal info changes
2022-11-16 16:51:26 +08:00
Minghao Li 84c9b79b4d fix(sync): fix hb-timer heap-use-after-free 2022-11-16 16:12:35 +08:00
Shengliang Guan 201ce10fbc fix: restore wal info changes 2022-11-16 15:45:40 +08:00
Shengliang Guan 12f7022789 Merge remote-tracking branch 'origin/3.0' into fix/TD-20439 2022-11-16 14:31:32 +08:00
Shengliang Guan 1114bdefb4 fix: invalid log print 2022-11-16 14:31:17 +08:00
Minghao Li 4c912aa955 fix(sync): fix hb-timer memory leak 2022-11-16 14:28:20 +08:00
Benguang Zhao 3e13cd8280 fix: check if timer triggered ahead of time in syncNodeElect 2022-11-16 14:26:18 +08:00
Minghao Li 81592dfb09 fix(sync): fix hb-timer memory leak 2022-11-16 14:25:21 +08:00
Minghao Li 7bcd13e82a fix(sync): fix elect timer memory leak 2022-11-16 14:05:34 +08:00
Shengliang Guan 9099f5cd10
Merge pull request #18190 from taosdata/fix/TD-20437
fix(sync): fix asan error, TD-20437
2022-11-16 12:31:38 +08:00
Shengliang Guan 3ada61c346 restore some invalid code modify 2022-11-16 11:13:53 +08:00
Minghao Li 023f61ccf5 fix(sync): fix asan error, TD-20437 2022-11-16 10:54:06 +08:00
Minghao Li 475919dd77 refactor(sync): add rtt trace log 2022-11-16 10:10:02 +08:00
Shengliang Guan aab1ec632c fix: heap-use-after-free in syncNodeEqPingTimer 2022-11-15 22:29:59 +08:00
Shengliang Guan 6c0bbe684b fix: heap-use-after-free in syncNodeEqPingTimer 2022-11-15 22:28:03 +08:00
Minghao Li 7d63efd2af refactor(sync): optimize, make LRU Cache hit more 2022-11-15 19:24:43 +08:00
Minghao Li c5aa7e072d refactor(sync): optimize, make LRU Cache hit more 2022-11-15 19:17:28 +08:00
Minghao Li 9e8404f60a refactor(sync): adjust timer 2022-11-15 17:50:15 +08:00
Benguang Zhao bf634a840d enh: check lastVer and commit version during syncNodeOpen 2022-11-15 17:13:31 +08:00
Shengliang Guan a57efc49b4 fix: memory leak of sync timer 2022-11-15 13:43:30 +08:00
Benguang Zhao c0c1cd8211 enh: reset sync log repl mgr if restarting of the peer detected in HeartbeatReply 2022-11-15 10:24:11 +08:00
Minghao Li d381b4da93 fix(sync): fix memory leak 2022-11-14 18:17:14 +08:00
Minghao Li 76628a52e6 fix(sync): do not use SNError 2022-11-14 17:33:48 +08:00
Minghao Li ac8eeb87af refactor(sync): modify error log 2022-11-14 17:19:20 +08:00
Minghao Li 8f55e007f4 refactor(sync): add trace log 2022-11-14 16:23:52 +08:00
Minghao Li 9b58176c58 fix(sync): fix AddressSanitizer error: TD-20372 2022-11-14 15:56:34 +08:00
Minghao Li c20627c1d6 fix(sync): fix AddressSanitizer error: TD-20372 2022-11-14 14:58:21 +08:00
Minghao Li 51861bb82b refactor(sync): delete some code 2022-11-14 14:20:13 +08:00
Shengliang Guan 11c3463814 refact: adjust sync code struct 2022-11-13 18:18:46 +08:00
Shengliang Guan 4940080a1c refact: adjust sync log prints 2022-11-13 18:00:11 +08:00
Shengliang Guan f1a41f5a37 refact: sync message headfile 2022-11-13 17:21:30 +08:00
Shengliang Guan f2191363b4 refact: sync local cmd msg 2022-11-13 17:14:03 +08:00
Shengliang Guan d37d83ee26 refact: adjust sync leadertransfer msg 2022-11-13 17:00:47 +08:00
Shengliang Guan fd7a499946 refact: adjust sync snapshotsend rsp 2022-11-13 16:41:40 +08:00
Shengliang Guan eec0ab8c8d refact: adjust sync snapshotsend msg 2022-11-13 16:39:21 +08:00
Shengliang Guan d5f7f8c398 refact: remove sync apply msg 2022-11-13 16:11:49 +08:00
Shengliang Guan 7bcda46c59 refact: remove sync pre snapshot 2022-11-13 16:03:45 +08:00
Shengliang Guan 973fc99f75
Merge pull request #18094 from taosdata/feature/3.0_mhli
refactor(sync): pre snapshot
2022-11-13 15:38:33 +08:00
Minghao Li ce4f32b8e7 refactor(sync): pre snapshot 2022-11-13 12:21:14 +08:00