Commit Graph

1355 Commits

Author SHA1 Message Date
dmchen 7468749666 memory leak 2023-07-19 10:48:04 +08:00
dmchen e7dfb8c26d memory leak 2023-07-19 10:36:55 +08:00
dmchen 93766f8c96 memory leak 2023-07-19 08:32:16 +08:00
dmchen 3711fdd865 feat/TD-22970 2023-07-18 16:09:38 +08:00
yihaoDeng 79f01ad655 add version check in rpc 2023-07-05 08:16:25 +00:00
wade zhang f523eba5ce
Merge pull request #21795 from taosdata/FIX/TD-24892-3.0
enh: adjust logging level of sync heartbeat
2023-06-27 11:57:11 +08:00
dapan1121 4dae9f4eff merge main to 3.0 2023-06-26 18:43:00 +08:00
Benguang Zhao d31ee66d63 enh: taosMsleep 1 on syncLogStorePersist failure 2023-06-20 19:52:29 +08:00
Benguang Zhao 1f21e769e5 enh: adjust logging level of sync-heartbeat to TRACE 2023-06-20 19:49:53 +08:00
Benguang Zhao 3689b41f3a Merge branch '3.0' into FIX/TD-24182-3.0 2023-06-12 09:39:49 +08:00
Benguang Zhao 267cbfbc1c enh: update syncNodePropose 2023-05-29 19:49:28 +08:00
wade zhang 8d679d7686
Merge pull request #21299 from taosdata/FIX/TD-22970-3.0
enh: refactor some func names for syncLogReplProcessReply
2023-05-29 10:59:56 +08:00
dmchen 0fdeb5fbae restore learner stuck 2023-05-17 17:28:20 +08:00
Benguang Zhao 47a1d64125 enh: refactor some func names for syncLogReplProcessReply 2023-05-15 11:32:08 +08:00
Haojun Liao 7ef16e1922 other: merge main. 2023-05-12 11:49:53 +08:00
Benguang Zhao bd5372c378 fix: protect against nullptr in syncRespCleanRsp 2023-05-08 17:08:24 +08:00
Benguang Zhao fee4050d79 enh: rename error code TSDB_CODE_SYN_NEGO_WIN_EXCEEDED 2023-04-25 18:05:36 +08:00
Benguang Zhao 693bc09f19 enh: comment off unused error codes in sync and wal 2023-04-25 17:36:13 +08:00
Xiaoyu Wang 90b3f0093b
Merge pull request #21069 from taosdata/fix/change-learner-config-format
change learner config format
2023-04-25 16:42:43 +08:00
cadem 7e2dee8a0f filter voter when agree upon 2023-04-25 15:49:17 +08:00
cadem 2fd9640a39 change learner config format 2023-04-25 15:15:28 +08:00
cadem 5a512eb767 remove null pointer 2023-04-24 16:06:56 +08:00
Xiaoyu Wang f5a974489e
Merge pull request #21045 from taosdata/fix/block-check-to-async-check
fix/block-check-to-async-check
2023-04-24 15:41:17 +08:00
cadem a781d43577 fix/block-check-to-async-check 2023-04-24 10:23:43 +08:00
Benguang Zhao 104781124a fix: update commit index from heartbeat on learner in the same way as on follower 2023-04-24 09:36:25 +08:00
Benguang Zhao 7781932da2 fix: spool logging msg with pMsg->term in syncNodeOnHeartbeat 2023-04-23 17:19:01 +08:00
dm chen d594e4963f
Merge branch '3.0' into feat/learner 2023-04-20 19:11:06 +08:00
Benguang Zhao a1ca9466cd enh: adjust size limit of appyQ and negotiationWin 2023-04-20 14:28:56 +08:00
Benguang Zhao 55c6f115b0 enh: add applied-index in sync node logging msg 2023-04-20 14:28:56 +08:00
cadem 66bacdb165 vnode config compitible 2023-04-19 20:13:32 +08:00
cadem 3b78d4382b add learner 2023-04-18 19:03:45 +08:00
Benguang Zhao b958030b0c enh: remove unused functions in sync 2023-04-17 18:52:09 +08:00
Xiaoyu Wang c218e7c55b
Merge pull request #20897 from taosdata/FIX/TD-23509-main
enh: refactor some vars in syncLogReplProcessReplyAsNormal
2023-04-13 17:41:06 +08:00
Benguang Zhao 2a0493f40c enh: refactor some vars in syncLogReplProcessReplyAsNormal 2023-04-13 09:53:25 +08:00
Xiaoyu Wang 933660ae8d Merge remote-tracking branch 'origin/main' into fix/3.0_merge_main 2023-04-12 14:13:23 +08:00
Benguang Zhao 3efa36ca51 enh: refactor func name syncLogIsReplicationBarrier to syncLogReplBarrier 2023-04-12 10:13:17 +08:00
Benguang Zhao 09786a127d enh: refactor func names doOnce, attempt, probe, and sendTo of syncLogRepl 2023-04-12 10:13:06 +08:00
Benguang Zhao f6be5f2c0e enh: change sync log repl mgr to sync log repl in logging msg 2023-04-12 10:12:57 +08:00
Benguang Zhao edc9fe9705 enh: change the error msg of INVALID_VGROUP_ID to Vnode is closed or removed 2023-04-12 10:12:41 +08:00
Xiaoyu Wang 4c04b155d5 merge main 2023-04-11 15:56:28 +08:00
Benguang Zhao 0a1476763a enh: refactor some func names of syncLogReplMgr 2023-04-06 16:26:44 +08:00
Xiaoyu Wang e9d7a099cc merge main 2023-04-04 14:50:58 +08:00
Xiaoyu Wang ed48713a4b
Merge pull request #20615 from taosdata/fix/trigger-election-by-sync-msg
Fix/trigger election by sync msg
2023-03-27 11:54:53 +08:00
Xiaoyu Wang d2b8c5e433
Merge pull request #20524 from taosdata/fix/clusterid-isolation
fix: clusterid isolation
2023-03-25 09:19:49 +08:00
cadem 86ca5ce210 fix/trigger election by sync msg 2023-03-24 09:13:20 +08:00
Shengliang Guan 8d1224ce22 refactor: format code 2023-03-23 22:31:20 +08:00
dapan1121 5b02af6a91 fix: merge main to 3.0 2023-03-22 16:08:16 +08:00
cadem ea35f0ae11 feat/balance vgroup leader 2023-03-22 09:36:59 +08:00
cadem 39f6ce1694 remove memory leak and syncNodeInRaftGroup 2023-03-20 18:34:20 +08:00
cadem 7c970d1847 fix/clusterid isolation 2023-03-18 11:16:52 +08:00
Benguang Zhao 9f97162ef7 enh: separate election timer events 2023-03-14 21:02:06 +08:00
Benguang Zhao e350f71396 enh: reset elect timer at the end of callbacks 2023-03-14 19:45:31 +08:00
Shengliang Guan bf03965931
Merge pull request #20413 from taosdata/FIX/TD-22564-main
enh: not allow to propose if fsm applying progress lagging behind too far
2023-03-14 09:36:04 +08:00
Benguang Zhao 8139b725d2 fix: refuse to write when applying progress lagging behind on restored only 2023-03-10 10:57:39 +08:00
Benguang Zhao 5e53b1225b enh: finish restore with commit and applied indexes instead of num of items in apply queue 2023-03-09 19:35:42 +08:00
Benguang Zhao 552d0bc8a0 enh: not allow to insert if Tsdb applied lagging behind too far 2023-03-09 18:56:12 +08:00
Benguang Zhao 9d10739908 enh: send rsp of negotiation failure ahead of apply queue 2023-03-09 16:18:44 +08:00
Shengliang Guan a8dbfe9595
Merge pull request #20346 from taosdata/FIX/TD-22572-main
enh: no need to wait for emptying apply queue in syncNodePreClose
2023-03-09 15:17:10 +08:00
Benguang Zhao 24ebb2f547 enh: no need to wait for emptying apply queue in syncNodePreClose 2023-03-08 19:35:05 +08:00
Shengliang Guan 72680094fc
Merge pull request #20314 from taosdata/FIX/TD-22983-main
enh: keep extra raft Logs before minimum match index
2023-03-08 17:52:46 +08:00
Benguang Zhao eca97bf5b4 enh: keep extra raft Logs before minimum match index 2023-03-07 16:44:47 +08:00
Benguang Zhao 21c18a4a9b enh: use syncNodeReplicateReset in syncNodeOnSnapshotRsp 2023-03-07 16:34:02 +08:00
Benguang Zhao 383459441d enh: simplify conditions of triggering snapshot 2023-03-07 15:43:20 +08:00
Benguang Zhao 62d4729eb8 enh: print term in logging msg of raftStoreWriteFile 2023-03-07 15:19:47 +08:00
Benguang Zhao b91734cf91 enh: sync log retention of mnode configurable with mndLogRetention 2023-03-04 09:51:34 +08:00
Xiaoyu Wang d6dd087f84 merge main 2023-02-25 10:29:20 +08:00
Xiaoyu Wang 58fc265b80 merge main 2023-02-24 13:26:45 +08:00
Xiaoyu Wang d04d610a85
Merge pull request #20061 from taosdata/FIX/TD-22611-main
enh: refactor syncBeginSnapshot and walBeginSnapshot for logRetention
2023-02-24 13:12:06 +08:00
Xiaoyu Wang 1ab144609e merge main 2023-02-23 14:58:22 +08:00
Benguang Zhao e45367f924 fix: resolve coverity scan issues in sync and wal 2023-02-23 14:16:21 +08:00
Benguang Zhao 3b47dd753e enh: update pSyncNode->minMatchIndex in sncNodeEqPeerHeartbeatTimer 2023-02-21 20:01:54 +08:00
Benguang Zhao b0b9877265 fix: check if log buffer is empty in syncNodeOnLocalCmd 2023-02-21 19:00:47 +08:00
Benguang Zhao 0c7a4bfad9 enh: refactor syncBeginSnapshot and walBeginSnapshot for logRetention 2023-02-20 19:19:49 +08:00
Xiaoyu Wang c597de099f merge main 2023-02-20 13:41:27 +08:00
Benguang Zhao d51c3c36fb fix: not allow to read if sync is restoring 2023-02-17 19:47:52 +08:00
Xiaoyu Wang 4353e70c89
Merge pull request #20017 from taosdata/FIX/TD-22285-main
fix: synchronize access to raftStore
2023-02-17 12:57:44 +08:00
Benguang Zhao 99bfc95d54 fix: synchronize access to raftStore 2023-02-13 19:00:10 +08:00
Benguang Zhao 767080922a fix: set SYNC_VNODE_LOG_RETENTION as TSDB_SYNC_LOG_BUFFER_RETENTION + 1 2023-02-13 14:16:19 +08:00
Xiaoyu Wang 3382a24a69 merge main 2023-02-10 18:03:11 +08:00
Benguang Zhao 5ce5dded75 enh: reset wal reader after walReadVer 2023-02-08 14:41:15 +08:00
Xiaoyu Wang 09925437e3 merge main 2023-02-08 09:51:52 +08:00
Shengliang Guan 4d20469e2b fix: adjust log formats 2023-02-07 00:12:05 +08:00
Benguang Zhao e0412d3057 fix: request snapshot from maximum of commit vers of tsdb and wal 2023-02-03 18:52:59 +08:00
Xiaoyu Wang 5d499e52f9 merge main 2023-02-03 17:13:11 +08:00
Benguang Zhao 561ee87e9d enh: change the level of sync probe logging msg to trace 2023-02-03 09:22:00 +08:00
Benguang Zhao b6b0b3439e enh: rename syncNodeOnSnapshotPre to syncNodeOnSnapshotPrep 2023-02-02 19:34:32 +08:00
Benguang Zhao 043fc8d980 enh: improve logging msgs for sync snapshot repl 2023-02-01 19:26:58 +08:00
Hongze Cheng 0f00862d8b Merge branch 'fix/TD-22070' of https://github.com/taosdata/TDengine into fix/3.0_merge_main 2023-01-30 10:17:59 +08:00
Benguang Zhao bd23a36f86 fix: round lastApplyIndex up to beginIndex -1 in syncBeginSnapshot 2023-01-29 18:03:09 +08:00
Hongze Cheng 5e7b6602c5 Merge branch 'main' of https://github.com/taosdata/TDengine into fix/3.0_merge_main 2023-01-29 14:05:15 +08:00
Xiaoyu Wang 284286cbc4
Merge pull request #19621 from taosdata/FIX/TD-21218-main
enh: remove unused old routines in sync
2023-01-29 10:56:29 +08:00
Xiaoyu Wang 24157e78d6 merge main 2023-01-28 17:52:58 +08:00
Benguang Zhao 1f01ba7cc0 fix: not keep wal log vnodeCommit'ed for single replica db 2023-01-18 16:34:08 +08:00
Benguang Zhao e55a76e25a Merge branch main into FIX/TD-21218-main 2023-01-18 10:15:16 +08:00
Benguang Zhao d611793537 enh: remove unused old routines in sync 2023-01-18 10:07:16 +08:00
Shengliang Guan e11d57d58c
Merge pull request #19533 from taosdata/FIX/TD-21662-main
enh: skip WAL forceSync for single replica vgroup
2023-01-17 14:25:04 +08:00
Shengliang Guan d476b6db13 enh: update epset on dnode info changed 2023-01-16 15:41:50 +08:00
Shengliang Guan bd531ccfb3
Merge pull request #19542 from taosdata/enh/TD-20047
refact: adjust return value of tmsgUpdateDnodeInfo
2023-01-13 10:54:10 +08:00
Shengliang Guan cd0404bc25 refact: adjust return value of tmsgUpdateDnodeInfo 2023-01-12 17:08:33 +08:00
Shengliang Guan 3973e0512d Merge remote-tracking branch 'origin/main' into fix/TD-21663-2 2023-01-12 13:29:35 +08:00
Benguang Zhao 5a4cc36079 enh: skip WAL forceSync for single replica vgroup 2023-01-12 09:25:55 +08:00
Benguang Zhao 871a585a61 enh: fsync each WAL log after appending when wal_level=2 and wal_fsync_period=0 2023-01-11 18:28:45 +08:00
Shengliang Guan cff741e4c4 fix: coverity issues 2023-01-11 16:56:14 +08:00
Benguang Zhao 639652314f Merge branch main to FIX/TD-21428-main 2023-01-09 16:17:00 +08:00
Shengliang Guan 9a9e93b6fe fix: compile error in mac 2023-01-09 12:06:20 +08:00
Shengliang Guan 2aeda3a941 enh: refact raft store file 2023-01-09 12:01:36 +08:00
Shengliang Guan 42d911bf8e Merge remote-tracking branch 'origin/main' into FIX/TD-21043-main 2023-01-08 09:44:07 +08:00
Shengliang Guan 71be00a811 fix: minor changes 2023-01-06 15:42:11 +08:00
Shengliang Guan 81dcb23cae fix: handle error while write raft config file 2023-01-06 14:26:43 +08:00
Benguang Zhao e66f19ab46 enh: vote for higher lastLogTerm despite commitIndex 2023-01-05 17:09:37 +08:00
Benguang Zhao 47ace00090 enh: refactor some sync func names for pipelining 2023-01-05 17:09:37 +08:00
Shengliang Guan 84bea778c9 Merge branch 'fix/TD-21746' into FIX/TD-21043-main 2023-01-05 16:15:50 +08:00
Shengliang Guan b8e1064b0f fix: compile error 2023-01-05 16:15:42 +08:00
Shengliang Guan a28398c060 fix: compile error 2023-01-05 16:11:01 +08:00
Shengliang Guan ef3e60c387 Merge branch 'fix/TD-21746' into FIX/TD-21043-main 2023-01-05 15:58:30 +08:00
Shengliang Guan ed56abd40f fix: crash if reader is already dropped 2023-01-05 15:55:33 +08:00
Shengliang Guan 7e5d97f0da fix: stop snapshot receiver on sync post close 2023-01-05 12:00:35 +08:00
Benguang Zhao 9d5e74a3ff Merge branch 'main' into FIX/TD-21043-main 2023-01-05 09:47:22 +08:00
Benguang Zhao 442902e5cb fix: send rpc response on closing sync or failing to enqueue 2023-01-04 19:18:46 +08:00
Shengliang Guan bf6dc99461 fix: adjust sync logs 2023-01-04 11:48:30 +08:00
Shengliang Guan 34260cd397 Merge branch 'main' into FIX/TD-21043-main 2023-01-04 09:29:07 +08:00
Shengliang Guan 70b513c09c fix: vnode set the wrong replica info after snapshot transfered 2023-01-03 19:47:04 +08:00
Benguang Zhao 4031dc1af4 Merge branch main into FIX/TD-21043-main 2023-01-02 16:41:46 +08:00
Benguang Zhao 2baa71883d enh: logging states of sync log repl mgrs and the ring buffer in syncPrintNodeLog 2023-01-02 11:13:53 +08:00
Benguang Zhao cb433c191b enh: reset as stagnation only when not matched in syncLogReplMgrRetryOnNeed 2023-01-02 08:58:13 +08:00
Shengliang Guan 574915a48b fix: compatbility issue 2022-12-30 20:10:49 +08:00
Benguang Zhao 03f4b12386 enh: print peer addr in hex format 2022-12-30 19:36:18 +08:00
Shengliang Guan 01209614e6 fix: compatiable for pre version 2022-12-30 19:04:18 +08:00
Benguang Zhao eb524e610a enh: reset sync log replication on stagnation for eight times maxRetryWaitMs 2022-12-30 19:02:46 +08:00
Shengliang Guan 469dfb9d4e fix: compile errors 2022-12-30 17:47:17 +08:00
Benguang Zhao 4718f4d1b6 fix: resend acked msgs on exceeding maximum retryWaitMs 2022-12-30 17:24:44 +08:00
Shengliang Guan 9c1f2997f1 fix: test compile error 2022-12-30 17:16:02 +08:00
Shengliang Guan c2323db00d fix: allow the ip resolved by fqdn different between dnodes 2022-12-30 17:04:14 +08:00
Benguang Zhao e8e189cbbb enh: add sync log buffer info in logging msg in syncLogReplMgrRetryOnNeed 2022-12-29 15:48:59 +08:00
Shengliang Guan b05c65cd47 refact: rename variables 2022-12-29 11:21:22 +08:00
Shengliang Guan 4b7ab0a839 refact: adjust log 2022-12-29 11:00:33 +08:00
Benguang Zhao e22ce2df87 fix: use pReply->lastSendIndex instead while updating commitIndex 2022-12-29 10:45:25 +08:00
Shengliang Guan 7e67dc032d refact: rename variables 2022-12-29 10:41:01 +08:00
Benguang Zhao d307413c36 Merge branch 'main' into FIX/TD-21043-main 2022-12-29 10:03:17 +08:00
Benguang Zhao 044e58b712 enh: adjust logging msgs for sync probe and rollback 2022-12-29 10:00:35 +08:00
Benguang Zhao 2890a8cb96 fix: return error on failing to truncate raft log 2022-12-28 20:34:40 +08:00
Benguang Zhao 0c4ade9373 fix: update sync node commitIndex only if matchTerm equals currentTerm upon heartbeat 2022-12-28 20:25:52 +08:00
Benguang Zhao 724cf98dc3 fix: be conservative on commit progress in appendEntries 2022-12-28 20:25:52 +08:00
Shengliang Guan 71a2848376 fix: double free on append log failed 2022-12-27 17:51:52 +08:00
Benguang Zhao 8916722dd7 Merge branch main to FIX/TD-21043-main 2022-12-27 14:50:39 +08:00
Shengliang Guan 09fbb8ebc4 Merge branch 'main' into FIX/TD-21535-main 2022-12-27 10:47:12 +08:00
Benguang Zhao a7bfeb5fbe fix: check existence of SMsgHead in SSyncRaftEntry data or SRpcMsg pCont 2022-12-26 23:10:46 +08:00
Shengliang Guan 794fb5d1b5 fix: handle error if sync buffer is full 2022-12-26 20:40:33 +08:00
Shengliang Guan 668a26c1b0 enh: handle error while transfer snapshot 2022-12-26 15:03:18 +08:00
Benguang Zhao fda2f55fe5 Merge branch main to FIX/TD-21043-main 2022-12-26 14:26:25 +08:00