Commit Graph

1223 Commits

Author SHA1 Message Date
Benguang Zhao e0412d3057 fix: request snapshot from maximum of commit vers of tsdb and wal 2023-02-03 18:52:59 +08:00
Xiaoyu Wang 5d499e52f9 merge main 2023-02-03 17:13:11 +08:00
Benguang Zhao 561ee87e9d enh: change the level of sync probe logging msg to trace 2023-02-03 09:22:00 +08:00
Benguang Zhao b6b0b3439e enh: rename syncNodeOnSnapshotPre to syncNodeOnSnapshotPrep 2023-02-02 19:34:32 +08:00
Benguang Zhao 043fc8d980 enh: improve logging msgs for sync snapshot repl 2023-02-01 19:26:58 +08:00
Hongze Cheng 0f00862d8b Merge branch 'fix/TD-22070' of https://github.com/taosdata/TDengine into fix/3.0_merge_main 2023-01-30 10:17:59 +08:00
Benguang Zhao bd23a36f86 fix: round lastApplyIndex up to beginIndex -1 in syncBeginSnapshot 2023-01-29 18:03:09 +08:00
Hongze Cheng 5e7b6602c5 Merge branch 'main' of https://github.com/taosdata/TDengine into fix/3.0_merge_main 2023-01-29 14:05:15 +08:00
Xiaoyu Wang 284286cbc4
Merge pull request #19621 from taosdata/FIX/TD-21218-main
enh: remove unused old routines in sync
2023-01-29 10:56:29 +08:00
Xiaoyu Wang 24157e78d6 merge main 2023-01-28 17:52:58 +08:00
Benguang Zhao 1f01ba7cc0 fix: not keep wal log vnodeCommit'ed for single replica db 2023-01-18 16:34:08 +08:00
Benguang Zhao e55a76e25a Merge branch main into FIX/TD-21218-main 2023-01-18 10:15:16 +08:00
Benguang Zhao d611793537 enh: remove unused old routines in sync 2023-01-18 10:07:16 +08:00
Shengliang Guan e11d57d58c
Merge pull request #19533 from taosdata/FIX/TD-21662-main
enh: skip WAL forceSync for single replica vgroup
2023-01-17 14:25:04 +08:00
Shengliang Guan d476b6db13 enh: update epset on dnode info changed 2023-01-16 15:41:50 +08:00
Shengliang Guan bd531ccfb3
Merge pull request #19542 from taosdata/enh/TD-20047
refact: adjust return value of tmsgUpdateDnodeInfo
2023-01-13 10:54:10 +08:00
Shengliang Guan cd0404bc25 refact: adjust return value of tmsgUpdateDnodeInfo 2023-01-12 17:08:33 +08:00
Shengliang Guan 3973e0512d Merge remote-tracking branch 'origin/main' into fix/TD-21663-2 2023-01-12 13:29:35 +08:00
Benguang Zhao 5a4cc36079 enh: skip WAL forceSync for single replica vgroup 2023-01-12 09:25:55 +08:00
Benguang Zhao 871a585a61 enh: fsync each WAL log after appending when wal_level=2 and wal_fsync_period=0 2023-01-11 18:28:45 +08:00
Shengliang Guan cff741e4c4 fix: coverity issues 2023-01-11 16:56:14 +08:00
Benguang Zhao 639652314f Merge branch main to FIX/TD-21428-main 2023-01-09 16:17:00 +08:00
Shengliang Guan 9a9e93b6fe fix: compile error in mac 2023-01-09 12:06:20 +08:00
Shengliang Guan 2aeda3a941 enh: refact raft store file 2023-01-09 12:01:36 +08:00
Shengliang Guan 42d911bf8e Merge remote-tracking branch 'origin/main' into FIX/TD-21043-main 2023-01-08 09:44:07 +08:00
Shengliang Guan 71be00a811 fix: minor changes 2023-01-06 15:42:11 +08:00
Shengliang Guan 81dcb23cae fix: handle error while write raft config file 2023-01-06 14:26:43 +08:00
Benguang Zhao e66f19ab46 enh: vote for higher lastLogTerm despite commitIndex 2023-01-05 17:09:37 +08:00
Benguang Zhao 47ace00090 enh: refactor some sync func names for pipelining 2023-01-05 17:09:37 +08:00
Shengliang Guan 84bea778c9 Merge branch 'fix/TD-21746' into FIX/TD-21043-main 2023-01-05 16:15:50 +08:00
Shengliang Guan b8e1064b0f fix: compile error 2023-01-05 16:15:42 +08:00
Shengliang Guan a28398c060 fix: compile error 2023-01-05 16:11:01 +08:00
Shengliang Guan ef3e60c387 Merge branch 'fix/TD-21746' into FIX/TD-21043-main 2023-01-05 15:58:30 +08:00
Shengliang Guan ed56abd40f fix: crash if reader is already dropped 2023-01-05 15:55:33 +08:00
Shengliang Guan 7e5d97f0da fix: stop snapshot receiver on sync post close 2023-01-05 12:00:35 +08:00
Benguang Zhao 9d5e74a3ff Merge branch 'main' into FIX/TD-21043-main 2023-01-05 09:47:22 +08:00
Benguang Zhao 442902e5cb fix: send rpc response on closing sync or failing to enqueue 2023-01-04 19:18:46 +08:00
Shengliang Guan bf6dc99461 fix: adjust sync logs 2023-01-04 11:48:30 +08:00
Shengliang Guan 34260cd397 Merge branch 'main' into FIX/TD-21043-main 2023-01-04 09:29:07 +08:00
Shengliang Guan 70b513c09c fix: vnode set the wrong replica info after snapshot transfered 2023-01-03 19:47:04 +08:00
Benguang Zhao 4031dc1af4 Merge branch main into FIX/TD-21043-main 2023-01-02 16:41:46 +08:00
Benguang Zhao 2baa71883d enh: logging states of sync log repl mgrs and the ring buffer in syncPrintNodeLog 2023-01-02 11:13:53 +08:00
Benguang Zhao cb433c191b enh: reset as stagnation only when not matched in syncLogReplMgrRetryOnNeed 2023-01-02 08:58:13 +08:00
Shengliang Guan 574915a48b fix: compatbility issue 2022-12-30 20:10:49 +08:00
Benguang Zhao 03f4b12386 enh: print peer addr in hex format 2022-12-30 19:36:18 +08:00
Shengliang Guan 01209614e6 fix: compatiable for pre version 2022-12-30 19:04:18 +08:00
Benguang Zhao eb524e610a enh: reset sync log replication on stagnation for eight times maxRetryWaitMs 2022-12-30 19:02:46 +08:00
Shengliang Guan 469dfb9d4e fix: compile errors 2022-12-30 17:47:17 +08:00
Benguang Zhao 4718f4d1b6 fix: resend acked msgs on exceeding maximum retryWaitMs 2022-12-30 17:24:44 +08:00
Shengliang Guan 9c1f2997f1 fix: test compile error 2022-12-30 17:16:02 +08:00
Shengliang Guan c2323db00d fix: allow the ip resolved by fqdn different between dnodes 2022-12-30 17:04:14 +08:00
Benguang Zhao e8e189cbbb enh: add sync log buffer info in logging msg in syncLogReplMgrRetryOnNeed 2022-12-29 15:48:59 +08:00
Shengliang Guan b05c65cd47 refact: rename variables 2022-12-29 11:21:22 +08:00
Shengliang Guan 4b7ab0a839 refact: adjust log 2022-12-29 11:00:33 +08:00
Benguang Zhao e22ce2df87 fix: use pReply->lastSendIndex instead while updating commitIndex 2022-12-29 10:45:25 +08:00
Shengliang Guan 7e67dc032d refact: rename variables 2022-12-29 10:41:01 +08:00
Benguang Zhao d307413c36 Merge branch 'main' into FIX/TD-21043-main 2022-12-29 10:03:17 +08:00
Benguang Zhao 044e58b712 enh: adjust logging msgs for sync probe and rollback 2022-12-29 10:00:35 +08:00
Benguang Zhao 2890a8cb96 fix: return error on failing to truncate raft log 2022-12-28 20:34:40 +08:00
Benguang Zhao 0c4ade9373 fix: update sync node commitIndex only if matchTerm equals currentTerm upon heartbeat 2022-12-28 20:25:52 +08:00
Benguang Zhao 724cf98dc3 fix: be conservative on commit progress in appendEntries 2022-12-28 20:25:52 +08:00
Shengliang Guan 71a2848376 fix: double free on append log failed 2022-12-27 17:51:52 +08:00
Benguang Zhao 8916722dd7 Merge branch main to FIX/TD-21043-main 2022-12-27 14:50:39 +08:00
Shengliang Guan 09fbb8ebc4 Merge branch 'main' into FIX/TD-21535-main 2022-12-27 10:47:12 +08:00
Benguang Zhao a7bfeb5fbe fix: check existence of SMsgHead in SSyncRaftEntry data or SRpcMsg pCont 2022-12-26 23:10:46 +08:00
Shengliang Guan 794fb5d1b5 fix: handle error if sync buffer is full 2022-12-26 20:40:33 +08:00
Shengliang Guan 668a26c1b0 enh: handle error while transfer snapshot 2022-12-26 15:03:18 +08:00
Benguang Zhao fda2f55fe5 Merge branch main to FIX/TD-21043-main 2022-12-26 14:26:25 +08:00
Benguang Zhao 7227e53b98 fix: set restore finish only after reaching the current term 2022-12-26 14:22:54 +08:00
Benguang Zhao 5159d60f56 enh: vnodeCommit on consensus only 2022-12-23 20:16:32 +08:00
Shengliang Guan b59bee6696 fix: restart snapshot sender on receiver is restart 2022-12-23 11:03:50 +08:00
Shengliang Guan 773423a6b6 fix: remove some logs 2022-12-23 09:11:45 +08:00
Shengliang Guan 48b6bd438d fix: restart snapshot sender on receiver is restart 2022-12-22 17:30:02 +08:00
Benguang Zhao 738c233a22 fix: change log level to trace on missing entries in syncRespMgr 2022-12-22 14:42:55 +08:00
Shengliang Guan 6e7e3139b1 fix: heap-use-after-free while alter vnode replicas 2022-12-21 17:33:34 +08:00
Shengliang Guan 510ad2e39e fix: heap-use-after-free while transfer snapshot between vnode replicas 2022-12-21 17:15:34 +08:00
Shengliang Guan d674c8370b refact: update sync log 2022-12-20 21:30:46 +08:00
Shengliang Guan 9c8b194c34 refact: set FpSnapshotStopRead return type to void 2022-12-20 15:07:27 +08:00
Shengliang Guan 41dcd32b8e refact: adjust some logs 2022-12-20 15:01:03 +08:00
Shengliang Guan 12b6cf15a0 refact: set FpGetSnapshotInfo return type to void 2022-12-20 14:57:04 +08:00
Shengliang Guan b74e0b0715
Merge pull request #19004 from taosdata/FIX/TD-21169-main
fix: allow to rollback sync log buffer beyond startIndex with refill
2022-12-19 12:57:17 +08:00
Benguang Zhao a218108140 fix: allow to rollback sync log buffer beyond startIndex with refill 2022-12-19 11:15:03 +08:00
Shengliang Guan ead5d8edf2 fix: reduce drop dnode speed makes data more secure 2022-12-17 18:34:29 +08:00
Benguang Zhao 8af1cf15a7 enh: adjust batchSize dynamically on retryBackoff 2022-12-14 21:37:16 +08:00
Shengliang Guan 60bab9ae55 refact: post sem in vnode while sync timeout 2022-12-14 16:09:28 +08:00
Shengliang Guan 9af36669ad refact: post sem in vnode while sync timeout 2022-12-14 11:56:08 +08:00
Shengliang Guan 2b256542a5 refact: add vnode timer 2022-12-14 09:14:40 +08:00
Shengliang Guan 50b66df39f fix: control rpc qitem memory 2022-12-10 14:02:57 +08:00
Minghao Li 291750b9c3 fix(sync): snapshot problem 2022-12-08 22:34:08 +08:00
Shengliang Guan 932d7a7ac6
Merge pull request #18808 from taosdata/fix/sync
fix(sync): checkout NULL pointer
2022-12-08 17:16:12 +08:00
Minghao Li abd5c696f0 fix(sync): checkout NULL pointer 2022-12-08 15:21:41 +08:00
Shengliang Guan 1bb1025f7d enh: add tassert 2022-12-07 22:24:47 +08:00
Shengliang Guan 6d94afe48f
Revert "refact: adjust some assert cases" 2022-12-07 21:51:17 +08:00
Shengliang Guan 297ba7f7d4
Merge pull request #18775 from taosdata/fix/TD-20045
refact: adjust some assert cases
2022-12-07 21:44:34 +08:00
Shengliang Guan be227bd6f6
Merge pull request #18783 from taosdata/feature/3.0_mhli
refactor(sync): re send snapshot in timer-routine when response timeout
2022-12-07 21:26:15 +08:00
Minghao Li c29401edf2 refactor(sync): re send snapshot in timer-routine 2022-12-07 19:46:26 +08:00
Shengliang Guan 4172acf95d git lo 2022-12-07 19:39:53 +08:00
Shengliang Guan 6ef608f7af fix: complie error 2022-12-07 19:02:43 +08:00
Shengliang Guan d5126d469a refact: replcase ASSERT with tAssert 2022-12-07 18:42:48 +08:00
Shengliang Guan f69a188f7e refact: replcase ASSERT with tAssert 2022-12-07 18:37:40 +08:00