Commit Graph

1322 Commits

Author SHA1 Message Date
Benguang Zhao b0f7355d11 enh: check snap begin index against commit index on leader 2024-05-06 16:57:22 +08:00
Benguang Zhao d2f8410586 enh: propagate code of vnodeSnapRead as terrno upwards 2024-04-28 16:47:30 +08:00
Shungang Li c39fcc5194 fix: arb assigned step down need to reset token 2024-04-11 16:56:45 +08:00
Shungang Li 16e0fc44e2 fix: arb reply to set-assigned no matter what error 2024-04-08 19:56:22 +08:00
Benguang Zhao ced7c19943 enh: not to start snap replication if too many open files already 2024-03-25 17:01:23 +08:00
Shungang Li acf42a3d7a fix: arb append noop after become assigned 2024-03-21 18:13:25 +08:00
Shungang Li 4180eea091 enh: arb add more log 2024-03-21 18:13:04 +08:00
Shungang Li d0df927dfa feat: arb add version in sarbgroup 2024-03-19 09:31:05 +08:00
Shungang Li 3a656c3595 feat: support 2 replica with arbitrator 2024-03-19 09:30:35 +08:00
Benguang Zhao dd7f375d8e enh: use reference id of sync node in timer callbacks of sync 2024-02-28 19:01:22 +08:00
Alex Duan ed4a7b0719 coverage: comment no call file syncMain.c 2024-02-16 21:48:01 +08:00
Benguang Zhao 57714dff65 fix: reset sync timer although failed to enqueue since Out of Memory in rpc queue 2024-02-01 11:07:17 +08:00
Yihao Deng 663b5b4ecf sort epset 2024-01-23 09:09:29 +00:00
Yihao Deng 62e6b5ca31 sort epset 2024-01-23 06:23:34 +00:00
Yihao Deng 04538f9049 add test case 2024-01-22 08:59:40 +00:00
Yihao Deng aa14e67da9 refactor retry 2024-01-22 07:21:14 +00:00
Yihao Deng a20845ec69 refactor retry 2024-01-22 01:04:06 +00:00
Yihao Deng 6c732a14a3 refactor retry 2024-01-19 06:20:16 +00:00
Benguang Zhao 84810185c7 fix: skip acked msg in snapshotReSend 2024-01-18 11:16:18 +08:00
Haojun Liao 3d98fc6a67 other: merge 3.0 2024-01-16 18:29:33 +08:00
Haojun Liao 9a4b7a6d82 fix(stream): remove invalid lock, and fix a typo. 2024-01-16 14:52:27 +08:00
Benguang Zhao 485bad1ebd refact: use config syncSnapReplMaxWaitN instead 2024-01-10 11:31:00 +08:00
Benguang Zhao 7979d4532b enh: let max num of concurrent msgs of snap replication be configurable 2024-01-09 16:49:27 +08:00
Benguang Zhao a811a60ad4 enh: restore sync log store from snap on fsm state incomplete 2024-01-04 20:15:17 +08:00
Benguang Zhao baa7f9c895 enh: adjust error msg as warn for not ready to propose etc 2023-12-28 17:29:49 +08:00
Benguang Zhao d83f85bf26 enh: send rsp msg on rejecting snap replication due to smaller term 2023-12-28 17:26:46 +08:00
Benguang Zhao 0e6ea7af71 enh: check snapshot begin index for unexpected change in syncNodeOnSnapshotBegin 2023-12-26 10:54:40 +08:00
Benguang Zhao 7b967ffdc6 enh: retry on fsm commit when rpc out of memory in syncFsmExecute 2023-12-25 20:34:38 +08:00
wade zhang 40994c3fbd
Merge pull request #24174 from taosdata/FIX/TD-28001-3.0
enh: protect syncNodeRestore with log buffer mutex
2023-12-25 10:08:43 +08:00
Benguang Zhao 4137a44fd0 enh: protect syncNodeRestore with log buffer mutex 2023-12-21 17:49:20 +08:00
Benguang Zhao 4c13dee721 enh: protect processing of snap preparation rsp with sender buf mutex 2023-12-19 12:49:48 +08:00
Benguang Zhao 41ef6075e2 enh: check result of FpGetSnapshotInfo for exchange snap info 2023-12-13 18:38:47 +08:00
Benguang Zhao 926c28f62f enh: clear info data of snap sender and receiver at stop 2023-12-13 18:38:44 +08:00
Benguang Zhao 0a7ef098ba enh: reduce wait time to start a new snap replication 2023-12-13 14:01:52 +08:00
Benguang Zhao 6eb64fcd9b fix: set start of snap replication incremental properly 2023-12-13 13:48:45 +08:00
Benguang Zhao c74c4fe208 enh: clean WAL logs based on size if one follower is offline. 2023-12-13 10:10:02 +08:00
Benguang Zhao af8a5c0ada enh: protect stop of snap sender and receiver with the mutex of its buffer 2023-12-12 19:22:34 +08:00
Benguang Zhao c5cde7ffe8 enh: resend new snap replication msg on all acked if not finished yet 2023-12-12 18:35:11 +08:00
Benguang Zhao 1255b46469 fix: destroy dataReaderArr properly in tsdbSnapRAWReaderClose 2023-12-07 15:29:42 +08:00
Benguang Zhao 081c83710e enh: save a copy of snapshot info in syncNodeOnSnapshotPrepRsp 2023-12-07 15:29:37 +08:00
Benguang Zhao 030f3db4d6 refact: improve code of syncNodeOnSnapshotBegin with syncSnapSendRsp 2023-12-07 15:28:14 +08:00
Benguang Zhao 41fe39de3e refact: improve code with syncNodeExchangeSnapInfo 2023-12-07 15:28:14 +08:00
Benguang Zhao d4add073cc refact: improve code with syncSnapSendRsp 2023-12-07 15:28:14 +08:00
Benguang Zhao 1a9b08fa08 refact: relocate func syncSnapInfoDataRealloc 2023-12-07 15:28:14 +08:00
facetosea 845493294d osfile 2023-11-21 16:31:31 +08:00
Benguang Zhao 8f1e3197b2 enh: print lastApplyTerm of snap sender in format of int64 2023-11-06 17:31:31 +08:00
Benguang Zhao 2cf6b3c1e4 fix: release duplicate msgs in syncSnapBufferRecv 2023-11-03 14:01:39 +08:00
Benguang Zhao 456c8d23f3 fix: set cursor properly in syncSnapBufferRecv 2023-11-03 10:09:07 +08:00
Benguang Zhao ce4fb52926 enh: resend end msg on timeout in snapshotReSend 2023-11-02 18:56:00 +08:00
Benguang Zhao 995a1e1f8e enh: send rsp on duplicate msgs in syncSnapBufferRecv 2023-11-02 18:41:25 +08:00
Benguang Zhao 3221aef1a3 refact: improve code with syncSnapSendMsg 2023-11-02 18:41:25 +08:00
Benguang Zhao 7852b2cecf fix: set ack of response properly in syncSnapSendRsp 2023-11-02 18:41:25 +08:00
Benguang Zhao 70e261f662 enh: terminate snap replication on timeout 2023-10-30 10:14:26 +08:00
Benguang Zhao c3f9cae36b refact: improve code of syncNodeOnSnapshot 2023-10-27 18:55:30 +08:00
Benguang Zhao 4163a3be7c feat: resend snap replication of data on timeout 2023-10-27 17:58:26 +08:00
Benguang Zhao fe553352b8 enh: cache snap blocks sent in snapshotSend for resending 2023-10-25 20:26:11 +08:00
Benguang Zhao ec5b1f2ec1 enh: logging buf info for snapshot reader and sender 2023-10-25 15:04:14 +08:00
Benguang Zhao 7d9d1c6877 enh: terminate snap replication on timeout 2023-10-25 14:50:53 +08:00
Benguang Zhao 4e3a8b893d enh: restore wal log from snapshot after finish 2023-10-24 20:03:48 +08:00
Benguang Zhao 374217ceff fixup: adjust a logging msg in syncNodeStartSnapshot 2023-10-24 19:29:09 +08:00
Benguang Zhao 95188ab8c3 enh: adjust some logging msgs for sync log replication mgr 2023-10-24 19:11:27 +08:00
Benguang Zhao 4d61e87c0f enh: add signature info in logging msgs of snap replication 2023-10-24 17:28:46 +08:00
Benguang Zhao 811f1bbbea enh: tidy up logging msg in syncNodeOnSnapshotRsp 2023-10-24 15:47:47 +08:00
Benguang Zhao 1c60e67a83 enh: send the END snap msg at last 2023-10-24 14:16:46 +08:00
Benguang Zhao f444cd7a6d enh: log signature of snap sender/receiver while started or stopped 2023-10-24 11:11:11 +08:00
Benguang Zhao e34da43e38 feat: support pipelining of snap replication 2023-10-23 19:32:44 +08:00
Benguang Zhao a2e0480839 refact: rename as SYNC_FSM_STATE_COMPLETE 2023-10-19 11:18:57 +08:00
Benguang Zhao d671283b8b refact: adjust logging msg for incomplete fsm state 2023-10-19 11:18:57 +08:00
Benguang Zhao 9643799dc5 fixup: compiler error at labels since allowed only at statements 2023-10-19 11:04:39 +08:00
Benguang Zhao 233a3c4034 enh: terminate on incompletenss of fsm state for dbs of single replica 2023-10-19 11:04:39 +08:00
Benguang Zhao 810678ebcb enh: tidy up debugging msgs of snapshot replication 2023-10-19 11:04:39 +08:00
Benguang Zhao c89c69f951 enh: use waitTime to prevent from starting snapshot too frequently 2023-10-19 11:04:39 +08:00
Benguang Zhao be6411ebbe fixup: set lastSendTime with taosGetTimestampMs 2023-10-19 11:04:39 +08:00
Benguang Zhao a53ba24118 fix: set startTime in snapshotReSend 2023-10-19 11:04:39 +08:00
Benguang Zhao e901adfdf3 enh: check snapshot receiver and sender by signature 2023-10-19 11:04:39 +08:00
Benguang Zhao eb4e2aa58f feat: restore incomplete fsm state with maxVerValid via snapshot replication 2023-10-19 11:04:36 +08:00
Benguang Zhao e1c03118ab enh: extract snapshot info for both of snap reader and writer 2023-10-19 10:51:13 +08:00
Benguang Zhao 410ced8320 feat: use TLV format to encode data of snapshot info 2023-10-19 10:51:13 +08:00
Benguang Zhao 517f1f7e40 fixup: fix syncNodeOnSnapshotPrep 2023-10-19 10:37:34 +08:00
Benguang Zhao 083dd148be feat: exchange difference of snapshot info for replication 2023-10-19 10:37:34 +08:00
Benguang Zhao 4ca897246c enh: proceed sync log buffer on failure of appending too 2023-10-17 14:56:07 +08:00
Benguang Zhao be3ba000a1 enh: reserve half a buffer size at syncLogBufferInit 2023-10-07 14:17:46 +08:00
Haojun Liao 372747cc23
Merge pull request #22818 from taosdata/fix/3_liaohj
fix(stream): fix error in fill history and check quit status of vnode.
2023-09-10 20:47:06 +08:00
Haojun Liao aa8909b267 other: add some logs. 2023-09-09 15:18:54 +08:00
xsren e5302b1677 stack overflow 2023-09-07 11:00:52 +08:00
dapan1121 cc17848b78 fix: merge 3.0 to main 2023-09-01 13:24:47 +08:00
dm chen e393a98ee9
Merge branch '3.0' into feat/TD-22970 2023-08-18 13:37:18 +08:00
Benguang Zhao 7735e6f388 Merge branch 3.0 to FEAT/TD-25699-3.0 2023-08-17 16:04:23 +08:00
dmchen fee4b875d1 error code 2023-08-16 17:49:17 +08:00
dm chen e020c4e8c5
Merge pull request #22456 from taosdata/3.0
merge 3.0 to feat/TD-22970
2023-08-16 16:49:43 +08:00
dmchen de5aedd8f3 vnode.json 2023-08-16 10:20:48 +08:00
Haojun Liao ad9f3cbc43 other: merge main. 2023-08-16 09:14:10 +08:00
Benguang Zhao 239a79d405 enh: add some vnode info in SStatusReq 2023-08-15 17:06:33 +08:00
Minglei Jin fac7e521e9 s3/evict: fetch atime from stat file 2023-08-07 15:59:37 +08:00
dm chen 5b03ab1705
Merge branch '3.0' into feat/TD-22970 2023-08-03 17:43:51 +08:00
dmchen 5d4f0cbc71 myindex 2023-08-02 16:36:07 +08:00
dmchen 8a0e9ff0e0 fix/retry_resolve_fqdn 2023-08-01 14:24:28 +08:00
wade zhang cc3cc73cfc
Merge pull request #22199 from taosdata/fix/TS-3708
fix/TS-3708: check term for role time
2023-07-27 15:43:23 +08:00
Shungang Li 167ecea705 fix: check term for role time
1. time of mnode becomes current role in this term
2. show 0 for offline mnodes
2023-07-27 14:16:54 +08:00
Benguang Zhao f5fced5ab9 fix: not to walEndSnapshot in syncNodeTimerRoutine 2023-07-26 20:06:51 +08:00