Commit Graph

297 Commits

Author SHA1 Message Date
Benguang Zhao 28efd7dcd7 enh: check trans conflicts in mndTransValidate 2023-05-31 10:53:36 +08:00
Haojun Liao de44c9160c refactor: do some internal refactor. 2023-05-20 18:05:39 +08:00
Haojun Liao 7ef16e1922 other: merge main. 2023-05-12 11:49:53 +08:00
Haojun Liao 05d416f3b9 fix(stream): fix invalid access when handling error, not start stream if tsDisablestream is set. 2023-04-28 23:53:53 +08:00
Haojun Liao 057cc2d30d
Merge pull request #21018 from taosdata/feature/3_liaohj
fix(stream): set the correct start offset for stream task.
2023-04-24 12:02:20 +08:00
dm chen d594e4963f
Merge branch '3.0' into feat/learner 2023-04-20 19:11:06 +08:00
Benguang Zhao a21e0fe75e enh: propose vnode commit synchronously 2023-04-20 14:28:56 +08:00
cadem 3b78d4382b add learner 2023-04-18 19:03:45 +08:00
Haojun Liao 1350af5267 fix(stream): set the correct initial checkpoint version to restore the operators state and add check for the initial destination tables. 2023-04-16 22:48:22 +08:00
Haojun Liao 1cd2268a99 Merge branch 'main' into feature/3_liaohj 2023-04-14 18:30:55 +08:00
Haojun Liao 70b45a4cf0 fix(stream): all data should be extracted from wal. 2023-04-13 23:22:09 +08:00
Benguang Zhao d8386754ee enh: try to propose vnode commit at vnode closing 2023-04-13 19:45:24 +08:00
Haojun Liao 7419c0bfe9 enh(stream): the stream will start after vnode restore being completed. 2023-04-10 16:56:14 +08:00
Benguang Zhao cc76d78673 enh: separate sync read and write events 2023-03-14 20:35:39 +08:00
Benguang Zhao d679eaf648 enh: update pMnode->applied only when pMsg->code as zero 2023-03-10 18:10:34 +08:00
Benguang Zhao 96e70c2795 enh: update logging msg in vnodeRestoreFinish 2023-03-09 20:05:19 +08:00
Benguang Zhao 5e53b1225b enh: finish restore with commit and applied indexes instead of num of items in apply queue 2023-03-09 19:35:42 +08:00
Benguang Zhao 1392711e66 enh: add fsm FpAppliedIndexCb to get the current applied index 2023-03-09 18:14:04 +08:00
Benguang Zhao 9d10739908 enh: send rsp of negotiation failure ahead of apply queue 2023-03-09 16:18:44 +08:00
wangmm0220 e54e12eff0 fix:give error if col is same in schemless & fix json parse error in TD-22903 2023-03-04 11:57:27 +08:00
Shengliang Guan 3b475d4c0d fix: adjust some log while split 2023-02-03 14:40:19 +08:00
Shengliang Guan ef3e60c387 Merge branch 'fix/TD-21746' into FIX/TD-21043-main 2023-01-05 15:58:30 +08:00
Shengliang Guan 7e5d97f0da fix: stop snapshot receiver on sync post close 2023-01-05 12:00:35 +08:00
Benguang Zhao 4031dc1af4 Merge branch main into FIX/TD-21043-main 2023-01-02 16:41:46 +08:00
Shengliang Guan c2323db00d fix: allow the ip resolved by fqdn different between dnodes 2022-12-30 17:04:14 +08:00
Benguang Zhao 92e05b8ece enh: schedule vnodeCommit uniformly distributed 2022-12-27 16:28:44 +08:00
Benguang Zhao 8916722dd7 Merge branch main to FIX/TD-21043-main 2022-12-27 14:50:39 +08:00
Shengliang Guan 794fb5d1b5 fix: handle error if sync buffer is full 2022-12-26 20:40:33 +08:00
Benguang Zhao fda2f55fe5 Merge branch main to FIX/TD-21043-main 2022-12-26 14:26:25 +08:00
Benguang Zhao 5159d60f56 enh: vnodeCommit on consensus only 2022-12-23 20:16:32 +08:00
Shengliang Guan 48b6bd438d fix: restart snapshot sender on receiver is restart 2022-12-22 17:30:02 +08:00
Shengliang Guan 9c8b194c34 refact: set FpSnapshotStopRead return type to void 2022-12-20 15:07:27 +08:00
Shengliang Guan 12b6cf15a0 refact: set FpGetSnapshotInfo return type to void 2022-12-20 14:57:04 +08:00
Shengliang Guan 4db6b043c6 fix: reduce the frequency of retry in sync not ready case while alter db 2022-12-14 19:01:31 +08:00
Shengliang Guan 60bab9ae55 refact: post sem in vnode while sync timeout 2022-12-14 16:09:28 +08:00
Shengliang Guan 2b256542a5 refact: add vnode timer 2022-12-14 09:14:40 +08:00
Shengliang Guan b89877b4c1 refact: add vnode timer 2022-12-13 13:41:06 +08:00
Shengliang Guan 6d94afe48f
Revert "refact: adjust some assert cases" 2022-12-07 21:51:17 +08:00
Shengliang Guan d5126d469a refact: replcase ASSERT with tAssert 2022-12-07 18:42:48 +08:00
Minghao Li a1ed4b334c fix(sync): close snapshot receiver in pre-close 2022-12-05 18:50:19 +08:00
Benguang Zhao a7807d3ee4 fix: synchronize syncPropose for executing blocking msgs in vnodeProposeMsg 2022-12-03 20:53:56 +08:00
Benguang Zhao 7eca212756 Merge branch '3.0' into FIX/TD-19334-3.0 2022-12-03 10:02:59 +08:00
Benguang Zhao 2ce07c6ec1 fix: get result of tmsPutToQueue for FpCommitCb 2022-12-03 09:05:50 +08:00
Shengliang Guan f3e980de14 enh: remove TSDB_CODE_RPC_REDIRECT 2022-12-02 22:45:11 +08:00
Shengliang Guan 524de026a5 enh: remove TSDB_CODE_RPC_REDIRECT 2022-12-02 22:24:35 +08:00
Shengliang Guan 61cd753947 enh: remove sync batch propose in vnode 2022-12-02 18:59:03 +08:00
Shengliang Guan 13f36ec20a refact: remove TSDB_CODE_APP_NOT_READY and TSDB_CODE_NODE_NOT_DEPLOYED 2022-12-02 16:06:10 +08:00
Shengliang Guan 806658545a
Merge pull request #18449 from taosdata/FIX/TD-19334-3.0
feat: implement pipelining of sync
2022-12-01 16:40:07 +08:00
Minghao Li 86d5cba6be refactor(sync): delete code wait snapshot end in pre-close 2022-12-01 13:34:33 +08:00
Benguang Zhao 55bae49d56 Merge branch 3.0 to FIX/TD-19334-3.0 2022-11-30 23:47:30 +08:00
Shengliang Guan 3850b58a3d fix: cannot close vnode while transferring snapshot 2022-11-30 11:08:30 +08:00
Shengliang Guan 82bc543ed7 fix: cannot close mnode while transferring snapshot 2022-11-30 11:05:25 +08:00
Shengliang Guan b6d3d2322c fix: cannot close vnode while transferring snapshot 2022-11-30 11:02:07 +08:00
yihaoDeng d463f05b3f change paramter 2022-11-29 10:28:32 +08:00
Benguang Zhao 4edef438ea enh: transfer ownership of msgs while committing sync log entries 2022-11-26 21:57:23 +08:00
Benguang Zhao 68f8ebac9d Merge branch 3.0 to FIX/TD-19334-3.0 2022-11-25 13:10:06 +08:00
Minghao Li 9f38bfeb2c refactor(sync): modify info log to trace log 2022-11-24 16:50:58 +08:00
Minghao Li 7fba711d40 refactor(sync): add info log 2022-11-24 16:03:43 +08:00
Minghao Li e43794c366 fix(sync): if msg commit, put it into apply-queue, do not care return code 2022-11-24 15:51:48 +08:00
Minghao Li e7e17302a4 enh(sync): use TSDB_CODE_SYN_NOT_LEADER instead of TSDB_CODE_RPC_REDIRECT 2022-11-21 15:35:36 +08:00
Benguang Zhao b90ee79623 fix: use syncLogBufferCommit in syncNodeOnLocalCmd 2022-11-21 13:51:01 +08:00
Benguang Zhao 363cbc8985 fix: update cbMeta rsp handle info in syncLogFsmExecute 2022-11-18 09:37:58 +08:00
Benguang Zhao da469149db enh: debug to info 2022-11-17 20:28:18 +08:00
Benguang Zhao 051b73c1ed Merge branch 3.0 to FIX/TD-19334-3.0 2022-11-17 17:28:11 +08:00
Benguang Zhao 6062632722 enh: turn commit-cb logging msg to debug level in vnodeSyncCommitMsg 2022-11-16 19:53:22 +08:00
Minghao Li d672e7a05c refactor(sync): add FpApplyQueueItems in fsm 2022-11-09 16:18:28 +08:00
Minghao Li b6aea6ae17 fix(sync): when apply queue not empty, can not read 2022-11-07 16:40:53 +08:00
Benguang Zhao 5878c9a31a fix: impl ring log buffer 2022-11-07 14:27:22 +08:00
Shengliang Guan 2e6f75107d enh: adjust the number of vnode threads so that one vnode has one write thread 2022-11-04 17:38:35 +08:00
Shengliang Guan fc41f43c9d fix: deadlock while drop db 2022-11-04 16:15:37 +08:00
Shengliang Guan a0983cf8c1 enh: adjust tqueue and tworker log 2022-11-04 10:58:23 +08:00
Shengliang Guan 7a537bba09 refact: adjust sync.h and syncState 2022-11-02 10:24:55 +08:00
Shengliang Guan 64633e3dbb enh: refact syncMsg code 2022-11-01 18:34:09 +08:00
Shengliang Guan ee63b49800 Merge remote-tracking branch 'origin/3.0' into fix/TD-20052 2022-11-01 17:11:27 +08:00
Shengliang Guan a71dbd83d2
Merge pull request #17803 from taosdata/fix/TD-20052
enh: refact syncMsg code
2022-11-01 16:45:56 +08:00
Shengliang Guan d35028ae4a enh: refact sync callback func 2022-11-01 16:10:07 +08:00
Shengliang Guan f4dc7d0766 enh: refact sync callback func 2022-11-01 15:35:10 +08:00
Shengliang Guan e79e50ae36 enh: refact syncMsg code 2022-11-01 13:58:25 +08:00
Shengliang Guan 1724aa5638
Merge pull request #17779 from taosdata/fix/sync
refactor(sync): check msgcb, putToQueueFp NULL
2022-11-01 10:43:56 +08:00
Shengliang Guan 392564cc7d enh: refact syncEnv code 2022-10-31 23:40:43 +08:00
Shengliang Guan 1c446b1bf4 Merge branch '3.0' into fix/sync 2022-10-31 23:30:24 +08:00
Minghao Li d246514da2 refactor(sync): check msgcb, putToQueueFp NULL 2022-10-31 18:16:58 +08:00
Minghao Li 0b20b914bb refactor(sync): add sync local cmd 2022-10-31 14:17:26 +08:00
Minghao Li 7cb3112d77 refactor(sync): modify function name 2022-10-27 15:52:48 +08:00
Shengliang Guan ec786b9d78 fix: alter replica one by one 2022-10-24 11:57:26 +08:00
Shengliang Guan 71ac720ac0 fix: compile error in mac 2022-10-22 08:47:09 +08:00
Shengliang Guan 922436e7d4 fix: lock mem items of tqueue 2022-10-21 19:12:03 +08:00
Minghao Li cc7a393978 refactor(sync): refactor sync 2022-10-20 19:42:22 +08:00
Shengliang Guan 4d318b32da refact: alter db replica 2022-10-20 16:47:03 +08:00
Minghao Li 5965629b2e refactor(sync): refacotr sync 2022-10-20 16:05:14 +08:00
Benguang Zhao 2aa7afe7fa Merge branch '3.0' into FIX/TD-19593-3.0 2022-10-19 16:31:13 +08:00
Minghao Li 28a5a9d7e1 refactor(sync): add log, update quorum first when reconfig 2022-10-19 10:57:50 +08:00
Minghao Li 4c9f10b6f3 refactor(sync): add sync ctrl queue in vnode 2022-10-18 19:12:34 +08:00
Minghao Li e810f2ad64 refactor(sync): delete old code, ok 2022-10-18 13:53:03 +08:00
Minghao Li 8a6eaed6f6 refactor(sync): delete some code 2022-10-17 17:36:51 +08:00
Minghao Li fa30b94c67 refactor(sync): append entries 2022-10-16 12:07:02 +08:00
Minghao Li 4d123c4da6 refactor(sync): add interface in sync 2022-10-14 11:18:48 +08:00
Minghao Li 733440b352 refactor(sync): add double queues in vnode 2022-10-13 14:37:18 +08:00
Hongze Cheng 6ed0634fb7 format more code 2022-10-13 11:56:16 +08:00
Minghao Li 3416ee66d8 fix(sync): enqueue timer msg 2022-10-12 15:35:15 +08:00