Commit Graph

240 Commits

Author SHA1 Message Date
Shengliang Guan 4223be379a fix: do not process query and fetch msg until vnode restore finished 2022-09-29 14:15:26 +08:00
Shengliang Guan ee484470f3 fix: do not process query and fetch msg until vnode restore finished 2022-09-29 14:13:44 +08:00
Shengliang Guan 1e5dc921e0 fix: set wal apply version on vnode reopen 2022-09-26 20:32:02 +08:00
Minghao Li dfed091937 fix(sync): wait until apply queue is empty when restore 2022-09-20 18:50:23 +08:00
Minghao Li 22c6d82ded refactor(sync): add syncIsReadyForRead 2022-08-15 14:45:52 +08:00
Minghao Li 6cff4dcfd8 refactor(sync): add syncIsReadyForRead 2022-08-15 14:42:40 +08:00
Liu Jicong b9c9ea5974
Merge pull request #16103 from taosdata/feature/stream
refactor(stream): remove unneccessary param in converting data
2022-08-15 13:26:46 +08:00
Liu Jicong 6f75e03a55 refactor(stream): remove unneccessary param in converting data 2022-08-15 11:06:53 +08:00
Shengliang Guan 65fa1e0164 fix: deadlock of mnode if its state changed 2022-08-12 19:20:31 +08:00
Shengliang Guan 2c28cdcbb5 fix: deadlock of mnode if its state changed 2022-08-12 18:49:41 +08:00
Shengliang Guan 353109cd53 fix: deadlock of vnode if its state changed 2022-08-12 17:25:08 +08:00
Shengliang Guan 4f90578270 fix: deadlock of vnode if its state changed 2022-08-12 16:32:11 +08:00
Minghao Li b4c8685766 refactor(sync): add leader, follower call back 2022-08-10 17:17:30 +08:00
Li Minghao 7722f88093
Merge pull request #15861 from taosdata/feature/3.0_mhli
refactor(sync): speed up replicate
2022-08-08 20:36:49 +08:00
Liu Jicong 87c1656f52
Merge pull request #15859 from taosdata/feature/stream
fix(stream): memory leak
2022-08-08 19:55:13 +08:00
Minghao Li df18cc5f47 refactor(sync): speed up replicate 2022-08-08 19:46:37 +08:00
Liu Jicong 48449e80c3 fix(stream): memory leak 2022-08-08 19:17:28 +08:00
Liu Jicong e30b74ad5a fix(stream): memory leak 2022-08-08 18:53:49 +08:00
Minghao Li 0f63837e69 refactor(sync): make leader life longer 2022-08-08 13:25:02 +08:00
Minghao Li e628b70726 refactor(sync): make leader life longer 2022-08-06 13:17:08 +08:00
Minghao Li 32830ca9c0 refactor(sync): make leader life longer 2022-08-04 20:44:10 +08:00
Minghao Li 9be864a6be refactor(sync): make leader life longer 2022-08-04 20:36:12 +08:00
Shengliang Guan 72b8e0eb20 refactor: adjust logs 2022-08-03 19:17:42 +08:00
Shengliang Guan f7e8341457 fix: adjust logs 2022-08-03 10:56:37 +08:00
Shengliang Guan d5ff7c3207 fix: remove redundant syncNodeReplicate calls 2022-08-02 21:02:26 +08:00
Shengliang Guan efb0127fbf refactor: adjust logs 2022-08-02 16:48:49 +08:00
Shengliang Guan d5aea7dac2 refactor: adjust sync log 2022-08-02 16:39:12 +08:00
Li Minghao b0746d9a0b
Merge pull request #15660 from taosdata/feature/3.0_mhli
feat(sync): set batch-size 1
2022-08-02 09:57:55 +08:00
Minghao Li 2c1846214d feat(sync): set batch-size 1 2022-08-01 20:26:45 +08:00
Shengliang Guan 2b2e1c79c9 fix: write snapshot after apply queue is empty 2022-08-01 19:40:38 +08:00
Minghao Li 5ad0ac9500 refactor(sync): add propose batch 2022-07-28 20:24:31 +08:00
Minghao Li df26c5f21a refactor(sync): add trace log 2022-07-28 10:54:11 +08:00
Minghao Li a93c346f24 refactor(sync): add trace log 2022-07-28 10:49:36 +08:00
Minghao Li d1068ceaf5 refactor(sync): add trace log 2022-07-27 19:37:32 +08:00
Minghao Li 9a540919b9 refactor(sync): pre-commit integration 2022-07-26 17:23:26 +08:00
Minghao Li 0addf09996 refactor(sync): add pre-commit interface 2022-07-26 11:24:39 +08:00
Shengliang Guan bc9a553db0 fix: the message cannot be processed until the vnode recovery is complete 2022-07-25 19:08:08 +08:00
Shengliang Guan 3bceeef439 enh: add batch processing method to vnode 2022-07-25 17:16:26 +08:00
Shengliang Guan 8dacdd57c5 enh: add batch processing method to vnode 2022-07-25 17:10:04 +08:00
Shengliang Guan 993f5fe9ec fix: let certain type of write messages to be executed sequentially 2022-07-18 18:37:58 +08:00
Minghao Li 604e5b750c refactor(sync): add index/term in vnodeSnapWriterClose 2022-07-16 18:19:54 +08:00
Minghao Li fdf7930702 refactor(sync): add index/term in snapshot write 2022-07-16 18:09:36 +08:00
Minghao Li b86ec034db refactor(sync): modify elect/heartbeat timer 2022-07-15 18:05:51 +08:00
Minghao Li 5b6c7bc38d refactor(sync): add leader transfer callback 2022-07-15 14:26:18 +08:00
Minghao Li 473e134f31 refactor(sync): add resp ttl clean 2022-07-12 16:57:19 +08:00
Minghao Li 96f9274fef refactor(sync): add timer routines 2022-07-12 15:04:32 +08:00
Minghao Li 9e4c4c50a0 refactor(sync): update to SYNC_STRATEGY_WAL_FIRST 2022-07-10 19:10:06 +08:00
Minghao Li ee3ceccb0a fix(sync): vnode snapshot sender 2022-07-10 16:05:21 +08:00
Minghao Li 0521bd5afe refactor(sync): add vnodeSnapWriterClose IsApply 2022-07-10 14:28:46 +08:00
Minghao Li 32c3cecf2a refactor(sync): add snapshot writer 2022-07-10 11:33:28 +08:00
Hongze Cheng 668ca4a4fb Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/tsdb_snapshot 2022-07-10 01:51:45 +00:00
Hongze Cheng 0840affc32 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/tsdb_snapshot 2022-07-08 12:33:12 +00:00
Shengliang Guan e4a855e591 Merge remote-tracking branch 'origin/3.0' into fix/valgrind 2022-07-08 19:54:26 +08:00
Li Minghao 94cc3af08f
Merge pull request #14686 from taosdata/feature/3.0_mhli
refactor(sync): add fake syncRestoreFromSnapshot
2022-07-08 19:46:51 +08:00
Shengliang Guan a5e8ddbc56 refactor: adjust logs 2022-07-08 18:00:19 +08:00
Minghao Li 56e65d13d1 refactor(sync): add fake syncRestoreFromSnapshot 2022-07-08 17:37:25 +08:00
Hongze Cheng fdf6d22d1b Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/tsdb_snapshot 2022-07-07 01:17:00 +00:00
Shengliang Guan c1667cdd84
Merge pull request #14600 from taosdata/fix/dnode
refactor: redirect vnode msg
2022-07-06 21:01:57 +08:00
dapan1121 82dbf54719 Merge branch 'fix/dnode' of github.com:taosdata/TDengine into fix/dnode 2022-07-06 20:34:07 +08:00
dapan1121 a3bf5b96c4 fix: fix query redirect issue 2022-07-06 20:33:23 +08:00
Hongze Cheng bf0b37390d Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/tsdb_snapshot 2022-07-06 12:24:27 +00:00
Shengliang Guan 0163ec4d4b Merge remote-tracking branch 'origin/3.0' into fix/dnode 2022-07-06 18:53:26 +08:00
Minghao Li 0e12b29ca9 refactor(sync): add propose batch in no snapshot strategy 2022-07-06 17:51:12 +08:00
Hongze Cheng 0901640ba2 make snapshot compile 2022-07-06 09:46:14 +00:00
Minghao Li b73914fb0d refactor(sync): add term in rpcMsg 2022-07-06 16:52:39 +08:00
Minghao Li fcb2197200 refactor(sync): add vnodeSnapshotStopRead into callback 2022-07-06 16:27:58 +08:00
Shengliang Guan 5e18e07a35 refactor: pre process vnode msg 2022-07-06 16:06:55 +08:00
Minghao Li cc9888837e refactor(sync): add vnodeSnapshotStopRead into callback 2022-07-06 16:05:57 +08:00
Minghao Li 432e1a39b7 refactor(sync): add vnodeSnapshotStopRead into callback 2022-07-06 15:47:24 +08:00
Shengliang Guan efeef24f1c refactor: adjust vnode propose msg 2022-07-05 21:43:55 +08:00
Shengliang Guan 3087208dc9 refactor: adjust vnode propose msg 2022-07-05 21:22:34 +08:00
Shengliang Guan 64b540bef5 refactor: adjust vnode propose msg 2022-07-05 20:04:17 +08:00
Minghao Li 6e59c13cbd refactor(sync): add sync strategy 2022-07-04 15:57:28 +08:00
Minghao Li 0c1a46c26e refactor(sync): add sync strategy 2022-07-04 15:29:55 +08:00
Minghao Li ded4616074 refactor(sync): add sync strategy 2022-07-04 14:55:26 +08:00
Minghao Li a5d3b7033a refactor(sync): add snapshot writer param 2022-07-04 14:18:06 +08:00
Minghao Li 0ffc6c46f3 refactor(sync): add snapshot2 interface 2022-07-01 14:47:12 +08:00
dapan1121 c28c77a099 Merge branch '3.0' into feature/queryredirect 2022-06-30 14:35:15 +08:00
yihaoDeng e389dcedc8 add query epset 2022-06-30 10:30:36 +08:00
dapan1121 f579cc4c15 Merge branch '3.0' into enh/stopquery 2022-06-29 08:57:35 +08:00
Shengliang Guan c0183e1fa8 fix: duplicate response while set standby in vnode 2022-06-28 15:50:47 +08:00
Minghao Li 33d1440e7b refactor(sync): adjust trace log 2022-06-28 14:23:45 +08:00
Minghao Li 6eecbcd1a6 refactor(sync): optimized one replica 2022-06-26 01:16:11 +08:00
Minghao Li a6f33ba01c refactor(sync): optimized one replica 2022-06-25 20:31:42 +08:00
Minghao Li 87defc2790 refactor(sync): add interface: get retry epset 2022-06-24 14:26:31 +08:00
Shengliang Guan 714c599fd7 fix: deadlock while set standby 2022-06-21 11:40:27 +08:00
Minghao Li e441bd266b refactor(sync): add changing state 2022-06-20 17:48:56 +08:00
Minghao Li 5968c6353f refactor(sync): get snapshot and create reader 2022-06-20 10:58:59 +08:00
Yihao Deng 2941254a2b
Merge branch '3.0' into enh/trace1 2022-06-18 18:26:26 +08:00
yihaoDeng 974f56cdf1 add trace base func 2022-06-18 18:12:31 +08:00
Shengliang Guan 94071f4cc7 refactor: add more logs 2022-06-17 16:52:25 +08:00
Shengliang Guan 43f8f34b0f refactor: adjust logs 2022-06-17 14:24:17 +08:00
Shengliang Guan 62f21b528e refactor: remove duplicate conninfo in SRpcMsg 2022-06-17 10:52:45 +08:00
Shengliang Guan 80e0b830fe refactor: remove duplicate conninfo in SRpcMsg 2022-06-17 10:40:42 +08:00
Shengliang Guan 7aa087a48d feat: redistribute vgroup 2022-06-16 15:25:04 +08:00
Shengliang Guan fdee8a0cb3 feat: redistribute vgroup 2022-06-16 09:55:03 +08:00
Shengliang Guan b0f048a3f2 feat: redistribute vgroup 2022-06-15 20:57:55 +08:00
Minghao Li 4b18bd718e refactor(sync): adjust errno 2022-06-15 16:14:17 +08:00
Shengliang Guan 548397db16 feat: redistribute vgroup 2022-06-14 20:58:59 +08:00
Shengliang Guan f917bd3a61 feat: redistribute vgroup 2022-06-14 20:40:27 +08:00
Minghao Li e4897e5f46 enh(sync): add leader transfer 2022-06-13 15:52:43 +08:00
Shengliang Guan 95e4b79091 feat: redistribute vgroup 2022-06-13 11:55:38 +08:00
Minghao Li aad288ab17 refactor(sync): add debug log 2022-06-12 15:21:56 +08:00
Li Minghao 797cde53d2
Merge pull request #13692 from taosdata/feature/3.0_mhli
refactor(sync): add rpcMsg to reconfig callback
2022-06-10 18:22:00 +08:00
Minghao Li 972fee7fbc refactor(sync): add rpcMsg to reconfig callback 2022-06-10 17:39:30 +08:00
Shengliang Guan f30d9a034e feat: redistribute vgroup to dnodes 2022-06-10 15:39:11 +08:00
Shengliang Guan 4da408afe6 enh: call walEndSnapshot while sdb writefile 2022-06-09 17:44:39 +08:00
Shengliang Guan 65f65b53b3 Merge remote-tracking branch 'origin/3.0' into feature/sync-refactor 2022-06-09 13:49:43 +08:00
Shengliang Guan bc8e6b7fd7 refactor: adjust vnode sync 2022-06-08 21:17:17 +08:00
Shengliang Guan ae9e11bb0f refactor: add sync sem for vnode 2022-06-08 19:18:09 +08:00
Shengliang Guan a047d4a559 Merge remote-tracking branch 'origin/feature/sync-refactor' into fix/mnode 2022-06-07 16:37:50 +08:00
Shengliang Guan 36fd0dac68 refactor: add alter-confirm while alter db 2022-06-05 16:34:20 +08:00
Shengliang Guan 1157bca45f enh: adjust vnode replica 2022-06-02 13:57:12 +08:00
Minghao Li 6de1a73d4e Merge branch '3.0' of https://github.com/taosdata/TDengine into feature/3.0_mhli 2022-06-02 13:21:23 +08:00
Shengliang Guan 7fcfd45a03 feat: increase the number of database replicas 2022-06-01 17:26:36 +08:00
Minghao Li cdc0dc487f Merge branch '3.0' of https://github.com/taosdata/TDengine into feature/3.0_mhli 2022-05-30 21:24:05 +08:00
Minghao Li bdc9acbf2e enh(sync): add snapshotEnable 2022-05-30 12:26:15 +08:00
Li Minghao e3068a60ee
Merge pull request #13180 from taosdata/feature/3.0_mhli
enh(sync): add SSnapshot callback: reader, writer
2022-05-29 07:37:54 +08:00
Minghao Li cd2e8fe730 enh(sync): add SSnapshot callback: reader, writer 2022-05-29 07:15:29 +08:00
Cary Xu 5eba0520b7 fix: init buffer to avoid invalid write 2022-05-29 01:22:58 +08:00
Cary Xu f51e1b8405 fix: init logbuf to avoid invalid write 2022-05-29 00:47:30 +08:00
Minghao Li aa85781560 enh(sync): add mndSnapshotRead mndSnapshotApply 2022-05-24 15:28:12 +08:00
Minghao Li 43f2a51e4b fix(sync) sync/mnode eq msg 2022-05-23 22:08:14 +08:00
Minghao Li aeb86ee8ac enh(sync) vnode FpRestoreFinish 2022-05-23 18:22:04 +08:00
Shengliang Guan ff91282bee refactor: adjust vnode sync 2022-05-20 10:51:53 +08:00
Shengliang Guan 0161b6456c refactor: adjust msgcb 2022-05-19 19:44:01 +08:00
Shengliang Guan 36fe62fbd2 refactor: make more object global 2022-05-16 23:23:49 +08:00
Shengliang Guan 6d0b51bfd2 refactor: adjust SRpcMsg handle to info 2022-05-16 20:07:09 +08:00
Shengliang Guan fc94b71c80 refactor: adjust SRpcMsg 2022-05-16 15:17:11 +08:00
Minghao Li 8b9a2c20f3 enh(sync): add error log, linux api error, %X 2022-05-12 12:05:58 +08:00
Shengliang Guan 2bff14b528 refactor: adjust log 2022-05-08 22:23:20 +08:00
Hongze Cheng 42c6f01980 refact vnode includes 2022-04-26 11:04:26 +00:00
yihaoDeng d8a82e3223 fix hb problem 2022-04-24 12:11:27 +08:00
Minghao Li 250622d1de snapshot from -1 2022-04-20 19:58:36 +08:00
Minghao Li ec73953a0f add SyncApplyMsg into vmProcessApplyQueue 2022-04-20 15:02:00 +08:00
Minghao Li e0332e9c12 sync integration 2022-04-19 22:04:02 +08:00
Minghao Li 4fbcb4929a sync integration 2022-04-19 16:24:05 +08:00
Minghao Li 9a7924049f sync integration 2022-04-19 15:43:24 +08:00
Hongze Cheng f1df5eaabf more refact 2022-01-13 05:37:12 +00:00
Hongze Cheng c78f3e357f refact vnode code 2022-01-12 09:26:42 +00:00