Commit Graph

2482 Commits

Author SHA1 Message Date
Shengliang Guan 7a537bba09 refact: adjust sync.h and syncState 2022-11-02 10:24:55 +08:00
Shengliang Guan fee43064f7
Merge pull request #17812 from taosdata/fix/TD-20052
enh: refact sync callback func
2022-11-01 21:09:00 +08:00
Shengliang Guan 871757240a
Merge pull request #17777 from taosdata/FIX/TS-1984-3.0
fix: fsync wal files and meta if data size not synced yet beyond a threshold
2022-11-01 18:53:10 +08:00
Shengliang Guan ee63b49800 Merge remote-tracking branch 'origin/3.0' into fix/TD-20052 2022-11-01 17:11:27 +08:00
Shengliang Guan a71dbd83d2
Merge pull request #17803 from taosdata/fix/TD-20052
enh: refact syncMsg code
2022-11-01 16:45:56 +08:00
Shengliang Guan 68f1641991
Merge pull request #17800 from taosdata/feature/stream
refactor(stream): fill history
2022-11-01 16:15:07 +08:00
Shengliang Guan d35028ae4a enh: refact sync callback func 2022-11-01 16:10:07 +08:00
Shengliang Guan f4dc7d0766 enh: refact sync callback func 2022-11-01 15:35:10 +08:00
Minghao Li 59448cd18e refactor(sync): pre snapshot on message 2022-11-01 15:20:08 +08:00
Shengliang Guan 2791f6260a
Merge pull request #17794 from taosdata/fix/3.0_bugfix_wxy
fix: drop index error
2022-11-01 15:03:21 +08:00
Shengliang Guan e79e50ae36 enh: refact syncMsg code 2022-11-01 13:58:25 +08:00
Xiaoyu Wang 1b179f65b2 fix: interp _irowts error 2022-11-01 13:34:10 +08:00
dapan1121 bb4acf21b4
Merge pull request #17799 from taosdata/enh/TD-20040
enh: support get meta only from cache
2022-11-01 13:27:11 +08:00
Liu Jicong 8ca5f0bd9c Merge branch '3.0' into feature/stream 2022-11-01 13:20:20 +08:00
Liu Jicong 5e253cc8ea refactor(stream): fill history 2022-11-01 11:56:14 +08:00
Minghao Li 21d60cb5be refactor(sync): pre snapshot on message 2022-11-01 11:46:29 +08:00
dapan1121 973a942d0f enh: support get meta only from cache 2022-11-01 11:43:40 +08:00
Minghao Li 094c14e272 Merge branch '3.0' of https://github.com/taosdata/TDengine into feature/3.0_mhli 2022-11-01 10:47:42 +08:00
Minghao Li 69af9556db refactor(sync): add PreSnapshotReply 2022-11-01 10:47:19 +08:00
Shengliang Guan 26778f29da enh: add config for persist wal at the beginning of vnodeCommit 2022-11-01 10:42:13 +08:00
Minghao Li 981461ea46 refactor(sync): add PreSnapshotTest 2022-11-01 10:25:31 +08:00
benguang.zhao 07db554fab enh: persist wal at the beginning of vnodeCommit 2022-11-01 00:00:18 +08:00
Shengliang Guan 9bc48e2658 Merge remote-tracking branch 'origin/3.0' into fix/TD-20052 2022-10-31 23:42:03 +08:00
Shengliang Guan 392564cc7d enh: refact syncEnv code 2022-10-31 23:40:43 +08:00
Shengliang Guan e817e649c6
Merge pull request #17788 from taosdata/enh/TD-19090
enh: force drop dnode
2022-10-31 23:27:54 +08:00
Liu Jicong 2e640c38a2 refactor: stream and tmq message 2022-10-31 18:37:28 +08:00
Minghao Li 77ba900776 refactor(sync): add sync local cmd, step down 2022-10-31 16:12:40 +08:00
Minghao Li 0b20b914bb refactor(sync): add sync local cmd 2022-10-31 14:17:26 +08:00
Xiaoyu Wang ae4354c277 enh: add sql command 'drop dnode id force' 2022-10-31 10:30:54 +08:00
Shengliang Guan 24f31b0f72
Merge pull request #17746 from taosdata/feature/3.0_mhli
refactor(sync): adjust elect timer, add some tests
2022-10-29 17:02:19 +08:00
Shengliang Guan ffdfd39c5e
Merge pull request #17731 from taosdata/fix/TD-19815
fix: add more ut cases and fix issues
2022-10-28 14:24:41 +08:00
Shengliang Guan 800ff0b957
Merge pull request #17675 from taosdata/fix/3.0_bugfix_wxy
enh: add unit test and delete useless code
2022-10-28 13:29:26 +08:00
54liuyao 7d8a282258 fix(stream):tqBuildDeleteReq error 2022-10-28 11:19:26 +08:00
Xiaoyu Wang 0840e79f90 Merge remote-tracking branch 'origin/3.0' into fix/3.0_bugfix_wxy 2022-10-28 10:46:31 +08:00
Xiaoyu Wang e8c0515dce enh: flag of whether the subplan is added as a show statement 2022-10-28 10:46:04 +08:00
dapan1121 b6068fd9d9 enh: add catalog ut cases 2022-10-27 19:33:00 +08:00
Minghao Li d7c866ee12 enh(sync): add test 2022-10-27 17:59:16 +08:00
Minghao Li 8b5d005db7 refactor(sync): add SyncLocalCmd 2022-10-27 17:16:46 +08:00
Minghao Li bbb624b63e Merge branch '3.0' of https://github.com/taosdata/TDengine into feature/3.0_mhli 2022-10-27 16:22:08 +08:00
Minghao Li 04c0684149 refactor(sync): add SyncLocalCmd 2022-10-27 16:21:54 +08:00
Minghao Li 7cb3112d77 refactor(sync): modify function name 2022-10-27 15:52:48 +08:00
Liu Jicong 52d8f7bd35
Merge pull request #17701 from taosdata/feature/stream
fix(query): set block capacity
2022-10-27 13:38:46 +08:00
Liu Jicong 6cd8361a0a refactor(sma) 2022-10-27 11:06:16 +08:00
Shengliang Guan 4f86c27bd5
Merge pull request #17688 from taosdata/feature/sync2-merge
refactor(sync): check pSyncTimer NULL
2022-10-27 10:13:52 +08:00
Xiaoyu Wang 02ac6fa552 enh: add unit test and delete useless code 2022-10-26 17:01:55 +08:00
Minghao Li 169fd67ddb refactor(sync): adjust log retention size 2022-10-26 15:06:54 +08:00
Liu Jicong b56e7a0f8c
Merge pull request #17650 from taosdata/feature/stream
refactor(stream): recover and fill history
2022-10-26 11:10:03 +08:00
Haojun Liao 339c93021f
Merge pull request #17654 from taosdata/fix/liao_cov
refactor: fix typo and do  some internal  refactor.
2022-10-26 10:41:00 +08:00
Liu Jicong 8d8fd2b2bc refactor(stream): recover and fill history 2022-10-26 10:20:33 +08:00
Haojun Liao d06bcb2219 refactor: fix typo and do some internal refactor. 2022-10-26 09:47:11 +08:00
Liu Jicong 52b4b510a8 merge 3.0 2022-10-26 09:18:29 +08:00
Liu Jicong 75e5e490fd refactor(stream): recover and fill history 2022-10-26 00:31:00 +08:00
Shengliang Guan 20a279e69a
Merge pull request #17605 from taosdata/fix/3.0_bugfix_wxy
fix: wrong permissions of 'show variables' command
2022-10-25 14:17:06 +08:00
Cary Xu 6d0d42569a enh: remove obsolete codes for raw data row 2022-10-25 11:30:57 +08:00
Xiaoyu Wang 0fdce91b5a fix: wrong permissions of 'show variables' command 2022-10-24 16:34:10 +08:00
Shengliang Guan 21445a717c Merge remote-tracking branch 'origin/3.0' into feature/sync2-merge 2022-10-22 09:07:39 +08:00
Shengliang Guan 5d293869a9
Merge pull request #17553 from taosdata/fix/liao_cov
fix(query): fix coverity issues.
2022-10-22 08:14:44 +08:00
Shengliang Guan f5d1b3f8f1 Merge remote-tracking branch 'origin/3.0' into feature/sync2-merge 2022-10-21 19:12:06 +08:00
dapan1121 1b65cd2089 fix: fix show create table crash issue 2022-10-21 17:24:06 +08:00
Liu Jicong 5571ebee0f
Merge pull request #17542 from taosdata/feature/stream
enh(stream): internal optimize
2022-10-21 14:31:42 +08:00
Haojun Liao b53cc7f3dd fix(query): fix coverity issues. 2022-10-21 14:00:46 +08:00
Liu Jicong e0b5b9263e refactor: remove unused code 2022-10-21 10:42:24 +08:00
Liu Jicong 035e6b13c8 enh(stream): internal optimize 2022-10-21 10:29:05 +08:00
dapan1121 a01d49b223
Merge pull request #17522 from taosdata/feat/TD-19386
feat: add retrieve DB and table route info APIs
2022-10-21 08:31:11 +08:00
Minghao Li cc7a393978 refactor(sync): refactor sync 2022-10-20 19:42:22 +08:00
Shengliang Guan 894e75ca65 fix: comment sncReconfig 2022-10-20 18:32:19 +08:00
Haojun Liao abff4fb1f2
Merge pull request #17336 from taosdata/feature/3_liaohj
other:merge 3.0, and support last query cache
2022-10-20 18:15:38 +08:00
dapan1121 0d727eedcf Merge remote-tracking branch 'origin/3.0' into feat/TD-19386 2022-10-20 16:30:20 +08:00
Minghao Li 5965629b2e refactor(sync): refacotr sync 2022-10-20 16:05:14 +08:00
dapan1121 7c133359ce feat: add retrieve db and table route info api 2022-10-20 15:13:39 +08:00
Minghao Li 74b48e6df8 refacotr(sync): modify sync-snapshot 2022-10-20 14:53:03 +08:00
Shengliang Guan 025c92586f Merge remote-tracking branch 'origin/3.0' into enh/TD-19660 2022-10-20 11:45:56 +08:00
Shengliang Guan 34b08b7b71 fix: improve test coverage 2022-10-20 11:27:00 +08:00
54liuyao 368f5134c5 feat(stream):optimize state window disc buff 2022-10-20 09:04:51 +08:00
dapan1121 723110c449 feat: add retrieve db and table route info API 2022-10-19 19:25:02 +08:00
Shengliang Guan 881db69feb
Merge pull request #17453 from taosdata/feature/sync2-merge
refactor(sync): add sync ctrl queue in vnode
2022-10-19 15:50:09 +08:00
Haojun Liao f7fdeecc44
Merge branch '3.0' into feature/3_liaohj 2022-10-19 11:23:55 +08:00
Minghao Li 28a5a9d7e1 refactor(sync): add log, update quorum first when reconfig 2022-10-19 10:57:50 +08:00
Shengliang Guan fc5af24975
Merge pull request #17444 from taosdata/enh/TD-19622
refact: remove bnode codes
2022-10-19 10:06:35 +08:00
Minghao Li 4c9f10b6f3 refactor(sync): add sync ctrl queue in vnode 2022-10-18 19:12:34 +08:00
54liuyao 8efd7e8763 feat(stream):replace disk buff 2022-10-18 18:13:47 +08:00
Shengliang Guan 3a7d89a6bb refact: remove bnode codes 2022-10-18 17:34:58 +08:00
Minghao Li 1b36ad119c refactor(sync): rename functions 2022-10-18 15:24:00 +08:00
Minghao Li e810f2ad64 refactor(sync): delete old code, ok 2022-10-18 13:53:03 +08:00
Xiaoyu Wang 0228caaa0d enh: last cache optimize 2022-10-18 11:38:59 +08:00
Minghao Li 092a07475d refactor(sync): process hb and appendentries 2022-10-17 16:38:44 +08:00
Xiaoyu Wang 9abea76791 fix: do coverity scan 2022-10-17 15:43:42 +08:00
Minghao Li fa30b94c67 refactor(sync): append entries 2022-10-16 12:07:02 +08:00
Benguang Zhao 616eb5f903 Merge branch '3.0' into FIX/TD-19239-3.0 2022-10-16 00:29:01 +08:00
Benguang Zhao 7fb827debd fix: refactor walScanLogGetLastVer, walCheckAndRepairMeta, and walCheckAndRepairIdx.
* search for the last entry in the contiguous range of valid WAL from the last pos fsynced as firstTrial
    * find the last entry before the last pos fsynced backwards as second trial
    * reserve sufficient space for computing CRC32 checksum, esp. of WAL record body
    * rebuild meta info to resolve potential misalignment between lists of meta and actual log files
    * retract commitIndex and appliedIndex to lastLogIndex if needed
    * put an upper size limit on possibly corrupted WAL range to be recovered
2022-10-15 23:56:31 +08:00
Shengliang Guan edf9253a16 Merge remote-tracking branch 'origin/3.0' into enh/TD-19463_2 2022-10-15 17:19:08 +08:00
dapan1121 0df311a78f
Merge pull request #17264 from taosdata/refact/query_opt
refactor:do some internal refactor to optimize the query performance.
2022-10-14 19:51:46 +08:00
Shengliang Guan ea4ae8a960 Merge remote-tracking branch 'origin/3.0' into enh/TD-19463_2 2022-10-14 19:23:02 +08:00
Shengliang Guan 78fb1911d4 enh: refactor the code to create and delete mnodes 2022-10-14 17:59:09 +08:00
dapan1121 40591003d1 Merge branch 'refact/query_opt' of github.com:taosdata/TDengine into refact/query_opt 2022-10-14 13:09:30 +08:00
Minghao Li 4d123c4da6 refactor(sync): add interface in sync 2022-10-14 11:18:48 +08:00
dapan1121 9a024590f5
Merge pull request #17321 from taosdata/feat/caseWhen
feat: support case when operator
2022-10-14 09:57:29 +08:00
dapan1121 74be3572db enh: add query response policy 2022-10-14 09:31:18 +08:00
dapan1121 f3919c4450 Merge remote-tracking branch 'origin/3.0' into feat/caseWhen 2022-10-14 09:14:01 +08:00
Minghao Li 2ae4081a3f refactor(sync): add double queues in vnode 2022-10-13 20:57:36 +08:00