Commit Graph

455 Commits

Author SHA1 Message Date
Haojun Liao 4b2fa43dae
Revert "fix(query): handle partition by in table scan operator" 2022-10-28 18:05:19 +08:00
Haojun Liao d0a7a43e6f other:merge 3.0 2022-10-28 18:02:50 +08:00
yihaoDeng 9de0afc8ea opt mem 2022-10-27 21:22:36 +08:00
yihaoDeng 6a978be730 opt mem 2022-10-27 20:38:57 +08:00
Haojun Liao 5a971dd03a fix(query): handle partition by in table scan operator with limit/offset value. 2022-10-27 16:58:32 +08:00
Minglei Jin 441fe8119c Merge branch '3.0' into fix/TD-19468-2 2022-10-25 10:51:35 +08:00
Minglei Jin 89f7ad2920 fix: optimize tsdb cache loading speed 2022-10-25 10:36:30 +08:00
Shengliang Guan e86cdc8cde
Merge pull request #17381 from taosdata/feature/addIdxToSysTable
Feature/addIdxToSysTable
2022-10-23 14:38:37 +08:00
Shengliang Guan 4d318b32da refact: alter db replica 2022-10-20 16:47:03 +08:00
yihaoDeng 66a3269c6b add pre check 2022-10-19 19:57:31 +08:00
yihaoDeng 12ec7d7193 add pre check 2022-10-19 17:54:06 +08:00
Minghao Li 4c9f10b6f3 refactor(sync): add sync ctrl queue in vnode 2022-10-18 19:12:34 +08:00
Hongze Cheng bd2546a765
Merge pull request #17303 from taosdata/fix/TD-19482
fix(meta): META_READER_NOLOCK with inner meta readers
2022-10-13 13:19:57 +08:00
Minglei Jin 060eb307a9 fix(mac): new metaReaderReleaseLock api to keep reader's buffer 2022-10-13 12:02:18 +08:00
Shengliang Guan 58b0ca6efe
Merge pull request #17273 from taosdata/fix/TD-19223-D
fix: support statistics of insert_req
2022-10-11 20:54:38 +08:00
Cary Xu 114ae8dbda fix: support statistics of insert_req 2022-10-11 18:22:29 +08:00
Cary Xu 02979f081d fix: support statistics of insert_req 2022-10-11 17:47:23 +08:00
Minglei Jin 9a410b96ef fix(query): new META_READER_NOLOCK flag for metaReaderInit 2022-10-10 15:04:33 +08:00
yihaoDeng c62b1985d7 fix invalid tag value 2022-10-05 18:32:30 +08:00
yihaoDeng 16c1473823 enh(query): opt get table meta 2022-10-01 13:49:30 +08:00
Haojun Liao 1f57a5a1cc
Merge pull request #17172 from taosdata/feature/3_liaohj
fix(query): fix memory leak.
2022-09-30 13:45:01 +08:00
Haojun Liao c9286fed25 fix(query): fix memory leak. 2022-09-30 13:03:25 +08:00
yihaoDeng f41b494ac6 opt tbname in 2022-09-30 10:19:56 +08:00
Shengliang Guan e6ac8ed3a9
Merge pull request #17121 from taosdata/szhou/fixbugs
enhance: optimize when select from ins_tags when table_name='xxxx'
2022-09-30 09:39:27 +08:00
yihaoDeng 0d3da10954 fix invalid read 2022-09-30 09:31:19 +08:00
yihaoDeng d74779805a opt tbname in 2022-09-29 23:13:54 +08:00
yihaoDeng 1286f7473c QRY: opt tbname in 2022-09-28 22:07:16 +08:00
slzhou 99bc329384 enhance: optimize select from ins_tags where table_name='tablename' without iterating through meta tdb 2022-09-28 16:30:40 +08:00
Liu Jicong 0e8aaf4c9e feat(tmq): push optimization 2022-09-28 10:38:49 +08:00
Hongze Cheng f0a5820d01 add tsdb config support 2022-09-08 18:36:08 +08:00
Hongze Cheng 2e8b43d01c more code 2022-09-08 16:56:29 +08:00
Haojun Liao d9d7c81872
Merge branch '3.0' into refact/tsdb_optimize 2022-09-03 10:14:48 +08:00
Shengliang Guan 25c67f6ebb enh: add hash prefix and suffix option to db 2022-09-02 19:00:11 +08:00
Hongze Cheng 1cba6138b8 Merge branch '3.0' of https://github.com/taosdata/TDengine into refact/tsdb_optimize 2022-09-02 16:39:15 +08:00
Shengliang Guan acab522494 enh: let create database SST_TRIGGER 2 worker 2022-09-02 15:19:50 +08:00
Minglei Jin 97d533d520 tsdbCache/usage: new cacheload column for db.vgroups to check usage 2022-09-01 16:41:08 +08:00
Minglei Jin 01aca9ffc7 fix: stat timeseries every minute to avoid dnode offline caused by massive tables 2022-08-30 10:07:33 +08:00
wade zhang 2ad31384f6
Merge pull request #15818 from taosdata/feature/TD-14761
feat: get meta and data from tmq using snapshot
2022-08-29 09:49:35 +08:00
Shengliang Guan c581212712
Merge pull request #16439 from taosdata/feature/3_liaohj
feature(query): support last function cache and retrieve data.
2022-08-28 21:27:13 +08:00
Haojun Liao 60d9acb7b4 feature(query): support last function cache and retrieve data. 2022-08-26 15:27:19 +08:00
Minglei Jin 85da71460e fix: stats normal tables' timeseries 2022-08-25 16:22:55 +08:00
wangmm0220 c7bf08d5af feat: get snapshot data for taosX 2022-08-24 17:42:33 +08:00
wangmm0220 f2912a17ba fix:conflicts from 3.0 2022-08-19 16:38:23 +08:00
Hui Li 1a5ae2bfdf
Merge pull request #16207 from taosdata/feature/3.0_query_optimize
fix: get meta null if table does not exists
2022-08-18 16:54:19 +08:00
wangmm0220 fbc69a10c4 Merge branch '3.0' into feature/TD-14761 2022-08-18 16:45:06 +08:00
Hui Li 35af88cbaa
Merge pull request #16195 from taosdata/feature/3.0_interval_hash_optimize
enh: rsma batch process
2022-08-18 16:07:14 +08:00
wangmm0220 03bb9e7f01 fix: get meta null if table does not exists 2022-08-18 15:44:28 +08:00
wangmm0220 44ce4f1cf3 Merge branch '3.0' of https://github.com/taosdata/TDengine into feature/TD-14761 2022-08-18 10:45:45 +08:00
wangmm0220 4f16771de4 fix:error in get table list by tag filter 2022-08-17 14:45:31 +08:00
wangmm0220 78c9f245b1 fix:conflicts from 3.0 2022-08-16 15:18:11 +08:00
wangmm0220 19c5051b8c fix:confilcts from 3.0 2022-08-16 14:42:19 +08:00
Cary Xu 313a546b85 other: merge 3.0 2022-08-15 16:25:39 +08:00
Liu Jicong 6f75e03a55 refactor(stream): remove unneccessary param in converting data 2022-08-15 11:06:53 +08:00
Cary Xu ae7550eb86 enh: rsma exec in async mode 2022-08-12 21:00:48 +08:00
wangmm0220 e102f81f92 opti:use suid+uid->tags index to optimize time cost 2022-08-12 11:33:53 +08:00
wangmm0220 32f9bc0dd0 opti:logic for get table list 2022-08-11 18:29:28 +08:00
wangmm0220 c381ffd38c fix:error in tmq for snapshot 2022-08-09 19:06:24 +08:00
wangmm0220 f28155714e fix:confilcts from 3.0 2022-08-06 12:31:15 +08:00
wangmm0220 45e7597df3 feat:get data from snapshot for taosx 2022-08-05 21:12:18 +08:00
wangmm0220 c3cd858a63 feat:add snapshot for tmq in stable and db 2022-08-04 15:01:59 +08:00
Liu Jicong c089d3ba08 merge 3.0 2022-08-02 22:53:49 +08:00
Liu Jicong d43eec5d16 enh(stream): directly dispatch 2022-08-02 22:23:33 +08:00
Minglei Jin 7d0d87f0b1
Merge pull request #15648 from taosdata/fix/TD-17593
fix: first round number of chile tables and timeseries
2022-08-01 23:03:37 +08:00
Minglei Jin cfab6c9b20 fix: first round number of chile tables and timeseries 2022-08-01 18:01:44 +08:00
54liuyao b3d104349f feat(stream):optimize stream update scan 2022-08-01 17:09:46 +08:00
yihaoDeng ac169b8d90 fix index bugf 2022-07-30 10:30:58 +08:00
Haojun Liao 6d86ef0c33 other: merge 3.0 2022-07-25 11:22:09 +08:00
Haojun Liao 93af7aaaf7 fix(query):fix limit/offset bug. 2022-07-25 11:18:30 +08:00
Yihao Deng ca7fe4e9b5
Merge pull request #15345 from taosdata/fix/indexMemleak
fix: avoid mem leak
2022-07-23 16:38:49 +08:00
yihaoDeng 98aa28ef1e avoid mem leak 2022-07-23 15:32:18 +08:00
dapan1121 741f8f7e55 fix: remove filter ut 2022-07-23 14:55:12 +08:00
Haojun Liao abfa6d9162 refactor(query): do some internal refactor and add some logs. 2022-07-20 22:38:19 +08:00
Cary Xu 2204a770ab Merge branch '3.0' into feature/TD-11274-3.0 2022-07-18 13:22:41 +08:00
Cary Xu 6460514147 enh: grant refactor and grant check 2022-07-18 13:22:21 +08:00
Minghao Li 604e5b750c refactor(sync): add index/term in vnodeSnapWriterClose 2022-07-16 18:19:54 +08:00
Hongze Cheng 25a2d04b85 more vnode snapshot writer 2022-07-14 07:37:53 +00:00
Haojun Liao 649cf7e55d fix(query): support last_row(tags) for super table query. 2022-07-13 14:21:44 +08:00
Haojun Liao ea5a68046e
Merge pull request #14825 from taosdata/feature/3_liaohj
refactor: do some internal refactor.
2022-07-12 20:13:20 +08:00
Haojun Liao 6e709dc2e0 fix(query): check if table exists during creating lastrow reader. 2022-07-12 16:30:34 +08:00
Shengliang Guan e9d4948e84 enh: transfer leader before close vnode and mnode 2022-07-12 14:46:52 +08:00
Minglei Jin 53f56217f7 tsdbCache: use cachelast & cachelastsize cfg from vnode 2022-07-11 20:16:48 +08:00
Haojun Liao 69e9a2ad5c
Merge branch '3.0' into feature/3_liaohj 2022-07-10 14:46:53 +08:00
Haojun Liao 40380ef9c1 refactor: do internal refactor. 2022-07-10 10:15:27 +08:00
Hongze Cheng 668ca4a4fb Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/tsdb_snapshot 2022-07-10 01:51:45 +00:00
Hongze Cheng 0840affc32 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/tsdb_snapshot 2022-07-08 12:33:12 +00:00
Liu Jicong 938868e39f merge from 3.0 2022-07-08 17:57:11 +08:00
Liu Jicong 3cd5a35054 refactor(stream): internal refactor 2022-07-08 17:48:34 +08:00
dapan1121 50a6ef7f39
Merge pull request #14635 from taosdata/feature/insertselect
feat: support insert from query res
2022-07-08 16:59:21 +08:00
Haojun Liao 1711d646c1
Merge pull request #14671 from taosdata/feature/3_liaohj
enh(query): add block sma for int type column data.
2022-07-08 16:23:13 +08:00
Hongze Cheng 57cc359858 more work 2022-07-08 05:31:34 +00:00
dapan1121 0925064d24 Merge branch 'feature/3.0_debug_wxy' into feature/insertselect 2022-07-08 10:28:53 +08:00
Liu Jicong 866e4c4be0 refactor(stream): internal refactor 2022-07-07 17:56:52 +08:00
Haojun Liao 557873c1bc other: merge 3.0 2022-07-07 16:50:00 +08:00
Haojun Liao 41be3e4d04 refactor: do some internal refactor. 2022-07-07 15:56:43 +08:00
Haojun Liao 57bf509dee refactor: do some internal refactor. 2022-07-07 15:40:04 +08:00
Hongze Cheng 089d5e6150 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/tsdb_snapshot 2022-07-07 01:37:50 +00:00
Yihao Deng 31655c07d7
Merge pull request #14611 from taosdata/feat/idxFix1
enh: refactor idx code
2022-07-07 09:21:06 +08:00
Hongze Cheng fdf6d22d1b Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/tsdb_snapshot 2022-07-07 01:17:00 +00:00
dapan1121 d4696ef31f Merge branch '3.0' into feature/insertselect 2022-07-07 09:02:09 +08:00
Shengliang Guan 0163ec4d4b Merge remote-tracking branch 'origin/3.0' into fix/dnode 2022-07-06 18:53:26 +08:00
yihaoDeng 1e5ddcb92f merge 3.0 2022-07-06 18:29:11 +08:00
dapan1121 0d4fb5bb80 feat: support insert from query 2022-07-06 16:29:51 +08:00
Shengliang Guan 5e18e07a35 refactor: pre process vnode msg 2022-07-06 16:06:55 +08:00
Hongze Cheng 2b4696310a Merge branch 'feat/tsdb_refact' of https://github.com/taosdata/TDengine into feat/tsdb_snapshot 2022-07-06 05:26:23 +00:00
Minglei Jin fc20a61c85
Merge branch '3.0' into feat/tsdb_refact 2022-07-06 00:37:21 +08:00
Shengliang Guan 64b540bef5 refactor: adjust vnode propose msg 2022-07-05 20:04:17 +08:00
Hongze Cheng e9d157dd2c more snapshot 2022-07-05 11:19:37 +00:00
Hongze Cheng 406d35d43c Merge branch 'feat/tsdb_refact' of https://github.com/taosdata/TDengine into feat/tsdb_snapshot 2022-07-05 03:08:58 +00:00
Haojun Liao c7559a81ca refactor: do some internal refactor. 2022-07-04 23:28:27 +08:00
Hongze Cheng 5891d97a0d more work 2022-07-04 12:04:40 +00:00
Hongze Cheng 64b1400d7c Merge branch 'feat/tsdb_refact' of https://github.com/taosdata/TDengine into feat/tsdb_snapshot 2022-07-04 11:25:41 +00:00
Hongze Cheng 27b719febd refact some code 2022-07-04 11:24:54 +00:00
Hongze Cheng 0408ba414c more work 2022-07-04 07:21:04 +00:00
Hongze Cheng fd98b9082f more code 2022-07-04 07:00:21 +00:00
Hongze Cheng eb888684e3 more refact 2022-07-04 06:47:41 +00:00
Hongze Cheng b2f3ff2741 more 2022-07-04 06:14:39 +00:00
Hongze Cheng 38ca993452 make merge compile 2022-07-04 05:21:02 +00:00
Hongze Cheng ddb198de23 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/tsdb_refact 2022-07-04 03:42:50 +00:00
Liu Jicong 4695dc2dae feat(tmq): add snapshot test 2022-06-30 14:41:50 +08:00
Liu Jicong c2955a807b feat(tmq): offset support snapshot 2022-06-29 21:04:51 +08:00
Haojun Liao 5efd5a3b6d fix(query):adjust api for retrieve lastrow in executor. 2022-06-28 23:24:20 +08:00
Haojun Liao 4a59e1300b other: merge 3.0. 2022-06-28 15:22:32 +08:00
Cary Xu e6dd04f573 refactor: rsma restore 2022-06-27 14:47:14 +08:00
Haojun Liao dbd8c300fa refactor: do tsdbread refactor. 2022-06-27 10:46:20 +08:00
Cary Xu 0597f3b9cd refactor: rsma resource release 2022-06-26 18:44:49 +08:00
Liu Jicong 0c1a51bad6 enh(stream): refine tqRetrieveDataBlock api 2022-06-25 20:03:29 +08:00
slzhou a9f094613a fix: restore table merge scan operator 2022-06-25 13:52:52 +08:00
wangmm0220 62ce467711 fix:error in compile 2022-06-24 17:37:30 +08:00
wangmm0220 a95f98f7e7 feat:merge from 3.0 2022-06-23 20:50:48 +08:00
wangmm0220 26cceaf172 feat:sort table group if needed 2022-06-23 19:58:12 +08:00
Haojun Liao bf0caa2038 Merge branch '3.0' into feature/3_liaohj 2022-06-22 20:32:02 +08:00
shenglian zhou c1f5f825b7 feat: prepare for multiple group tsdb reads 2022-06-22 18:51:16 +08:00
Haojun Liao 14ddf539e0 refactor(query): do some internal refactor. 2022-06-22 17:21:04 +08:00
Haojun Liao a2cec0e488
Merge pull request #14004 from taosdata/feature/3_liaohj
feature(query): support show table block distribution.
2022-06-20 15:13:10 +08:00
Haojun Liao ad0595b9ec Merge branch '3.0' into feature/3_liaohj 2022-06-20 14:08:21 +08:00
Haojun Liao 659e429b87 feature(query): support show table block distribution. 2022-06-20 12:54:46 +08:00
Hongze Cheng 21ea4e3a0b more work 2022-06-20 02:38:08 +00:00
Hongze Cheng bdc427dc78 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/tsdb_refact 2022-06-20 01:26:31 +00:00
wangmm0220 2bd2996e74 feat:add comment function 2022-06-16 20:45:00 +08:00
wangmm0220 e28e92ea35 feat:add ttl 2022-06-16 20:44:25 +08:00
Hongze Cheng 760905f632 refact 2022-06-16 11:14:56 +00:00
Hongze Cheng 5bd3732adf refact more code 2022-06-16 09:53:07 +00:00
Hongze Cheng 5485c7fc9f refact tsdb read 2022-06-16 09:18:30 +00:00
Hongze Cheng d59b0254d3 more work 2022-06-16 08:58:00 +00:00
Hongze Cheng 07792850cb refact code 2022-06-16 06:29:28 +00:00
Liu Jicong 6fcee0e244 refactor(tsdb): tsdb reader open 2022-06-10 15:20:57 +08:00
Shengliang Guan ae9e11bb0f refactor: add sync sem for vnode 2022-06-08 19:18:09 +08:00
yihaoDeng 0ca6a5ae27 refactor json index 2022-06-05 21:46:07 +08:00
dapan1121 bcec782dd2 Merge branch '3.0' into feature/qnode 2022-06-03 20:47:46 +08:00
dapan1121 f6c6083aad reschedule timeout task 2022-06-02 21:02:02 +08:00
Cary Xu 80e9120fb4 Merge branch '3.0' into feature/TD-14481-3.0 2022-06-02 12:26:46 +08:00
Liu Jicong f2048b00cb fix(tmq): subscribe stb 2022-06-02 11:01:05 +08:00
Cary Xu 9939e4d1c4 feat: tsma refactor 2022-06-01 19:36:19 +08:00
Cary Xu e88abb16c2 feat: tsma days refactor 2022-06-01 19:06:58 +08:00
Shengliang Guan 141be56075 Merge remote-tracking branch 'origin/3.0' into fix/tsim 2022-06-01 17:31:47 +08:00
Shengliang Guan 7fcfd45a03 feat: increase the number of database replicas 2022-06-01 17:26:36 +08:00
Cary Xu 737820ee24
Merge pull request #13371 from taosdata/feature/TD-14481-3.0
feat: tsma/rsma refactor
2022-06-01 15:24:27 +08:00
Cary Xu a8d75ae650 Merge branch '3.0' into feature/TD-14481-3.0 2022-06-01 15:10:43 +08:00
Cary Xu 15b25eeec5 feat: tsma/rsma refactor 2022-06-01 15:06:12 +08:00
wangmm0220 588c4f5abf Merge branch '3.0' into feat/tag_refact 2022-06-01 13:25:41 +08:00
wangmm0220 19b0932781 feat:merge from 3.0 2022-05-31 23:46:04 +08:00
Cary Xu 6ae33e242b Merge branch '3.0' into feature/TD-14481-3.0 2022-05-31 21:08:12 +08:00
Cary Xu d8405d82dc feat: tsma refactor 2022-05-31 21:07:52 +08:00
yihaoDeng 64ffbc1eea enh: support tag filter 2022-05-31 18:34:17 +08:00
wangmm0220 816cea07f9 feat:add new logic for new tag format 2022-05-31 17:49:33 +08:00
Yihao Deng 7710766583
Merge branch '3.0' into enh/tagFlt 2022-05-28 18:40:54 +08:00
yihaoDeng 6acbe7e777 enh: support tag filter 2022-05-28 16:15:24 +08:00
slzhou 7a459a26a8 enhance:modify table scan operator that can accept several scan ranges 2022-05-27 17:59:27 +08:00
WANG MINGMING dfe0440c5f
Merge pull request #13044 from taosdata/3.0
3.0
2022-05-26 21:42:21 +08:00
Hongze Cheng fe22f0f6d3 use two version in server and refact 2022-05-26 08:29:52 +00:00
wangmm0220 051020f932 fix: remove table group code in 2.x 2022-05-26 16:05:27 +08:00
WANG MINGMING dfbd780b5b
Merge pull request #13004 from taosdata/3.0
3.0
2022-05-26 09:56:37 +08:00
wangmm0220 71ec636c3c feat: add tag condition 2022-05-25 22:29:24 +08:00
wangmm0220 eea32f5f0a feat: add tag condition 2022-05-25 22:21:04 +08:00
Hongze Cheng 9fbbb25aea feat: vnode snapshot 2022-05-24 09:21:14 +00:00
Hongze Cheng 067af9d0be feat: vnode snapshot 1 2022-05-24 06:50:47 +00:00
Hongze Cheng 528f10c3fe feat: vnode pre-process msg 2022-05-23 08:38:05 +00:00
Hongze Cheng d784da0da0 feat: discard const when decode 2022-05-23 07:47:49 +00:00
Haojun Liao ee470a9427 other: merge 3.0 2022-05-20 17:12:04 +08:00
Haojun Liao fa84d0585b enh(query): enable remove the candidate table ids in the stream scanner. 2022-05-20 17:07:53 +08:00
Shengliang Guan f2a84eda09 refactor: adjust vnode header file 2022-05-20 10:45:43 +08:00
Liu Jicong 2174b5e48e enh(tq): update tb uid when droping table 2022-05-19 16:46:12 +08:00
Hongze Cheng ef684076c4 refact: tdb api 2022-05-18 07:57:29 +00:00
Hongze Cheng 6454a205a8 more alter table 2022-05-16 12:13:59 +00:00
Hongze Cheng 2ddfd66d48 more alter table 2022-05-16 06:17:56 +00:00
Cary Xu 9e7b43c836 feat: sma code refactor 2022-05-15 22:03:02 +08:00
Cary Xu 069ce051f0 feat: move sma module from tsdb to vnode 2022-05-15 20:17:20 +08:00
Haojun Liao e468363ce1
Merge pull request #12409 from taosdata/feature/3.0_liaohj
fix(query): close read fd when finishing scanning data files.
2022-05-13 01:25:38 +08:00
Haojun Liao aae019d18a fix(query): close read fd when finishing scanning data files. 2022-05-13 00:32:02 +08:00
Hongze Cheng 7ed7e1de40 feat: tag read 2022-05-12 11:21:44 +00:00
Shengliang Guan 2bff14b528 refactor: adjust log 2022-05-08 22:23:20 +08:00
Shengliang Guan c4264da2ec refactor: vnodes mgmt 2022-05-08 22:20:53 +08:00
Cary Xu 95d30b7f5d enh: code format optimization 2022-05-08 17:09:00 +08:00
Cary Xu b603e798c6 feat: rsma config optimization 2022-05-08 17:04:19 +08:00
Cary Xu 215613f4cd feat: set tsdb cfg for rollup sma 2022-05-07 22:33:19 +08:00
Hongze Cheng 323ce214b6 refact encode APIs 2022-05-07 10:03:06 +00:00
Hongze Cheng 5d150204dd more refact 2022-05-07 06:57:31 +00:00
Haojun Liao 2b803d8b93 enh(query): set uid for the result datablock of stream scanner when handling the submit block. 2022-05-06 23:40:26 +08:00
Cary Xu c7ca57f557 feat: rollup data submit 2022-05-02 00:30:47 +08:00
Haojun Liao ca786a9251
Merge pull request #12065 from taosdata/feature/3.0_liaohj
enh(query): enable check sma status for each column in query.
2022-04-29 20:49:46 +08:00