Commit Graph

3636 Commits

Author SHA1 Message Date
liuyao 2a74aa317f inc sleep time 2023-04-19 16:41:53 +08:00
Xiaoyu Wang 7cf9919ab0
Merge pull request #20964 from taosdata/enh/3.0_planner_optimize
feat: last queries with tags output can be read from cache
2023-04-19 14:34:32 +08:00
54liuyao 5b7ccc42ca inc sleep time 2023-04-19 13:38:30 +08:00
Minglei Jin 76edc16ce1 operator/cache-scan: pass col list down to tsdb cache 2023-04-19 10:04:48 +08:00
Xiaoyu Wang 6669c3a5ad feat: last queries with tags output can be read from cache 2023-04-18 17:13:14 +08:00
liuyao db4f7ca55f fix bug 2023-04-18 14:00:28 +08:00
dapan1121 5becc19c3c fix: add debug info 2023-04-18 11:40:20 +08:00
kailixu 50053fdc01 Merge branch '3.0' into enh/TD-21161-3.0 2023-04-18 11:13:30 +08:00
Haojun Liao 97da34050b fix(query): fix invalid free. 2023-04-18 10:40:53 +08:00
dapan1121 8ef7fa9bf8 fix: add group cache hash 2023-04-17 16:33:55 +08:00
dapan1121 bd71cb8870 fix: group cache save issue 2023-04-17 16:09:54 +08:00
dapan1121 20c9cea5f0 fix: free uid list issue 2023-04-17 15:50:25 +08:00
dapan1121 ed3778dc9f fix: nodes free issue 2023-04-17 15:44:15 +08:00
dapan1121 31d187444e fix: grou cache issue 2023-04-17 15:33:54 +08:00
dapan1121 4506813ddb enh: add group cache 2023-04-17 15:14:06 +08:00
Haojun Liao 4ed26bbc19 fix(stream): update the table list api. 2023-04-17 14:08:54 +08:00
kailixu fd3b552357 Merge branch '3.0' into enh/TD-21161-3.0 2023-04-17 11:42:46 +08:00
Haojun Liao eb7f510ccb fix(query): return correct suid to delete sink. 2023-04-17 10:59:24 +08:00
Haojun Liao 1350af5267 fix(stream): set the correct initial checkpoint version to restore the operators state and add check for the initial destination tables. 2023-04-16 22:48:22 +08:00
Haojun Liao 04e042f21d Merge branch 'feature/3_liaohj' into enh/rocksRevert 2023-04-15 09:35:43 +08:00
Haojun Liao 3ee3b16ebb fix(query): fix the invalid read. 2023-04-14 19:37:58 +08:00
Haojun Liao d420734971 Merge remote-tracking branch 'origin/enh/rocksRevert' into enh/rocksRevert 2023-04-14 18:03:19 +08:00
Haojun Liao ab4b08a4b5 Merge branch 'feature/3_liaohj' into enh/rocksRevert 2023-04-14 17:44:50 +08:00
liuyao b8ac811f20 fix bug 2023-04-14 17:35:17 +08:00
dapan1121 423ec923ca enh: reuse tsdb cache reader 2023-04-14 14:30:20 +08:00
Haojun Liao eb0e1f848a fix(stream): remove unused tqreader, do some internal refactor, set the meta value for streamtask. 2023-04-14 12:00:09 +08:00
Haojun Liao 5850a3ab01 Merge remote-tracking branch 'origin/enh/rocksRevert' into enh/rocksRevert 2023-04-14 10:37:17 +08:00
Haojun Liao b57c813681 other: merge feature/3_liaohj 2023-04-14 10:36:54 +08:00
liuyao 4906855a8b delete mark 2023-04-14 09:47:56 +08:00
liuyao cb0b4ffbd3 use interval state 2023-04-14 09:38:35 +08:00
Haojun Liao f8b672f09f other: merge main. 2023-04-14 09:07:18 +08:00
liuyao 34bf638f19 fix bug 2023-04-13 16:21:57 +08:00
dapan1121 48f2e26c79 fix: remove protect 2023-04-13 15:59:52 +08:00
dapan1121 1b47b35c3d fix: memory protect issue 2023-04-13 15:23:35 +08:00
dapan1121 945997f22a fix: add memory protect 2023-04-13 15:18:53 +08:00
Xiaoyu Wang a44d455e56 merge 3.0 2023-04-13 14:32:05 +08:00
dapan1121 e86ffad8ef fix: add debug info 2023-04-13 14:23:12 +08:00
liuyao 259815fd83 scan multiple range 2023-04-13 10:46:38 +08:00
dapan1121 3493fffa2f
Merge pull request #20863 from taosdata/fix/TD-23556
fix: fix max/min(tag) random result
2023-04-13 09:57:18 +08:00
liuyao 8992721e20 refact child cache 2023-04-13 09:15:50 +08:00
Ganlin Zhao 81610773c5 add test cases 2023-04-12 18:40:56 +08:00
liuyao e42caca9c2 delete some log 2023-04-12 17:39:44 +08:00
liuyao 9be89ce00a delete expired check point 2023-04-12 17:33:58 +08:00
dapan1121 ba1219303b fix: add debug info 2023-04-12 15:48:18 +08:00
dapan1121 23920e10c1 enh: optimize log perf 2023-04-12 13:58:29 +08:00
liuyao 20f7838c8f opt interval final window 2023-04-12 13:32:49 +08:00
kailixu 2daab8e65e Merge branch '3.0' into enh/TD-21161-3.0 2023-04-12 13:10:12 +08:00
kailixu 04fa4d2e87 Merge branch '3.0' into enh/TD-21161-3.0 2023-04-12 13:05:47 +08:00
liuyao 6a98d55c2f add ci test 2023-04-12 11:04:57 +08:00
Xiaoyu Wang 8b8ac0cd77 merge main 2023-04-12 10:43:28 +08:00
yihaoDeng 29d80b1c76 fix invalid free 2023-04-11 14:04:39 +00:00
Haojun Liao f6315af0c9 other: merge main. 2023-04-11 19:41:17 +08:00
Xiaoyu Wang 9578c4538a Merge remote-tracking branch 'origin/3.0' into fix/3.0_merge_main 2023-04-11 19:33:23 +08:00
yihaoDeng 71d161ae38 Merge branch 'enh/rocksRevert' of https://github.com/taosdata/TDengine into enh/rocksRevert 2023-04-11 11:15:41 +00:00
yihaoDeng 911f08b382 Merge branch 'dev3' into enh/rocksRevert 2023-04-11 11:10:33 +00:00
liuyao 4c2d0b5f63 feat:opt final window 2023-04-11 19:10:10 +08:00
liuyao 34ff1322e4 op final window 2023-04-11 19:10:10 +08:00
Haojun Liao 24c9495772
Merge pull request #20857 from taosdata/fix/TS-3081
fix:optimize log & change the length of tag if tag is null in schemaless
2023-04-11 19:01:07 +08:00
yihaoDeng b24b91886a Merge branch 'dev3' into enh/rocksRevert 2023-04-11 10:59:00 +00:00
Ganlin Zhao 0201348bbe add test cases 2023-04-11 17:58:55 +08:00
liuyao 665fbd1b40 disable encode 2023-04-11 17:15:14 +08:00
Xiaoyu Wang 4c04b155d5 merge main 2023-04-11 15:56:28 +08:00
Ganlin Zhao d163a16f3a fix: fix max/min(tag) random result 2023-04-11 15:46:32 +08:00
liuyao 95d81604c7 feat:encode&&decode stream scan op 2023-04-11 14:34:31 +08:00
wangmm0220 c40c695ea7 fix:optimize log & change the length of tag if tag is null in schemaless 2023-04-11 13:49:18 +08:00
Ganlin Zhao ea6c96df32 fix memory leak 2023-04-11 11:13:23 +08:00
liuyao 74da3c05bc feat:set check point id 2023-04-11 10:33:10 +08:00
Haojun Liao a4ba5401f9 enh(stream): set the start version of all operators. 2023-04-11 10:01:36 +08:00
xinsheng Ren 965af6cc82
fix: handle leak (#20836)
* fix: handle leak

* fix: del unused code

---------

Co-authored-by: facetosea <25808407@qq.com>
2023-04-11 09:46:06 +08:00
Ganlin Zhao 3078e2d487 feat(query): INTERP support boolean type 2023-04-10 18:35:35 +08:00
Haojun Liao 497c9ea9c8 Merge branch 'main' into feature/3_liaohj 2023-04-10 17:57:26 +08:00
liuyao f236457904 feat:add data version 2023-04-10 17:35:16 +08:00
Haojun Liao f5b52749c2 refactor: do some internal refactor. 2023-04-09 01:39:09 +08:00
slzhou af5a16b129 fix: set block allocated to false for each call to downstream operator 2023-04-07 18:54:37 +08:00
liuyao 955f8f9f07 feat:optimize get patitionby name 2023-04-07 18:45:09 +08:00
kailixu e976fcb91d Merge branch '3.0' into enh/TD-21161-3.0 2023-04-07 17:51:35 +08:00
wangmm0220 05ec2b0928 fix:[TD-23517] set offset type to wal if only meta & check if tag is the same type in schemaless 2023-04-07 14:24:29 +08:00
liuyao 1f63859e21 feat:add buff swap 2023-04-07 12:50:59 +08:00
liuyao 0716a4aee8 feat:add check point 2023-04-06 16:45:22 +08:00
Haojun Liao 7e734e3088 Merge remote-tracking branch 'origin/feature/3_liaohj' into feature/3_liaohj 2023-04-06 15:09:06 +08:00
Haojun Liao 665ba407cf fix: fix syntax error. 2023-04-06 15:08:35 +08:00
Haojun Liao 06c7bbe91b
Merge branch 'main' into feature/3_liaohj 2023-04-06 14:41:06 +08:00
Haojun Liao 18955be092 refactor: erase unnecessary error log. 2023-04-06 14:40:01 +08:00
Haojun Liao 2b2059ef18
Merge pull request #20534 from taosdata/fix/TD-22671
fix:error in TD-23218 & remove useless logic
2023-04-06 11:47:24 +08:00
Xiaoyu Wang c134432c45 merge main 2023-04-06 09:31:45 +08:00
54liuyao 1892b806b5 feat:add stream state buff 2023-04-04 17:09:35 +08:00
54liuyao 429b5cd646 feat:add stream file state 2023-04-04 17:09:35 +08:00
yihaoDeng 628bb62c8a add backpressure 2023-04-04 07:20:05 +00:00
Xiaoyu Wang e9d7a099cc merge main 2023-04-04 14:50:58 +08:00
Ganlin Zhao 23ec9287c9 fix: fix tsim crash on windows due to invalid input to strftime 2023-04-04 10:33:41 +08:00
wangmm0220 1d7581f660 fix:conflicts from main 2023-04-03 19:59:33 +08:00
wangmm0220 d651ba02ae fix:lose consume data because of exec close if consume while insert data 2023-04-03 19:54:52 +08:00
Haojun Liao 3ef7d43dae refactor: do some internal refactor. 2023-04-03 17:47:48 +08:00
wangmm0220 1114d358a4 fix:lose consume data because of exec close if consume while insert data 2023-04-03 17:06:51 +08:00
kailixu 37bc1bca36 enh: column/row max length support up to 64K 2023-04-03 17:00:52 +08:00
Haojun Liao 08bd021a6f refactor: do some internal refactor. 2023-04-03 14:49:14 +08:00
Haojun Liao 81c3d16a2d fix(query):set the table list ptr. 2023-04-03 13:29:11 +08:00
Haojun Liao 6e0f1cb1e0 refactor: do some internal refactor. 2023-04-03 11:57:43 +08:00
Haojun Liao 91ae07b6c7 fix(tmq): set the table list correctly. 2023-04-03 11:57:17 +08:00
wangmm0220 2d6436c57d fix:modify log & sleep 500ms if data is inserting while consume 2023-04-03 11:24:22 +08:00
wangmm0220 446f31925e fix:conflict from main 2023-04-02 23:47:58 +08:00
Haojun Liao 09df16f6e4 fix(query): fix memory leak. 2023-04-02 22:47:26 +08:00
wangmm0220 f977b27b88 fix:remove useless setmsg 2023-04-02 22:38:18 +08:00
wangmm0220 b029c8f157 fix:remove useless setmsg 2023-04-02 22:34:51 +08:00
Haojun Liao 167a56f8d0 fix(query): set the correct group table list. 2023-04-02 21:25:54 +08:00
Haojun Liao a887ccda89 fix(query): destroy the tablelist in cache scanner. 2023-04-02 15:30:56 +08:00
Haojun Liao addabf3ba7 refactor: push down the tableListinfo to scanner. 2023-04-02 15:25:31 +08:00
Haojun Liao ae4234cce0 fix(tmq): add lock when check table list. 2023-03-31 19:36:27 +08:00
wangmm0220 97b5c7abee fix:merge from main 2023-03-31 16:20:21 +08:00
Haojun Liao 82d98f9c97
Merge branch 'main' into feature/3_liaohj 2023-03-31 16:07:40 +08:00
Haojun Liao f57899e070 refactor: do some internal refactor. 2023-03-31 16:06:38 +08:00
Haojun Liao 36ccf34d50
Merge pull request #20707 from taosdata/fix/TD-23397
fix:state window return wrong block type
2023-03-31 11:31:30 +08:00
Haojun Liao 450c5b447c fix(tmq): quit the scan asap. 2023-03-31 10:35:13 +08:00
dapan1121 00376b45fb
Merge pull request #20708 from taosdata/szhou/fix-ts3013
fix: add filter to exchange node for union-all subquery
2023-03-30 18:14:48 +08:00
shenglian zhou a3a3dc8243 fix: add filter to exchange node for union-all subquery 2023-03-30 16:41:26 +08:00
54liuyao ae98ad43a5 fix:state window return wrong block type 2023-03-30 16:38:54 +08:00
dapan1121 15578cf980
Merge branch 'main' into fix/cencVer 2023-03-30 15:36:30 +08:00
Haojun Liao d947619b4f
Merge pull request #20691 from taosdata/feature/3_liaohj
fix(stream):fix the race condition when creating new tables.
2023-03-30 14:39:20 +08:00
dapan1121 a778dc8c09
Merge pull request #20698 from taosdata/szhou/fix-ts23354-2
fix: join before interval
2023-03-30 14:14:45 +08:00
Haojun Liao e1d85ce074 fix(tmq): fix error. 2023-03-30 12:04:47 +08:00
Haojun Liao 5f4cb41e28 fix(tmq): set correct start offset value. 2023-03-29 23:45:41 +08:00
slzhou 84d75c2ec0 fix: join after interval 2023-03-29 19:51:13 +08:00
Haojun Liao c8ad465a0d refactor: do some internal refactor. 2023-03-29 19:40:34 +08:00
Haojun Liao 56c98d7768 refactor: do some internal refactor. 2023-03-29 19:35:04 +08:00
dapan1121 3810e57c15 fix: tag copy issue 2023-03-29 19:10:10 +08:00
wangmm0220 2243184a4d fix:conflicts 2023-03-29 17:53:05 +08:00
wangmm0220 9d9ae749d1 opti:tmq logic & fix CI cases 2023-03-29 17:27:04 +08:00
Haojun Liao d998912ce8 fix(query): fix syntax error. 2023-03-29 17:11:41 +08:00
Haojun Liao 25245b9005 Merge branch 'main' into feature/3_liaohj 2023-03-29 16:40:12 +08:00
Haojun Liao 152fc5daab fix(stream):fix the race condition when creating new tsables. 2023-03-29 16:36:35 +08:00
dapan1121 9952be43f6 Merge remote-tracking branch 'origin/main' into fix/cencVer 2023-03-29 15:50:14 +08:00
dapan1121 0659814d16
Merge pull request #20674 from taosdata/fix/TS-3010
fix: query schema is old issue
2023-03-29 11:41:07 +08:00
dapan1121 0327a8eaa3 fix: block rows number type 2023-03-29 10:46:56 +08:00
wangmm0220 d0c55ef572 fix:conflicts 2023-03-28 18:12:13 +08:00
dapan1121 a87d35be08 fix: optimize performance 2023-03-28 17:40:46 +08:00
dapan1121 22ad3129b9 fix: query schema is old issue 2023-03-28 15:21:47 +08:00
Haojun Liao fca79dbc53 Merge branch 'fix/liaohj' into main 2023-03-28 11:20:01 +08:00
yihaoDeng e1046015ae add backend 2023-03-28 02:25:11 +00:00
Haojun Liao c158087d66 fix(tmq): kill the ongoing tsdb scans while transferring the ownership of vnode to other consumers. 2023-03-28 09:53:49 +08:00
Haojun Liao 5c128e2292 refactor: do some internal refactor. 2023-03-28 09:27:48 +08:00
yihaoDeng 47bd13a7b1 add backend 2023-03-27 13:25:06 +00:00
dapan1121 61571d9296 enh: optimize count performance 2023-03-27 19:40:29 +08:00
yihaoDeng 2cc2e5d522 add backend 2023-03-27 01:39:00 +00:00
wangmm0220 f1d67b6059 fix:conflict 2023-03-25 19:03:23 +08:00
Haojun Liao 7d1aa634fb
Merge pull request #20527 from taosdata/fix/TD-23200
fix:scan of fill history ended prematurely
2023-03-25 15:01:42 +08:00
Haojun Liao 61974b9f70
Merge pull request #20605 from taosdata/fix/TD-23272
fix:add combine function for groupKey
2023-03-25 15:01:33 +08:00
Haojun Liao 27c848453e
Merge pull request #20625 from taosdata/fix/TD-23220
fix: modify stream fill linear
2023-03-25 15:01:06 +08:00
yihaoDeng b9531fc9a7 add backend 2023-03-25 06:46:19 +00:00
yihaoDeng 8e409f81ae add backend 2023-03-25 06:43:17 +00:00
54liuyao f18cfc25d6 fix:reset parameter ignoreExpried for fill history 2023-03-24 11:06:05 +08:00
54liuyao ffa59f69aa fix:add combine function for groupKey 2023-03-23 15:20:45 +08:00
yihaoDeng b701198dbb add backend 2023-03-22 13:19:56 +00:00
wangmm0220 6fae38619d fix:error in TD-23218 & remove useless logic 2023-03-22 19:36:12 +08:00
dapan1121 6506805784 fix: fix no group slimit issue and test cases 2023-03-22 17:14:45 +08:00
wangmm0220 dd4cf0597b fix:error in optimize consume logic 2023-03-22 17:04:02 +08:00
dapan1121 5b02af6a91 fix: merge main to 3.0 2023-03-22 16:08:16 +08:00
dapan1121 97c7d363f2 fix: slimit not work issue 2023-03-22 15:18:54 +08:00
dapan1121 7258ea9244
Merge pull request #20576 from taosdata/fix/TS-2933
enh: optimize table merge scan performance
2023-03-22 13:45:00 +08:00
wangmm0220 c07e563ecd fix:error in optimize consume logic 2023-03-22 10:43:11 +08:00
dapan1121 cb3b4a6d8a Merge remote-tracking branch 'origin/main' into fix/TS-2947 2023-03-22 08:56:21 +08:00
dapan1121 56d5034b7f fix: table merge scan limit issue 2023-03-22 08:55:43 +08:00
dapan1121 ddfcba76f3 fix: optimize table merge scan perf 2023-03-21 18:51:16 +08:00
54liuyao a614ef777f fix: modify pull linear 2023-03-21 18:19:45 +08:00
dapan1121 3ab55496c1
Merge pull request #20561 from taosdata/fix/TS-2891-M
fix: select ins_columns from stb/tb
2023-03-21 16:24:46 +08:00
Haojun Liao d5a386a563 fix(client): fix coverity issues. 2023-03-21 14:03:36 +08:00
dapan1121 ddab83a2ba enh: optimize table merge scan performance 2023-03-21 11:42:46 +08:00
kailixu 179579f204 chore: more code 2023-03-20 17:41:22 +08:00
kailixu 24dbcaa844 chore: merge main 2023-03-20 17:32:54 +08:00
wangmm0220 f7b7320f5f fix:set offset if read wal none 2023-03-20 16:57:45 +08:00
wangmm0220 506c192bff fix:error in TD-23218 & remove useless logic 2023-03-20 16:26:15 +08:00
Haojun Liao ca1dffff45
Merge pull request #20508 from taosdata/fix/liaohj
fix(client): fix potential memory leak.
2023-03-20 16:11:22 +08:00
wangmm0220 f80078030c fix:error in TD-23218 & remove useless logic 2023-03-20 15:40:01 +08:00
wangmm0220 f94b1df529 fix:error in TD-23218 & remove useless logic 2023-03-20 14:55:11 +08:00
wangmm0220 c0b41ea0b3 fix:error in TD-23218 & remove useless logic 2023-03-20 14:09:13 +08:00
wangmm0220 a5144f0ba2 fix:set offset if read wal none 2023-03-20 10:10:07 +08:00
Haojun Liao c678740968 refactor: do some internal refactor. 2023-03-19 19:22:43 +08:00
Haojun Liao 7e712a14b6 fix(tmq): adjust log. 2023-03-19 19:06:28 +08:00
Haojun Liao ae5155edcf fix(tmq): do some internal refactor. 2023-03-19 10:49:30 +08:00
Cary Xu 7a3c897a80
Revert "fix(query): invalid write when query of ins_columns" 2023-03-18 20:49:48 +08:00
wangmm0220 ccba1d07c6 fix:error in TD-23218 & remove useless logic 2023-03-18 18:42:49 +08:00
wangmm0220 7616a283e3 fix:error in TD-23218 & remove useless logic 2023-03-18 18:23:38 +08:00
yihaoDeng afaa77cc3e fix tag filter 2023-03-18 10:01:45 +00:00
54liuyao 2185464836 fix:scan of fill history ended prematurely 2023-03-18 13:38:33 +08:00
kailixu d90c8e834a chore: var def optimization 2023-03-18 13:07:15 +08:00
kailixu 45a625f2dc fix: add mem check 2023-03-18 12:50:37 +08:00
Ganlin Zhao 8fa4aa1435 fix(query): do not update ts window at exchange operator. 2023-03-18 12:06:59 +08:00
kailixu 5d82380993 chore: code optimization 2023-03-17 16:55:53 +08:00
kailixu 5f2ced466b Merge branch 'main' into fix/TS-2891-M 2023-03-17 16:49:06 +08:00
kailixu ed3fc6bdf1 fix: select ins_columns from stb/ctb 2023-03-17 14:48:23 +08:00
Haojun Liao 8d1c6956d6 fix(query): set the tag filter flag. 2023-03-17 14:28:30 +08:00
kailixu a85e30efe6 fix: select ins_columns from stb/ctb 2023-03-17 14:19:00 +08:00
Haojun Liao d5a8a4aefe
Merge pull request #20502 from taosdata/fix/liaohj
fix(client): set the initial value for num_of_rows.
2023-03-17 12:50:04 +08:00
kailixu 7ed966e3f1 fix: select ins_columns from stb/tb 2023-03-17 12:33:34 +08:00
Haojun Liao 970155a845 fix(query): fix coverity issues. 2023-03-16 21:53:34 +08:00
kailixu ba5c3fb2ab fix: select ins_columns for stb with 4096 columns 2023-03-16 00:01:54 +08:00
kailixu acd57f03e6 fix(query): invalid write when query of ins_columns 2023-03-15 20:31:54 +08:00
Shengliang Guan 51e503dd2c
Merge pull request #20464 from taosdata/fix/TD-23156
fix:source task needs to wait && stream state window does not handle null
2023-03-15 14:09:26 +08:00
Shengliang Guan dd2940b8b3
Merge pull request #20463 from taosdata/fix/TS-2883
fix: fix table count operator groupId issue
2023-03-15 14:08:54 +08:00
Shengliang Guan 09ca41b3f7
Merge pull request #20467 from taosdata/fix/TS-2893
fix:create same sub table
2023-03-15 14:07:47 +08:00
54liuyao 25732f7c3c fix:source task needs to wait & stream state window does not handle null 2023-03-15 13:15:17 +08:00