Commit Graph

1183 Commits

Author SHA1 Message Date
liuyao e8945cedd8 fix issue 2023-11-03 16:03:23 +08:00
liuyao f51c985914 stream event window 2023-10-25 17:50:16 +08:00
liuyao 5852a0975e set fill history range 2023-10-18 19:49:05 +08:00
slzhou 34246ea001 fix: tag scan support limit and remove slimit optimization 2023-10-16 16:43:15 +08:00
liuyao 1cebda368a session&state operator buff 2023-09-20 15:06:08 +08:00
wangjiaming0909 4a131000e4 fix: data error of partition by col + interval 2023-09-07 10:49:09 +08:00
wangjiaming0909 2c4e0fee07 feat: optimize partition node, replace with sort node 2023-09-05 10:53:30 +08:00
yihaoDeng 6fe649c458 Merge branch 'enh/3.0' into enh/triggerCheckPoint2 2023-08-21 09:12:40 +08:00
liuyao 87c65f3b68 Merge remote-tracking branch 'origin/3.0' into enh/triggerCheckPoint2 2023-08-18 15:27:02 +08:00
dapan1121 efc5589aa2 Merge remote-tracking branch 'origin/3.0' into feat/TD-24700 2023-08-18 14:11:26 +08:00
slzhou 85d1dbe00a Merge branch '3.0' of github.com:taosdata/TDengine into szhou/select-tags-scan 2023-08-17 16:27:37 +08:00
dapan1121 3045a623e1 Merge remote-tracking branch 'origin/3.0' into feat/TD-24700 2023-08-17 14:16:05 +08:00
dapan1121 e8fa9aa633 fix: join blockId and target issues 2023-08-17 13:50:26 +08:00
Haojun Liao ea6574b3c7 other: merge 3.0 2023-08-17 00:07:55 +08:00
dapan1121 143c657571 Merge remote-tracking branch 'origin/3.0' into feat/TD-24700 2023-08-16 14:50:31 +08:00
dapan1121 91d6734b34 fix: join condition push down issue 2023-08-16 14:28:39 +08:00
shenglian zhou e93ed3b556 enhance: table san type and disable partition tags optimize for tag scan 2023-08-16 14:09:22 +08:00
liuyao fc09f8ef1e Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/ly_refactor 2023-08-16 09:36:28 +08:00
slzhou 4fdaaba3ce Merge branch '3.0' of github.com:taosdata/TDengine into szhou/tag-scan-opt 2023-08-15 17:18:25 +08:00
shenglian zhou 84e472ad03 enhance: tag cond col list only once and tag scan derive from scan 2023-08-15 16:10:54 +08:00
liuyao 1b4e51ee4a Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/ly_refactor 2023-08-15 14:20:49 +08:00
liuyao d1c289823f refactor stream session window 2023-08-14 17:52:39 +08:00
liuyao 3043c7f09f refactor operator 2023-08-14 17:52:39 +08:00
liuyao 57a020edfc refact stream interval 2023-08-14 17:52:39 +08:00
liuyao 9d1e5a512d add stream task id 2023-08-14 17:52:39 +08:00
slzhou 57d1957dee enhance: tag scan code refactoring 2023-08-14 15:57:27 +08:00
wangjiaming0909 5c276fa547 fix: make kill query work for sysscanoperator 2023-08-14 15:21:58 +08:00
dapan1121 c9656d3f77 fix: fix memory issues 2023-08-11 17:39:41 +08:00
shenglian zhou 7c39bc9890 fix: some minor modifications 2023-08-11 13:50:41 +08:00
shenglian zhou b2e615d4e7 enhance: tag scan cursor based block 2023-08-10 17:30:01 +08:00
Haojun Liao f633c7fe2b other: merge 3.0. 2023-08-10 11:56:30 +08:00
dapan1121 ce1b294c51 fix: memory leak issues 2023-08-10 11:29:14 +08:00
dapan1121 1d0624bbf1 Merge remote-tracking branch 'origin/3.0' into feat/TD-24700 2023-08-09 10:32:13 +08:00
dapan1121 1aac643a9b enh: support single vnode join 2023-08-09 10:30:35 +08:00
dapan1121 68e0fb924a
Merge pull request #22165 from taosdata/feat/3.0/TD-25271
feature: optimize interval with limit
2023-08-08 10:34:02 +08:00
dapan1121 a95295774a enh: end table scan 2023-08-07 19:35:33 +08:00
dapan1121 0546bdceb2 Merge remote-tracking branch 'origin/3.0' into feat/TD-24700 2023-08-07 11:23:15 +08:00
Haojun Liao 8a11a0418f other: merge 3.0 2023-08-07 09:19:26 +08:00
wangjiaming0909 fba43e1748 feature: optimize interval with limit 2023-08-04 15:04:04 +08:00
wangjiaming0909 632f5fbe8f feat: optimize table merge scan when 1 child table 2023-08-03 15:33:25 +08:00
Haojun Liao 9981cecbed refactor: do some internal refactor. 2023-07-31 15:24:35 +08:00
Haojun Liao 8dfef8768a other: merge 3.0 2023-07-29 22:54:16 +08:00
dapan1121 b7126b9cc6 Merge remote-tracking branch 'origin/3.0' into feat/TD-24700 2023-07-28 18:01:11 +08:00
dapan1121 9ed1417bba enh: remove group cache 2023-07-28 18:00:33 +08:00
liuyao 0b53bdbae6 op stream scan 2023-07-27 15:09:25 +08:00
dapan1121 e83a46b88f enh: cache necessary file for seq mode 2023-07-26 19:17:59 +08:00
dapan1121 6a0061ccfb fix: invalid task status update issue 2023-07-26 13:54:58 +08:00
dapan1121 fb63294289 fix: hash join res issue 2023-07-25 09:03:52 +08:00
Haojun Liao 1e34f84f78 other: merge 3.0 2023-07-24 15:23:03 +08:00
dapan1121 4f75eb5655 Merge remote-tracking branch 'origin/3.0' into feat/TD-24700 2023-07-24 11:43:15 +08:00
dapan1121 ebf1a91fb5 enh: read/write from disk cache 2023-07-24 11:39:00 +08:00
dapan1121 ae8caa8275 enh: add disk cache 2023-07-21 19:25:38 +08:00
dapan1121 3725cafe00 enh: add disk cache 2023-07-21 17:30:09 +08:00
dapan1121 fde8eabfd7
Merge pull request #22111 from taosdata/szhou/tms-dev-2
enhance: table merge scan optimization
2023-07-20 16:28:29 +08:00
dapan1121 58c5d5e70e fix: group cache block cache issue 2023-07-20 10:21:19 +08:00
liuyao 8a6ed67f9d fill history 2023-07-20 09:13:30 +08:00
dapan1121 a41888a9ef fix: batch fetch issue 2023-07-19 19:14:30 +08:00
dapan1121 8b62c75c26 fix: merge join ignore param issue 2023-07-19 14:42:18 +08:00
slzhou d1a1976aa4 enhance: add limit to merge sort 2023-07-19 13:59:43 +08:00
dapan1121 04fea1e38f enh: add batch fetch process 2023-07-18 19:35:45 +08:00
dapan1121 294376de0b enh: add batch table scan 2023-07-18 14:44:53 +08:00
slzhou ba2b404295 enhance: optimize msortComparFn for table merge scan 2023-07-17 21:07:55 +08:00
dapan1121 a1e18ac898 fix: fix global cache issue 2023-07-17 09:25:28 +08:00
slzhou f93af4d2e0 enhance: pass simple test 2023-07-16 20:28:54 +08:00
shenglian zhou 8b6d7db7ad enhance: use one tsdb reader to read table sequentially 2023-07-16 17:54:39 +08:00
dapan1121 188df1d675 fix: fix bugs 2023-07-14 19:36:56 +08:00
dapan1121 2312f10372 enh: support concurrent fetch from group cache 2023-07-14 13:30:13 +08:00
liuyao 020cdf4d27 get checkpoint id 2023-07-12 14:06:36 +08:00
dapan1121 6763c6f98c enh: support parallel group cache fetch 2023-07-12 11:29:54 +08:00
liuyao 0cfc81c16b add checkpoint id for recover 2023-07-12 11:08:12 +08:00
liuyao 7d4bb1b932 add checkpoint id for recover 2023-07-12 10:48:58 +08:00
Haojun Liao 9484f3da94
Merge branch '3.0' into enh/triggerCheckPoint2 2023-07-12 10:20:18 +08:00
dapan1121 a42bd9e478 Merge remote-tracking branch 'origin/3.0' into feat/TD-24700 2023-07-11 19:34:39 +08:00
dapan1121 185071fae9 enh: add group cache func 2023-07-11 19:34:03 +08:00
liuyao 6298f17c45 delete invalid code 2023-07-11 19:21:27 +08:00
wangjiaming0909 1d7515213b feat: 1. add limit for diskBasedBuf
2. use referenced tuple before actually pushing into pq
3. use limitInfo instead of maxRows in sort pyhsical node
2023-07-11 14:16:20 +08:00
dapan1121 2d3f9c739d enh: add group cache 2023-07-10 19:23:52 +08:00
liuyao 84f0dfd6d4 stream operator checkpoint 2023-07-10 11:07:08 +08:00
Shungang Li 8de31219b4 fix: type convert failure returns errcode
TSDB_CODE_SCALAR_CONVERT_ERROR:
"Cannot convert to specific type"
2023-07-10 09:29:29 +08:00
dapan1121 c19c59d5e6 enh: optimize oprator param usage 2023-07-07 16:49:35 +08:00
dapan1121 779224f0a6 fix: fix bugs 2023-07-06 19:33:31 +08:00
liuyao 0e914a19c6 stream operartor checkpoint 2023-07-06 14:28:34 +08:00
dapan1121 18c2400c75 fix: dynamic query ctrl compile issues 2023-07-06 11:13:43 +08:00
dapan1121 b371b7e6be fix: compile issue and merge join crash issue 2023-07-06 10:52:28 +08:00
dapan1121 0718859c0a enh: support passing params between nodes 2023-07-05 19:24:06 +08:00
dapan1121 c85bbef2e9 Merge remote-tracking branch 'origin/3.0' into feat/TD-24700 2023-07-05 11:13:57 +08:00
dapan1121 7b9d73c77a feat: add dynamic query ctrl operator 2023-07-05 11:07:08 +08:00
dapan1121 ac35ae9839 feat: add dynamic query ctrl operator 2023-07-03 19:29:46 +08:00
dapan1121 5971395dcf feat: add group cache operator 2023-07-03 13:42:06 +08:00
dapan1121 60290b98e4 feat: add group cache operator 2023-06-30 19:20:36 +08:00
dapan1121 9f0da17c49 Merge remote-tracking branch 'origin/3.0' into feat/TD-24700 2023-06-28 19:40:55 +08:00
liuyao 2fc5eeb810 session win range 2023-06-28 17:20:08 +08:00
Haojun Liao ed900d6ff6
Merge branch '3.0' into refact/fillhistory 2023-06-28 13:48:26 +08:00
Haojun Liao a19e63fd23 fix(stream): fix error in handling fill history. 2023-06-27 23:00:14 +08:00
wangjiaming0909 57ddb3437d feature: optimize order by limit using priority queue 2023-06-27 17:50:50 +08:00
Haojun Liao 3289ad62be other: merge 3.0 2023-06-27 11:33:40 +08:00
dapan1121 4dae9f4eff merge main to 3.0 2023-06-26 18:43:00 +08:00
liuyao e236bf818c set fill history info 2023-06-25 17:47:10 +08:00
dapan1121 9972aa81d6 Merge remote-tracking branch 'origin/3.0' into feat/TD-24700 2023-06-25 17:31:32 +08:00
dapan1121 24a5a3f41b fix: compile issues 2023-06-25 17:31:04 +08:00
Haojun Liao ceb78fdad2
Merge branch '3.0' into refact/fillhistory 2023-06-24 18:53:48 +08:00
dapan1121 2b55a75e82 enh: refact code 2023-06-21 19:33:27 +08:00
dapan1121 7e555e437b enh: add hash join 2023-06-20 19:34:16 +08:00
liuyao 74bea44300 stream op transform 2023-06-20 17:30:59 +08:00
dapan1121 1a53a9084e feat: add buffer page 2023-06-19 19:40:15 +08:00
liuyao 41c193945f fill history pause&resume 2023-06-19 17:28:19 +08:00
wangjiaming0909 fb4f174fbc feature: add input, output ts order for execution plans 2023-06-16 10:26:09 +08:00
dapan1121 e6afcbf07f feat: hash join init version 2023-06-15 19:34:15 +08:00
liuyao c58bde9715 stream operator fill history 2023-06-13 10:57:36 +08:00
Haojun Liao 53246ed6bb other: merge other branch. 2023-06-09 09:41:10 +08:00
Haojun Liao 6a3c935b4a fix(stream): fix error in fill history scan. 2023-06-07 09:15:55 +08:00
liuyao 201d0f2d18 fix stream ci issue 2023-06-06 16:37:08 +08:00
Haojun Liao fcc706c45c enh(stream): refactor the fill history task. 2023-06-05 15:59:01 +08:00
liuyao 17f2c3f882 reset wind info 2023-06-02 18:27:22 +08:00
Haojun Liao 706e350217 fix(query): fix error in fill and partition. 2023-06-01 14:36:42 +08:00
Haojun Liao 5301c5756a other: merge main into 3.0. 2023-06-01 09:29:18 +08:00
kailixu f984e67eaa fix(query): invalid buffer page 2023-05-29 16:04:35 +08:00
kailixu 3bbf5405c6 fix(query): invalid buf page 2023-05-29 14:36:29 +08:00
Haojun Liao 0966213847 fix(arch): set the correct module api dependency. 2023-05-25 14:21:40 +08:00
Haojun Liao a9b18d203d fix:fix error. 2023-05-24 23:49:26 +08:00
Haojun Liao 1f7f326bed refactor: do some internal refactor and set the api function ptr. 2023-05-24 13:22:05 +08:00
Haojun Liao 85afbf0d35 refactor: do some internal refactor. 2023-05-23 18:58:54 +08:00
Haojun Liao a63473b1cc refacotor: do some internal refactor. 2023-05-23 18:54:32 +08:00
Haojun Liao e67b532d8a refactor: refactor the module dependency. 2023-05-23 18:29:23 +08:00
Haojun Liao 93c4e3fe70 other: remove empty files. 2023-05-19 09:12:16 +08:00
Haojun Liao 1e020a46c9 other: merge main. 2023-05-19 09:07:35 +08:00
yihaoDeng 9380b22394 merge 3.0 2023-05-18 05:46:38 +00:00
Haojun Liao 041ffa91bd other: merge main. 2023-05-17 15:42:15 +08:00
liuyao 9258dcd740 fix:mem leak 2023-05-15 11:19:17 +08:00
Haojun Liao 170c603995 other: merge 3.0 2023-05-13 20:16:55 +08:00
dapan1121 69795286fa Merge remote-tracking branch 'origin/main' into enh/tsbsPerf.4 2023-05-12 13:46:16 +08:00
dapan1121 0dd0b16842 enh: optimize table scan for last query 2023-05-12 13:30:17 +08:00
Haojun Liao 7ef16e1922 other: merge main. 2023-05-12 11:49:53 +08:00
Yihao Deng cb223acf82
Merge branch 'main' into enh/rocksdbSstate 2023-05-08 09:45:27 +08:00
yihaoDeng 08c3a63341 Merge branch 'enh/standVer' into enh/rocksdbSstateMerge 2023-05-06 12:37:54 +00:00
Haojun Liao 29fcd1b83a refactor: do some internal refactor. 2023-05-06 10:08:05 +08:00
Haojun Liao b3da6cb224 fix(query): fix syntax error. 2023-04-28 14:56:50 +08:00
Haojun Liao b7c8346b44 other: merge other branch. 2023-04-28 13:06:47 +08:00
Haojun Liao da0d9c78ef refactor: do some internal refactor. 2023-04-28 11:42:34 +08:00
Haojun Liao 8205168428 fix(query): fix memory leak. 2023-04-28 09:16:11 +08:00
Haojun Liao 7adc21028a refactor: do some internal refactor. 2023-04-28 00:23:38 +08:00
Haojun Liao 25010cb11e fix(query): stop tsdbreade ASAP, and do some internal refactor. 2023-04-27 22:21:18 +08:00
liuyao d429e070da fix fill bug 2023-04-24 18:23:35 +08:00
shenglian zhou 758427b3c4 fix: use slimit to indicate group for tag scan 2023-04-24 15:48:20 +08:00
yihaoDeng 917b07348c Merge branch 'fix/rocksdbState' into enh/rocksRevert 2023-04-23 02:37:26 +00:00
Haojun Liao 4ed26bbc19 fix(stream): update the table list api. 2023-04-17 14:08:54 +08:00
Haojun Liao 1350af5267 fix(stream): set the correct initial checkpoint version to restore the operators state and add check for the initial destination tables. 2023-04-16 22:48:22 +08:00
Haojun Liao 04e042f21d Merge branch 'feature/3_liaohj' into enh/rocksRevert 2023-04-15 09:35:43 +08:00
Haojun Liao 3ee3b16ebb fix(query): fix the invalid read. 2023-04-14 19:37:58 +08:00
Haojun Liao 5850a3ab01 Merge remote-tracking branch 'origin/enh/rocksRevert' into enh/rocksRevert 2023-04-14 10:37:17 +08:00
Haojun Liao b57c813681 other: merge feature/3_liaohj 2023-04-14 10:36:54 +08:00
liuyao cb0b4ffbd3 use interval state 2023-04-14 09:38:35 +08:00
Haojun Liao f8b672f09f other: merge main. 2023-04-14 09:07:18 +08:00
liuyao 8992721e20 refact child cache 2023-04-13 09:15:50 +08:00
Haojun Liao f6315af0c9 other: merge main. 2023-04-11 19:41:17 +08:00
Xiaoyu Wang 9578c4538a Merge remote-tracking branch 'origin/3.0' into fix/3.0_merge_main 2023-04-11 19:33:23 +08:00
yihaoDeng 911f08b382 Merge branch 'dev3' into enh/rocksRevert 2023-04-11 11:10:33 +00:00
yihaoDeng b24b91886a Merge branch 'dev3' into enh/rocksRevert 2023-04-11 10:59:00 +00:00
Xiaoyu Wang 4c04b155d5 merge main 2023-04-11 15:56:28 +08:00
liuyao 95d81604c7 feat:encode&&decode stream scan op 2023-04-11 14:34:31 +08:00
Ganlin Zhao ea6c96df32 fix memory leak 2023-04-11 11:13:23 +08:00
liuyao 74da3c05bc feat:set check point id 2023-04-11 10:33:10 +08:00
Haojun Liao a4ba5401f9 enh(stream): set the start version of all operators. 2023-04-11 10:01:36 +08:00
xinsheng Ren 965af6cc82
fix: handle leak (#20836)
* fix: handle leak

* fix: del unused code

---------

Co-authored-by: facetosea <25808407@qq.com>
2023-04-11 09:46:06 +08:00
liuyao f236457904 feat:add data version 2023-04-10 17:35:16 +08:00
liuyao 955f8f9f07 feat:optimize get patitionby name 2023-04-07 18:45:09 +08:00
liuyao 0716a4aee8 feat:add check point 2023-04-06 16:45:22 +08:00
Haojun Liao 7e734e3088 Merge remote-tracking branch 'origin/feature/3_liaohj' into feature/3_liaohj 2023-04-06 15:09:06 +08:00
Haojun Liao 665ba407cf fix: fix syntax error. 2023-04-06 15:08:35 +08:00
Haojun Liao 2b2059ef18
Merge pull request #20534 from taosdata/fix/TD-22671
fix:error in TD-23218 & remove useless logic
2023-04-06 11:47:24 +08:00
54liuyao 1892b806b5 feat:add stream state buff 2023-04-04 17:09:35 +08:00
54liuyao 429b5cd646 feat:add stream file state 2023-04-04 17:09:35 +08:00
Xiaoyu Wang e9d7a099cc merge main 2023-04-04 14:50:58 +08:00
wangmm0220 1d7581f660 fix:conflicts from main 2023-04-03 19:59:33 +08:00
wangmm0220 d651ba02ae fix:lose consume data because of exec close if consume while insert data 2023-04-03 19:54:52 +08:00
Haojun Liao 3ef7d43dae refactor: do some internal refactor. 2023-04-03 17:47:48 +08:00
Haojun Liao 08bd021a6f refactor: do some internal refactor. 2023-04-03 14:49:14 +08:00
Haojun Liao 91ae07b6c7 fix(tmq): set the table list correctly. 2023-04-03 11:57:17 +08:00
Haojun Liao 167a56f8d0 fix(query): set the correct group table list. 2023-04-02 21:25:54 +08:00
Haojun Liao addabf3ba7 refactor: push down the tableListinfo to scanner. 2023-04-02 15:25:31 +08:00
wangmm0220 97b5c7abee fix:merge from main 2023-03-31 16:20:21 +08:00
dapan1121 15578cf980
Merge branch 'main' into fix/cencVer 2023-03-30 15:36:30 +08:00
Haojun Liao 56c98d7768 refactor: do some internal refactor. 2023-03-29 19:35:04 +08:00
Haojun Liao 152fc5daab fix(stream):fix the race condition when creating new tsables. 2023-03-29 16:36:35 +08:00
dapan1121 a87d35be08 fix: optimize performance 2023-03-28 17:40:46 +08:00
wangmm0220 f1d67b6059 fix:conflict 2023-03-25 19:03:23 +08:00
Haojun Liao 27c848453e
Merge pull request #20625 from taosdata/fix/TD-23220
fix: modify stream fill linear
2023-03-25 15:01:06 +08:00
yihaoDeng 8e409f81ae add backend 2023-03-25 06:43:17 +00:00
54liuyao f18cfc25d6 fix:reset parameter ignoreExpried for fill history 2023-03-24 11:06:05 +08:00
wangmm0220 dd4cf0597b fix:error in optimize consume logic 2023-03-22 17:04:02 +08:00
dapan1121 5b02af6a91 fix: merge main to 3.0 2023-03-22 16:08:16 +08:00
dapan1121 7258ea9244
Merge pull request #20576 from taosdata/fix/TS-2933
enh: optimize table merge scan performance
2023-03-22 13:45:00 +08:00
54liuyao a614ef777f fix: modify pull linear 2023-03-21 18:19:45 +08:00
dapan1121 ddab83a2ba enh: optimize table merge scan performance 2023-03-21 11:42:46 +08:00
wangmm0220 f7b7320f5f fix:set offset if read wal none 2023-03-20 16:57:45 +08:00
Haojun Liao 7e712a14b6 fix(tmq): adjust log. 2023-03-19 19:06:28 +08:00
Haojun Liao ae5155edcf fix(tmq): do some internal refactor. 2023-03-19 10:49:30 +08:00
wangmm0220 ccba1d07c6 fix:error in TD-23218 & remove useless logic 2023-03-18 18:42:49 +08:00
wangmm0220 7616a283e3 fix:error in TD-23218 & remove useless logic 2023-03-18 18:23:38 +08:00
Shengliang Guan 041f03e918
Merge pull request #20414 from taosdata/feat/TD-23058
feat: correct slimit&limit clause
2023-03-12 20:48:16 +08:00