Commit Graph

4870 Commits

Author SHA1 Message Date
liuyao f51c985914 stream event window 2023-10-25 17:50:16 +08:00
dapan1121 6dcc555bbc fix: view privilege issue 2023-10-25 10:47:01 +08:00
yihaoDeng 1a4cfd11a5 Merge branch 'enh/new3.0' into enh/refactorBackend 2023-10-20 15:28:10 +08:00
Haojun Liao da8f6a4c2f
Merge pull request #23248 from taosdata/feat/TD-26647
recover session buff state
2023-10-19 15:34:03 +08:00
liuyao 5852a0975e set fill history range 2023-10-18 19:49:05 +08:00
Haojun Liao c6dd73b68b
Merge pull request #23187 from taosdata/feat/TD-26056
feat:add replay logic
2023-10-18 11:43:43 +08:00
slzhou 34246ea001 fix: tag scan support limit and remove slimit optimization 2023-10-16 16:43:15 +08:00
wangmm0220 473142fab7 fix:conflicts from 3.0 2023-10-16 11:35:56 +08:00
yihaoDeng b6005d6183 refactor backend 2023-10-13 16:07:34 +08:00
liuyao 7269dedb39 Merge branch '3.0' of https://github.com/taosdata/TDengine into 3.0 2023-10-13 11:35:01 +08:00
liuyao 429125be93 session state recover 2023-10-13 11:32:35 +08:00
Haojun Liao eb4449999f other: merge 3.0 2023-10-12 10:33:48 +08:00
liuyao 26c87e5f41 fix mem leak 2023-10-10 10:26:26 +08:00
wangmm0220 33045e63ae feat:[TD-26056] add replay logic 2023-10-09 17:35:40 +08:00
Haojun Liao 74ff0c5b50 Merge branch 'main' into fix/liaohj 2023-10-09 10:14:53 +08:00
Haojun Liao ee6516f3c4 enh(stream): add trans to reset task status to avoid being frozen in checkpoint status due to doing checkpoint failure of partial tasks. 2023-10-09 10:13:53 +08:00
wangmm0220 5f7b6f19ba feat:[TD-26056] add replay logic 2023-10-08 19:05:59 +08:00
liuyao 1d952ca8ea rebuild session window 2023-10-08 18:27:05 +08:00
wangmm0220 b04d57fcc3 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26056 2023-10-08 16:15:19 +08:00
wangmm0220 3f2d890560 feat:[TD-26056] add replay logic 2023-10-08 16:06:15 +08:00
liuyao 1e323c0408 fix issue 2023-10-07 19:11:46 +08:00
liuyao 1aaf873134 fix issue 2023-10-07 17:43:50 +08:00
liuyao 59d47e1e1f fix issuse 2023-10-07 10:34:35 +08:00
liuyao b7b96b67be use secondary pointer 2023-10-07 09:40:23 +08:00
liuyao c95dc167b7 add ci 2023-09-26 17:19:21 +08:00
shenglian zhou 5a28981d50 fix: set null when creating empty input for count 2023-09-26 16:00:56 +08:00
liuyao ca2325f886 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26174 2023-09-26 10:41:31 +08:00
liuyao 82e18e32b0 add ci 2023-09-26 10:41:12 +08:00
liuyao 83c58a25cb ignore udpate check 2023-09-25 16:58:23 +08:00
kailixu bc8ebf1562 Merge branch '3.0' into enh/TS-3812-3.0 2023-09-23 18:19:08 +08:00
kailixu 8f828e052b enh: timeseries calculation optimization 2023-09-22 20:07:51 +08:00
liuyao 0d983e28ef Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26174 2023-09-22 19:25:41 +08:00
liuyao 410a177637 fix issue 2023-09-22 15:00:26 +08:00
liuyao 4979fc5283 fix issue 2023-09-22 09:40:08 +08:00
liuyao b1d9cd1c4a release state 2023-09-21 10:12:43 +08:00
liuyao b4be5fe895 fix mem leak 2023-09-20 17:35:11 +08:00
liuyao 1cebda368a session&state operator buff 2023-09-20 15:06:08 +08:00
kailixu a9d30f25d2 enh: rsma support delete raw data 2023-09-20 10:11:03 +08:00
xsren b2170e9791 fill data of varchar type 2023-09-18 16:03:04 +08:00
xsren 83d8e3a524 mem exception handle 2023-09-18 13:48:09 +08:00
liuyao c14721744c stream partition ignore stream_get_all 2023-09-15 15:01:20 +08:00
liuyao 6d64a22b5f project op ignore checkpoint block 2023-09-15 11:41:33 +08:00
dapan1121 8ef01584ee
Merge pull request #22629 from taosdata/feat/TD-25620
feat: optimize partition node, replace with sort node
2023-09-14 17:26:15 +08:00
wangjiaming0909 cb78c54d72 optimize sort perf 2023-09-13 18:37:42 +08:00
Haojun Liao 60f5056ab7 other: merge 3.0 2023-09-12 22:00:40 +08:00
Haojun Liao b317c8ebff fix(stream): disable merge submit blocks. 2023-09-08 12:46:15 +08:00
dapan1121 fdeb924d0d
Merge pull request #22715 from taosdata/fix/m/TD-26114
fix: desc fill missed one window
2023-09-07 11:36:30 +08:00
wangjiaming0909 4a131000e4 fix: data error of partition by col + interval 2023-09-07 10:49:09 +08:00
dapan1121 e4f52bae5b
Merge pull request #22764 from taosdata/fix/TD-26132
fix: fix coverity issues
2023-09-07 10:09:30 +08:00
liuyao d7caed1c44 opt stream state 2023-09-06 16:34:25 +08:00
dapan1121 875a081adc fix: typo issue 2023-09-06 14:11:24 +08:00
dapan1121 0b18689fa6 fix: fix coverity issues 2023-09-06 10:57:49 +08:00
wangjiaming0909 5dedaebb01 fix: desc fill missed one window 2023-09-06 10:53:19 +08:00
wangjiaming0909 2c4e0fee07 feat: optimize partition node, replace with sort node 2023-09-05 10:53:30 +08:00
wangjiaming0909 22b53c3ece fix: 1. select tag from meters partition by tag limit returned wrong num of rows
2. select tag from meters partition by tag returned wrong num of rows
2023-09-04 18:16:12 +08:00
liuyao cfcbd53024 merge code 2023-09-01 14:14:54 +08:00
liuyao e4ab656ed5 ENodeType 2023-09-01 14:11:18 +08:00
dapan1121 cc17848b78 fix: merge 3.0 to main 2023-09-01 13:24:47 +08:00
dapan1121 228e6c6acd Merge remote-tracking branch 'origin/main' into 3.0 2023-09-01 10:01:10 +08:00
dapan1121 62d77c8be2
Merge pull request #22654 from taosdata/fix/TD-26046
fix: trim block and partition by constant function issue
2023-08-31 09:04:46 +08:00
wangmm0220 23c4d7eb0a fix:dead lock 2023-08-30 18:10:19 +08:00
dapan1121 2e7897239a fix: trim block and partition by constant function issue 2023-08-30 16:51:44 +08:00
Haojun Liao 24b1a050fc other: merge 3.0 2023-08-30 16:00:14 +08:00
dapan1121 f6321d0c4f Merge remote-tracking branch 'origin/main' into fix/m23.1 2023-08-30 11:03:33 +08:00
liuyao ff2e1fbd9a encode interval op 2023-08-29 15:13:50 +08:00
yihaoDeng 20b037d9cc Merge branch 'enh/3.0' into enh/triggerCheckPoint2 2023-08-28 10:46:00 +08:00
dapan1121 0cce255a02 Merge remote-tracking branch 'origin/3.0' into fix/m23.0 2023-08-28 10:06:53 +08:00
Haojun Liao 88f6596965
Merge pull request #22464 from taosdata/feat/TD-18789
feat:support varbinary type
2023-08-28 09:45:57 +08:00
dapan1121 1f40da6fef Merge remote-tracking branch 'origin/main' into 3.0 2023-08-28 09:28:55 +08:00
shenglian zhou 9fc75fb73d fix: wrong start key for pFill when unit of sliding is y or n 2023-08-25 14:59:39 +08:00
liuyao 5f055b6cff mem leak 2023-08-25 14:55:46 +08:00
liuyao 1019d070fd mem leak 2023-08-25 14:52:45 +08:00
Haojun Liao f805a49df2
Merge pull request #22555 from taosdata/fix/TD-25948
mem leak
2023-08-25 09:28:18 +08:00
dapan1121 3c7ca2418c
Merge pull request #22532 from taosdata/fix/m/TD-25863
fix: fill operator with desc ts order returned 1 more rows
2023-08-24 17:29:57 +08:00
liuyao 7da464d8b7 mem leak 2023-08-24 16:36:58 +08:00
liuyao b142979f7f mem leak 2023-08-24 15:00:09 +08:00
wangjiaming0909 3c8bd57140 fix: fill operator with desc ts order returned 1 more rows 2023-08-24 13:31:28 +08:00
liuyao 08553b7788 mem leak 2023-08-24 11:31:15 +08:00
liuyao 7ebce2814f mem leak 2023-08-24 11:19:59 +08:00
liuyao f66f203caa reload semi session state 2023-08-23 19:04:11 +08:00
liuyao 6b61da1a41 reload semi session state 2023-08-23 15:36:15 +08:00
dapan1121 cb70861986 fix: memory leak issue 2023-08-22 18:40:42 +08:00
dapan1121 fe4e45647e fix: global data sink manager issue 2023-08-22 18:29:25 +08:00
liuyao 689e880ec8 fix asan error 2023-08-21 14:33:39 +08:00
wangjiaming0909 aec02a55be fix: fill last group data between groups 2023-08-21 13:05:13 +08:00
yihaoDeng 6fe649c458 Merge branch 'enh/3.0' into enh/triggerCheckPoint2 2023-08-21 09:12:40 +08:00
yihaoDeng 84799cb920 fix compile error 2023-08-18 17:25:14 +08:00
yihaoDeng 0537323bac fix get error 2023-08-18 16:54:33 +08:00
liuyao 3005fd642c merge 3.0 2023-08-18 15:33:13 +08:00
liuyao 87c65f3b68 Merge remote-tracking branch 'origin/3.0' into enh/triggerCheckPoint2 2023-08-18 15:27:02 +08:00
liuyao 3e3c8eccbb adj op 2023-08-18 14:42:07 +08:00
dapan1121 efc5589aa2 Merge remote-tracking branch 'origin/3.0' into feat/TD-24700 2023-08-18 14:11:26 +08:00
slzhou 85d1dbe00a Merge branch '3.0' of github.com:taosdata/TDengine into szhou/select-tags-scan 2023-08-17 16:27:37 +08:00
dapan1121 43c056fb61 fix: node clone and mac compile issues 2023-08-17 16:01:38 +08:00
shenglian zhou 4a9391929c fix: select tags - ctb cursor pause/unlock and lock/resume 2023-08-17 14:59:17 +08:00
dapan1121 3045a623e1 Merge remote-tracking branch 'origin/3.0' into feat/TD-24700 2023-08-17 14:16:05 +08:00
dapan1121 e8fa9aa633 fix: join blockId and target issues 2023-08-17 13:50:26 +08:00
liuyao 1b8ec28d53 format code 2023-08-17 11:45:26 +08:00
liuyao 380e7406d4 multi agg 2023-08-17 10:22:52 +08:00
liuyao 5ce7688a93 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/ly_refactor 2023-08-17 09:06:46 +08:00
Haojun Liao ea6574b3c7 other: merge 3.0 2023-08-17 00:07:55 +08:00
wangmm0220 b3f945c4c5 fix:conflict 2023-08-16 19:35:05 +08:00
dapan1121 73d7caa63a fix: remove uid from scan list 2023-08-16 19:12:32 +08:00
wangmm0220 f266d51764 feat:support varbinary type 2023-08-16 19:05:07 +08:00
Haojun Liao f1359076c1
Merge pull request #22450 from taosdata/fix/3_liaohj
other: merge main.
2023-08-16 16:48:33 +08:00
dapan1121 143c657571 Merge remote-tracking branch 'origin/3.0' into feat/TD-24700 2023-08-16 14:50:31 +08:00
dapan1121 91d6734b34 fix: join condition push down issue 2023-08-16 14:28:39 +08:00
shenglian zhou e93ed3b556 enhance: table san type and disable partition tags optimize for tag scan 2023-08-16 14:09:22 +08:00
dapan1121 a6ecb7253e
Merge pull request #22390 from taosdata/feat/3.0/TD-25365
feat: optimize select agg_func partition by tag slimit
2023-08-16 13:32:58 +08:00
wangjiaming0909 e587cc50e6 feat: optimize select agg_func partition by tag slimit 2023-08-16 11:20:56 +08:00
kailixu 6ee95dca30 Merge branch '3.0' into fix/TD-25717-3.0 2023-08-16 10:19:34 +08:00
liuyao fc09f8ef1e Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/ly_refactor 2023-08-16 09:36:28 +08:00
Haojun Liao ad9f3cbc43 other: merge main. 2023-08-16 09:14:10 +08:00
kailixu 3b69736b29 fix: set precision of interval with value from table scan node 2023-08-15 19:59:13 +08:00
slzhou 4fdaaba3ce Merge branch '3.0' of github.com:taosdata/TDengine into szhou/tag-scan-opt 2023-08-15 17:18:25 +08:00
slzhou 49e4b11547 fix: fix compilation error 2023-08-15 17:00:53 +08:00
liuyao 19dfcf3a59 refactor stream scan log 2023-08-15 16:29:48 +08:00
shenglian zhou 84e472ad03 enhance: tag cond col list only once and tag scan derive from scan 2023-08-15 16:10:54 +08:00
liuyao 37e6100204 refactor stream scan log 2023-08-15 15:42:50 +08:00
liuyao 1b4e51ee4a Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/ly_refactor 2023-08-15 14:20:49 +08:00
wangmm0220 7441801e9d feat:support varbinary type 2023-08-15 13:57:05 +08:00
dapan1121 edd4a78772
Merge pull request #22408 from taosdata/fix/3.0/TS-3810
fix: make kill query work for sysscanoperator
2023-08-15 10:08:21 +08:00
dapan1121 8fc0f1bbd6 Merge remote-tracking branch 'origin/3.0' into feat/TD-24700 2023-08-15 09:00:53 +08:00
liuyao d1c289823f refactor stream session window 2023-08-14 17:52:39 +08:00
liuyao 4b435e2cbf format code 2023-08-14 17:52:39 +08:00
liuyao 3043c7f09f refactor operator 2023-08-14 17:52:39 +08:00
liuyao 57a020edfc refact stream interval 2023-08-14 17:52:39 +08:00
liuyao 9d1e5a512d add stream task id 2023-08-14 17:52:39 +08:00
dapan1121 6a78053b51 feat: add hint supporting 2023-08-14 17:21:15 +08:00
slzhou f9c897221c fix: move the setting of onlyCtbIdx to front end 2023-08-14 16:30:31 +08:00
slzhou 57d1957dee enhance: tag scan code refactoring 2023-08-14 15:57:27 +08:00
wangjiaming0909 5c276fa547 fix: make kill query work for sysscanoperator 2023-08-14 15:21:58 +08:00
dapan1121 6ce28e8886 Merge remote-tracking branch 'origin/3.0' into feat/TD-24700 2023-08-14 10:49:56 +08:00
dapan1121 b4b9a12d61 fix: memory issue 2023-08-14 09:06:21 +08:00
slzhou f83bfec067 fix: change only meta ctb idx back to false 2023-08-12 08:28:25 +08:00
slzhou edd2fa4f35 fix: pass compilation and simple test 2023-08-12 08:17:43 +08:00
dapan1121 20b3f8c1aa
Merge pull request #22402 from taosdata/fix/TS-3799
fix: add time window boundary check before interpolation
2023-08-11 17:59:55 +08:00
slzhou 47d2f9ad6d fix: first run without tag cond 2023-08-11 17:52:52 +08:00
dapan1121 c9656d3f77 fix: fix memory issues 2023-08-11 17:39:41 +08:00
slzhou 6530658815 fix: continue coding 2023-08-11 17:05:59 +08:00
slzhou 42a4f364c1 Merge branch 'szhou/tag-scan-opt' of github.com:taosdata/TDengine into szhou/tag-scan-opt 2023-08-11 16:48:49 +08:00
shenglian zhou a0c62d215d enhance: tag scan only meta ctb idx backend modification 2023-08-11 14:54:43 +08:00
shenglian zhou 7c39bc9890 fix: some minor modifications 2023-08-11 13:50:41 +08:00
kailixu 1d089fe085 fix: dup read lock on windows 2023-08-11 11:34:57 +08:00
Ganlin Zhao 1afbde7d2f fix: add time window boundary check before interpolation 2023-08-11 10:19:32 +08:00
shenglian zhou 20f5e2af5b continue coding and save work 2023-08-10 17:40:54 +08:00
shenglian zhou b2e615d4e7 enhance: tag scan cursor based block 2023-08-10 17:30:01 +08:00
liuyao e2481599b0 fix mem leak 2023-08-10 13:58:46 +08:00
Haojun Liao f633c7fe2b other: merge 3.0. 2023-08-10 11:56:30 +08:00
Haojun Liao b658608541
Merge pull request #22388 from taosdata/fix/3_liaohj
other: merge main.
2023-08-10 11:43:02 +08:00
dapan1121 ce1b294c51 fix: memory leak issues 2023-08-10 11:29:14 +08:00
dapan1121 81439ba0cf fix: memory invalid read and perf issue 2023-08-09 13:31:38 +08:00
Haojun Liao 3cdb16352c fix(stream): avoid launching check downstream when failed to add stream task into stream meta. 2023-08-09 12:03:14 +08:00
dapan1121 1d0624bbf1 Merge remote-tracking branch 'origin/3.0' into feat/TD-24700 2023-08-09 10:32:13 +08:00
dapan1121 1aac643a9b enh: support single vnode join 2023-08-09 10:30:35 +08:00
Haojun Liao db92546cf7 fix(stream): remove invalid filter. 2023-08-08 16:09:33 +08:00
Haojun Liao 17c6143471 fix(stream): check more status when handling the state transfer. 2023-08-08 15:08:11 +08:00
dapan1121 68e0fb924a
Merge pull request #22165 from taosdata/feat/3.0/TD-25271
feature: optimize interval with limit
2023-08-08 10:34:02 +08:00
Haojun Liao db8ce3de3b other: merge main. 2023-08-08 10:17:51 +08:00
Haojun Liao 327e13c3f7 fix(stream): fix the syntax error. 2023-08-08 10:07:28 +08:00
Haojun Liao ac00e1d520 fix(stream): fetch all data before paused and dump to sink node. 2023-08-08 09:54:43 +08:00
Haojun Liao 0e3fd5277d fix(stream): dump results to sink node before paused. 2023-08-08 09:54:39 +08:00
Haojun Liao ca2183acfd refactor: do some internal refactor. 2023-08-08 09:50:40 +08:00
Haojun Liao 143f39b6f7 fix(stream): set the correct end key of delete block. 2023-08-08 09:49:43 +08:00
dapan1121 a95295774a enh: end table scan 2023-08-07 19:35:33 +08:00
dapan1121 443c6ef318
Merge pull request #22333 from taosdata/fix/TD-25546
fix: fix tsort crash caused by not enough disk space
2023-08-07 19:02:11 +08:00
dapan1121 0546bdceb2 Merge remote-tracking branch 'origin/3.0' into feat/TD-24700 2023-08-07 11:23:15 +08:00
dapan1121 da27a306db fix: mutex init issue 2023-08-07 11:22:25 +08:00
Haojun Liao d3bc7c3c94 refactor: do some internal refactor. 2023-08-07 09:20:53 +08:00
Haojun Liao 8a11a0418f other: merge 3.0 2023-08-07 09:19:26 +08:00
Ganlin Zhao 9f3af66ae0 fix: fix tsort crash caused by not enough disk space 2023-08-04 16:03:06 +08:00
wangjiaming0909 fba43e1748 feature: optimize interval with limit 2023-08-04 15:04:04 +08:00
slzhou 7676afff19 fix: stream use column node 2023-08-03 21:43:08 +08:00
slzhou 658c64f16f fix: make statekey of state window operator not target node 2023-08-03 21:43:08 +08:00
wangjiaming0909 632f5fbe8f feat: optimize table merge scan when 1 child table 2023-08-03 15:33:25 +08:00
wade zhang 211af11f39
Merge pull request #22303 from taosdata/fix/TD-25538
reset state window end key
2023-08-03 14:03:54 +08:00
liuyao 74c69bbb6e reset state window end key 2023-08-03 11:23:46 +08:00
liuyao 3464979489 set dummy delete data request 2023-08-03 09:03:48 +08:00
liuyao 71b000f08c reload state window state 2023-08-01 18:22:40 +08:00
Haojun Liao 6365d5000b
Merge pull request #22271 from taosdata/fix/3_liaohj
fix(stream): dump results to sink node before paused.
2023-08-01 15:50:17 +08:00
Haojun Liao f6ae9cf9bb fix(stream): fetch all data before paused and dump to sink node. 2023-08-01 10:16:14 +08:00
Haojun Liao b83860372c fix(stream): dump results to sink node before paused. 2023-08-01 00:50:30 +08:00
Haojun Liao 36ef9a537f
Merge pull request #22256 from taosdata/fix/TD-25457
check update data
2023-07-31 22:56:05 +08:00
Haojun Liao 2640e41705
Merge pull request #22261 from taosdata/fix/3_liaohj
fix(stream): set the correct end key of delete block.
2023-07-31 22:55:50 +08:00
liuyao 32b59af4b1 check update data 2023-07-31 17:32:24 +08:00
Haojun Liao 9981cecbed refactor: do some internal refactor. 2023-07-31 15:24:35 +08:00
Haojun Liao fe21943c9c fix(stream): set the correct end key of delete block. 2023-07-31 14:23:46 +08:00
Haojun Liao f359a0dca3 fix(stream): set the correct end key of delete block. 2023-07-31 14:22:46 +08:00
liuyao 09c806539f fix double free 2023-07-30 17:21:42 +08:00
Haojun Liao 8dfef8768a other: merge 3.0 2023-07-29 22:54:16 +08:00
Haojun Liao 80ad5a0abb
Merge pull request #22243 from taosdata/fix/3_liaohj
fix(stream): initialize the filter window initial range.
2023-07-29 21:10:42 +08:00
Haojun Liao 399088e2bd fix(stream): remove invalid code. 2023-07-29 19:23:35 +08:00
Haojun Liao 94551e6e46 fix(stream): update the load block position. 2023-07-29 18:48:22 +08:00
Haojun Liao e0c310215c
Merge pull request #22237 from taosdata/fix/TD-25420
init scan state
2023-07-29 16:55:43 +08:00
Haojun Liao 71e16d1eeb
Merge pull request #22238 from taosdata/fix/TD-25423
save compact window info
2023-07-29 16:55:27 +08:00
Haojun Liao 0bd2548937 fix(stream): initialize the filter window initial range. 2023-07-29 16:41:01 +08:00
Haojun Liao f6e07d1fdb other: merge 3.0 2023-07-29 01:32:02 +08:00
Haojun Liao 92d1dbd9ad fix(stream): set the time window filter before generating create table result. 2023-07-29 01:23:06 +08:00
liuyao 73ed6fe649 save compace window info 2023-07-28 19:30:26 +08:00
dapan1121 b7126b9cc6 Merge remote-tracking branch 'origin/3.0' into feat/TD-24700 2023-07-28 18:01:11 +08:00
dapan1121 9ed1417bba enh: remove group cache 2023-07-28 18:00:33 +08:00
liuyao d712124921 init scan state 2023-07-28 17:25:56 +08:00
dapan1121 9c7b53083b
Merge pull request #22223 from taosdata/fix/td-25378
fix: fix memleak during create initial sources for block merge sort
2023-07-28 13:09:34 +08:00
Haojun Liao 2a78cd2d23
Merge pull request #22215 from taosdata/fix/liaohj
other: merge main.
2023-07-28 13:06:17 +08:00
slzhou bcf4c1ebae fix: fix memleak during create initial sources for block merge sort 2023-07-28 09:54:56 +08:00
Haojun Liao 688884de08
Merge pull request #22220 from taosdata/fix/ly_stream_fill
fix stream fill issue
2023-07-28 09:27:21 +08:00
Haojun Liao ccc0f13649
Merge pull request #22214 from taosdata/fix/3_liaohj
fix(stream): scan wal in step2
2023-07-28 00:42:15 +08:00
Haojun Liao 22a5a18fff fix(stream): 1. set correct timewindow after step2. 2. handle the case when the task is failed to be added into the meta store. 2023-07-27 18:57:36 +08:00
liuyao f667a09cc6 fix stream fill issue 2023-07-27 18:56:25 +08:00
liuyao 5d21f50340 adjust history task trigger mode 2023-07-27 17:45:28 +08:00
Haojun Liao b145771a1b other: merge 3.0 2023-07-27 16:38:57 +08:00
Haojun Liao 3d403dca5a other: merge main. 2023-07-27 16:23:41 +08:00
Haojun Liao 3fdbd5383f Merge remote-tracking branch 'origin/fix/3_liaohj' into fix/3_liaohj 2023-07-27 16:11:07 +08:00
Haojun Liao 6ff50d4eaf fix(stream): update the step2 scan wal files. 2023-07-27 16:10:55 +08:00
liuyao 7c9898cfa5 adj stream scan 2023-07-27 15:56:06 +08:00
liuyao c54bd55c68 op stream scan 2023-07-27 15:16:22 +08:00
liuyao c72274504e op stream scan 2023-07-27 15:13:57 +08:00
liuyao 0b53bdbae6 op stream scan 2023-07-27 15:09:25 +08:00
liuyao 0ac7ebe9c7 op stream scan 2023-07-27 14:56:06 +08:00
Haojun Liao 40fe3ef4f6 fix(stream): refactor the step2 wal scan. 2023-07-27 14:49:20 +08:00
liuyao 1894608b80 optimize session operator reload state 2023-07-27 09:59:58 +08:00
Haojun Liao 05504023f5
Merge pull request #22200 from taosdata/fix/ly_stream_test
stream fill operator mem leak
2023-07-27 09:38:22 +08:00
dapan1121 e83a46b88f enh: cache necessary file for seq mode 2023-07-26 19:17:59 +08:00
liuyao c368db30c3 stream fill operator mem leak 2023-07-26 17:38:37 +08:00
Haojun Liao 432c943c25 fix(stream): do filter before the update check. 2023-07-26 16:34:39 +08:00
Haojun Liao 610f9d19c1
Merge pull request #22188 from taosdata/fix/3_liaohj
fix(stream): set the correct step2 scan time window range.
2023-07-26 16:34:10 +08:00
Haojun Liao df57768a3e Merge branch '3.0' into fix/3_liaohj 2023-07-26 14:45:11 +08:00
dapan1121 4e5fbb52ee Merge remote-tracking branch 'origin/3.0' into feat/TD-24700 2023-07-26 13:56:46 +08:00
dapan1121 6a0061ccfb fix: invalid task status update issue 2023-07-26 13:54:58 +08:00
Haojun Liao 4d6b9d4a15 fix(stream): split delete msg for real-time scan from wal. 2023-07-26 09:08:17 +08:00
Haojun Liao 1c1bf63e1f other: merge 3.0 2023-07-25 18:17:11 +08:00
dapan1121 66042669a1
Merge pull request #22176 from taosdata/szhou/enhance-limit-proc
fix: choose heap sort for table merge scan with long row and limit
2023-07-25 17:48:11 +08:00
slzhou f4c28d848b fix: table merge scan use heap sort when there is limit 2023-07-25 15:23:00 +08:00
Haojun Liao d29f835a63 fix(stream): set the correct step2 scan time window range. 2023-07-25 15:09:22 +08:00
slzhou ca2ad71bb8 fix: return null when there are no input stream blocks for priority queue sort 2023-07-25 13:08:37 +08:00
slzhou a205eba2ab fix: choose heap sort for table merge scan when row size is big and has limit 2023-07-25 09:48:08 +08:00
dapan1121 fb63294289 fix: hash join res issue 2023-07-25 09:03:52 +08:00
dapan1121 10f9c40dba
Merge pull request #22171 from taosdata/szhou/enhance-limit-proc
enhance: skip data blocks with the merge limit ts when create initial…
2023-07-25 08:42:35 +08:00
Haojun Liao 01f11bf5a6 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2
# Conflicts:
#	source/common/src/tglobal.c
#	source/libs/executor/src/timewindowoperator.c
2023-07-24 15:25:43 +08:00
Haojun Liao 1e34f84f78 other: merge 3.0 2023-07-24 15:23:03 +08:00
slzhou 1d24b96e82 enhance: skip data blocks with the merge limit ts when create initial source 2023-07-24 15:16:39 +08:00
liuyao 992f1cb328 merge code 2023-07-24 15:00:48 +08:00
dapan1121 6fbf251978
Merge pull request #22138 from taosdata/enh/TS-3625
fix: fix(value, null) output behavior
2023-07-24 13:17:19 +08:00
dapan1121 4f75eb5655 Merge remote-tracking branch 'origin/3.0' into feat/TD-24700 2023-07-24 11:43:15 +08:00
dapan1121 ebf1a91fb5 enh: read/write from disk cache 2023-07-24 11:39:00 +08:00
Haojun Liao 321be1f83f
Merge pull request #22135 from taosdata/fix/3_liaohj
refactor: do some internal refactor.
2023-07-22 15:06:28 +08:00
dapan1121 ae8caa8275 enh: add disk cache 2023-07-21 19:25:38 +08:00
dapan1121 3725cafe00 enh: add disk cache 2023-07-21 17:30:09 +08:00
liuyao 4451b2185a transform stream state 2023-07-21 10:32:53 +08:00
liuyao d45563684b
Merge branch '3.0' into enh/triggerCheckPoint2 2023-07-21 10:23:41 +08:00
Ganlin Zhao 62b73db8bf fix: fix(value, null) output behavior 2023-07-21 10:19:41 +08:00
Ganlin Zhao 624b6b094f fix: fix(value, null) output behavior 2023-07-21 10:14:12 +08:00
Haojun Liao d0da988b7d Merge branch '3.0' into fix/3_liaohj 2023-07-21 09:47:44 +08:00
dapan1121 2ef01728ca
Merge pull request #22089 from wangjiaming0909/fix/3.0/TD-23763
feat: optimize partition by tbname slimit
2023-07-21 09:29:36 +08:00
dapan1121 fde8eabfd7
Merge pull request #22111 from taosdata/szhou/tms-dev-2
enhance: table merge scan optimization
2023-07-20 16:28:29 +08:00
Haojun Liao 45cb478b31 refactor: do some internal refactor. 2023-07-20 15:36:46 +08:00
wangjiaming0909 7d850c1a5e feat: optimize partition by tbname slimit 2023-07-20 15:07:55 +08:00
slzhou 1a0031a43c enhance: uinfo to qdebug and increase pages num to 2048 2023-07-20 13:53:13 +08:00
slzhou 5d9f6fd481 fix: fix limit/offset bugs 2023-07-20 12:29:34 +08:00
dapan1121 7221f447df fix: group cache table index issue 2023-07-20 11:00:29 +08:00
dapan1121 3f58bc5578 fix: group cache last block index issue 2023-07-20 10:55:15 +08:00
dapan1121 58c5d5e70e fix: group cache block cache issue 2023-07-20 10:21:19 +08:00
slzhou 30129f64da enhance: merge blocks of the same table before sort 2023-07-20 09:28:19 +08:00
liuyao 8a6ed67f9d fill history 2023-07-20 09:13:30 +08:00
dapan1121 b9b8fa1ba2 fix: table list issue 2023-07-19 19:41:54 +08:00
dapan1121 a41888a9ef fix: batch fetch issue 2023-07-19 19:14:30 +08:00
liuyao af18afba9d fill history 2023-07-19 17:19:55 +08:00
liuyao c7e4aa4f77 set win range 2023-07-19 15:51:22 +08:00
dapan1121 d125bb0952 fix: merge join reset params issue 2023-07-19 14:59:05 +08:00
liuyao 8481725517 remove redundant results 2023-07-19 14:58:28 +08:00
dapan1121 8b62c75c26 fix: merge join ignore param issue 2023-07-19 14:42:18 +08:00
slzhou d1a1976aa4 enhance: add limit to merge sort 2023-07-19 13:59:43 +08:00
dapan1121 38be8f2a8e fix: reset rows before reuse block 2023-07-19 13:42:15 +08:00
dapan1121 6960872515 enh: add merge join reset 2023-07-19 11:56:13 +08:00
dapan1121 b2cea6ab84 fix: block info capicity issue 2023-07-19 11:42:54 +08:00
dapan1121 6d7912003d fix: block data memory issue 2023-07-19 11:34:44 +08:00
dapan1121 c45359c989 enh: add batch table scan 2023-07-19 10:37:30 +08:00
liuyao fd02b9a71e
Merge branch '3.0' into enh/triggerCheckPoint2 2023-07-19 10:02:06 +08:00
wangmm0220 5c344b0159 fix:conflicts from main 2023-07-19 09:05:05 +08:00
dapan1121 04fea1e38f enh: add batch fetch process 2023-07-18 19:35:45 +08:00
liuyao caa4503352 reset state key memory 2023-07-18 18:02:39 +08:00
liuyao bada18f5f0 heap use after free 2023-07-18 17:59:42 +08:00
slzhou 4348b9c51d fix: use uinfo to show on stdout 2023-07-18 16:47:31 +08:00
slzhou f79fc81d9c fix: add to page buf in the same way as single source sort 2023-07-18 15:46:38 +08:00
liuyao 14e591c802 mem leak 2023-07-18 14:51:32 +08:00
dapan1121 294376de0b enh: add batch table scan 2023-07-18 14:44:53 +08:00
yihaoDeng ad0b0c3821 fix mem leak 2023-07-18 06:04:41 +00:00
dapan1121 c2245a3546
Merge pull request #22100 from taosdata/fix/TD-25241
fix: fix interval in nested query filter not applied
2023-07-18 13:52:35 +08:00
liuyao a4676fc74b init winkey 2023-07-18 10:43:35 +08:00
slzhou 97a6e89d11 enhance: refactor create initial sources 2023-07-18 10:38:40 +08:00
Ganlin Zhao 94b13df641 fix: fix interval in nested query filter not applied 2023-07-18 10:36:07 +08:00
slzhou ba2b404295 enhance: optimize msortComparFn for table merge scan 2023-07-17 21:07:55 +08:00
yihaoDeng 1b8ec19509 fix compile err on windows 2023-07-17 11:44:40 +00:00
liuyao d45adeaa4e add checksum 2023-07-17 18:04:17 +08:00
slzhou 1b9754f1bc enhance: add log with info level. change to debug later 2023-07-17 16:18:06 +08:00
Haojun Liao 08f43b9d00 fix(stream): fix checkpoint block not fetched bug. 2023-07-17 15:31:54 +08:00
dapan1121 c22619ab67 fix: add perf debug info 2023-07-17 15:26:59 +08:00
slzhou 655233fd4f fix: create initial source with blocks 2023-07-17 15:05:30 +08:00
dapan1121 2e0b4236e3 fix: hash join row index issue 2023-07-17 14:45:45 +08:00
liuyao e80ae266ab refact 2023-07-17 14:37:54 +08:00
dapan1121 efbb6cb193 fix: add debug line 2023-07-17 13:50:19 +08:00
Haojun Liao b2a905bd91
Merge branch '3.0' into enh/triggerCheckPoint2 2023-07-17 11:50:12 +08:00
dapan1121 8872e017af fix: group table scan issue 2023-07-17 11:15:17 +08:00
dapan1121 a1e18ac898 fix: fix global cache issue 2023-07-17 09:25:28 +08:00
shenglian zhou 9a0e9df567 enhance: block is ts sorted and each book is a source 2023-07-16 23:39:41 +08:00
slzhou f93af4d2e0 enhance: pass simple test 2023-07-16 20:28:54 +08:00
shenglian zhou 8b6d7db7ad enhance: use one tsdb reader to read table sequentially 2023-07-16 17:54:39 +08:00
dapan1121 188df1d675 fix: fix bugs 2023-07-14 19:36:56 +08:00
wangmm0220 6762a01d88 Merge branch 'main' of https://github.com/taosdata/TDengine into mark/tmq 2023-07-14 16:44:00 +08:00
wangmm0220 bbdcbcb75b fix:modify commit version to next validate version 2023-07-14 16:43:28 +08:00
dapan1121 aca9c5fe19 Merge remote-tracking branch 'origin/3.0' into feat/TD-24700 2023-07-14 13:31:07 +08:00
dapan1121 2312f10372 enh: support concurrent fetch from group cache 2023-07-14 13:30:13 +08:00
dapan1121 1a19d29eee
Merge pull request #22060 from taosdata/fix/TD-25209
fix: reset interpolation buffer after last valid row for interval + fill(next)
2023-07-14 09:30:56 +08:00
Ganlin Zhao a7af4d9348 fix: reset interpolation buffer after last valid row for interval + fill(next) 2023-07-13 18:18:26 +08:00
Haojun Liao e0ea0f2df4
Merge pull request #22020 from taosdata/fix/liaohj
other: merge main
2023-07-13 17:55:28 +08:00
liuyao d6bb19485a mem leak 2023-07-13 16:53:07 +08:00
liuyao 20235fb953 set ck id 2023-07-13 11:20:18 +08:00
Haojun Liao f41bcd73b0 other: merge main. 2023-07-13 11:02:09 +08:00
Haojun Liao c388802bda
Merge pull request #22024 from taosdata/fix/3_liaohj
fix(stream): fix concurrent bug in save task meta.
2023-07-12 18:17:27 +08:00
liuyao 020cdf4d27 get checkpoint id 2023-07-12 14:06:36 +08:00
dapan1121 6763c6f98c enh: support parallel group cache fetch 2023-07-12 11:29:54 +08:00
liuyao 0cfc81c16b add checkpoint id for recover 2023-07-12 11:08:12 +08:00
liuyao 7d4bb1b932 add checkpoint id for recover 2023-07-12 10:48:58 +08:00
Haojun Liao 9484f3da94
Merge branch '3.0' into enh/triggerCheckPoint2 2023-07-12 10:20:18 +08:00
Haojun Liao a049e310f6 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-07-12 10:16:26 +08:00
Haojun Liao 6f2fc4fab3 fix(stream): commit task meta after do vnode-wide checkpoint. 2023-07-12 10:16:14 +08:00
dapan1121 a42bd9e478 Merge remote-tracking branch 'origin/3.0' into feat/TD-24700 2023-07-11 19:34:39 +08:00
dapan1121 185071fae9 enh: add group cache func 2023-07-11 19:34:03 +08:00
Haojun Liao fed3803739 fix(stream): fix memory leak. 2023-07-11 19:29:52 +08:00
liuyao 6298f17c45 delete invalid code 2023-07-11 19:21:27 +08:00
wangjiaming0909 1d7515213b feat: 1. add limit for diskBasedBuf
2. use referenced tuple before actually pushing into pq
3. use limitInfo instead of maxRows in sort pyhsical node
2023-07-11 14:16:20 +08:00
Shungang Li 8f91da24e4 fix: type convert failure returns errcode
TSDB_CODE_SCALAR_CONVERT_ERROR:
"Cannot convert to specific type"
2023-07-11 10:20:50 +08:00
wade zhang 13bc1e744e
Merge pull request #21963 from luckeverda/fix/TD-24473-new
fix/TD-24473
2023-07-11 09:32:25 +08:00
liuyao 184b2d64f7 scan op state 2023-07-11 09:18:17 +08:00
Haojun Liao 3ffdbe923d other: merge 3.0 2023-07-11 09:12:57 +08:00
liuyao f35fd3c2f7 scan op state 2023-07-11 09:09:24 +08:00
liuyao 93f546f50d stream operator decode 2023-07-10 19:33:31 +08:00
dapan1121 2d3f9c739d enh: add group cache 2023-07-10 19:23:52 +08:00
dapan1121 61c85ae4fc Merge remote-tracking branch 'origin/3.0' into feat/TD-24700 2023-07-10 15:06:21 +08:00
dapan1121 39a58c354d
Merge pull request #22008 from taosdata/fix/TS-3648
fix: fix interp fill value unsigned type not being handled
2023-07-10 14:50:23 +08:00
liuyao ee196a88e6 fix ci bug 2023-07-10 13:45:18 +08:00
Ganlin Zhao edc2a3a780 fix an issue 2023-07-10 11:35:29 +08:00
Ganlin Zhao f7608ce92d remove udfd agg function handling 2023-07-10 11:35:03 +08:00
Ganlin Zhao 19d4c79ac6 return error code of udf execution failure 2023-07-10 11:34:49 +08:00
Ganlin Zhao cde9eac954 enh: add procedures on server for udf/udaf in nested queries where outer query is
constant table
2023-07-10 11:34:32 +08:00
Ganlin Zhao 05f26a842b fix: fix interp fill value unsigned type not being handled 2023-07-10 11:28:39 +08:00
liuyao f4df89f755 stream operator checkpoint 2023-07-10 11:16:50 +08:00
liuyao 84f0dfd6d4 stream operator checkpoint 2023-07-10 11:07:08 +08:00
Haojun Liao 5940bbfb33 fix(stream): set correct datablock. 2023-07-10 10:42:38 +08:00
liuyao e1134423de stream scan checkpoint 2023-07-10 10:22:09 +08:00
liuyao fa8025f337 scan operator checkpoinbt 2023-07-10 10:14:30 +08:00
Shungang Li 8de31219b4 fix: type convert failure returns errcode
TSDB_CODE_SCALAR_CONVERT_ERROR:
"Cannot convert to specific type"
2023-07-10 09:29:29 +08:00
Ganlin Zhao 340e4de30d fix an issue 2023-07-10 09:12:21 +08:00
Haojun Liao a5c19427e7 fix(stream): send correct rsp to mnode. 2023-07-08 09:39:44 +08:00
dapan1121 8e1f4d1d6a fix: operator param issues 2023-07-07 19:31:56 +08:00
dapan1121 c19c59d5e6 enh: optimize oprator param usage 2023-07-07 16:49:35 +08:00
dapan1121 779224f0a6 fix: fix bugs 2023-07-06 19:33:31 +08:00
Ganlin Zhao 365993d775 remove udfd agg function handling 2023-07-06 16:11:41 +08:00
liuyao d3bac29a32 checkpoint 2023-07-06 15:33:16 +08:00
Ganlin Zhao d4e07c551e return error code of udf execution failure 2023-07-06 15:05:49 +08:00
Ganlin Zhao b734506363 enh: add procedures on server for udf/udaf in nested queries where outer query is
constant table
2023-07-06 14:54:01 +08:00
liuyao 0e914a19c6 stream operartor checkpoint 2023-07-06 14:28:34 +08:00
Haojun Liao 5a9461a69a other: merge 3.0 2023-07-06 11:52:21 +08:00
Haojun Liao f4a3567935 other: merge 3.0 2023-07-06 11:24:30 +08:00
dapan1121 18c2400c75 fix: dynamic query ctrl compile issues 2023-07-06 11:13:43 +08:00
dapan1121 b371b7e6be fix: compile issue and merge join crash issue 2023-07-06 10:52:28 +08:00
dapan1121 4cb849267a Merge remote-tracking branch 'origin/3.0' into feat/TD-24700 2023-07-06 09:55:17 +08:00
dapan1121 e7c200ad6e enh: support dynamic table scan 2023-07-06 09:54:45 +08:00
dapan1121 0718859c0a enh: support passing params between nodes 2023-07-05 19:24:06 +08:00
Haojun Liao 74f5b3f80e
Merge pull request #21959 from taosdata/refact/fillhistory
refactor: do some internal refactor.
2023-07-05 17:47:00 +08:00
Haojun Liao 03dbcbf055 refactor: do some internal refactor. 2023-07-05 15:55:55 +08:00
dapan1121 c85bbef2e9 Merge remote-tracking branch 'origin/3.0' into feat/TD-24700 2023-07-05 11:13:57 +08:00
dapan1121 7b9d73c77a feat: add dynamic query ctrl operator 2023-07-05 11:07:08 +08:00
Haojun Liao 9b3e34d589
Merge pull request #21735 from taosdata/refact/fillhistory
refactor: refactor the fill history operation
2023-07-05 10:48:51 +08:00
Haojun Liao ff2bf35603 fix(stream): fix error in set the version range for secondary scan. 2023-07-04 15:08:39 +08:00
Haojun Liao 82342ebdc7
Merge pull request #21934 from taosdata/feature/TD-20678
feat:subscribe only meta info
2023-07-04 11:28:27 +08:00
dapan1121 ac35ae9839 feat: add dynamic query ctrl operator 2023-07-03 19:29:46 +08:00
Haojun Liao 200575647c
Merge branch '3.0' into refact/fillhistory 2023-07-03 15:16:18 +08:00
Haojun Liao 20d099dfa6
Merge pull request #21901 from taosdata/fix/liaohj
fix: fix coverity issue.
2023-07-03 15:15:21 +08:00
dapan1121 5971395dcf feat: add group cache operator 2023-07-03 13:42:06 +08:00
dapan1121 60290b98e4 feat: add group cache operator 2023-06-30 19:20:36 +08:00
wangmm0220 58c7011e0e feat:support only meta in tmq subscriptions 2023-06-30 11:42:40 +08:00
dapan1121 7dddfd0a5a Merge remote-tracking branch 'origin/3.0' into feat/TD-24700 2023-06-29 19:29:27 +08:00
Haojun Liao 622e1cb608 fix: fix coverity issue. 2023-06-29 15:54:09 +08:00
Haojun Liao c24a7f6454
Merge pull request #21876 from taosdata/feature/TS-3495
fix:add log & init to 0 specific
2023-06-29 13:44:25 +08:00
wade zhang 80130b2691
Merge pull request #21851 from luckeverda/fix/TD-24473
fix/TD-24542/TD-24484/TD-24473
2023-06-29 10:42:53 +08:00
Shungang Li 308ba7a02e fix: type geometry predicates support
support "=, <>, is null, is not null, in, not in"
2023-06-29 09:44:51 +08:00
dapan1121 9f0da17c49 Merge remote-tracking branch 'origin/3.0' into feat/TD-24700 2023-06-28 19:40:55 +08:00
wangmm0220 6cd0f98e44 Merge branch '3.0' of https://github.com/taosdata/TDengine into feature/TS-3495 2023-06-28 18:09:30 +08:00
liuyao 2fc5eeb810 session win range 2023-06-28 17:20:08 +08:00
Haojun Liao f4309603e3 fix(stream): fix syntax error. 2023-06-28 14:05:38 +08:00
Haojun Liao ed900d6ff6
Merge branch '3.0' into refact/fillhistory 2023-06-28 13:48:26 +08:00
wangmm0220 1fc664693e fix:continue consume if wal is dropped 2023-06-28 11:54:48 +08:00
Haojun Liao a19e63fd23 fix(stream): fix error in handling fill history. 2023-06-27 23:00:14 +08:00
dapan1121 8f39b9d2e4 enh: optimize query plan 2023-06-27 19:36:51 +08:00
Yihao Deng 4de7db06f9
Merge branch '3.0' into enh/triggerCheckPoint2 2023-06-27 17:57:14 +08:00
wangjiaming0909 57ddb3437d feature: optimize order by limit using priority queue 2023-06-27 17:50:50 +08:00
Haojun Liao 32fddeff18 fix(stream): fix error retrieve data from source task.And optimize the test cases. 2023-06-27 16:24:47 +08:00
Haojun Liao 3289ad62be other: merge 3.0 2023-06-27 11:33:40 +08:00
Haojun Liao 600607ef84
Merge pull request #21846 from taosdata/fix/TD-24969
stream single session op end window function
2023-06-27 10:38:38 +08:00
dapan1121 4dae9f4eff merge main to 3.0 2023-06-26 18:43:00 +08:00
liuyao d1ca2ae2a0 stream single session op end window function 2023-06-26 17:10:06 +08:00
dapan1121 ce2635074d enh: add uid/vgid functions 2023-06-26 11:48:47 +08:00
liuyao 1d22e6ba52 stream session end window function 2023-06-26 10:51:45 +08:00
yihaoDeng 04ab8e19d0 Merge branch 'enh/dev30' into enh/triggerCheckPoint2 2023-06-25 19:58:45 +08:00
liuyao e236bf818c set fill history info 2023-06-25 17:47:10 +08:00
dapan1121 9972aa81d6 Merge remote-tracking branch 'origin/3.0' into feat/TD-24700 2023-06-25 17:31:32 +08:00
dapan1121 24a5a3f41b fix: compile issues 2023-06-25 17:31:04 +08:00
Haojun Liao e4e66ad0a4 fix: fix memory leak. 2023-06-25 14:56:08 +08:00
Haojun Liao 7e7feeffdf fix: fix memory leak. 2023-06-25 14:38:31 +08:00
Haojun Liao 6857881742 Merge branch '3.0' into refact/fillhistory 2023-06-25 10:41:32 +08:00
wade zhang 254a20bdf3
Merge pull request #21660 from luckeverda/feat/TD-23739
feat/TD-23739: enhance ttl, deletetime modified by writing-op
2023-06-25 09:06:57 +08:00
Haojun Liao ceb78fdad2
Merge branch '3.0' into refact/fillhistory 2023-06-24 18:53:48 +08:00
dapan1121 3ad98b4eea fix: copy result issue 2023-06-21 19:51:06 +08:00
dapan1121 2b55a75e82 enh: refact code 2023-06-21 19:33:27 +08:00
liuyao d23c80b12f free mem 2023-06-21 10:24:34 +08:00
wangjiaming0909 eb7d23ca95 fix: fill operator with wrong input ts order 2023-06-21 09:23:58 +08:00
liuyao 1bed2b1e40 free mem 2023-06-21 09:13:46 +08:00
dapan1121 7e555e437b enh: add hash join 2023-06-20 19:34:16 +08:00
liuyao fbed0acace free mem 2023-06-20 19:23:30 +08:00
liuyao 3cfda2c579 scan op transform 2023-06-20 17:44:41 +08:00
Minglei Jin fa5d52613e fix(query/scan-oper): use META_READER_NOLOCK to init meta reader 2023-06-20 17:33:28 +08:00
liuyao 74bea44300 stream op transform 2023-06-20 17:30:59 +08:00
yihaoDeng 548e439aa2 add checkpoint 2023-06-19 20:48:49 +08:00
dapan1121 1a53a9084e feat: add buffer page 2023-06-19 19:40:15 +08:00
Shungang Li b93f653d7e feat: enhance ttl, deletetime modified by writing-ops
new config item: ttlChangeOnWrite (default 0)
ttl delete time changes on last write if true
2023-06-19 19:03:35 +08:00
liuyao 41c193945f fill history pause&resume 2023-06-19 17:28:19 +08:00
dapan1121 1ca24fea6b
Merge pull request #21742 from wangjiaming0909/feature/3.0/TD-24656
feature: add input, output ts order for execution plans
2023-06-18 19:24:29 +08:00
slzhou fc523d1265 fix: at most 128 k-way merge to decrease memory usage 2023-06-18 07:53:35 +08:00
slzhou 9e781ed7a6 fix: destory data block to fix oom 2023-06-18 06:50:53 +08:00
slzhou 577c131360 fix: search k-way number 2023-06-17 22:13:08 +08:00
slzhou 0a567252f5 fix: oom issue since table merge scan 2023-06-17 18:50:33 +08:00
wangjiaming0909 61309862c2 fix comments of TD-24656 2023-06-16 18:12:02 +08:00
Ganlin Zhao 9cddf06053 handle 0 result case for groups 2023-06-16 16:11:56 +08:00
Ganlin Zhao e4c9a7474e remove test code 2023-06-16 14:58:23 +08:00
Ganlin Zhao e74c0ac987 save index instead of ts 2023-06-16 14:11:19 +08:00
dapan1121 bb8840d4ec
Merge pull request #21749 from taosdata/szhou/fix-ts3543
fix: table merge scan oom with muliti-level merge sort
2023-06-16 14:05:25 +08:00
dapan1121 9a3781ea19
Merge pull request #21743 from taosdata/fix/td-24784
fix: cleanup datablock so that varmeta length is right
2023-06-16 13:20:56 +08:00
wade zhang d5f37359f4
Merge pull request #21722 from taosdata/fix/TD-24761
fix(tsdb/cache): rewrite cache update to fix cpu usage
2023-06-16 11:52:02 +08:00
wangjiaming0909 fb4f174fbc feature: add input, output ts order for execution plans 2023-06-16 10:26:09 +08:00
Ganlin Zhao fe2629d061 Merge branch '3.0' into feat/TD-22193 2023-06-16 10:16:51 +08:00
Haojun Liao 933801269a fix(stream): fix memory leak and failed to close vnode. 2023-06-16 09:55:11 +08:00
slzhou e35553d6a0 fix: fix memory sanitizer error 2023-06-16 09:02:15 +08:00
shenglian zhou 376688479c fix: remove multi-reader since two level merge is used 2023-06-16 09:00:50 +08:00
slzhou 0b61b88c10 fix: fix oom issue 2023-06-16 09:00:31 +08:00
dapan1121 e6afcbf07f feat: hash join init version 2023-06-15 19:34:15 +08:00
Haojun Liao f3df37bf28 fix(stream): fix memory leak. 2023-06-15 17:56:58 +08:00
Minglei Jin 158ae209bf cache/lru: new applyF API for tlrucache 2023-06-15 16:34:51 +08:00
shenglian zhou b7165da5e3 fix: cleanup datablock so that varmeta length is right 2023-06-15 16:10:28 +08:00
Haojun Liao 74e0138f72 Merge branch '3.0' into refact/fillhistory 2023-06-15 15:25:00 +08:00
liuyao 693942b821 trans state 2023-06-15 14:13:17 +08:00
Haojun Liao 1b9eca5ce0 other: merge main. 2023-06-15 13:03:17 +08:00
Haojun Liao 55724157c4 refactor: remove one function. 2023-06-15 10:40:25 +08:00
Haojun Liao 7c6fbd7772 enh(stream): do some internal refactor and support secondary scan for history data. 2023-06-14 14:10:09 +08:00
yihaoDeng ed33e6ea43 change log level when filter tag 2023-06-13 07:06:08 +00:00
slzhou 13ddd37529 fix: fix memory sanitizer error 2023-06-13 14:51:41 +08:00
liuyao c58bde9715 stream operator fill history 2023-06-13 10:57:36 +08:00
yihaoDeng 8dc6d1cc6a change log level when filter tag 2023-06-13 01:51:22 +00:00
dapan1121 7956a8c420 fix: row size too big issue 2023-06-09 13:49:25 +08:00
Haojun Liao 53246ed6bb other: merge other branch. 2023-06-09 09:41:10 +08:00
Ganlin Zhao bef6214904 remove test code 2023-06-08 19:30:05 +08:00
Ganlin Zhao 145bb93967 fix block only have one row 2023-06-08 19:21:04 +08:00
Haojun Liao c9aa59cbb9 refactor: do some internal refactor. 2023-06-08 18:59:25 +08:00
Ganlin Zhao 21fccc2d48 fix switchin group issue 2023-06-08 18:25:32 +08:00
Ganlin Zhao 7ee05df7c6 fix lastBlock remain ts not saved 2023-06-08 17:46:25 +08:00
Ganlin Zhao b4c2085ddc feat: add pipeline processing for timeslice operator 2023-06-08 16:32:35 +08:00
Haojun Liao 2b6ace653a refactor: do some internal refactor. 2023-06-08 16:14:27 +08:00
dapan1121 a9ed1f6d46
Merge pull request #21567 from wangjiaming0909/fix/3.0/TD-24525
fix: prevent projectoperator scanning all rows when limit with no group
2023-06-08 15:14:48 +08:00
Haojun Liao f582705feb refactor: do some internal refactor. 2023-06-08 14:18:06 +08:00
dapan1121 958160be0b
Merge pull request #21599 from taosdata/enh/TD-24274
enh: enable interp fill value support scarlar expression
2023-06-08 10:39:38 +08:00
dapan1121 6c74282946
Merge pull request #21597 from taosdata/enh/TD-24586
enh: optimize filter performance
2023-06-08 09:05:56 +08:00
Ganlin Zhao c612d945ec fix fill value bug 2023-06-07 18:27:29 +08:00
dapan1121 a4f5bac344
Merge pull request #21606 from taosdata/szhou/fix-ts3498
fix: rewrite count(*) to count(1) for temp table
2023-06-07 15:56:50 +08:00
dapan1121 47c891fbc5 Merge remote-tracking branch 'origin/main' into enh/TD-24586 2023-06-07 09:27:56 +08:00
liuyao 2ab43ca0d0 semi interval op check data ts 2023-06-07 09:24:17 +08:00
Haojun Liao 6a3c935b4a fix(stream): fix error in fill history scan. 2023-06-07 09:15:55 +08:00
wangjiaming0909 3cb64f3775 fix: prevent projectoperator scanning all rows when limit with no group 2023-06-06 19:28:55 +08:00
liuyao bff2aae354 fix stream ci issue 2023-06-06 19:18:43 +08:00
liuyao 49ca147c47 fix stream ci issue 2023-06-06 19:18:43 +08:00
dapan1121 a0428387a9 enh: corrent column data reassign issue 2023-06-06 16:44:15 +08:00
liuyao 201d0f2d18 fix stream ci issue 2023-06-06 16:37:08 +08:00
dapan1121 65d323d9c7
Merge pull request #21222 from taosdata/fix/TD-24001
enh: optimize timeline function validation
2023-06-06 14:22:53 +08:00
dapan1121 02b1257b01 enh: reassign data column in blocks 2023-06-06 11:17:02 +08:00
slzhou e2ac3d00ad fix: fix mem leak 2023-06-06 10:20:52 +08:00
dapan1121 7381209618 enh: optimize filter performance 2023-06-05 16:08:11 +08:00
Haojun Liao fcc706c45c enh(stream): refactor the fill history task. 2023-06-05 15:59:01 +08:00
Minglei Jin d02746d86f fix(query/sys): pause/resume with sys scan operator 2023-06-05 15:24:39 +08:00
dapan1121 532e02fb2a enh: improve filter performance 2023-06-05 10:47:15 +08:00
Haojun Liao 044e56fc97
Merge branch '3.0' into fix/resume_mem 2023-06-03 12:19:17 +08:00
Haojun Liao cb7bb954b5
Merge pull request #21577 from taosdata/fix/TD-24515
reset unclosed window info
2023-06-03 11:21:06 +08:00
Haojun Liao cca69f3038 Merge branch '3.0' into fix/resume_mem 2023-06-02 18:40:48 +08:00
liuyao 17f2c3f882 reset wind info 2023-06-02 18:27:22 +08:00
Haojun Liao 3d7defa881 refactor: do some internal refactor. 2023-06-02 15:43:38 +08:00
Haojun Liao 2edba85efe refactor: do some internal refactor. 2023-06-02 15:27:44 +08:00
Haojun Liao bcd8867fb2 refactor: do some internal refactor. 2023-06-02 15:27:14 +08:00
Haojun Liao 76106165da other: add some logs. 2023-06-02 15:13:25 +08:00
yihaoDeng f59161464d avoid mem leak 2023-06-02 06:48:26 +00:00
dapan1121 ddd3a53e56 Merge remote-tracking branch 'origin/3.0' into fix/TD-24001 2023-06-02 13:57:34 +08:00
Haojun Liao cce87a036f other: merge 3.0. 2023-06-02 13:34:20 +08:00
Haojun Liao d45aa7ef84
Merge pull request #21555 from taosdata/fix/liaohj_main
other: merge main into 3.0.
2023-06-02 13:11:12 +08:00
Haojun Liao f1bd829977 refactor: do some internal refactor. 2023-06-02 13:10:54 +08:00
dapan1121 7df4f8a89e
Merge pull request #21556 from taosdata/fix/TD-24489
fix: fix interval operator ensure capacity logic
2023-06-02 11:52:25 +08:00
Haojun Liao b5d87b1d5c
Merge pull request #21564 from taosdata/fix/TD-24565
set recover scan version
2023-06-02 11:20:53 +08:00
Haojun Liao 27b7d1ec88 refactor: do some internal refactor. 2023-06-02 11:17:44 +08:00
liuyao 274771d7b4 TD-24565 2023-06-02 10:08:07 +08:00
Haojun Liao fca91b3c0b
Merge pull request #21558 from taosdata/fix/TD-24520
reset sream fill block index
2023-06-02 09:04:38 +08:00
Haojun Liao bbf3f1ccd9 fix(query): add more check. 2023-06-02 00:22:35 +08:00
Haojun Liao 403617976c fix(query): fix error in fill. 2023-06-01 22:45:03 +08:00
Haojun Liao 1036259a7b fix(query): fix error in fill. 2023-06-01 18:25:05 +08:00
jiajingbin 2935ebcfc4 set session update info 2023-06-01 17:26:03 +08:00
liuyao 64656a59d9 reset sream fill block index 2023-06-01 16:28:32 +08:00
Haojun Liao 706e350217 fix(query): fix error in fill and partition. 2023-06-01 14:36:42 +08:00
Ganlin Zhao 6517ede044 fix: fix interval operator ensure capacity logic 2023-06-01 11:23:31 +08:00
Haojun Liao 5d98a319c7
Merge pull request #21515 from taosdata/feature/TD-19042
feat: support create topic as stable with conditions
2023-06-01 09:56:55 +08:00
Haojun Liao 5301c5756a other: merge main into 3.0. 2023-06-01 09:29:18 +08:00
Haojun Liao 46f731e4d9
Merge pull request #21551 from taosdata/fix/resume_mem
fix(query): check the version range when dump partial rows. #TD-24504
2023-05-31 21:51:07 +08:00
Haojun Liao 87deb36f8a refactor: do some internal refactor. 2023-05-31 19:36:02 +08:00
liuyao 7d699ae579 fix sliding window issue 2023-05-30 15:16:11 +08:00
wangmm0220 8835028002 fix:deal with node is null 2023-05-30 10:21:18 +08:00
wangmm0220 d490ca753f Merge branch '3.0' of https://github.com/taosdata/TDengine into feature/TD-19042 2023-05-30 09:48:49 +08:00
wangmm0220 16e14b1c82 fix:compile error 2023-05-29 17:27:35 +08:00
wangmm0220 41ed0138b4 fix:compile error 2023-05-29 17:25:11 +08:00
wangmm0220 07bdb95b1a fix:compile error 2023-05-29 17:10:11 +08:00
kailixu f984e67eaa fix(query): invalid buffer page 2023-05-29 16:04:35 +08:00
Haojun Liao 2ac83ec9c7
Merge pull request #21511 from taosdata/refact/fillhistory
refactor: do some internal refactor.
2023-05-29 15:43:40 +08:00
wangmm0220 78db3520a6 fix:conflict 2023-05-29 14:57:03 +08:00
kailixu 3bbf5405c6 fix(query): invalid buf page 2023-05-29 14:36:29 +08:00
wangmm0220 a71878d07f feat: support create topic as stable with conditions 2023-05-29 11:46:59 +08:00
Haojun Liao 8f61e2d6ef refactor: do some internal refactor. 2023-05-29 10:50:50 +08:00
Haojun Liao 953a69a829 refactor: do some internal refactor. 2023-05-29 10:12:27 +08:00
dapan1121 e2d45438cb
Merge pull request #21405 from taosdata/szhou/scl-flt
enhance: scalar filter improvement
2023-05-28 18:49:39 +08:00
slzhou 70bcbafbb8 fix: json value length is not same as binary/nchar length 2023-05-26 13:36:56 +08:00
slzhou 81c796953e fix: address sanitizer error 2023-05-26 10:55:52 +08:00
Haojun Liao cea8334427
Merge pull request #21449 from taosdata/refact/fillhistory
refactor: remove the module dependency.  TD-24279
2023-05-26 09:01:45 +08:00
dapan1121 e70c433a59 enh: support time line query from union/union all subquery 2023-05-26 08:44:23 +08:00
Haojun Liao e24ce2111f fix: set function ptr. 2023-05-26 00:00:07 +08:00
Haojun Liao c3be7b14be fix: set correct function ptr. 2023-05-25 17:51:03 +08:00
Haojun Liao 0966213847 fix(arch): set the correct module api dependency. 2023-05-25 14:21:40 +08:00
Haojun Liao da9f33a483 fix: fix error in set function ptr. 2023-05-25 09:56:34 +08:00
liuyao 1f81642303 fix sma sliding window 2023-05-25 09:12:10 +08:00
Haojun Liao 4a42f6b983 fix: fix error in api call. 2023-05-25 00:50:03 +08:00
Haojun Liao a9b18d203d fix:fix error. 2023-05-24 23:49:26 +08:00
Haojun Liao ab907e3344 fix(query): fix syntax error. 2023-05-24 21:53:40 +08:00
dapan1121 137a9eb602
Merge pull request #21455 from taosdata/enh/add_varchar_sma
fix: fix count var type error
2023-05-24 18:41:01 +08:00
wangmm0220 8537e4e80e feat:add tag filter for stable subscribe 2023-05-24 18:26:55 +08:00
Haojun Liao fe09705855 fix: set the init function pointer. 2023-05-24 17:13:20 +08:00
Dingle Zhang 984211f3b4
Feature/3.0 geometry (#21037)
* Add GEOMETRY data type and make sql.c able to parse it. The GEMETRY works like BINARY so far.

* add GEOMETRY type into gConvertTypes to fix some issues like DELETE calling

* change some test cases to make sure no same timestamp is inserted, and add my smoketest.sh

* Add a function MakePoint() and introduce a lib geometry

* implement sql functions GeomFromText() and AsText()

* Use GEOS *_r funcions instead for thread safety

* Handle with TSDB_DATA_TYPE_GEOMETRY when INSERT geometry data by converting WKT.
Add geosWrapper to wrap the basic GEOS functions for TDEngine.

* refactor AsText and MakePoint functions to be like GeomFromText

* Show WKT when print geometry data in screen
Dump hex data when dump geometry data in a file

* define TYPE_BYTES item for TSDB_DATA_TYPE_GEOMETRY, which casued some strange issues.

* set number of decimals of WKT to 6

* Implement SQL function Intersects()

* refactor geometry sql functions

* Add geosErrMsgeHandler() to get the GEOS error detail

* use threadlocal to instantiate SGeosContext
call destroyGeosContext() only if the thread exists

* remove SGeosContext *context param for all geometry functions since we use thread local one,
so that all caller do not need to know the context.

* Modify Intersects() to call PreparedIntersects() when one of param is a constant, which has higher performance.

* rename prepareFn() to initCtxFn() to avoid confusion with PreparedFn

* Add prefix "ST_" for all geometry functions

* move getThreadLocalGeosCtx() and destroyThreadLocalGeosCtx() into util,
so that all unit test tools can compile

* Add unit test for geometry lib, only test MakePoint so far

* refactor and enhance existing cases in geomFuncTest

* implement NULL type and NULL value test for geomFuncTest

* add test on geomFromText()

* add unit test on AsText() in geomFuncTest

* combine some makePointFunction test items

* add intersectsFunctionTwoColumns test
refactor on callGeomFromTextWrapper functions

* enhance intersectsFunction test to add cases like input constant , NULL type, NULL value, or wrong content

* add more cases into intersectsFunction test

* Add basic test on geometry in system test

* Add ST_GeomFromText and ST_AsText function test in system test on geometry

* add ST_Intersects function test in system test on geometry

* support to check expectedErrno in system test on geometry

* adjust geomTest unit test and geometry system test

* add geometry data type and functions in doc english version

* implement touchesFunction() in geometry lib
refactor geometry relation functions model

* separate gemFuncTest into several src files

* add unit test on touchesFunction

* support sql function ST_Touches()
add system test on ST_Touches

* add docs for ST_Touches()

* Add ST_Contains()

* Add ST_Covers()

* Add ST_Equals()

* add swapAllowed param for geomRelationFunction()
read geom2 earlier intead of at doGeosRelation()

* Add ST_ContainsProperly()

* build on windows

* Merge from 3.0 to 3.0_geometry

* change macro definition TSDB_DATA_TYPE_GEOMETRY as the last one for compatibility

* change '\\NULL' to 'NULL' back in shellDumpFieldToFile()

* add /usr/local/include into include directory

* add /usr/local/inlcude and /usr/local/lib in cmake.platform for DARWIN
2023-05-24 15:36:46 +08:00
Ganlin Zhao 89bea7100f fix: fix count var type error 2023-05-24 00:31:05 -07:00
Haojun Liao 1f7f326bed refactor: do some internal refactor and set the api function ptr. 2023-05-24 13:22:05 +08:00
wangjiaming0909 9a421a92f9 fix: core dump when select with interval caused by order 2023-05-24 10:32:10 +08:00
Haojun Liao 66477a28ca refactor: do some internal refactor. 2023-05-23 19:10:50 +08:00
Haojun Liao 85afbf0d35 refactor: do some internal refactor. 2023-05-23 18:58:54 +08:00
Haojun Liao a63473b1cc refacotor: do some internal refactor. 2023-05-23 18:54:32 +08:00
Haojun Liao c66c0c4dfd refactor: do some internal refactor. 2023-05-23 18:42:52 +08:00
Haojun Liao 3d084adf1f Merge remote-tracking branch 'origin/refact/fillhistory' into refact/fillhistory
# Conflicts:
#	source/dnode/vnode/inc/vnode.h
#	source/libs/executor/src/executil.c
#	source/libs/index/CMakeLists.txt
#	source/libs/index/src/indexFilter.c
2023-05-23 18:32:47 +08:00
Haojun Liao e67b532d8a refactor: refactor the module dependency. 2023-05-23 18:29:23 +08:00
yihaoDeng c15b1e3520 opt compile 2023-05-23 11:46:02 +08:00
Haojun Liao f520de0dab refactor: adjust the module dependency. 2023-05-22 10:07:01 +08:00
Hui Li 3f824e2045
Merge pull request #21355 from taosdata/mark/tmq
fix:error in pHandle lock
2023-05-22 08:57:45 +08:00
dapan1121 8fe62bb0e1
Merge pull request #21391 from taosdata/fix/TD-24278
fix: fix assert crash in tsort.c
2023-05-20 14:15:19 +08:00
dapan1121 70444e2d82
Merge pull request #21329 from taosdata/feat/TD-21187
feat(query): interp support ignore null value opition
2023-05-20 14:14:21 +08:00
dapan1121 d801aaa2e6
Merge pull request #21352 from taosdata/fix/TD-24218
fix: fix interp in nested query and fill value with string issue
2023-05-20 14:10:26 +08:00
dapan1121 c0d3da9b32
Merge pull request #21382 from taosdata/szhou/fix-td24277
fix: result block ensure capacity when finalize may produce serveral …
2023-05-20 14:08:41 +08:00
wangmm0220 04858fae22 fix:tsdbreader is free by mistake 2023-05-20 12:20:54 +08:00
wangmm0220 f8de38e532 fix:core dump in tsdbreader is null when tsdbreader is closed by subscribe msg and current offset equal to saved 2023-05-19 22:52:58 +08:00
Haojun Liao 200c1a367b
Merge pull request #21378 from taosdata/fix/nodisk
fix(query): do some internal refactor, and fix the bug when calender duration exists in sliding and offset.
2023-05-19 19:30:04 +08:00
Ganlin Zhao 709b59a3a6 fix: fix assert crash in tsort.c 2023-05-19 17:27:15 +08:00
wangmm0220 ff2b545b27 fix:set task status killed when vnode receive subscribe msg from mnode 2023-05-19 17:16:47 +08:00
slzhou f9da4abdcb fix: change more variable names 2023-05-19 15:38:52 +08:00
shenglian zhou f36b0be17d fix: join eq conditions not only for tag 2023-05-19 14:32:03 +08:00
wangmm0220 238254e49e fix:add task status check in doQueueScan & checkout consumer in tqProcessPollReq 2023-05-19 14:06:43 +08:00
slzhou 7218a03487 fix: result block ensure capacity when finalize may produce serveral rows 2023-05-19 11:16:31 +08:00
Haojun Liao 93c4e3fe70 other: remove empty files. 2023-05-19 09:12:16 +08:00
Haojun Liao 1e020a46c9 other: merge main. 2023-05-19 09:07:35 +08:00
Haojun Liao d4b0e102af fix:do some internal refactor. 2023-05-19 08:55:59 +08:00
dapan1121 386b8484ba
Merge pull request #21328 from taosdata/szhou/fix-ts3405
fix: join improvement
2023-05-19 08:51:06 +08:00
Haojun Liao c4c5bbb65c other: merge 3.0 2023-05-18 17:28:40 +08:00
Haojun Liao dbd52ecffa
Merge pull request #21364 from taosdata/enh/rocksdbSstate
state merge into 3.0
2023-05-18 17:25:44 +08:00
Haojun Liao 84a81716b3
Merge branch '3.0' into feature/3_liaohj 2023-05-18 17:00:56 +08:00
Haojun Liao 8a328b6636 fix(stream): fix error in stream read. 2023-05-18 16:59:18 +08:00
slzhou 4db88e8ffe fix: fix ci comments 2023-05-18 15:45:58 +08:00
dapan1121 b2333b7f15
Merge pull request #21363 from taosdata/fix/TD-24246
fix: fill window end issue
2023-05-18 15:36:52 +08:00
yihaoDeng 9380b22394 merge 3.0 2023-05-18 05:46:38 +00:00
slzhou 51cb79fc1d fix: set rightUseBuildTable correctly 2023-05-18 13:28:46 +08:00
slzhou 304423e27b Merge branch 'main' of github.com:taosdata/TDengine into szhou/fix-ts3405 2023-05-18 13:27:58 +08:00
slzhou 7102c107eb fix: remove parameter of filling build table 2023-05-18 13:19:52 +08:00
Haojun Liao 5d5b2bb16a refactor: do some internal refactor. 2023-05-18 12:59:19 +08:00
shenglian zhou d7f8757844 fix: memory leak 2023-05-18 11:23:50 +08:00
shenglian zhou 14d4a81e75 fix: build hash table is created during creating join operator 2023-05-18 11:15:04 +08:00
shenglian zhou ee16b46112 fix: remove group keys from join operator 2023-05-18 10:46:19 +08:00
dapan1121 8994081592 fix: memory size overflow issue 2023-05-18 10:25:10 +08:00
dapan1121 e494c99839 fix: fill window end issue 2023-05-17 19:35:57 +08:00
Haojun Liao b9c6e2a294 fix(stream): fix syntax error. 2023-05-17 18:47:13 +08:00
Haojun Liao ffee5ebc61 Merge branch '3.0' into feature/3_liaohj 2023-05-17 17:47:44 +08:00
Ganlin Zhao 90ef52f40d fix fill(value, string) issue 2023-05-17 17:11:02 +08:00
Haojun Liao 041ffa91bd other: merge main. 2023-05-17 15:42:15 +08:00
Haojun Liao 366cd1871a
Merge pull request #21314 from taosdata/fix/liaohj_main
fix(stream):extract delete msg from wal.
2023-05-17 14:52:49 +08:00
dapan1121 fb7a06e06e
Merge pull request #21271 from taosdata/enh/tsbsPerf.4
Enh/tsbs perf.4
2023-05-17 11:00:14 +08:00
Haojun Liao f3f52c0232 fix(stream): add some logs and set the wal offset to be the ended version when finishing the step2 recover stage. 2023-05-17 10:43:23 +08:00
Ganlin Zhao 727a628861 Merge branch '3.0' into feat/TD-21187 2023-05-17 10:34:38 +08:00
slzhou 03e77288e8 fix: add on conditions null check and rightRowLocations no longer hides the outer scope rightRowLocations 2023-05-17 10:07:19 +08:00
Haojun Liao d457b84aba
Merge pull request #21311 from taosdata/mark/tmq
fix:add lock to pHandle for safety
2023-05-17 09:11:39 +08:00
shenglian zhou 568725a245 fix: using right rows to build hash table when the tag equal cond is not null and same ts row row number is greater than 16 2023-05-17 08:33:47 +08:00
dapan1121 df973ce28e fix: remove debug info 2023-05-16 18:37:00 +08:00
Ganlin Zhao 375aa2f26b feat(query): interp support ignore null value opition 2023-05-16 16:33:28 +08:00
shenglian zhou c6555c3b37 fix: join operator finished 2023-05-16 16:25:55 +08:00
dapan1121 de45d163ca fix: compile issue 2023-05-16 14:18:23 +08:00
dapan1121 e7df9b8fa0 enh: optimize copy group result 2023-05-16 14:12:48 +08:00
Haojun Liao e35d145734 fix(stream): fix memory leak. 2023-05-16 13:59:13 +08:00
Ganlin Zhao 6cd9fac7da fix linear interpolation bugs 2023-05-16 11:30:08 +08:00
wangmm0220 36454c73ed fix:add lock to pHandle for safety 2023-05-15 18:38:14 +08:00
Ganlin Zhao 23c1aa2db0 fix: fix multithread issue in destroyTimesliceOperator 2023-05-15 17:55:37 +08:00
liuyao 502efb3d01 op stream selectivity buff 2023-05-15 16:26:24 +08:00
Ganlin Zhao b1ead824f8 fix: fix linear interpolation error 2023-05-15 14:26:09 +08:00
liuyao a6570a4327 Merge branch 'enh/rocksdbSstate' of https://github.com/taosdata/TDengine into enh/rocksdbSstate 2023-05-15 11:19:55 +08:00
liuyao 9258dcd740 fix:mem leak 2023-05-15 11:19:17 +08:00
Haojun Liao 170c603995 other: merge 3.0 2023-05-13 20:16:55 +08:00
Haojun Liao 99148d6719 other: merge 3.0 2023-05-13 20:02:48 +08:00
Haojun Liao 236926b9ee other: merge enh/rocksdbstate 2023-05-13 19:49:28 +08:00
Haojun Liao 1975e94501 Merge branch 'main' into enh/rocksdbSstate 2023-05-13 19:41:03 +08:00
Haojun Liao 5b2ef2a675 other: merge main and remove invalid return data for poll. 2023-05-13 02:31:39 +08:00
dapan1121 69795286fa Merge remote-tracking branch 'origin/main' into enh/tsbsPerf.4 2023-05-12 13:46:16 +08:00
Haojun Liao 43e06b9132 Merge branch '3.0' into feature/3_liaohj 2023-05-12 13:36:02 +08:00
dapan1121 0dd0b16842 enh: optimize table scan for last query 2023-05-12 13:30:17 +08:00
Haojun Liao 7ef16e1922 other: merge main. 2023-05-12 11:49:53 +08:00
dapan1121 9394afec68
Merge pull request #21144 from taosdata/feat/TD-19801
feat(query): support interp with super table
2023-05-12 11:37:20 +08:00
Ganlin Zhao 83e049812c fix asan error 2023-05-12 10:21:01 +08:00
liuyao 8b7b804606 opt partition by tbname 2023-05-11 18:47:27 +08:00
Ganlin Zhao 3bf9cb2d78 fix 2023-05-11 17:28:46 +08:00
Ganlin Zhao 788b521592 Revert "fix"
This reverts commit 9ce1e8ccf4.
2023-05-11 17:20:58 +08:00
Haojun Liao a76e47ef54 refactor: add some logs. 2023-05-11 14:19:27 +08:00
Haojun Liao f0f90888ab refactor: update some logs. 2023-05-11 13:48:50 +08:00
Ganlin Zhao 9ce1e8ccf4 fix 2023-05-11 13:23:40 +08:00
Haojun Liao 28c43f0151 fix(stream): add null check. 2023-05-11 11:36:27 +08:00
Haojun Liao 8a1b0ed052 refactor: do some internal refactor. 2023-05-11 10:35:09 +08:00
Haojun Liao b02b3117b5 refactor: do some internal refactor. 2023-05-11 10:14:29 +08:00
Ganlin Zhao 121564de2f add threshold for group result 2023-05-11 10:04:25 +08:00
Haojun Liao dbd79cc80c refactor: do some internal refactor. 2023-05-10 22:22:01 +08:00
Ganlin Zhao 37d607c820 enh: remove group_key from subsidiaries if multiple select function
presents
2023-05-10 18:51:21 +08:00
yihaoDeng 5708fcb5cb Merge branch 'enh/3.0' into enh/rocksdbSstateMerge 2023-05-10 08:02:16 +00:00
Ganlin Zhao 523f08fe4b return result after finish processing of each group 2023-05-10 11:18:42 +08:00
liuyao 62ccd4bf16 avoid delete data 2023-05-10 09:11:04 +08:00
yihaoDeng 711c475693 fix invalid free 2023-05-09 10:34:14 +00:00
dapan1121 52fd6a84ac enh: support db cfg cache update 2023-05-09 17:04:20 +08:00
yihaoDeng 55014aa003 Merge branch 'enh/rocksdbSstate' into enh/rocksdbSstateMerge 2023-05-09 08:58:51 +00:00
Ganlin Zhao e1140d4c15 optimize duplicate timestamp check 2023-05-09 15:05:41 +08:00
Ganlin Zhao 4693c22970 optimize group key storage 2023-05-09 14:06:09 +08:00
wade zhang ebdc1a3234
Merge pull request #20996 from taosdata/fix/TD-23623
enh(cache/rocks): base for rocks put/get
2023-05-09 13:27:33 +08:00
dapan1121 a1eefd25ea fix: count wrong group number issue 2023-05-09 11:33:47 +08:00
Ganlin Zhao 3b10ac29ce use functionType instead of functionName 2023-05-09 11:09:29 +08:00
liuyao eb52e73305 Merge branch 'enh/rocksdbSstate' of https://github.com/taosdata/TDengine into enh/rocksdbSstate 2023-05-08 09:54:00 +08:00
liuyao fc8cab6fe1 recover setSelectValueColumnInfo 2023-05-08 09:53:27 +08:00
Yihao Deng cb223acf82
Merge branch 'main' into enh/rocksdbSstate 2023-05-08 09:45:27 +08:00
yihaoDeng 08c3a63341 Merge branch 'enh/standVer' into enh/rocksdbSstateMerge 2023-05-06 12:37:54 +00:00
dapan1121 c83367e455 enh: add table group cache 2023-05-06 19:24:47 +08:00
Haojun Liao c6007d53e8
Merge pull request #21190 from taosdata/fix/TS-3347
fix:[TS-3347]set ver to first version if version stored is smaller th…
2023-05-06 18:51:49 +08:00
dapan1121 1de5f84536
Merge pull request #21184 from taosdata/fix/TD-23898-a
fix: fix taosd not exit when press ctrl+c
2023-05-06 17:46:38 +08:00
liuyao 6ceda68365 opt selectivity function 2023-05-06 17:42:38 +08:00
wangmm0220 ee32620808 fix:[TS-3347]set ver to first version if version stored is smaller than first version in wal when subscribe db 2023-05-06 16:22:30 +08:00
Minglei Jin 596bee8028 Merge branch '3.0' into fix/TD-23623 2023-05-06 16:07:26 +08:00
Ganlin Zhao 33d4e0cc67 fix: fix taosd not exit when press ctrl+c 2023-05-06 15:03:17 +08:00
Haojun Liao da6212bab0 other: merge main. 2023-05-06 12:51:38 +08:00
Shengliang Guan af81f91c0f
Merge pull request #21162 from taosdata/FIX/TD-22103-3.0
enh: unify error msg for disk space checking in doInitAggInfoSup
2023-05-06 11:15:57 +08:00
Haojun Liao 29fcd1b83a refactor: do some internal refactor. 2023-05-06 10:08:05 +08:00
Haojun Liao 08ce790cda fix(query): fix memory leak. 2023-05-05 18:20:27 +08:00
Ganlin Zhao 5a1681d91d fix data block not properly saved 2023-05-05 15:24:15 +08:00
Benguang Zhao 0e6de09353 enh: unify error msg for disk space checking in doInitAggInfoSup 2023-05-05 14:53:32 +08:00
Haojun Liao 9b5c205498 fix(stream): set correct ssdatablock for tqRetrieveDataBlock 2023-05-05 13:41:25 +08:00
yihaoDeng a1b9dcf595 fix mem leak 2023-05-05 02:20:11 +00:00
Haojun Liao 23c49594b7 other: merge main. 2023-05-04 16:41:53 +08:00
Haojun Liao 09a04052ec refactor: do some internal refactor. 2023-05-04 16:15:14 +08:00
Haojun Liao 39cac9d308 refactor: remove log ; 2023-04-29 14:06:26 +08:00
Haojun Liao 8b57184a9a
Merge pull request #21123 from taosdata/fix/liaohj_main
refactor: remove assert.
2023-04-29 00:44:24 +08:00
Haojun Liao 05d416f3b9 fix(stream): fix invalid access when handling error, not start stream if tsDisablestream is set. 2023-04-28 23:53:53 +08:00
Ganlin Zhao 42df9f587f fix group_key not set properly 2023-04-28 16:41:36 +08:00
Haojun Liao a0d08b7fe4 fix(query): add null ptr check. 2023-04-28 16:29:09 +08:00
Ganlin Zhao 76eea9f7c4 fix group_key check 2023-04-28 14:59:35 +08:00
Haojun Liao b3da6cb224 fix(query): fix syntax error. 2023-04-28 14:56:50 +08:00
Haojun Liao 03b1de017a refactor: remove assert. 2023-04-28 14:12:17 +08:00
Haojun Liao b7c8346b44 other: merge other branch. 2023-04-28 13:06:47 +08:00
Haojun Liao a0c2b34788
Merge pull request #21119 from taosdata/fix/liaohj_main
refactor: do some internal refactor.
2023-04-28 12:53:31 +08:00
Haojun Liao da0d9c78ef refactor: do some internal refactor. 2023-04-28 11:42:34 +08:00
Haojun Liao f850388ed9
Merge pull request #21116 from taosdata/fix/liaohj_main
fix(query): stop tsdbreade ASAP, and do some internal refactor. TD-23249
2023-04-28 11:42:05 +08:00
liuyao 2984c5a758 merge main 2023-04-28 10:34:46 +08:00
Haojun Liao 3ac1ce69b6 fix(query): set correct scan flag. 2023-04-28 10:02:37 +08:00
Haojun Liao 6482ef9ad1 refactor: do some internal refactor. 2023-04-28 09:19:53 +08:00
Haojun Liao 8205168428 fix(query): fix memory leak. 2023-04-28 09:16:11 +08:00
Haojun Liao 7adc21028a refactor: do some internal refactor. 2023-04-28 00:23:38 +08:00
Haojun Liao 25010cb11e fix(query): stop tsdbreade ASAP, and do some internal refactor. 2023-04-27 22:21:18 +08:00
kailixu fa822ff286 Merge branch '3.0' into enh/TD-21161-3.0 2023-04-27 19:11:16 +08:00
Haojun Liao ad7c3218f7
Merge pull request #21111 from taosdata/fix/liaohj_main
enh(query): stop tsdb reader ASAP.  TD-23249
2023-04-27 17:45:38 +08:00
Haojun Liao 91f9b58f9a refactor: do some internal refactor. 2023-04-27 16:06:06 +08:00
Haojun Liao 17a5691afb refactor: remove assert. 2023-04-27 15:37:33 +08:00
Haojun Liao d83f29dc23 refactor: remove assert. 2023-04-27 15:33:04 +08:00
Haojun Liao e1bd65ec0a
Merge pull request #21105 from taosdata/fix/liaohj_main
fix(query): check the init status for pReader->status.merger  TD-23903
2023-04-27 12:40:13 +08:00
Ganlin Zhao 54d82fce8a add reset when switching groups 2023-04-27 11:28:20 +08:00
Haojun Liao db1d75bb48 refactor: do some internal refactor. 2023-04-27 09:28:20 +08:00
Ganlin Zhao c64788ad71 fix group restore 2023-04-26 18:37:23 +08:00
Ganlin Zhao 75f76a62ab fix process next group bug 2023-04-26 18:07:19 +08:00
Minglei Jin a1fba2df65 Merge branch '3.0' into fix/TD-23623 2023-04-26 17:38:47 +08:00