Commit Graph

3971 Commits

Author SHA1 Message Date
Haojun Liao 92d1dbd9ad fix(stream): set the time window filter before generating create table result. 2023-07-29 01:23:06 +08:00
liuyao 73ed6fe649 save compace window info 2023-07-28 19:30:26 +08:00
liuyao d712124921 init scan state 2023-07-28 17:25:56 +08:00
dapan1121 9c7b53083b
Merge pull request #22223 from taosdata/fix/td-25378
fix: fix memleak during create initial sources for block merge sort
2023-07-28 13:09:34 +08:00
Haojun Liao 2a78cd2d23
Merge pull request #22215 from taosdata/fix/liaohj
other: merge main.
2023-07-28 13:06:17 +08:00
slzhou bcf4c1ebae fix: fix memleak during create initial sources for block merge sort 2023-07-28 09:54:56 +08:00
Haojun Liao 688884de08
Merge pull request #22220 from taosdata/fix/ly_stream_fill
fix stream fill issue
2023-07-28 09:27:21 +08:00
Haojun Liao ccc0f13649
Merge pull request #22214 from taosdata/fix/3_liaohj
fix(stream): scan wal in step2
2023-07-28 00:42:15 +08:00
Haojun Liao 22a5a18fff fix(stream): 1. set correct timewindow after step2. 2. handle the case when the task is failed to be added into the meta store. 2023-07-27 18:57:36 +08:00
liuyao f667a09cc6 fix stream fill issue 2023-07-27 18:56:25 +08:00
liuyao 5d21f50340 adjust history task trigger mode 2023-07-27 17:45:28 +08:00
Haojun Liao b145771a1b other: merge 3.0 2023-07-27 16:38:57 +08:00
Haojun Liao 3d403dca5a other: merge main. 2023-07-27 16:23:41 +08:00
Haojun Liao 3fdbd5383f Merge remote-tracking branch 'origin/fix/3_liaohj' into fix/3_liaohj 2023-07-27 16:11:07 +08:00
Haojun Liao 6ff50d4eaf fix(stream): update the step2 scan wal files. 2023-07-27 16:10:55 +08:00
liuyao 7c9898cfa5 adj stream scan 2023-07-27 15:56:06 +08:00
liuyao c54bd55c68 op stream scan 2023-07-27 15:16:22 +08:00
liuyao c72274504e op stream scan 2023-07-27 15:13:57 +08:00
liuyao 0b53bdbae6 op stream scan 2023-07-27 15:09:25 +08:00
liuyao 0ac7ebe9c7 op stream scan 2023-07-27 14:56:06 +08:00
Haojun Liao 40fe3ef4f6 fix(stream): refactor the step2 wal scan. 2023-07-27 14:49:20 +08:00
liuyao 1894608b80 optimize session operator reload state 2023-07-27 09:59:58 +08:00
Haojun Liao 05504023f5
Merge pull request #22200 from taosdata/fix/ly_stream_test
stream fill operator mem leak
2023-07-27 09:38:22 +08:00
liuyao c368db30c3 stream fill operator mem leak 2023-07-26 17:38:37 +08:00
Haojun Liao 432c943c25 fix(stream): do filter before the update check. 2023-07-26 16:34:39 +08:00
Haojun Liao 610f9d19c1
Merge pull request #22188 from taosdata/fix/3_liaohj
fix(stream): set the correct step2 scan time window range.
2023-07-26 16:34:10 +08:00
Haojun Liao df57768a3e Merge branch '3.0' into fix/3_liaohj 2023-07-26 14:45:11 +08:00
Haojun Liao 4d6b9d4a15 fix(stream): split delete msg for real-time scan from wal. 2023-07-26 09:08:17 +08:00
dapan1121 66042669a1
Merge pull request #22176 from taosdata/szhou/enhance-limit-proc
fix: choose heap sort for table merge scan with long row and limit
2023-07-25 17:48:11 +08:00
slzhou f4c28d848b fix: table merge scan use heap sort when there is limit 2023-07-25 15:23:00 +08:00
Haojun Liao d29f835a63 fix(stream): set the correct step2 scan time window range. 2023-07-25 15:09:22 +08:00
slzhou ca2ad71bb8 fix: return null when there are no input stream blocks for priority queue sort 2023-07-25 13:08:37 +08:00
slzhou a205eba2ab fix: choose heap sort for table merge scan when row size is big and has limit 2023-07-25 09:48:08 +08:00
dapan1121 10f9c40dba
Merge pull request #22171 from taosdata/szhou/enhance-limit-proc
enhance: skip data blocks with the merge limit ts when create initial…
2023-07-25 08:42:35 +08:00
slzhou 1d24b96e82 enhance: skip data blocks with the merge limit ts when create initial source 2023-07-24 15:16:39 +08:00
dapan1121 6fbf251978
Merge pull request #22138 from taosdata/enh/TS-3625
fix: fix(value, null) output behavior
2023-07-24 13:17:19 +08:00
Haojun Liao 321be1f83f
Merge pull request #22135 from taosdata/fix/3_liaohj
refactor: do some internal refactor.
2023-07-22 15:06:28 +08:00
liuyao 4451b2185a transform stream state 2023-07-21 10:32:53 +08:00
Ganlin Zhao 62b73db8bf fix: fix(value, null) output behavior 2023-07-21 10:19:41 +08:00
Ganlin Zhao 624b6b094f fix: fix(value, null) output behavior 2023-07-21 10:14:12 +08:00
Haojun Liao d0da988b7d Merge branch '3.0' into fix/3_liaohj 2023-07-21 09:47:44 +08:00
dapan1121 2ef01728ca
Merge pull request #22089 from wangjiaming0909/fix/3.0/TD-23763
feat: optimize partition by tbname slimit
2023-07-21 09:29:36 +08:00
dapan1121 fde8eabfd7
Merge pull request #22111 from taosdata/szhou/tms-dev-2
enhance: table merge scan optimization
2023-07-20 16:28:29 +08:00
Haojun Liao 45cb478b31 refactor: do some internal refactor. 2023-07-20 15:36:46 +08:00
wangjiaming0909 7d850c1a5e feat: optimize partition by tbname slimit 2023-07-20 15:07:55 +08:00
slzhou 1a0031a43c enhance: uinfo to qdebug and increase pages num to 2048 2023-07-20 13:53:13 +08:00
slzhou 5d9f6fd481 fix: fix limit/offset bugs 2023-07-20 12:29:34 +08:00
slzhou 30129f64da enhance: merge blocks of the same table before sort 2023-07-20 09:28:19 +08:00
liuyao 8a6ed67f9d fill history 2023-07-20 09:13:30 +08:00
liuyao af18afba9d fill history 2023-07-19 17:19:55 +08:00
liuyao c7e4aa4f77 set win range 2023-07-19 15:51:22 +08:00
liuyao 8481725517 remove redundant results 2023-07-19 14:58:28 +08:00
slzhou d1a1976aa4 enhance: add limit to merge sort 2023-07-19 13:59:43 +08:00
wangmm0220 5c344b0159 fix:conflicts from main 2023-07-19 09:05:05 +08:00
liuyao caa4503352 reset state key memory 2023-07-18 18:02:39 +08:00
slzhou 4348b9c51d fix: use uinfo to show on stdout 2023-07-18 16:47:31 +08:00
slzhou f79fc81d9c fix: add to page buf in the same way as single source sort 2023-07-18 15:46:38 +08:00
dapan1121 c2245a3546
Merge pull request #22100 from taosdata/fix/TD-25241
fix: fix interval in nested query filter not applied
2023-07-18 13:52:35 +08:00
slzhou 97a6e89d11 enhance: refactor create initial sources 2023-07-18 10:38:40 +08:00
Ganlin Zhao 94b13df641 fix: fix interval in nested query filter not applied 2023-07-18 10:36:07 +08:00
slzhou ba2b404295 enhance: optimize msortComparFn for table merge scan 2023-07-17 21:07:55 +08:00
slzhou 1b9754f1bc enhance: add log with info level. change to debug later 2023-07-17 16:18:06 +08:00
slzhou 655233fd4f fix: create initial source with blocks 2023-07-17 15:05:30 +08:00
shenglian zhou 9a0e9df567 enhance: block is ts sorted and each book is a source 2023-07-16 23:39:41 +08:00
slzhou f93af4d2e0 enhance: pass simple test 2023-07-16 20:28:54 +08:00
shenglian zhou 8b6d7db7ad enhance: use one tsdb reader to read table sequentially 2023-07-16 17:54:39 +08:00
wangmm0220 6762a01d88 Merge branch 'main' of https://github.com/taosdata/TDengine into mark/tmq 2023-07-14 16:44:00 +08:00
wangmm0220 bbdcbcb75b fix:modify commit version to next validate version 2023-07-14 16:43:28 +08:00
dapan1121 1a19d29eee
Merge pull request #22060 from taosdata/fix/TD-25209
fix: reset interpolation buffer after last valid row for interval + fill(next)
2023-07-14 09:30:56 +08:00
Ganlin Zhao a7af4d9348 fix: reset interpolation buffer after last valid row for interval + fill(next) 2023-07-13 18:18:26 +08:00
Haojun Liao e0ea0f2df4
Merge pull request #22020 from taosdata/fix/liaohj
other: merge main
2023-07-13 17:55:28 +08:00
Haojun Liao f41bcd73b0 other: merge main. 2023-07-13 11:02:09 +08:00
Haojun Liao c388802bda
Merge pull request #22024 from taosdata/fix/3_liaohj
fix(stream): fix concurrent bug in save task meta.
2023-07-12 18:17:27 +08:00
Haojun Liao fed3803739 fix(stream): fix memory leak. 2023-07-11 19:29:52 +08:00
wangjiaming0909 1d7515213b feat: 1. add limit for diskBasedBuf
2. use referenced tuple before actually pushing into pq
3. use limitInfo instead of maxRows in sort pyhsical node
2023-07-11 14:16:20 +08:00
Shungang Li 8f91da24e4 fix: type convert failure returns errcode
TSDB_CODE_SCALAR_CONVERT_ERROR:
"Cannot convert to specific type"
2023-07-11 10:20:50 +08:00
wade zhang 13bc1e744e
Merge pull request #21963 from luckeverda/fix/TD-24473-new
fix/TD-24473
2023-07-11 09:32:25 +08:00
Haojun Liao 3ffdbe923d other: merge 3.0 2023-07-11 09:12:57 +08:00
dapan1121 39a58c354d
Merge pull request #22008 from taosdata/fix/TS-3648
fix: fix interp fill value unsigned type not being handled
2023-07-10 14:50:23 +08:00
Ganlin Zhao edc2a3a780 fix an issue 2023-07-10 11:35:29 +08:00
Ganlin Zhao f7608ce92d remove udfd agg function handling 2023-07-10 11:35:03 +08:00
Ganlin Zhao 19d4c79ac6 return error code of udf execution failure 2023-07-10 11:34:49 +08:00
Ganlin Zhao cde9eac954 enh: add procedures on server for udf/udaf in nested queries where outer query is
constant table
2023-07-10 11:34:32 +08:00
Ganlin Zhao 05f26a842b fix: fix interp fill value unsigned type not being handled 2023-07-10 11:28:39 +08:00
Shungang Li 8de31219b4 fix: type convert failure returns errcode
TSDB_CODE_SCALAR_CONVERT_ERROR:
"Cannot convert to specific type"
2023-07-10 09:29:29 +08:00
Ganlin Zhao 340e4de30d fix an issue 2023-07-10 09:12:21 +08:00
Ganlin Zhao 365993d775 remove udfd agg function handling 2023-07-06 16:11:41 +08:00
Ganlin Zhao d4e07c551e return error code of udf execution failure 2023-07-06 15:05:49 +08:00
Ganlin Zhao b734506363 enh: add procedures on server for udf/udaf in nested queries where outer query is
constant table
2023-07-06 14:54:01 +08:00
Haojun Liao 74f5b3f80e
Merge pull request #21959 from taosdata/refact/fillhistory
refactor: do some internal refactor.
2023-07-05 17:47:00 +08:00
Haojun Liao 03dbcbf055 refactor: do some internal refactor. 2023-07-05 15:55:55 +08:00
Haojun Liao 9b3e34d589
Merge pull request #21735 from taosdata/refact/fillhistory
refactor: refactor the fill history operation
2023-07-05 10:48:51 +08:00
Haojun Liao ff2bf35603 fix(stream): fix error in set the version range for secondary scan. 2023-07-04 15:08:39 +08:00
Haojun Liao 82342ebdc7
Merge pull request #21934 from taosdata/feature/TD-20678
feat:subscribe only meta info
2023-07-04 11:28:27 +08:00
Haojun Liao 200575647c
Merge branch '3.0' into refact/fillhistory 2023-07-03 15:16:18 +08:00
Haojun Liao 20d099dfa6
Merge pull request #21901 from taosdata/fix/liaohj
fix: fix coverity issue.
2023-07-03 15:15:21 +08:00
wangmm0220 58c7011e0e feat:support only meta in tmq subscriptions 2023-06-30 11:42:40 +08:00
Haojun Liao 622e1cb608 fix: fix coverity issue. 2023-06-29 15:54:09 +08:00
Haojun Liao c24a7f6454
Merge pull request #21876 from taosdata/feature/TS-3495
fix:add log & init to 0 specific
2023-06-29 13:44:25 +08:00
wade zhang 80130b2691
Merge pull request #21851 from luckeverda/fix/TD-24473
fix/TD-24542/TD-24484/TD-24473
2023-06-29 10:42:53 +08:00