Commit Graph

3971 Commits

Author SHA1 Message Date
liuyao c7e4aa4f77 set win range 2023-07-19 15:51:22 +08:00
liuyao 8481725517 remove redundant results 2023-07-19 14:58:28 +08:00
slzhou d1a1976aa4 enhance: add limit to merge sort 2023-07-19 13:59:43 +08:00
wangmm0220 5c344b0159 fix:conflicts from main 2023-07-19 09:05:05 +08:00
liuyao caa4503352 reset state key memory 2023-07-18 18:02:39 +08:00
slzhou 4348b9c51d fix: use uinfo to show on stdout 2023-07-18 16:47:31 +08:00
slzhou f79fc81d9c fix: add to page buf in the same way as single source sort 2023-07-18 15:46:38 +08:00
dapan1121 c2245a3546
Merge pull request #22100 from taosdata/fix/TD-25241
fix: fix interval in nested query filter not applied
2023-07-18 13:52:35 +08:00
slzhou 97a6e89d11 enhance: refactor create initial sources 2023-07-18 10:38:40 +08:00
Ganlin Zhao 94b13df641 fix: fix interval in nested query filter not applied 2023-07-18 10:36:07 +08:00
slzhou ba2b404295 enhance: optimize msortComparFn for table merge scan 2023-07-17 21:07:55 +08:00
slzhou 1b9754f1bc enhance: add log with info level. change to debug later 2023-07-17 16:18:06 +08:00
slzhou 655233fd4f fix: create initial source with blocks 2023-07-17 15:05:30 +08:00
shenglian zhou 9a0e9df567 enhance: block is ts sorted and each book is a source 2023-07-16 23:39:41 +08:00
slzhou f93af4d2e0 enhance: pass simple test 2023-07-16 20:28:54 +08:00
shenglian zhou 8b6d7db7ad enhance: use one tsdb reader to read table sequentially 2023-07-16 17:54:39 +08:00
wangmm0220 6762a01d88 Merge branch 'main' of https://github.com/taosdata/TDengine into mark/tmq 2023-07-14 16:44:00 +08:00
wangmm0220 bbdcbcb75b fix:modify commit version to next validate version 2023-07-14 16:43:28 +08:00
dapan1121 1a19d29eee
Merge pull request #22060 from taosdata/fix/TD-25209
fix: reset interpolation buffer after last valid row for interval + fill(next)
2023-07-14 09:30:56 +08:00
Ganlin Zhao a7af4d9348 fix: reset interpolation buffer after last valid row for interval + fill(next) 2023-07-13 18:18:26 +08:00
Haojun Liao e0ea0f2df4
Merge pull request #22020 from taosdata/fix/liaohj
other: merge main
2023-07-13 17:55:28 +08:00
Haojun Liao f41bcd73b0 other: merge main. 2023-07-13 11:02:09 +08:00
Haojun Liao c388802bda
Merge pull request #22024 from taosdata/fix/3_liaohj
fix(stream): fix concurrent bug in save task meta.
2023-07-12 18:17:27 +08:00
Haojun Liao fed3803739 fix(stream): fix memory leak. 2023-07-11 19:29:52 +08:00
wangjiaming0909 1d7515213b feat: 1. add limit for diskBasedBuf
2. use referenced tuple before actually pushing into pq
3. use limitInfo instead of maxRows in sort pyhsical node
2023-07-11 14:16:20 +08:00
Shungang Li 8f91da24e4 fix: type convert failure returns errcode
TSDB_CODE_SCALAR_CONVERT_ERROR:
"Cannot convert to specific type"
2023-07-11 10:20:50 +08:00
wade zhang 13bc1e744e
Merge pull request #21963 from luckeverda/fix/TD-24473-new
fix/TD-24473
2023-07-11 09:32:25 +08:00
Haojun Liao 3ffdbe923d other: merge 3.0 2023-07-11 09:12:57 +08:00
dapan1121 39a58c354d
Merge pull request #22008 from taosdata/fix/TS-3648
fix: fix interp fill value unsigned type not being handled
2023-07-10 14:50:23 +08:00
Ganlin Zhao edc2a3a780 fix an issue 2023-07-10 11:35:29 +08:00
Ganlin Zhao f7608ce92d remove udfd agg function handling 2023-07-10 11:35:03 +08:00
Ganlin Zhao 19d4c79ac6 return error code of udf execution failure 2023-07-10 11:34:49 +08:00
Ganlin Zhao cde9eac954 enh: add procedures on server for udf/udaf in nested queries where outer query is
constant table
2023-07-10 11:34:32 +08:00
Ganlin Zhao 05f26a842b fix: fix interp fill value unsigned type not being handled 2023-07-10 11:28:39 +08:00
Shungang Li 8de31219b4 fix: type convert failure returns errcode
TSDB_CODE_SCALAR_CONVERT_ERROR:
"Cannot convert to specific type"
2023-07-10 09:29:29 +08:00
Ganlin Zhao 340e4de30d fix an issue 2023-07-10 09:12:21 +08:00
Ganlin Zhao 365993d775 remove udfd agg function handling 2023-07-06 16:11:41 +08:00
Ganlin Zhao d4e07c551e return error code of udf execution failure 2023-07-06 15:05:49 +08:00
Ganlin Zhao b734506363 enh: add procedures on server for udf/udaf in nested queries where outer query is
constant table
2023-07-06 14:54:01 +08:00
Haojun Liao 74f5b3f80e
Merge pull request #21959 from taosdata/refact/fillhistory
refactor: do some internal refactor.
2023-07-05 17:47:00 +08:00
Haojun Liao 03dbcbf055 refactor: do some internal refactor. 2023-07-05 15:55:55 +08:00
Haojun Liao 9b3e34d589
Merge pull request #21735 from taosdata/refact/fillhistory
refactor: refactor the fill history operation
2023-07-05 10:48:51 +08:00
Haojun Liao ff2bf35603 fix(stream): fix error in set the version range for secondary scan. 2023-07-04 15:08:39 +08:00
Haojun Liao 82342ebdc7
Merge pull request #21934 from taosdata/feature/TD-20678
feat:subscribe only meta info
2023-07-04 11:28:27 +08:00
Haojun Liao 200575647c
Merge branch '3.0' into refact/fillhistory 2023-07-03 15:16:18 +08:00
Haojun Liao 20d099dfa6
Merge pull request #21901 from taosdata/fix/liaohj
fix: fix coverity issue.
2023-07-03 15:15:21 +08:00
wangmm0220 58c7011e0e feat:support only meta in tmq subscriptions 2023-06-30 11:42:40 +08:00
Haojun Liao 622e1cb608 fix: fix coverity issue. 2023-06-29 15:54:09 +08:00
Haojun Liao c24a7f6454
Merge pull request #21876 from taosdata/feature/TS-3495
fix:add log & init to 0 specific
2023-06-29 13:44:25 +08:00
wade zhang 80130b2691
Merge pull request #21851 from luckeverda/fix/TD-24473
fix/TD-24542/TD-24484/TD-24473
2023-06-29 10:42:53 +08:00
Shungang Li 308ba7a02e fix: type geometry predicates support
support "=, <>, is null, is not null, in, not in"
2023-06-29 09:44:51 +08:00
wangmm0220 6cd0f98e44 Merge branch '3.0' of https://github.com/taosdata/TDengine into feature/TS-3495 2023-06-28 18:09:30 +08:00
liuyao 2fc5eeb810 session win range 2023-06-28 17:20:08 +08:00
Haojun Liao f4309603e3 fix(stream): fix syntax error. 2023-06-28 14:05:38 +08:00
Haojun Liao ed900d6ff6
Merge branch '3.0' into refact/fillhistory 2023-06-28 13:48:26 +08:00
wangmm0220 1fc664693e fix:continue consume if wal is dropped 2023-06-28 11:54:48 +08:00
Haojun Liao a19e63fd23 fix(stream): fix error in handling fill history. 2023-06-27 23:00:14 +08:00
wangjiaming0909 57ddb3437d feature: optimize order by limit using priority queue 2023-06-27 17:50:50 +08:00
Haojun Liao 32fddeff18 fix(stream): fix error retrieve data from source task.And optimize the test cases. 2023-06-27 16:24:47 +08:00
Haojun Liao 3289ad62be other: merge 3.0 2023-06-27 11:33:40 +08:00
Haojun Liao 600607ef84
Merge pull request #21846 from taosdata/fix/TD-24969
stream single session op end window function
2023-06-27 10:38:38 +08:00
dapan1121 4dae9f4eff merge main to 3.0 2023-06-26 18:43:00 +08:00
liuyao d1ca2ae2a0 stream single session op end window function 2023-06-26 17:10:06 +08:00
liuyao 1d22e6ba52 stream session end window function 2023-06-26 10:51:45 +08:00
liuyao e236bf818c set fill history info 2023-06-25 17:47:10 +08:00
Haojun Liao e4e66ad0a4 fix: fix memory leak. 2023-06-25 14:56:08 +08:00
Haojun Liao 7e7feeffdf fix: fix memory leak. 2023-06-25 14:38:31 +08:00
Haojun Liao 6857881742 Merge branch '3.0' into refact/fillhistory 2023-06-25 10:41:32 +08:00
wade zhang 254a20bdf3
Merge pull request #21660 from luckeverda/feat/TD-23739
feat/TD-23739: enhance ttl, deletetime modified by writing-op
2023-06-25 09:06:57 +08:00
Haojun Liao ceb78fdad2
Merge branch '3.0' into refact/fillhistory 2023-06-24 18:53:48 +08:00
liuyao d23c80b12f free mem 2023-06-21 10:24:34 +08:00
wangjiaming0909 eb7d23ca95 fix: fill operator with wrong input ts order 2023-06-21 09:23:58 +08:00
liuyao 1bed2b1e40 free mem 2023-06-21 09:13:46 +08:00
liuyao fbed0acace free mem 2023-06-20 19:23:30 +08:00
liuyao 3cfda2c579 scan op transform 2023-06-20 17:44:41 +08:00
Minglei Jin fa5d52613e fix(query/scan-oper): use META_READER_NOLOCK to init meta reader 2023-06-20 17:33:28 +08:00
liuyao 74bea44300 stream op transform 2023-06-20 17:30:59 +08:00
Shungang Li b93f653d7e feat: enhance ttl, deletetime modified by writing-ops
new config item: ttlChangeOnWrite (default 0)
ttl delete time changes on last write if true
2023-06-19 19:03:35 +08:00
liuyao 41c193945f fill history pause&resume 2023-06-19 17:28:19 +08:00
dapan1121 1ca24fea6b
Merge pull request #21742 from wangjiaming0909/feature/3.0/TD-24656
feature: add input, output ts order for execution plans
2023-06-18 19:24:29 +08:00
slzhou fc523d1265 fix: at most 128 k-way merge to decrease memory usage 2023-06-18 07:53:35 +08:00
slzhou 9e781ed7a6 fix: destory data block to fix oom 2023-06-18 06:50:53 +08:00
slzhou 577c131360 fix: search k-way number 2023-06-17 22:13:08 +08:00
slzhou 0a567252f5 fix: oom issue since table merge scan 2023-06-17 18:50:33 +08:00
wangjiaming0909 61309862c2 fix comments of TD-24656 2023-06-16 18:12:02 +08:00
Ganlin Zhao 9cddf06053 handle 0 result case for groups 2023-06-16 16:11:56 +08:00
Ganlin Zhao e4c9a7474e remove test code 2023-06-16 14:58:23 +08:00
Ganlin Zhao e74c0ac987 save index instead of ts 2023-06-16 14:11:19 +08:00
dapan1121 bb8840d4ec
Merge pull request #21749 from taosdata/szhou/fix-ts3543
fix: table merge scan oom with muliti-level merge sort
2023-06-16 14:05:25 +08:00
dapan1121 9a3781ea19
Merge pull request #21743 from taosdata/fix/td-24784
fix: cleanup datablock so that varmeta length is right
2023-06-16 13:20:56 +08:00
wade zhang d5f37359f4
Merge pull request #21722 from taosdata/fix/TD-24761
fix(tsdb/cache): rewrite cache update to fix cpu usage
2023-06-16 11:52:02 +08:00
wangjiaming0909 fb4f174fbc feature: add input, output ts order for execution plans 2023-06-16 10:26:09 +08:00
Ganlin Zhao fe2629d061 Merge branch '3.0' into feat/TD-22193 2023-06-16 10:16:51 +08:00
Haojun Liao 933801269a fix(stream): fix memory leak and failed to close vnode. 2023-06-16 09:55:11 +08:00
slzhou e35553d6a0 fix: fix memory sanitizer error 2023-06-16 09:02:15 +08:00
shenglian zhou 376688479c fix: remove multi-reader since two level merge is used 2023-06-16 09:00:50 +08:00
slzhou 0b61b88c10 fix: fix oom issue 2023-06-16 09:00:31 +08:00
Haojun Liao f3df37bf28 fix(stream): fix memory leak. 2023-06-15 17:56:58 +08:00
Minglei Jin 158ae209bf cache/lru: new applyF API for tlrucache 2023-06-15 16:34:51 +08:00
shenglian zhou b7165da5e3 fix: cleanup datablock so that varmeta length is right 2023-06-15 16:10:28 +08:00
Haojun Liao 74e0138f72 Merge branch '3.0' into refact/fillhistory 2023-06-15 15:25:00 +08:00
liuyao 693942b821 trans state 2023-06-15 14:13:17 +08:00
Haojun Liao 1b9eca5ce0 other: merge main. 2023-06-15 13:03:17 +08:00
Haojun Liao 55724157c4 refactor: remove one function. 2023-06-15 10:40:25 +08:00
Haojun Liao 7c6fbd7772 enh(stream): do some internal refactor and support secondary scan for history data. 2023-06-14 14:10:09 +08:00
yihaoDeng ed33e6ea43 change log level when filter tag 2023-06-13 07:06:08 +00:00
slzhou 13ddd37529 fix: fix memory sanitizer error 2023-06-13 14:51:41 +08:00
liuyao c58bde9715 stream operator fill history 2023-06-13 10:57:36 +08:00
yihaoDeng 8dc6d1cc6a change log level when filter tag 2023-06-13 01:51:22 +00:00
dapan1121 7956a8c420 fix: row size too big issue 2023-06-09 13:49:25 +08:00
Haojun Liao 53246ed6bb other: merge other branch. 2023-06-09 09:41:10 +08:00
Ganlin Zhao bef6214904 remove test code 2023-06-08 19:30:05 +08:00
Ganlin Zhao 145bb93967 fix block only have one row 2023-06-08 19:21:04 +08:00
Haojun Liao c9aa59cbb9 refactor: do some internal refactor. 2023-06-08 18:59:25 +08:00
Ganlin Zhao 21fccc2d48 fix switchin group issue 2023-06-08 18:25:32 +08:00
Ganlin Zhao 7ee05df7c6 fix lastBlock remain ts not saved 2023-06-08 17:46:25 +08:00
Ganlin Zhao b4c2085ddc feat: add pipeline processing for timeslice operator 2023-06-08 16:32:35 +08:00
Haojun Liao 2b6ace653a refactor: do some internal refactor. 2023-06-08 16:14:27 +08:00
dapan1121 a9ed1f6d46
Merge pull request #21567 from wangjiaming0909/fix/3.0/TD-24525
fix: prevent projectoperator scanning all rows when limit with no group
2023-06-08 15:14:48 +08:00
Haojun Liao f582705feb refactor: do some internal refactor. 2023-06-08 14:18:06 +08:00
dapan1121 958160be0b
Merge pull request #21599 from taosdata/enh/TD-24274
enh: enable interp fill value support scarlar expression
2023-06-08 10:39:38 +08:00
dapan1121 6c74282946
Merge pull request #21597 from taosdata/enh/TD-24586
enh: optimize filter performance
2023-06-08 09:05:56 +08:00
Ganlin Zhao c612d945ec fix fill value bug 2023-06-07 18:27:29 +08:00
dapan1121 a4f5bac344
Merge pull request #21606 from taosdata/szhou/fix-ts3498
fix: rewrite count(*) to count(1) for temp table
2023-06-07 15:56:50 +08:00
dapan1121 47c891fbc5 Merge remote-tracking branch 'origin/main' into enh/TD-24586 2023-06-07 09:27:56 +08:00
liuyao 2ab43ca0d0 semi interval op check data ts 2023-06-07 09:24:17 +08:00
Haojun Liao 6a3c935b4a fix(stream): fix error in fill history scan. 2023-06-07 09:15:55 +08:00
wangjiaming0909 3cb64f3775 fix: prevent projectoperator scanning all rows when limit with no group 2023-06-06 19:28:55 +08:00
liuyao bff2aae354 fix stream ci issue 2023-06-06 19:18:43 +08:00
liuyao 49ca147c47 fix stream ci issue 2023-06-06 19:18:43 +08:00
dapan1121 a0428387a9 enh: corrent column data reassign issue 2023-06-06 16:44:15 +08:00
liuyao 201d0f2d18 fix stream ci issue 2023-06-06 16:37:08 +08:00
dapan1121 65d323d9c7
Merge pull request #21222 from taosdata/fix/TD-24001
enh: optimize timeline function validation
2023-06-06 14:22:53 +08:00
dapan1121 02b1257b01 enh: reassign data column in blocks 2023-06-06 11:17:02 +08:00
slzhou e2ac3d00ad fix: fix mem leak 2023-06-06 10:20:52 +08:00
dapan1121 7381209618 enh: optimize filter performance 2023-06-05 16:08:11 +08:00
Haojun Liao fcc706c45c enh(stream): refactor the fill history task. 2023-06-05 15:59:01 +08:00
Minglei Jin d02746d86f fix(query/sys): pause/resume with sys scan operator 2023-06-05 15:24:39 +08:00
dapan1121 532e02fb2a enh: improve filter performance 2023-06-05 10:47:15 +08:00
Haojun Liao 044e56fc97
Merge branch '3.0' into fix/resume_mem 2023-06-03 12:19:17 +08:00
Haojun Liao cb7bb954b5
Merge pull request #21577 from taosdata/fix/TD-24515
reset unclosed window info
2023-06-03 11:21:06 +08:00
Haojun Liao cca69f3038 Merge branch '3.0' into fix/resume_mem 2023-06-02 18:40:48 +08:00
liuyao 17f2c3f882 reset wind info 2023-06-02 18:27:22 +08:00
Haojun Liao 3d7defa881 refactor: do some internal refactor. 2023-06-02 15:43:38 +08:00
Haojun Liao 2edba85efe refactor: do some internal refactor. 2023-06-02 15:27:44 +08:00
Haojun Liao bcd8867fb2 refactor: do some internal refactor. 2023-06-02 15:27:14 +08:00
Haojun Liao 76106165da other: add some logs. 2023-06-02 15:13:25 +08:00
yihaoDeng f59161464d avoid mem leak 2023-06-02 06:48:26 +00:00
dapan1121 ddd3a53e56 Merge remote-tracking branch 'origin/3.0' into fix/TD-24001 2023-06-02 13:57:34 +08:00
Haojun Liao cce87a036f other: merge 3.0. 2023-06-02 13:34:20 +08:00