Commit Graph

4673 Commits

Author SHA1 Message Date
Haojun Liao ac08f659c3 refactor: remove invalid procedure in fill-history. 2024-01-26 16:20:43 +08:00
54liuyao 4d8fbc0396 stream count window sliding 2024-01-26 16:15:25 +08:00
54liuyao 9e86dfaee7 stream count window sliding 2024-01-26 15:56:26 +08:00
54liuyao bc4f3d1296 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-22023 2024-01-26 15:55:06 +08:00
slzhou 686258b26e feat: deep clean up for data blocks 2024-01-26 14:52:24 +08:00
slzhou 82871f7ee3 feat: no in mem reader and blocks are to disk 2024-01-26 14:23:34 +08:00
slzhou c46769ef37 fix: reader can be in memory or not 2024-01-26 14:10:02 +08:00
slzhou a06ba844ba fix: set dataload flag 2024-01-26 13:11:05 +08:00
slzhou 664647c4a4 Merge branch '3.0' of github.com:taosdata/TDengine into szhou/tms/port-3 2024-01-26 11:05:59 +08:00
Haojun Liao 834f08a2e0
Merge pull request #24552 from taosdata/fix/3_liaohj
fix(stream): do checkpoint after fill-history task completed.
2024-01-25 16:53:11 +08:00
slzhou 305d4a962a fix: page block and reader block for each child table input 2024-01-24 17:16:18 +08:00
slzhou 2f6a2923b7 fix: first running 2024-01-24 15:23:03 +08:00
slzhou 57a9ac75a8 feat: remove limit reached from merge scan operator 2024-01-24 11:37:47 +08:00
slzhou 4484e99e6c fix: compilation error 2024-01-24 11:13:37 +08:00
slzhou 033ebb5fa5 feat: prepare for switch between one reader and multi readers 2024-01-24 11:11:45 +08:00
slzhou 622dd10b19 feat: add operator next function 2024-01-24 10:21:17 +08:00
slzhou 3f2b469b5e feat: refactor code 2024-01-24 09:12:27 +08:00
slzhou 174673470d fix: linux compilation 2024-01-23 17:12:53 +08:00
slzhou 70f869ce33 fix: memory error when limit 0 2024-01-23 17:05:03 +08:00
shenglian zhou dd70c63dfe feat: table merge scan with one less disk usage 2024-01-23 16:34:14 +08:00
slzhou 5c9edce538 fix: whole block error 2024-01-23 10:45:26 +08:00
54liuyao 0975e37845 Merge branch '3.0' of https://github.com/taosdata/TDengine into 3.0 2024-01-23 10:07:50 +08:00
slzhou 6ca92a3d92 fix: meory leak 2024-01-23 08:41:59 +08:00
dapan1121 66c30f861f
Merge pull request #24529 from taosdata/szhou/fix/td-28350
fix: calculate interval end with new alogrithm
2024-01-23 08:41:37 +08:00
shenglian zhou 3f441bb8cf feat: extract rows within limit before sort to disk 2024-01-22 15:29:07 +08:00
slzhou 60b3ac93ab fix: fix compilation error 2024-01-22 13:11:46 +08:00
slzhou 5021d981b8 fix: fix memory leak 2024-01-22 11:23:38 +08:00
slzhou c3c8d7b07d fix: compute scalar functions before agg in session window 2024-01-22 10:11:06 +08:00
54liuyao 288b91a4c3 mid interval retrive 2024-01-22 10:08:45 +08:00
slzhou 9e3a42af01 fix: modify test case 2024-01-21 16:15:51 +08:00
slzhou e84d36dd39 fix: add test case 2024-01-19 22:42:10 +08:00
54liuyao 5a7d72d6ef Merge branch '3.0' of https://github.com/taosdata/TDengine into 3.0 2024-01-19 10:39:11 +08:00
dapan1121 497d07a198
Merge pull request #24482 from taosdata/szhou/fix/td-28222-2
fix: stream scan core due to table end index introduced in 1 null row…
2024-01-19 08:45:09 +08:00
wangmm0220 7246fedfef Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/ly_multi_marks 2024-01-18 19:08:35 +08:00
slzhou 64858af92f fix: calculate interval end with new alogrithm 2024-01-18 16:30:18 +08:00
Haojun Liao 719d1d1b90 refactor: do some internal refactor. 2024-01-18 14:34:18 +08:00
54liuyao 7986951f44 use taskid of operator 2024-01-18 11:02:18 +08:00
54liuyao 1309e56a95 use strncpy 2024-01-18 11:02:04 +08:00
54liuyao 94ab74cc7f clone task id 2024-01-18 11:01:50 +08:00
slzhou a1f7169b63 fix: remove uInfo 2024-01-18 09:52:04 +08:00
dapan1121 eed1095dc1
Merge pull request #24479 from taosdata/szhou/fix/td-28271
fix: add input ignore group to project
2024-01-18 08:49:31 +08:00
slzhou f1fb7f5c14 fix: change num of output groups when cout empty group is needed 2024-01-18 08:43:36 +08:00
54liuyao 3bbfb26e09 stream count window 2024-01-17 14:22:19 +08:00
slzhou 449c1631ef fix: add numOfOutputGroups back when group order scan 2024-01-17 13:34:37 +08:00
slzhou de6b559ab9 fix: remove some uage of table end index 2024-01-16 15:21:20 +08:00
slzhou 9a7ef7fa18 fix: reuse tableListGetGroupList 2024-01-16 15:08:50 +08:00
dapan1121 2fef37a5cc
Merge pull request #24315 from taosdata/fix/xsren/TD-28068/columnNodeRef2
fix: columanRefNode illegal type conversion
2024-01-16 10:08:34 +08:00
facetosea 79671d3e68 fix: internal error code 2024-01-16 10:07:46 +08:00
Haojun Liao 8f6256dfae
Merge pull request #24473 from taosdata/fix/TD-28319
set delete for session op
2024-01-16 10:02:06 +08:00
slzhou 764365047d fix: stream scan core due to table end index introduced in 1 null row for empty group 2024-01-16 09:28:45 +08:00
shenglian zhou 9c9d9dc24b fix: add input ignore group 2024-01-16 08:13:47 +08:00
54liuyao 2e543d950a set delete for session op 2024-01-15 17:36:23 +08:00
wangmm0220 2ab54a1335 fix:conflicts from 3.0 2024-01-15 16:54:52 +08:00
fullhonest cb2ab749b5 Fix TD-27003: use last row scan when select last_row, last 2024-01-15 15:22:29 +08:00
facetosea 1191902d38 fix error code and delete unused code 2024-01-15 13:06:22 +08:00
shenglian zhou 8ae3aa24be fix: set ignore input group id 2024-01-15 11:58:29 +08:00
factosea a794391866 unused code 2024-01-15 02:40:50 +08:00
factosea ab02ec74c9 fix taosd crash 2024-01-12 18:10:54 +08:00
54liuyao 52d8811bdc code coverage 2024-01-12 13:49:32 +08:00
Haojun Liao ee24bb9b03
Merge pull request #24444 from taosdata/fix/3_liaohj
fix(stream): close the inputQ of the related stream task.
2024-01-12 13:41:30 +08:00
Haojun Liao b36cc97236 fix(stream): close the inputQ of the related stream task when the fill-history task recv the trans-state msg from upstream. 2024-01-12 10:44:49 +08:00
Haojun Liao 578edd447f
Merge pull request #24421 from taosdata/szhou/fix/2/td-28154
fix: windows calculation when offset >0 and calendar sliding
2024-01-12 09:35:09 +08:00
factosea 3ed63df082 fix case 2024-01-11 18:34:21 +08:00
slzhou 3cea4fd2c7 fix: getNextTimeWindow use new time algorithm 2024-01-11 16:41:11 +08:00
slzhou ab137a56f0 fix: more interval end calculation with slide-start/slide-end as anchor 2024-01-11 08:31:16 +08:00
slzhou b4b4400958 fix: recalcuate window ekey 2024-01-10 21:36:09 +08:00
slzhou ba2ba0a8cb fix: time window computation error 2024-01-10 16:19:20 +08:00
Haojun Liao 9d0d0d9ddc Merge branch '3.0' into fix/3_liaohj 2024-01-10 09:57:46 +08:00
factosea d243308541 fix: colref 2024-01-10 09:04:40 +08:00
Haojun Liao af9dc441b2 fix(stream): reset the saved value for fill-history task. 2024-01-08 18:40:06 +08:00
factosea 45ec9fcbc8 fix: create param node from function node 2024-01-08 16:43:57 +08:00
Yihao Deng 1eee7b44e0 fix crash found on 3.1 2024-01-08 07:31:35 +00:00
factosea 8c3fe7cc70 fix: SColumnRefNode transfer to SelectFunction's param 2024-01-08 11:41:58 +08:00
slzhou 7c58a9a280 fix: disable sort by row id when num of tables is 1 2024-01-08 08:21:27 +08:00
slzhou 9646091492 fix: sort error due to out of space 2024-01-07 16:18:24 +08:00
slzhou 0f9be1033a fix: use page size of sort 2024-01-05 19:22:17 +08:00
54liuyao 0b9e3c9871 fix stream state buff issue 2024-01-05 16:20:55 +08:00
dapan1121 670317ccd7
Merge pull request #24053 from taosdata/enh/3.0/TD-26813
enh: support group by tag/tbname to list empty groups
2024-01-04 09:08:03 +08:00
Bob Liu 860146d425 initRemainGroups 2024-01-03 23:59:48 +08:00
factosea 8dc2a6bbd9 fix: orderby 2024-01-03 20:43:23 +08:00
factosea b6b2a41d83 fix: columnrefnode 2024-01-03 18:30:57 +08:00
Bob Liu b818faaa5e remainGroups 2024-01-03 17:51:27 +08:00
slzhou 06fd7ee96f fix: use the correct block to calc page size 2024-01-03 15:34:38 +08:00
slzhou fb732be16d fix: change pageSize and buf size 2024-01-03 15:09:24 +08:00
Haojun Liao a2e85c44c2
Merge pull request #24228 from taosdata/fix/3_liaohj
refactor: remove stream-scan-history event for stream task.
2024-01-03 14:43:20 +08:00
slzhou c9b2bb714d fix: bugs during self-test 2024-01-03 14:39:06 +08:00
shenglian zhou fbf67e4294 fix: save data when creating intial sources 2024-01-03 14:03:22 +08:00
Haojun Liao 29afc2ad6a fix(stream):add jump condition for loop. 2024-01-02 15:48:08 +08:00
Bob Liu 85ba9a4a5f remainGroups 2024-01-02 15:45:03 +08:00
54liuyao afc2a346e5 reset update info 2024-01-02 14:23:41 +08:00
dapan1121 06e3d8df1d
Merge pull request #24282 from taosdata/fix/3.0/TS-4411
fix: fill prev not working when desc fill
2024-01-02 13:07:21 +08:00
Haojun Liao e7a0044502 Merge branch '3.0' into fix/3_liaohj 2024-01-02 13:02:55 +08:00
shenglian zhou 91a705f731 Merge branch '3.0' of github.com:taosdata/TDengine into szhou/tms-wide-column 2024-01-02 10:41:31 +08:00
Bob Liu 673d3bc376 arrangeTableGroup 2023-12-31 13:15:05 +08:00
Bob Liu 7e1d59c565 sort 2023-12-29 16:22:41 +08:00
wangjiaming0909 90a8fe5581 fix: fill prev not working when desc fill 2023-12-29 15:08:56 +08:00
Haojun Liao 50ce4f4455
Merge pull request #24257 from taosdata/fix/TD-28091
reset datablock window info
2023-12-29 09:04:41 +08:00
Haojun Liao a662f6d63f
Merge pull request #24262 from taosdata/fix/TD-28099
reset unclose window info
2023-12-29 09:04:31 +08:00
Bob Liu e2b61a55fc refactor 2023-12-29 01:40:17 +08:00
Bob Liu 9f8f69a791 adjust 2023-12-28 21:54:16 +08:00
Bob Liu 424ab1bbe3 support table merge scan 2023-12-28 16:18:38 +08:00
54liuyao 51cd8e9fb7 reset unclose window info 2023-12-28 15:34:13 +08:00
54liuyao 448b7c939f reset datablock window info 2023-12-28 11:09:38 +08:00
54liuyao f1304680c5 log 2023-12-28 11:09:03 +08:00
54liuyao c124bcf52f check block rows 2023-12-28 11:09:03 +08:00
Bob Liu a5f88a86e9 adjust 2023-12-28 09:45:01 +08:00
Bob Liu abed781bd3 opt 2023-12-27 23:15:11 +08:00
Bob Liu d795798648 count state 2023-12-27 21:37:00 +08:00
54liuyao 382569591f log 2023-12-27 14:01:38 +08:00
54liuyao a46c921f68 check block rows 2023-12-27 11:29:03 +08:00
shenglian zhou 81b95f2135 Merge branch '3.0' of github.com:taosdata/TDengine into szhou/tms-wide-column 2023-12-27 09:27:46 +08:00
Bob Liu 42f9d54a70 adjust 2023-12-27 00:28:42 +08:00
Bob Liu 3faf1514f4 doGroupedTableScan 2023-12-26 20:47:15 +08:00
54liuyao ccf861dec8 Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/3_liaohj 2023-12-26 18:36:18 +08:00
54liuyao e2564a6189 fix issue 2023-12-26 18:35:49 +08:00
54liuyao ac3c76f608 init dummy function 2023-12-25 19:38:20 +08:00
Bob Liu ef5b5786b3 adjust 2023-12-22 18:14:26 +08:00
Bob Liu e3098accc4 support count empty table 2023-12-22 18:14:26 +08:00
dapan1121 709b7f4683
Merge pull request #24181 from taosdata/fix/TD-27967_TD-28004
fix: cache scan heap overflow and forbid DDD for to_char in windows
2023-12-22 16:54:46 +08:00
54liuyao 036fa8d0d9 sliding window 2023-12-21 19:51:09 +08:00
wangjiaming0909 153221e1d6 fix: cache scan heap overflow and forbid DDD for to_char in windows 2023-12-21 19:46:33 +08:00
slzhou a802d35af4 fix: change the pre-allocated column check 2023-12-21 16:36:56 +08:00
slzhou 094c6cdfb4 fix: the pre-allocated column has no data to copy 2023-12-21 16:31:35 +08:00
54liuyao 246ad22e0b mid operator igore expired data 2023-12-21 14:34:37 +08:00
slzhou d2b0ef75a5 fix: windows compilation 2023-12-21 13:10:37 +08:00
slzhou 1725986d9f fix: columns pre-allocated has no data and offsets 2023-12-21 11:45:04 +08:00
slzhou 7a237504f9 fix: change pagesize of row storage disk based buf 2023-12-21 09:36:11 +08:00
slzhou 70419dcbc6 fix: change memory size for row storage in memory pages 2023-12-21 08:22:22 +08:00
slzhou 7bc4791ad6 Merge branch 'szhou/tms-wide-column' of github.com:taosdata/TDengine into szhou/tms-wide-column 2023-12-21 08:17:48 +08:00
slzhou 084245e6d2 fix: row id sort when no limit and row size is more than 256 2023-12-21 08:05:09 +08:00
54liuyao a387e7e2d3 mid operator checkpoint 2023-12-20 18:50:55 +08:00
slzhou fd4b294972 Merge branch '3.0' of github.com:taosdata/TDengine into szhou/tms-wide-column 2023-12-20 17:10:00 +08:00
slzhou d6445d2d5b enhance: add length verification 2023-12-20 16:20:43 +08:00
wangmm0220 0eec9d5fbd fix:deal with stram_pull_over block in middle interval 2023-12-20 16:09:36 +08:00
wangmm0220 e16000a50c Merge branch 'feat/ly_multi_marks' of https://github.com/taosdata/TDengine into feat/ly_multi_marks 2023-12-20 11:00:31 +08:00
wangmm0220 dd0afef6f2 fix:set triggerParams=0 in mid interval 2023-12-20 11:00:25 +08:00
54liuyao 60722bcf4d use mid interval 2023-12-20 10:53:23 +08:00
slzhou 9ebca3eaff fix: access length col removed 2023-12-20 10:06:22 +08:00
slzhou bde2cf7b34 enhance: remove length col and refactor 2023-12-20 09:54:27 +08:00
slzhou f3847a00c6 fix: more space is required for a row 2023-12-20 08:10:45 +08:00
slzhou 1aa94a8b3d fix: ci error 2023-12-19 14:55:31 +08:00
wangjiaming0909 ad24c03538 fix: session window block row index overflow 2023-12-19 14:31:13 +08:00
WANG MINGMING 6f23b63d9e
Merge branch '3.0' into feat/ly_multi_marks 2023-12-18 16:22:56 +08:00
54liuyao 70a8281ef2 reset update info 2023-12-18 14:59:48 +08:00
slzhou 5be6ed9553 fix: increase page size and mem size 2023-12-18 14:23:30 +08:00
slzhou 0d711331b7 Merge branch '3.0' of github.com:taosdata/TDengine into szhou/tms-wide-column 2023-12-18 13:27:30 +08:00
Haojun Liao 1a9701d401
Merge pull request #23946 from taosdata/fix/snodeBackendCrash
Fix/snode backend crash
2023-12-16 13:13:28 +08:00
slzhou 8a6317b76a Merge branch '3.0' of github.com:taosdata/TDengine into szhou/fix-tms-duration 2023-12-15 22:09:43 +08:00
slzhou b2ee43540b enhance: add log and clean up 2023-12-15 21:55:25 +08:00
yihaoDeng 7ab7a64eb3 Merge branch '3.0' into fix/snodeBackendCrash 2023-12-15 18:16:14 +08:00
dapan1121 5bbec0108a
Merge pull request #24081 from taosdata/szhou/add-experimental-flag
fix: add experimental flag
2023-12-15 17:31:35 +08:00
slzhou ce48598f0d fix: pass first round test 2023-12-15 17:16:20 +08:00
shenglian zhou cc4a6c6d55 fix: add new duration block event 2023-12-15 15:04:47 +08:00
shenglian zhou 617d4bfb95 fix: add experimental flag 2023-12-15 10:40:54 +08:00
dm chen 81767dfa32
Merge branch '3.0' into feat/TS-4229 2023-12-14 17:02:51 +08:00
slzhou 803e9d3ffb fix: db previlege check 2023-12-14 08:11:27 +08:00
slzhou b309c251da fix: pass simple test 2023-12-13 13:21:26 +08:00
shenglian zhou 7f93cb9f1a fix: use pageid, offset, length as row index 2023-12-13 11:38:14 +08:00
54liuyao 0c284c4398 reset stream trigger 2023-12-12 16:04:58 +08:00
dapan1121 96c481d537
Merge pull request #24002 from taosdata/fix/xsren/TD-27792
int32->int16 error
2023-12-12 09:54:16 +08:00
Haojun Liao 5ab1b47cef
Merge pull request #24023 from taosdata/fix/TD-27807
ignore invalid event window
2023-12-12 09:37:23 +08:00
54liuyao 5e0ad7638d ignore invalid event window 2023-12-11 19:13:22 +08:00
Haojun Liao 1bf3f2d1bd
Merge pull request #24013 from taosdata/fix/TD-27795
set event window rows
2023-12-11 18:40:02 +08:00
54liuyao 7e21030dfd set event window rows 2023-12-11 15:16:01 +08:00
slzhou 2743228217 Merge branch '3.0' of github.com:taosdata/TDengine into feat/TS-4229 2023-12-11 14:15:17 +08:00
factosea f6d70daef8 int32->int16 error 2023-12-11 11:46:15 +08:00
54liuyao 06c0a090c2 opt ignore expried rule 2023-12-11 11:32:14 +08:00
slzhou 3b1a185949 fix: coldataSetNItems error 2023-12-11 09:12:16 +08:00
54liuyao 76a5560e1d Merge branch '3.0' of https://github.com/taosdata/TDengine into 3.0 2023-12-11 08:55:10 +08:00
slzhou c705a71bd9 feat: use disk based buf for src block storage 2023-12-10 22:25:46 +08:00
slzhou d01e82439e feature: replace two lru cache with hash 2023-12-10 19:11:39 +08:00
Haojun Liao 39ea7d7567
Merge pull request #23980 from taosdata/fix/3_liaohj
fix(tsdb): opt read stt file
2023-12-09 21:28:52 +08:00
slzhou 5dd50c10a2 Merge branch '3.0' of github.com:taosdata/TDengine into szhou/tms-duration 2023-12-09 19:25:07 +08:00
slzhou 9a9264e03a fix: fix memory leak 2023-12-09 19:00:23 +08:00
slzhou 92a695cd2f fix: memory leaks 2023-12-08 22:12:24 +08:00
slzhou 205e3ecf27 fix: fix mem leak of block data buf 2023-12-08 21:49:36 +08:00
slzhou 6acbbc3cff fix: typo error 2023-12-08 21:15:06 +08:00
54liuyao ccce9d5085 init delete mark 2023-12-08 18:12:05 +08:00
slzhou 83139b8d48 fix: save work 2023-12-08 17:45:54 +08:00
54liuyao 7570fa758b init delete mark 2023-12-08 16:28:18 +08:00
Haojun Liao 63b34c7acf fix(tsdb): add check for not load stt file blocks. 2023-12-08 16:09:58 +08:00
wangmm0220 d1c2a03dc7 fix:conflicts from 3.0 2023-12-08 15:58:52 +08:00
shenglian zhou 854766d986 enhance: save block then sort by row id 2023-12-08 15:57:29 +08:00
54liuyao 13193e29b7 delete invalid event window 2023-12-08 14:28:40 +08:00
Haojun Liao 9c72ce846e fix(tsdb): add more condition for not load data. 2023-12-08 14:23:37 +08:00
54liuyao 2528fff8a8 rebuild stream event window 2023-12-08 10:52:52 +08:00
Haojun Liao 9477146b30 fix(tsdb): fix syntax error. 2023-12-08 10:29:38 +08:00
Haojun Liao 4ffaff4d50 other: merge 3.0 2023-12-08 10:14:42 +08:00
Haojun Liao 446c14da72 fix(tsdb): opt read stt file 2023-12-08 10:03:36 +08:00
dapan1121 a2ee41233e
Merge pull request #23835 from taosdata/szhou/tms-duration
feat: tsdb output in duration order
2023-12-08 09:07:41 +08:00
Haojun Liao 7c17d6f313 fix(tsdb): opt read performance by check clean stt block if only row number required. 2023-12-07 23:12:54 +08:00
dapan1121 a4242e829a
Merge pull request #23960 from taosdata/enh/xsren/TD-26882
Enh/xsren/td 26882
2023-12-07 13:23:28 +08:00
slzhou 1ba1fbfabc fix: remove allow_forbid_func define 2023-12-07 10:45:26 +08:00
dapan1121 30eb035447
Merge pull request #23940 from taosdata/fix/TS-4327
fix: last/last_row crash with dropped column
2023-12-06 17:57:24 +08:00
Hongze Cheng 04e84ba152 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TS-4229 2023-12-06 16:43:00 +08:00
factosea a0e356bf84 Keep the last data with the same timestamp when inserting 2023-12-06 15:20:05 +08:00
shenglian zhou ac531c6d7f enhance: add fileset delimited front end 2023-12-06 10:45:12 +08:00
shenglian zhou a2e7c78d27 refactor: rename variables 2023-12-06 09:39:38 +08:00
shenglian zhou 8ff3f8e25e enhance: add duration order change by file /tmp/duration 2023-12-06 08:48:29 +08:00
yihaoDeng a82856dff7 fix mem leak 2023-12-05 20:28:12 +08:00