Commit Graph

19138 Commits

Author SHA1 Message Date
wangjiaming0909 59bf72428d fix show create table with empty table name 2024-05-17 17:52:17 +08:00
Haojun Liao a2692dbba4 refactor(query): opt memory prepare. 2024-05-17 17:51:41 +08:00
Haojun Liao 524549a08a Merge remote-tracking branch 'origin/enh/opt_prj' into enh/opt_prj 2024-05-17 17:04:29 +08:00
Haojun Liao 27c4e3634c refactor: do some internal refactor. 2024-05-17 17:04:05 +08:00
Yihao Deng bb47a8df33 opt checkpoint 2024-05-17 15:30:04 +08:00
Yihao Deng b0377a2e3a opt checkpoint 2024-05-17 14:21:04 +08:00
wade zhang b299ff0449
Merge pull request #25798 from taosdata/fix/backendInvalidFree
Fix/backendInvalidFree
2024-05-17 13:46:18 +08:00
Hongze Cheng 671eb83d4e
Merge pull request #25809 from taosdata/fix/optReadBufForQueryLargeData3
Fix/optReadBufForQueryLargeData3
2024-05-17 11:43:33 +08:00
Yihao Deng c5b3c04036 opt read buf 2024-05-17 10:27:56 +08:00
Hongze Cheng 56b2ccebf6
Merge pull request #25816 from taosdata/feat/TS-4050-3.0
feat/ts-4050-3.0
2024-05-17 09:13:19 +08:00
Haojun Liao 416339514f
Merge pull request #25822 from taosdata/feat/ly_opt_checkpoint
optimize stream operator checkpoint
2024-05-17 09:08:38 +08:00
Haojun Liao 6e1fe0ae38 refactor: do some internal refactor. 2024-05-16 23:30:35 +08:00
Yihao Deng a7b434075b opt checkpoint 2024-05-16 20:16:59 +08:00
Haojun Liao 5307f15766 refactor: do some internal refactor. 2024-05-16 19:54:29 +08:00
Haojun Liao 66254c96a7 fix(query):remove invalid assert. 2024-05-16 19:26:07 +08:00
dapan1121 028c388435
Merge pull request #25788 from taosdata/fix/3.0/TD-30044
fix partition_by_col interval not loading blocks caused crash
2024-05-16 18:20:25 +08:00
Yihao Deng 2359e0e61b opt checkpoint 2024-05-16 18:07:57 +08:00
Yihao Deng ef5d9316bb Merge branch 'enh/refactoBackendCp' into feat/ly_opt_checkpoint 2024-05-16 16:30:27 +08:00
54liuyao 7b50663240 optimize stream operator checkpoint 2024-05-16 16:24:58 +08:00
Haojun Liao 92b247e5b4 refactor: move compress data in query threads. 2024-05-16 15:55:48 +08:00
dapan1121 41e8a6996f
Merge pull request #25808 from taosdata/fix/TS-4787-3.0
fix(meta scan):check system table scan result
2024-05-16 15:10:24 +08:00
Yihao Deng bc41a5ee3c refactor transport 2024-05-16 14:14:09 +08:00
Haojun Liao 45d78aff8c enh(query): compress msg before sending. 2024-05-16 11:35:34 +08:00
Yihao Deng 427a98279e opt reset buf 2024-05-16 10:30:09 +08:00
dapan1121 51b9046cbc
Merge pull request #25773 from taosdata/enh/TS-4716/timewait
Enh/ts 4716/timewait
2024-05-16 10:17:10 +08:00
54liuyao 4be4a04621 fix(meta scan):check system table scan result 2024-05-16 09:56:07 +08:00
wangjiaming0909 2279f60eed fix partition_by_col interval not loading blocks caused crash 2024-05-16 09:48:00 +08:00
Hongze Cheng f4a9c5e3c8
Merge pull request #25669 from taosdata/enh/TD-29953
Enh/TD-29953
2024-05-15 17:26:26 +08:00
Yihao Deng f33bf898b4 fix invalid free 2024-05-15 16:56:02 +08:00
Yihao Deng 01e9ae6299 fix invalid free 2024-05-15 16:53:42 +08:00
factosea e1ae87bbf5 use tsem2 2024-05-15 14:57:14 +08:00
Haojun Liao 2b44211928 fix(test): update test case and fix a typo. 2024-05-15 14:52:59 +08:00
Haojun Liao abd90c733a fix(stream): remove backend files only after the in-memory task is dropped. 2024-05-15 14:24:35 +08:00
Yihao Deng b1c50e23b6 refactor checkpoint 2024-05-15 11:38:43 +08:00
dapan1121 126c7fa6a5
Merge pull request #25771 from taosdata/fix/3.0/TD-30037
fix get table meta without meta lock
2024-05-15 10:23:15 +08:00
Haojun Liao 042ed3caff fix(stream): fix invalid unlock. 2024-05-15 10:08:56 +08:00
Haojun Liao f905558c38
Merge pull request #25776 from taosdata/fix/TD-30049
fix(tsdb): fix deadlock when stopping reader.
2024-05-15 09:15:18 +08:00
Hongze Cheng 156b5e71f4
Merge pull request #25735 from taosdata/fix/TD-29772-3.0
fix/TD-29772
2024-05-15 09:13:01 +08:00
Haojun Liao 610aa80e65 fix(stream): init backend for fill-history task. 2024-05-15 00:08:38 +08:00
Haojun Liao 4eacf86843 fix(tsdb): fix deadlock when stopping reader. 2024-05-14 19:20:19 +08:00
Hongze Cheng c57dd5f607
Merge pull request #25764 from taosdata/fix/TD-30030-3.0
fix: error msg of show tags from ntb/view
2024-05-14 18:10:54 +08:00
Haojun Liao 241f8b3d2e fix(tsdb): fix deadlock when stopping reader. 2024-05-14 18:05:13 +08:00
Hongze Cheng 7b35a5964e
Merge pull request #25471 from taosdata/feat/TD-29196
feat: add pcre2 lib to precheck geometry wkt
2024-05-14 17:42:15 +08:00
Haojun Liao 1ccf743215 fix(stream): fix syntax error. 2024-05-14 16:19:21 +08:00
Haojun Liao 4fa8cfbffe fix(stream): fix syntax error. 2024-05-14 15:42:37 +08:00
wangjiaming0909 876ea12bfa fix get table meta without meta lock 2024-05-14 15:20:49 +08:00
Haojun Liao 6898eba6ed fix(stream): expand stream tasks are divided into two phase, the first is to build stream task and then expand stream task before start stream tasks. 2024-05-14 14:34:31 +08:00
kailixu ba8d44e49c fix: error msg of show tags from ntb/view 2024-05-14 12:49:09 +08:00
kailixu 4abe06627c fix: error msg of show table tags from view 2024-05-14 12:25:25 +08:00
Haojun Liao fb248b2682 fix(stream): not save the stream task for rsma. 2024-05-13 17:26:39 +08:00
kailixu 8ab24c71d0 fix: show tags from undefined table 2024-05-13 17:14:29 +08:00
dmchen 7c31014c4d add sql 2024-05-13 08:20:27 +00:00
Haojun Liao 3dfffe9113 fix(stream): async load and start stream tasks. 2024-05-13 15:31:26 +08:00
dmchen 939183d3df fix/TD-29772 2024-05-13 01:56:49 +00:00
Haojun Liao 56a1e7e01f
Merge pull request #25727 from taosdata/fix/xftan/TD-29988-3.0
fix: build fails on macOS and Windows
2024-05-13 09:44:19 +08:00
dapan1121 dc853c0d2f
Merge pull request #25726 from taosdata/opti/TS-4658
fix:[TS-4658] make error msg specific
2024-05-12 18:07:39 +08:00
Haojun Liao d32a80a872 fix(query): set correct row index. 2024-05-11 17:05:56 +08:00
Haojun Liao d214dd5cdd fix(stream): fix error in downloading remote backup checkpoint data. 2024-05-11 16:19:11 +08:00
wangmm0220 55ac177097 fix:[TS-4658] make error msg specific 2024-05-11 15:50:05 +08:00
t_max f030af3aab fix: build fails on macOS and Windows 2024-05-11 14:59:05 +08:00
Haojun Liao c54751e7e2 fix(query): set the pk for interp query. 2024-05-11 11:11:09 +08:00
Haojun Liao f8d8061260 refactor: do some internal refactor. 2024-05-11 11:08:51 +08:00
Haojun Liao d7e1f37cd4 Merge branch '3.0' into fix/3_liaohj 2024-05-11 10:28:12 +08:00
Haojun Liao 370c255128 refactor: do some internal refactor. 2024-05-11 10:27:55 +08:00
Haojun Liao 11ed1f54b3 refactor: do some internal refactor. 2024-05-11 10:09:23 +08:00
Haojun Liao 7f93ec2c53 fix(stream): update the checkpoint info for followers, and some internal refactor. 2024-05-11 09:37:02 +08:00
dapan1121 8059ce72d2
Merge pull request #25711 from taosdata/fix/3.0/TS-4769
modify tsma invalid interval msg
2024-05-10 17:57:20 +08:00
Shungang Li 7ae4415890 fix: refactor lastcache ser/des for compatibility 2024-05-09 19:04:11 +08:00
wangjiaming0909 5ede67f578 modify tsma invalid interval msg 2024-05-09 17:55:17 +08:00
Haojun Liao 845fcfa247
Merge pull request #25700 from taosdata/fix/3_liaohj
refactor: do some internal refactor.
2024-05-09 15:14:46 +08:00
Haojun Liao 6721ec3cd8 refactor: do some internal refactor. 2024-05-09 14:06:25 +08:00
Haojun Liao 2ee8f7da32
Merge pull request #25695 from taosdata/fix/3_liaohj
refactor: do some internal refactor.
2024-05-09 13:36:56 +08:00
Haojun Liao db848f7e6b refactor: do some internal refactor. 2024-05-09 10:15:34 +08:00
Haojun Liao 6693efaa85 refactor: do some internal refactor. 2024-05-09 10:11:37 +08:00
Haojun Liao a450deb60b
Merge pull request #25679 from taosdata/fix/3_liaohj
fix(query): set correct row length for rowid sort.
2024-05-09 10:10:27 +08:00
factosea 5a75c38897 test 2024-05-08 23:28:04 +08:00
Haojun Liao cbf994f04f fix(query): set correct length for json value. 2024-05-08 22:28:49 +08:00
Haojun Liao 81abf3fe6d refactor: do some internal refactor. 2024-05-08 19:04:50 +08:00
dapan1121 a221813f55
Merge pull request #25658 from taosdata/fix/3.0/TD-29931
fix check ctgCache.pTsmas outside of cache read lock
2024-05-08 18:51:23 +08:00
Haojun Liao 25d84ab7d3 refactor: do some internal refactor. 2024-05-08 18:41:57 +08:00
Haojun Liao 75e0ce8cbc fix(query): calculate the correct dst row length. 2024-05-08 18:25:56 +08:00
Haojun Liao ca022259a0 fix(query): set correct row length for rowid sort. 2024-05-08 18:17:22 +08:00
Haojun Liao 6e832b68bd refactor: do some internal refactor. 2024-05-08 16:40:51 +08:00
Haojun Liao f120a62434 refactor: do some internal refactor. 2024-05-08 16:37:31 +08:00
Haojun Liao 4f59754a63 refactor: do some internal refactor. 2024-05-08 16:22:02 +08:00
Haojun Liao dc9452fb0a fix(sort): set correct output row index. 2024-05-08 16:21:48 +08:00
Haojun Liao a1a198630a
Merge pull request #25666 from taosdata/fix/3_liaohj
refactor: do some internal refactor.
2024-05-08 15:33:53 +08:00
Yihao Deng a247a43863 change compress 2024-05-08 06:55:29 +00:00
Haojun Liao bc04093d11 refactor: do some internal refactor. 2024-05-08 13:54:25 +08:00
Haojun Liao 9ce8f6953d refactor: do some internal refactor. 2024-05-08 13:52:20 +08:00
Haojun Liao b26656fd1c
Merge pull request #25661 from taosdata/fix/3_liaohj
refactor: do some internal refactor.
2024-05-08 13:03:13 +08:00
Haojun Liao c43fbf6fee refactor: do some internal refactor. 2024-05-08 11:21:24 +08:00
Haojun Liao cdeb4462fb refactor: do some internal refactor. 2024-05-07 23:43:21 +08:00
Haojun Liao 55a630911d
Merge pull request #25653 from taosdata/fix/3_liaohj
refactor: do some internal refactor.
2024-05-07 23:12:30 +08:00
Haojun Liao b6debd985b fix(stream): always return success if repeatly recv checkpoint source msg. 2024-05-07 16:33:08 +08:00
factosea 446fc9f859 group by alias tablename 2024-05-07 15:57:49 +08:00
wangjiaming0909 f5a9f8c338 fix check ctgCache.pTsmas outside of cache read lock 2024-05-07 15:15:26 +08:00
54liuyao a5213e4cf9 adj delete mark 2024-05-07 15:01:45 +08:00
Haojun Liao 0e0f98eb8d refactor: do some internal refactor. 2024-05-07 10:50:44 +08:00
Haojun Liao bbd423f666 refactor: do some internal refactor. 2024-05-07 09:46:12 +08:00
Hongze Cheng 05f0253991
Merge pull request #25644 from taosdata/FIX/TD-29908-3.0
enh: check snap begin index against commit index on leader
2024-05-07 09:02:15 +08:00
Haojun Liao 3b43b8f8c7
Merge pull request #25646 from taosdata/fix/3_liaohj
fix(stream): set global close flag in the streamMeta.
2024-05-06 22:19:23 +08:00
dapan1121 12f38f7685
Merge pull request #25640 from taosdata/fix/TS-4737
fix: scheduler dead lock issue
2024-05-06 18:53:34 +08:00
Haojun Liao 18c66a5491 refactor: do some internal refactor. 2024-05-06 18:17:38 +08:00
Haojun Liao c982f6ac80 refactor: do some internal refactor. 2024-05-06 17:08:11 +08:00
Haojun Liao 7ad7ef7cfc refactor: do some internal refactor. 2024-05-06 17:03:41 +08:00
Haojun Liao 46e9fe6f97 fix(stream): set global close flag in the streamMeta. 2024-05-06 17:03:09 +08:00
Benguang Zhao b0f7355d11 enh: check snap begin index against commit index on leader 2024-05-06 16:57:22 +08:00
Haojun Liao d879c7c967 fix(stream): set global close flag in the streamMeta. 2024-05-06 16:40:49 +08:00
dapan1121 4f1a983074
Update schJob.c 2024-05-06 16:00:35 +08:00
dapan1121 e2b6699c7a fix: scheduler retry issue 2024-05-06 15:57:57 +08:00
dapan1121 d28fa202d7
Merge pull request #25639 from taosdata/enh/elimNotNullCond
Enh: eliminate not null cond
2024-05-06 15:56:43 +08:00
dapan1121 e45a348e5b fix: scheduler job retry issue 2024-05-06 14:08:37 +08:00
dapan1121 7809533c79 enh: eliminate not null condition 2024-05-06 13:45:16 +08:00
Yihao Deng 8061688e79 fix rocskdb init failed 2024-05-06 03:22:28 +00:00
dapan1121 90c0bb53c9 enh: eliminate cond 2024-05-06 09:30:55 +08:00
Haojun Liao 05a204dd6c refactor: do some internal refactor. 2024-04-30 19:30:56 +08:00
Haojun Liao 732e52d64d refactor: do some internal refactor, and add some logs. 2024-04-30 19:11:58 +08:00
Haojun Liao 94a0f9ab8f other: merge 3.0 2024-04-30 17:12:46 +08:00
Haojun Liao ed610d293f fix(stream): close task if it's in checkdown stream procedure. 2024-04-30 17:09:37 +08:00
Haojun Liao 629502e12e refactor: do some internal refactor. 2024-04-30 17:00:51 +08:00
Haojun Liao f2bc93b78d
Merge pull request #25598 from taosdata/fix/3_liaohj
refactor(stream): opt stream sink perf.
2024-04-30 16:59:22 +08:00
dapan1121 7cc173ffbe
Merge pull request #25601 from taosdata/fix/TD-29719/crash2
fix: pSchemaExt crash
2024-04-30 14:28:10 +08:00
dapan1121 b023e6f9df
Merge pull request #25589 from taosdata/fix/TS-4730
fix: create stream udf issue
2024-04-30 14:24:44 +08:00
dapan1121 c0bd60fa9d
Merge pull request #25596 from taosdata/use_tsma_when_partition_by_tag
use tsma when partition by tag
2024-04-30 13:25:56 +08:00
dapan1121 2bd83169bb fix: memory leak issue 2024-04-30 13:22:10 +08:00
factosea 879513c831 fix build failed 2024-04-30 12:09:20 +08:00
factosea 87c71337d1 fix: pSchemaExt null 2024-04-30 12:07:11 +08:00
factosea 5f582723eb fix: pSchemaExt crash 2024-04-30 10:23:40 +08:00
Shungang Li 40e0c6902e fix: geo regex multipoint with paren 2024-04-30 09:53:20 +08:00
Haojun Liao 973ca3be80 refactor: do some internal refactor. 2024-04-30 09:51:40 +08:00
Haojun Liao cd6261c8d4 refactor: do some internal refactor. 2024-04-30 09:49:11 +08:00
dapan1121 0ef476a09e fix: ut issue 2024-04-30 09:42:53 +08:00
wangjiaming0909 bf1c12af53 use tsma when partition by tag 2024-04-30 09:30:36 +08:00
dapan1121 48296447ce
Merge pull request #25586 from taosdata/fix/3.0/TD-29870
fix scanoperator using sma info of last group
2024-04-29 21:45:00 +08:00
Hongze Cheng c923faa4bf
Merge pull request #25578 from taosdata/fix/TD-29325
fix(tdb/btc): free txn early when closing btc
2024-04-29 18:04:02 +08:00
Hongze Cheng 95a78587b4
Merge pull request #25571 from taosdata/fix/TD-29844
Fix/TD-29844
2024-04-29 17:25:59 +08:00
dapan1121 1437b1cffb
Merge pull request #25580 from taosdata/enh/TS-4738
enh: optimize inner join cond
2024-04-29 17:03:56 +08:00
Hongze Cheng 052c79125a
Merge pull request #25570 from taosdata/fix/TS-4728-3.0
fix: TDB upsert no page recycled
2024-04-29 16:58:56 +08:00
Haojun Liao ed73617cc3
Merge pull request #25575 from taosdata/fix/3_liaohj
fix(tsdb): set the correct start pos for binary search.
2024-04-29 16:48:01 +08:00
Minglei Jin 785faf50aa btc/close: free txn only if iPage < 0 2024-04-29 16:27:11 +08:00
wangjiaming0909 94fc209d7d fix scanoperator using sma info of last group 2024-04-29 16:17:04 +08:00
dapan1121 a35dd72147 enh: optimize inner join cond 2024-04-29 15:44:12 +08:00
Minglei Jin d5f140aee2 fix(tdb/btc): free txn early when closing btc 2024-04-29 15:23:00 +08:00
Hongze Cheng 145837ab67 fix memory leak 2024-04-29 15:21:09 +08:00
Haojun Liao b0ef022e87 fix(tsdb): set the correct start pos for binary search. 2024-04-29 15:13:52 +08:00
Yihao Deng 3fd6770c81 avoid invalid read 2024-04-29 05:52:54 +00:00
Hongze Cheng 0b4f5150b6
Merge pull request #25550 from taosdata/fix/TD-29844
Fix/TD-29844
2024-04-29 13:48:30 +08:00
Hongze Cheng 577c2a69f2 add test 2024-04-29 13:43:31 +08:00
Hongze Cheng 175d50594a fix: TDB upsert no page recycled 2024-04-29 13:39:51 +08:00
dapan1121 2c5ae8011e
Merge pull request #25565 from taosdata/fix/3.0/TD-29769
fix count return negative value when loading sma
2024-04-29 13:35:37 +08:00
Hongze Cheng d8e682c567
Merge pull request #25555 from taosdata/FIX/TD-29834-3.0
enh: propagate code of vnodeSnapRead as terrno upwards
2024-04-29 11:26:03 +08:00
Yihao Deng b54198ba4a avoid invalid read 2024-04-29 03:18:38 +00:00
Yihao Deng 97aadd3aa7 avoid invalid read 2024-04-29 03:17:33 +00:00
wangjiaming0909 5bab2db71f fix count return negative value when loading sma 2024-04-29 10:43:26 +08:00
Yihao Deng 2beb46c9df Merge branch '3.0' into fix/TD-29844 2024-04-29 01:27:20 +00:00
dapan1121 0997355460
Merge pull request #25560 from taosdata/tsma_tradeoff
usable tsma
2024-04-29 09:22:50 +08:00
wangjiaming0909 cb008f18dc usable tsma 2024-04-29 09:18:40 +08:00
dapan1121 6ffa3945ea fix: create stream udf issue 2024-04-29 09:18:26 +08:00
Haojun Liao f115a33a94
Merge pull request #25538 from taosdata/fix/3_liaohj
refactor: do some internal refactor.
2024-04-28 23:21:52 +08:00
Haojun Liao 6c93fe5593 fix(stream): fix dead lock. 2024-04-28 18:35:00 +08:00
Haojun Liao b990632e8d fix(stream): fix dead lock. 2024-04-28 18:29:18 +08:00
Haojun Liao bf5d523116 fix(stream): disable the exec of complete check status in timer thread. 2024-04-28 17:57:34 +08:00
Hongze Cheng 13cd60f17f
Merge pull request #25524 from taosdata/feat/TD-29823
Feat/TD-29823
2024-04-28 17:51:39 +08:00
Benguang Zhao d2f8410586 enh: propagate code of vnodeSnapRead as terrno upwards 2024-04-28 16:47:30 +08:00
Yihao Deng 9e19c52924 Remove unnecessary memory free in uploadCheckpointData function 2024-04-28 06:50:54 +00:00
Yihao Deng fac8530580 fix invalid read 2024-04-28 06:50:33 +00:00
Yihao Deng af567ea2cb fix invalid read 2024-04-28 06:47:31 +00:00
Haojun Liao 57ee97814f fix(stream): fix failed to launch timer bug. 2024-04-28 14:29:18 +08:00
Haojun Liao 3c5ca17737 Merge branch '3.0' into fix/3_liaohj 2024-04-28 13:57:16 +08:00
dapan1121 d0c1e660c2 fix: ctable tag scan issue 2024-04-28 11:31:46 +08:00
Haojun Liao 6ea4823f1e fix(stream): update the timeout measurement. 2024-04-28 11:14:10 +08:00
Haojun Liao b2d8260f14 refactor: do some internal refactor. 2024-04-28 10:05:22 +08:00
Haojun Liao 8adaeb59a3 refactor: do some internal refactor. 2024-04-28 09:50:21 +08:00
factosea b314ca8509 fix: rewrite expr groupby 2024-04-28 09:45:54 +08:00
Haojun Liao 384efdc185
Merge pull request #25531 from taosdata/fix/3_liaohj
fix(stream):add ref for task in check rsp monitor timer.
2024-04-28 09:22:00 +08:00
Haojun Liao 1f6b7bbcff fix(util): fix dead lock. 2024-04-27 10:08:15 +08:00
Haojun Liao a33e7b2eb3 refactor: do some internal refactor. 2024-04-26 22:22:54 +08:00
Haojun Liao 2d1e9ba631 fix(stream):add ref for task in check rsp monitor timer. 2024-04-26 19:11:57 +08:00
Haojun Liao 324072fed8
Merge pull request #25525 from taosdata/fix/3_liaohj
fix(stream): update stream task meta info.
2024-04-26 18:15:09 +08:00
Haojun Liao b1b3246066 fix(stream): update the checkpoint executed transId range. 2024-04-26 17:03:01 +08:00
Haojun Liao 5f5595a6ab
Merge pull request #25517 from taosdata/fix/3_liaohj
fix(stream): add task node into update list if it is timeout for more than 100sec.
2024-04-26 17:00:23 +08:00
Yihao Deng ac15015cb8 Add RpcNoDelayfp function to handle specific message types 2024-04-26 08:10:39 +00:00
Haojun Liao 8b53f76691 fix(stream): discard the repeatly recv checkpoint-source msg. 2024-04-26 15:56:34 +08:00
Haojun Liao 3961903fea refactor: do some internal refactor. 2024-04-26 14:00:03 +08:00
Haojun Liao 88af030966 refactor: do some internal refactor. 2024-04-26 13:53:41 +08:00
Haojun Liao 19b0de6582 fix(stream): add task node into update list if it is timeout for more than 100sec. 2024-04-26 13:49:40 +08:00
Hongze Cheng e678d2508f
Merge pull request #25462 from taosdata/enh/supportTmqInterface
Enh/support tmq interface
2024-04-26 13:05:33 +08:00
Haojun Liao c565e31638
Merge pull request #25510 from taosdata/fix/3_liaohj
fix(stream): handle disorder node Update trans Id.
2024-04-26 12:44:00 +08:00
Haojun Liao e5069669cb refactor: do some internal refactor. 2024-04-26 11:16:40 +08:00
Haojun Liao a0e68c2bfb refactor: do some internal refactor. 2024-04-26 11:14:53 +08:00
Haojun Liao ae4e2bf671 fix(stream): suppress some warnings by ide. 2024-04-26 10:00:54 +08:00
Haojun Liao fae53efed9 fix(stream): add some logs for retry for notready/timeout downstream tasks. and do some internal refactor. 2024-04-26 09:58:20 +08:00
Haojun Liao 77961ea791 fix(stream): handle disorder node Update trans Id. 2024-04-26 09:45:42 +08:00
factosea 5a72630b3d fix: select failed as using table alias name 2024-04-26 09:40:29 +08:00
Haojun Liao 5df720910e
Merge pull request #25497 from taosdata/fix/TD-29672
save stream tbname
2024-04-26 09:14:24 +08:00
Haojun Liao b3d2ccec83
Merge pull request #25483 from taosdata/fix/3_liaohj
fix(query): add ts in cache_scan_operator if pk exists and only retri…
2024-04-25 22:32:26 +08:00
54liuyao b8e373f6a9 Merge branch '3.0' of https://github.com/taosdata/TDengine into 3.0 2024-04-25 19:26:41 +08:00
54liuyao 0551c1189d save stream tbname 2024-04-25 18:46:13 +08:00
54liuyao 220a31d02f save stream tbname 2024-04-25 17:48:32 +08:00
54liuyao dbe3b25618 save stream tbname 2024-04-25 17:37:59 +08:00
Haojun Liao addd2d2a84 fix(stream): fix syntax error. 2024-04-25 17:06:15 +08:00
Haojun Liao cd8baa7ba0 fix(stream): add log for update task epset, set correct update flag if epset updated. 2024-04-25 16:39:11 +08:00
Yihao Deng d06cf49182 Fix memory leak in copyDataAt function 2024-04-25 07:44:31 +00:00
dapan1121 a38a14e20c
Merge pull request #25484 from taosdata/fix/TD-29719/schemaExtCrash
fix: copy schemaExt in subtable
2024-04-25 14:26:08 +08:00
Haojun Liao d1ecfe5cf3 refactor: do some internal refactor. 2024-04-25 14:24:20 +08:00
Haojun Liao c7806ebca2 fix(util): fix race condition. 2024-04-25 13:58:02 +08:00
Hongze Cheng e6db086365
Merge pull request #25478 from taosdata/fix/TD-29781-3.0
fix: sys scan user tags
2024-04-25 11:38:36 +08:00
Haojun Liao 740115e117
Merge pull request #25474 from taosdata/fix/TD-29749
fix(stream):opt bloom filter
2024-04-25 11:29:28 +08:00
Shungang Li a7a736b6d6 feat: add pcre2 lib to precheck geometry wkt 2024-04-25 11:28:07 +08:00
Hongze Cheng 032835deec
Merge pull request #25472 from taosdata/fix/TD-29763
Release handle while query failed
2024-04-25 10:54:17 +08:00
dapan1121 8d42c364ed
Merge pull request #25477 from taosdata/fix/windowJoinViewIssue
fix: window join in view issue
2024-04-25 10:22:32 +08:00
Haojun Liao b698b8be96 fix(stream): pass the address of tmr_h id 2024-04-25 09:57:08 +08:00
factosea 91f5d92299 fix: unused code 2024-04-25 09:37:26 +08:00
factosea 46edf75ced fix: copy schemaExt in subtable 2024-04-25 09:33:01 +08:00
Haojun Liao ac860f7fe8 fix(query): add ts in cache_scan_operator if pk exists and only retrieve ts column. 2024-04-25 09:29:42 +08:00
54liuyao 403a877564 set pk length 2024-04-25 08:52:29 +08:00
kailixu 1348a98118 fix: sys scan user tags 2024-04-24 19:16:25 +08:00
dapan1121 3ed44d75b9 fix: window join in view issue 2024-04-24 19:14:20 +08:00
54liuyao 2a72ceadd1 Merge branch '3.0' of https://github.com/taosdata/TDengine into 3.0 2024-04-24 18:57:22 +08:00
Haojun Liao 3b08ee3d16
Merge pull request #25458 from taosdata/fix/3_liaohj
fix(stream): add task update trans conflict level.
2024-04-24 18:54:06 +08:00
54liuyao 85cd290aa5 opt bloom filter 2024-04-24 18:40:39 +08:00
54liuyao 3300bf04c1 opt bloom filter 2024-04-24 17:27:24 +08:00
Yihao Deng 41814cd9fb release handle while query failed 2024-04-24 06:37:37 +00:00
Hongze Cheng e47d17e826
Merge pull request #25451 from taosdata/enh/refactorCompress
refactor compress
2024-04-24 10:55:00 +08:00
Haojun Liao e5c679d280
Merge pull request #25453 from taosdata/fix/TD-29701
fix(stream):mem leak
2024-04-23 19:50:07 +08:00
Haojun Liao a37667968f refactor: do some internal refactor. 2024-04-23 19:49:14 +08:00
Haojun Liao 82cde46614 fix(stream): fix memory leak. 2024-04-23 19:48:50 +08:00
Haojun Liao ace5e12e65 fix(tsdb): set the correct lflag when creating tsdbCache reader. 2024-04-23 19:25:51 +08:00
Haojun Liao 10c792efa2 fix(stream):add related fill-history task to be done, when check-rsp moniting quit. 2024-04-23 16:55:47 +08:00
54liuyao cdaa5f9801 fix(stream):mem leak 2024-04-23 15:40:50 +08:00
Haojun Liao 7fda9d9fcb Merge branch '3.0' into fix/3_liaohj 2024-04-23 15:08:43 +08:00
Haojun Liao b0f68a9147 refactor: do some internal refactor. 2024-04-23 14:58:51 +08:00
Yihao Deng f3feb9dabe refactor compress 2024-04-23 06:37:18 +00:00
Haojun Liao cda0087d40
Merge pull request #25437 from taosdata/fix/TD-29721
fix(stream):save invalid delete info for final interval op
2024-04-23 14:13:48 +08:00
Haojun Liao 1adf59e7d8 fix(stream): do check when task is paused, and do some internal refactor. 2024-04-23 13:53:23 +08:00
dapan1121 07e01b3e97
Merge pull request #25386 from taosdata/fix/3.0/TD-29631
fix cancel create tsma memory use after free
2024-04-23 13:17:55 +08:00
dapan1121 92a7801d09
Merge pull request #25444 from taosdata/enh/groupJoinOpt
enh: optimize group join performance
2024-04-23 10:19:47 +08:00
Haojun Liao 34048937a4 fix(stream): check req id to remove expired check rsp . 2024-04-23 10:03:01 +08:00
dapan1121 94c7f32247 enh: optimize group join performance 2024-04-23 09:14:42 +08:00
Haojun Liao d7a08909dd
Merge pull request #25442 from taosdata/fix/3_liaohj
fix(stream): save the epset if task epset updated.
2024-04-23 09:10:45 +08:00
54liuyao a4a226a22d Merge branch '3.0' of https://github.com/taosdata/TDengine into 3.0 2024-04-23 08:58:25 +08:00
Haojun Liao 315b86cf66 fix(stream): save the epset if task epset updated. 2024-04-22 23:52:45 +08:00
Haojun Liao ada1c6d4c0
Merge pull request #25434 from taosdata/fix/3_liaohj
fix(stream):update the check-rsp prcedure, to avoid repeatly start check-rsp procedure.
2024-04-22 22:13:19 +08:00
54liuyao 0c62f5417a save invalid delete info for final interval op 2024-04-22 18:05:35 +08:00
Haojun Liao cf7ffb82e0 fix(stream): init before send msg, to avoid race condition. 2024-04-22 17:18:01 +08:00
Haojun Liao b6316c2692
Merge pull request #25432 from taosdata/fix/TD-29688
fix(stream):add option for update data
2024-04-22 14:57:28 +08:00
Haojun Liao 97c1f88b22 refactor: do some internal refactor. 2024-04-22 14:06:11 +08:00
Haojun Liao 6c76790e6c fix(stream): fix a typo 2024-04-22 14:03:13 +08:00
Haojun Liao a8fac441be fix(stream):update the check-rsp prcedure, to avoid repeatly start check-rsp procedure. 2024-04-22 14:02:31 +08:00
wangjiaming0909 f971cfb778 1. fix stream wrong group id for new child tables.
2. fix md5 function wrong bytes returned
2024-04-22 14:00:06 +08:00
54liuyao 2d48c2c993 fix(stream):add option for update data 2024-04-22 10:41:01 +08:00
Haojun Liao 00fa4e7f0c fix(tsdb): set correct pk info when creating cache scan operator. 2024-04-22 09:26:12 +08:00
Haojun Liao e5dddc4abf Merge branch '3.0' into fix/3_liaohj 2024-04-19 19:13:28 +08:00
Haojun Liao b75e77cb15 refactor: do some internal refactor. 2024-04-19 19:13:07 +08:00
Haojun Liao b903872a4e fix(stream): correct count down the ready tasks. 2024-04-19 19:02:34 +08:00
dapan1121 312ca43b9f
Merge pull request #25399 from taosdata/opti/TS-4658
opti:add local thread error msg array
2024-04-19 18:23:39 +08:00
Hongze Cheng 5500b11137
Merge pull request #25409 from taosdata/fix/TD-29107-3.0
fix/TD-29107
2024-04-19 17:45:25 +08:00
Haojun Liao adfc1fb927 Merge branch '3.0' into fix/3_liaohj 2024-04-19 16:24:53 +08:00
Haojun Liao 3baa47f266 fix(stream): record the task check downstream failed info. 2024-04-19 16:21:05 +08:00
Hongze Cheng fc5c84422e
Merge pull request #25256 from taosdata/feat/TD-24834
Feat/td 24834
2024-04-19 13:34:37 +08:00
Haojun Liao 62260bff79
Merge pull request #25389 from taosdata/fix/3_liaohj
fix(stream): reset checkpoint info after receiving task-reset info.
2024-04-19 11:23:55 +08:00
Hongze Cheng 7ddb82a9a4
Merge pull request #25323 from taosdata/enh/TS-4255-3.0
enh: nchar insert and query
2024-04-19 11:09:53 +08:00
Haojun Liao 3769da535e fix(stream): re-send checkmsg to downstream for fixed dispatch type. 2024-04-19 10:00:47 +08:00
Haojun Liao 815d12fd77 fix(stream): set check downstream completed for sink task. 2024-04-18 18:36:02 +08:00
Haojun Liao 4802cd1ddf Merge branch '3.0' into fix/3_liaohj 2024-04-18 17:53:30 +08:00
Hongze Cheng 614f1f5a9d
Merge pull request #25379 from taosdata/feat/addCompress
Feat/add compress
2024-04-18 17:10:34 +08:00
kailixu e6584cea91 Merge branch '3.0' into enh/TS-4255-3.0 2024-04-18 16:05:26 +08:00
Haojun Liao e7dee4ac63 refactor(stream): refactor check msg retry procedure and be tolerant to the dnode disconnection during check downstream tasks. 2024-04-18 15:55:21 +08:00
wangmm0220 529ca1d1c1 opti:add local thread error msg array 2024-04-18 13:56:43 +08:00
Yihao Deng 03f1250b93 limit index bg thread 2024-04-18 02:57:53 +00:00
Haojun Liao ac84a5f82b refactor: do some internal refactor. 2024-04-17 21:57:09 +08:00
Haojun Liao ddf98ae0c2 refactor: do some internal refactor. 2024-04-17 18:04:02 +08:00
Yihao Deng a461b24ac9 add compress 2024-04-17 09:37:23 +00:00
dm chen 1196ea72da
Merge branch '3.0' into feat/TD-24834 2024-04-17 17:13:29 +08:00
Yihao Deng 07008747ed add compress 2024-04-17 09:09:30 +00:00
Yihao Deng 2547f29de9 add compress 2024-04-17 08:59:38 +00:00
Yihao Deng f8dcf806d2 add compress 2024-04-17 08:58:10 +00:00
Yihao Deng 7cec8836b1 add compress 2024-04-17 08:39:43 +00:00
Yihao Deng 15f9e1e29e add compress 2024-04-17 08:38:46 +00:00
Yihao Deng 1363cd0a71 add compress 2024-04-17 08:33:40 +00:00
Hongze Cheng a34b644640
Merge pull request #25366 from taosdata/feat/compress_3.0
Feat/compress 3.0
2024-04-17 16:15:26 +08:00
Yihao Deng 0f629bebda add compress 2024-04-17 07:35:00 +00:00
Haojun Liao 9fdf13dccc
Merge pull request #25380 from taosdata/fix/3_liaohj
fix(stream): add return.
2024-04-17 15:04:00 +08:00
Yihao Deng 1d9b65226e add compress 2024-04-17 07:02:55 +00:00
kailixu 384e650882 enh: show encryptions 2024-04-17 14:41:47 +08:00
dapan1121 76eda6631c
Merge pull request #25382 from taosdata/fix/3.0/fix-release-ci
fix release build
2024-04-17 13:42:20 +08:00
wangjiaming0909 9bc8f3aea0 fix release build 2024-04-17 11:56:20 +08:00
Haojun Liao 24c000e052 Merge branch '3.0' into fix/3_liaohj 2024-04-17 11:27:54 +08:00
Yihao Deng 04e78d0ce7 Merge branch 'feat/3.0' into feat/compress_3.0 2024-04-17 03:23:02 +00:00
Yihao Deng 51fa1d40a4 fix other platform error 2024-04-17 03:02:54 +00:00
kailixu 74afb8deae chore: solve conflicts 2024-04-17 10:52:34 +08:00
Haojun Liao 13e14d0f55 fix(stream): add return. 2024-04-17 10:48:22 +08:00
yihaoDeng 40390ad918 add compress 2024-04-17 10:23:17 +08:00
yihaoDeng 2da8645d36 add compress 2024-04-17 10:22:54 +08:00
yihaoDeng 469e9ba069 add compress 2024-04-17 10:20:11 +08:00
dapan1121 5936d3a1b0
Merge pull request #25300 from taosdata/draft/tsma_before_ci
feat: support tsma
2024-04-17 10:00:17 +08:00
dapan1121 1b34752e38
Merge pull request #25377 from taosdata/fix/projectionLimit0
fix: projection limit 0 issue
2024-04-17 08:24:37 +08:00
Haojun Liao a439f61708
Merge pull request #25375 from taosdata/fix/3_liaohj
fix(stream): generate the checkpoint id
2024-04-16 19:41:07 +08:00
dapan1121 e7a43b4e58 fix: projection limit 0 issue 2024-04-16 18:47:03 +08:00
wangjiaming0909 fb72e29fe1 fix stream progress delay 2024-04-16 18:17:33 +08:00
Yihao Deng 6f9de676f0 Merge branch 'fix/compress_3.0' into feat/compress_3.0 2024-04-16 09:27:26 +00:00
Haojun Liao 8bdd43c305 fix(stream): wait for 50ms when no token in bucket for sink task. 2024-04-16 14:42:21 +08:00
wangjiaming0909 92e91c2032 fix ci 2024-04-16 14:27:06 +08:00
wangjiaming0909 1978a06e6e merge with 3.0 2024-04-16 14:27:06 +08:00
Haojun Liao 6d8687d239 fix(stream): add lock, and fix race condition. 2024-04-16 14:25:35 +08:00
wangjiaming0909 ce2cbd4ab5 fix stream fill history not finished 2024-04-16 14:25:34 +08:00
wangjiaming0909 039939196a forbid tsma agg funcs with tag columns 2024-04-16 14:25:34 +08:00
wangjiaming0909 1b37ef03fb fix duplicate tsma funcs 2024-04-16 14:25:34 +08:00
wangjiaming0909 97498e1844 fix create tsma txn and fix fetch wrong stream progress 2024-04-16 14:25:34 +08:00
wangjiaming0909 9cc33b1296 fix escaped tsma name 2024-04-16 14:25:34 +08:00
wangjiaming0909 de1c28d623 tsma avoid fetching tsma for no tsma tables 2024-04-16 14:25:34 +08:00
wangjiaming0909 f6200dd923 support long ctb names 2024-04-16 14:25:34 +08:00
wangjiaming0909 6ce0616ffd fix ci and TODOs 2024-04-16 14:25:34 +08:00
wangjiaming0909 e43580f71b fix ci 2024-04-16 14:25:20 +08:00
wangjiaming0909 2b594e02d2 fix tsma name too long 2024-04-16 14:25:20 +08:00
wangjiaming0909 43699959c8 fix ci 2024-04-16 14:25:01 +08:00
wangjiaming0909 7de0a34ae6 support maxTsmaCalcDelay, maxTsmaNum, skip_tsma 2024-04-16 14:25:01 +08:00
wangjiaming0909 a2cbbba24d find TODO 2024-04-16 14:23:26 +08:00
wangjiaming0909 d1101a0325 support filter out tsma res tbs when show stables/tables 2024-04-16 14:23:26 +08:00
wangjiaming0909 a8e00f7410 drop tb in transaction 2024-04-16 14:23:26 +08:00
wangjiaming0909 1ef153de63 support drop ctb for tsma 2024-04-16 14:23:25 +08:00
wangjiaming0909 1a06dd684e support drop ctb 2024-04-16 14:23:25 +08:00
wangjiaming0909 94f2f6ae22 fix drop ctb 2024-04-16 14:23:25 +08:00
wangjiaming0909 34dbdfd4dc support stddev and hyperloglog for tsma 2024-04-16 14:23:25 +08:00
wangjiaming0909 40a7262fcd support spread 2024-04-16 14:23:25 +08:00
wangjiaming0909 fa85d1caa7 support other tsma funcs 2024-04-16 14:23:25 +08:00
wangjiaming0909 cc9550f45e add tsma funcs 2024-04-16 14:20:59 +08:00
wangjiaming0909 98ca847eb8 add tests 2024-04-16 14:18:11 +08:00
wangjiaming0909 38ed0317e7 testing 2024-04-16 14:18:11 +08:00
wangjiaming0909 c9be37bdc6 fix norm_tb child tb tsma query 2024-04-16 14:18:11 +08:00
wangjiaming0909 79b726fdbc fix vgroupd num 1 2024-04-16 14:18:11 +08:00
wangjiaming0909 cf750bfdd4 fix split windows 2024-04-16 14:18:11 +08:00
wangjiaming0909 db00faeb02 fix split window 2024-04-16 14:18:11 +08:00
wangjiaming0909 f5f6306277 fix split window bug 2024-04-16 14:18:11 +08:00
wangjiaming0909 3c870acb16 add tests 2024-04-16 14:18:11 +08:00
wangjiaming0909 9625ce7cdf add tests 2024-04-16 14:18:11 +08:00
wangjiaming0909 ab60fbfdc3 add tsma test 2024-04-16 14:18:10 +08:00
wangjiaming0909 846de7780b add tests 2024-04-16 14:18:10 +08:00
wangjiaming0909 a1054234e2 fix query tsma child table 2024-04-16 14:18:10 +08:00
wangjiaming0909 dff0449474 start to support select child table using tsma 2024-04-16 14:18:10 +08:00
wangjiaming0909 c3e73d9168 fix recursive tsma 2024-04-16 14:18:10 +08:00
wangjiaming0909 d8200b2f63 fetch lastts vnode version before create tsma 2024-04-16 14:18:10 +08:00
wangjiaming0909 8e56d9a359 fix tsmas 2024-04-16 14:18:10 +08:00
wangjiaming0909 e947a2fb0d catalog cache get stream progress 2024-04-16 14:18:10 +08:00
wangjiaming0909 a4d2dfed67 stream supported api 2024-04-16 14:18:10 +08:00
wangjiaming0909 09bb7c3814 rebase fix 2024-04-16 14:18:10 +08:00
wangjiaming0909 6e7dc4b7b4 normal table tsma and add tests 2024-04-16 14:17:12 +08:00
wangjiaming0909 70ca830378 support recursive tsma creation 2024-04-16 14:17:12 +08:00
wangjiaming0909 1509ce04cf test tsma 2024-04-16 14:17:12 +08:00