Commit Graph

18746 Commits

Author SHA1 Message Date
Haojun Liao e5069669cb refactor: do some internal refactor. 2024-04-26 11:16:40 +08:00
Haojun Liao a0e68c2bfb refactor: do some internal refactor. 2024-04-26 11:14:53 +08:00
Haojun Liao ae4e2bf671 fix(stream): suppress some warnings by ide. 2024-04-26 10:00:54 +08:00
Haojun Liao fae53efed9 fix(stream): add some logs for retry for notready/timeout downstream tasks. and do some internal refactor. 2024-04-26 09:58:20 +08:00
Haojun Liao 77961ea791 fix(stream): handle disorder node Update trans Id. 2024-04-26 09:45:42 +08:00
Haojun Liao 5df720910e
Merge pull request #25497 from taosdata/fix/TD-29672
save stream tbname
2024-04-26 09:14:24 +08:00
Haojun Liao b3d2ccec83
Merge pull request #25483 from taosdata/fix/3_liaohj
fix(query): add ts in cache_scan_operator if pk exists and only retri…
2024-04-25 22:32:26 +08:00
54liuyao b8e373f6a9 Merge branch '3.0' of https://github.com/taosdata/TDengine into 3.0 2024-04-25 19:26:41 +08:00
54liuyao 0551c1189d save stream tbname 2024-04-25 18:46:13 +08:00
54liuyao 220a31d02f save stream tbname 2024-04-25 17:48:32 +08:00
54liuyao dbe3b25618 save stream tbname 2024-04-25 17:37:59 +08:00
Haojun Liao addd2d2a84 fix(stream): fix syntax error. 2024-04-25 17:06:15 +08:00
Haojun Liao cd8baa7ba0 fix(stream): add log for update task epset, set correct update flag if epset updated. 2024-04-25 16:39:11 +08:00
Yihao Deng d06cf49182 Fix memory leak in copyDataAt function 2024-04-25 07:44:31 +00:00
dapan1121 a38a14e20c
Merge pull request #25484 from taosdata/fix/TD-29719/schemaExtCrash
fix: copy schemaExt in subtable
2024-04-25 14:26:08 +08:00
Haojun Liao d1ecfe5cf3 refactor: do some internal refactor. 2024-04-25 14:24:20 +08:00
Haojun Liao c7806ebca2 fix(util): fix race condition. 2024-04-25 13:58:02 +08:00
Hongze Cheng e6db086365
Merge pull request #25478 from taosdata/fix/TD-29781-3.0
fix: sys scan user tags
2024-04-25 11:38:36 +08:00
Haojun Liao 740115e117
Merge pull request #25474 from taosdata/fix/TD-29749
fix(stream):opt bloom filter
2024-04-25 11:29:28 +08:00
Hongze Cheng 032835deec
Merge pull request #25472 from taosdata/fix/TD-29763
Release handle while query failed
2024-04-25 10:54:17 +08:00
dapan1121 8d42c364ed
Merge pull request #25477 from taosdata/fix/windowJoinViewIssue
fix: window join in view issue
2024-04-25 10:22:32 +08:00
Haojun Liao b698b8be96 fix(stream): pass the address of tmr_h id 2024-04-25 09:57:08 +08:00
factosea 91f5d92299 fix: unused code 2024-04-25 09:37:26 +08:00
factosea 46edf75ced fix: copy schemaExt in subtable 2024-04-25 09:33:01 +08:00
Haojun Liao ac860f7fe8 fix(query): add ts in cache_scan_operator if pk exists and only retrieve ts column. 2024-04-25 09:29:42 +08:00
54liuyao 403a877564 set pk length 2024-04-25 08:52:29 +08:00
kailixu 1348a98118 fix: sys scan user tags 2024-04-24 19:16:25 +08:00
dapan1121 3ed44d75b9 fix: window join in view issue 2024-04-24 19:14:20 +08:00
54liuyao 2a72ceadd1 Merge branch '3.0' of https://github.com/taosdata/TDengine into 3.0 2024-04-24 18:57:22 +08:00
Haojun Liao 3b08ee3d16
Merge pull request #25458 from taosdata/fix/3_liaohj
fix(stream): add task update trans conflict level.
2024-04-24 18:54:06 +08:00
54liuyao 85cd290aa5 opt bloom filter 2024-04-24 18:40:39 +08:00
54liuyao 3300bf04c1 opt bloom filter 2024-04-24 17:27:24 +08:00
Yihao Deng 41814cd9fb release handle while query failed 2024-04-24 06:37:37 +00:00
Hongze Cheng e47d17e826
Merge pull request #25451 from taosdata/enh/refactorCompress
refactor compress
2024-04-24 10:55:00 +08:00
Haojun Liao e5c679d280
Merge pull request #25453 from taosdata/fix/TD-29701
fix(stream):mem leak
2024-04-23 19:50:07 +08:00
Haojun Liao a37667968f refactor: do some internal refactor. 2024-04-23 19:49:14 +08:00
Haojun Liao 82cde46614 fix(stream): fix memory leak. 2024-04-23 19:48:50 +08:00
Haojun Liao ace5e12e65 fix(tsdb): set the correct lflag when creating tsdbCache reader. 2024-04-23 19:25:51 +08:00
Haojun Liao 10c792efa2 fix(stream):add related fill-history task to be done, when check-rsp moniting quit. 2024-04-23 16:55:47 +08:00
54liuyao cdaa5f9801 fix(stream):mem leak 2024-04-23 15:40:50 +08:00
Haojun Liao 7fda9d9fcb Merge branch '3.0' into fix/3_liaohj 2024-04-23 15:08:43 +08:00
Haojun Liao b0f68a9147 refactor: do some internal refactor. 2024-04-23 14:58:51 +08:00
Yihao Deng f3feb9dabe refactor compress 2024-04-23 06:37:18 +00:00
Haojun Liao cda0087d40
Merge pull request #25437 from taosdata/fix/TD-29721
fix(stream):save invalid delete info for final interval op
2024-04-23 14:13:48 +08:00
Haojun Liao 1adf59e7d8 fix(stream): do check when task is paused, and do some internal refactor. 2024-04-23 13:53:23 +08:00
dapan1121 07e01b3e97
Merge pull request #25386 from taosdata/fix/3.0/TD-29631
fix cancel create tsma memory use after free
2024-04-23 13:17:55 +08:00
dapan1121 92a7801d09
Merge pull request #25444 from taosdata/enh/groupJoinOpt
enh: optimize group join performance
2024-04-23 10:19:47 +08:00
Haojun Liao 34048937a4 fix(stream): check req id to remove expired check rsp . 2024-04-23 10:03:01 +08:00
dapan1121 94c7f32247 enh: optimize group join performance 2024-04-23 09:14:42 +08:00
Haojun Liao d7a08909dd
Merge pull request #25442 from taosdata/fix/3_liaohj
fix(stream): save the epset if task epset updated.
2024-04-23 09:10:45 +08:00
54liuyao a4a226a22d Merge branch '3.0' of https://github.com/taosdata/TDengine into 3.0 2024-04-23 08:58:25 +08:00
Haojun Liao 315b86cf66 fix(stream): save the epset if task epset updated. 2024-04-22 23:52:45 +08:00
Haojun Liao ada1c6d4c0
Merge pull request #25434 from taosdata/fix/3_liaohj
fix(stream):update the check-rsp prcedure, to avoid repeatly start check-rsp procedure.
2024-04-22 22:13:19 +08:00
54liuyao 0c62f5417a save invalid delete info for final interval op 2024-04-22 18:05:35 +08:00
Haojun Liao cf7ffb82e0 fix(stream): init before send msg, to avoid race condition. 2024-04-22 17:18:01 +08:00
Haojun Liao b6316c2692
Merge pull request #25432 from taosdata/fix/TD-29688
fix(stream):add option for update data
2024-04-22 14:57:28 +08:00
Haojun Liao 97c1f88b22 refactor: do some internal refactor. 2024-04-22 14:06:11 +08:00
Haojun Liao 6c76790e6c fix(stream): fix a typo 2024-04-22 14:03:13 +08:00
Haojun Liao a8fac441be fix(stream):update the check-rsp prcedure, to avoid repeatly start check-rsp procedure. 2024-04-22 14:02:31 +08:00
wangjiaming0909 f971cfb778 1. fix stream wrong group id for new child tables.
2. fix md5 function wrong bytes returned
2024-04-22 14:00:06 +08:00
54liuyao 2d48c2c993 fix(stream):add option for update data 2024-04-22 10:41:01 +08:00
Haojun Liao 00fa4e7f0c fix(tsdb): set correct pk info when creating cache scan operator. 2024-04-22 09:26:12 +08:00
Haojun Liao e5dddc4abf Merge branch '3.0' into fix/3_liaohj 2024-04-19 19:13:28 +08:00
Haojun Liao b75e77cb15 refactor: do some internal refactor. 2024-04-19 19:13:07 +08:00
Haojun Liao b903872a4e fix(stream): correct count down the ready tasks. 2024-04-19 19:02:34 +08:00
dapan1121 312ca43b9f
Merge pull request #25399 from taosdata/opti/TS-4658
opti:add local thread error msg array
2024-04-19 18:23:39 +08:00
Hongze Cheng 5500b11137
Merge pull request #25409 from taosdata/fix/TD-29107-3.0
fix/TD-29107
2024-04-19 17:45:25 +08:00
Haojun Liao adfc1fb927 Merge branch '3.0' into fix/3_liaohj 2024-04-19 16:24:53 +08:00
Haojun Liao 3baa47f266 fix(stream): record the task check downstream failed info. 2024-04-19 16:21:05 +08:00
Hongze Cheng fc5c84422e
Merge pull request #25256 from taosdata/feat/TD-24834
Feat/td 24834
2024-04-19 13:34:37 +08:00
Haojun Liao 62260bff79
Merge pull request #25389 from taosdata/fix/3_liaohj
fix(stream): reset checkpoint info after receiving task-reset info.
2024-04-19 11:23:55 +08:00
Hongze Cheng 7ddb82a9a4
Merge pull request #25323 from taosdata/enh/TS-4255-3.0
enh: nchar insert and query
2024-04-19 11:09:53 +08:00
Haojun Liao 3769da535e fix(stream): re-send checkmsg to downstream for fixed dispatch type. 2024-04-19 10:00:47 +08:00
Haojun Liao 815d12fd77 fix(stream): set check downstream completed for sink task. 2024-04-18 18:36:02 +08:00
Haojun Liao 4802cd1ddf Merge branch '3.0' into fix/3_liaohj 2024-04-18 17:53:30 +08:00
Hongze Cheng 614f1f5a9d
Merge pull request #25379 from taosdata/feat/addCompress
Feat/add compress
2024-04-18 17:10:34 +08:00
kailixu e6584cea91 Merge branch '3.0' into enh/TS-4255-3.0 2024-04-18 16:05:26 +08:00
Haojun Liao e7dee4ac63 refactor(stream): refactor check msg retry procedure and be tolerant to the dnode disconnection during check downstream tasks. 2024-04-18 15:55:21 +08:00
wangmm0220 529ca1d1c1 opti:add local thread error msg array 2024-04-18 13:56:43 +08:00
Haojun Liao ac84a5f82b refactor: do some internal refactor. 2024-04-17 21:57:09 +08:00
Haojun Liao ddf98ae0c2 refactor: do some internal refactor. 2024-04-17 18:04:02 +08:00
Yihao Deng a461b24ac9 add compress 2024-04-17 09:37:23 +00:00
dm chen 1196ea72da
Merge branch '3.0' into feat/TD-24834 2024-04-17 17:13:29 +08:00
Yihao Deng 07008747ed add compress 2024-04-17 09:09:30 +00:00
Yihao Deng 2547f29de9 add compress 2024-04-17 08:59:38 +00:00
Yihao Deng f8dcf806d2 add compress 2024-04-17 08:58:10 +00:00
Yihao Deng 7cec8836b1 add compress 2024-04-17 08:39:43 +00:00
Yihao Deng 15f9e1e29e add compress 2024-04-17 08:38:46 +00:00
Yihao Deng 1363cd0a71 add compress 2024-04-17 08:33:40 +00:00
Hongze Cheng a34b644640
Merge pull request #25366 from taosdata/feat/compress_3.0
Feat/compress 3.0
2024-04-17 16:15:26 +08:00
Yihao Deng 0f629bebda add compress 2024-04-17 07:35:00 +00:00
Haojun Liao 9fdf13dccc
Merge pull request #25380 from taosdata/fix/3_liaohj
fix(stream): add return.
2024-04-17 15:04:00 +08:00
Yihao Deng 1d9b65226e add compress 2024-04-17 07:02:55 +00:00
kailixu 384e650882 enh: show encryptions 2024-04-17 14:41:47 +08:00
dapan1121 76eda6631c
Merge pull request #25382 from taosdata/fix/3.0/fix-release-ci
fix release build
2024-04-17 13:42:20 +08:00
wangjiaming0909 9bc8f3aea0 fix release build 2024-04-17 11:56:20 +08:00
Haojun Liao 24c000e052 Merge branch '3.0' into fix/3_liaohj 2024-04-17 11:27:54 +08:00
Yihao Deng 04e78d0ce7 Merge branch 'feat/3.0' into feat/compress_3.0 2024-04-17 03:23:02 +00:00
Yihao Deng 51fa1d40a4 fix other platform error 2024-04-17 03:02:54 +00:00
kailixu 74afb8deae chore: solve conflicts 2024-04-17 10:52:34 +08:00
Haojun Liao 13e14d0f55 fix(stream): add return. 2024-04-17 10:48:22 +08:00
yihaoDeng 40390ad918 add compress 2024-04-17 10:23:17 +08:00
yihaoDeng 2da8645d36 add compress 2024-04-17 10:22:54 +08:00
yihaoDeng 469e9ba069 add compress 2024-04-17 10:20:11 +08:00
dapan1121 5936d3a1b0
Merge pull request #25300 from taosdata/draft/tsma_before_ci
feat: support tsma
2024-04-17 10:00:17 +08:00
dapan1121 1b34752e38
Merge pull request #25377 from taosdata/fix/projectionLimit0
fix: projection limit 0 issue
2024-04-17 08:24:37 +08:00
Haojun Liao a439f61708
Merge pull request #25375 from taosdata/fix/3_liaohj
fix(stream): generate the checkpoint id
2024-04-16 19:41:07 +08:00
dapan1121 e7a43b4e58 fix: projection limit 0 issue 2024-04-16 18:47:03 +08:00
wangjiaming0909 fb72e29fe1 fix stream progress delay 2024-04-16 18:17:33 +08:00
Yihao Deng 6f9de676f0 Merge branch 'fix/compress_3.0' into feat/compress_3.0 2024-04-16 09:27:26 +00:00
Haojun Liao 8bdd43c305 fix(stream): wait for 50ms when no token in bucket for sink task. 2024-04-16 14:42:21 +08:00
wangjiaming0909 92e91c2032 fix ci 2024-04-16 14:27:06 +08:00
wangjiaming0909 1978a06e6e merge with 3.0 2024-04-16 14:27:06 +08:00
Haojun Liao 6d8687d239 fix(stream): add lock, and fix race condition. 2024-04-16 14:25:35 +08:00
wangjiaming0909 ce2cbd4ab5 fix stream fill history not finished 2024-04-16 14:25:34 +08:00
wangjiaming0909 039939196a forbid tsma agg funcs with tag columns 2024-04-16 14:25:34 +08:00
wangjiaming0909 1b37ef03fb fix duplicate tsma funcs 2024-04-16 14:25:34 +08:00
wangjiaming0909 97498e1844 fix create tsma txn and fix fetch wrong stream progress 2024-04-16 14:25:34 +08:00
wangjiaming0909 9cc33b1296 fix escaped tsma name 2024-04-16 14:25:34 +08:00
wangjiaming0909 de1c28d623 tsma avoid fetching tsma for no tsma tables 2024-04-16 14:25:34 +08:00
wangjiaming0909 f6200dd923 support long ctb names 2024-04-16 14:25:34 +08:00
wangjiaming0909 6ce0616ffd fix ci and TODOs 2024-04-16 14:25:34 +08:00
wangjiaming0909 e43580f71b fix ci 2024-04-16 14:25:20 +08:00
wangjiaming0909 2b594e02d2 fix tsma name too long 2024-04-16 14:25:20 +08:00
wangjiaming0909 43699959c8 fix ci 2024-04-16 14:25:01 +08:00
wangjiaming0909 7de0a34ae6 support maxTsmaCalcDelay, maxTsmaNum, skip_tsma 2024-04-16 14:25:01 +08:00
wangjiaming0909 a2cbbba24d find TODO 2024-04-16 14:23:26 +08:00
wangjiaming0909 d1101a0325 support filter out tsma res tbs when show stables/tables 2024-04-16 14:23:26 +08:00
wangjiaming0909 a8e00f7410 drop tb in transaction 2024-04-16 14:23:26 +08:00
wangjiaming0909 1ef153de63 support drop ctb for tsma 2024-04-16 14:23:25 +08:00
wangjiaming0909 1a06dd684e support drop ctb 2024-04-16 14:23:25 +08:00
wangjiaming0909 94f2f6ae22 fix drop ctb 2024-04-16 14:23:25 +08:00
wangjiaming0909 34dbdfd4dc support stddev and hyperloglog for tsma 2024-04-16 14:23:25 +08:00
wangjiaming0909 40a7262fcd support spread 2024-04-16 14:23:25 +08:00
wangjiaming0909 fa85d1caa7 support other tsma funcs 2024-04-16 14:23:25 +08:00
wangjiaming0909 cc9550f45e add tsma funcs 2024-04-16 14:20:59 +08:00
wangjiaming0909 98ca847eb8 add tests 2024-04-16 14:18:11 +08:00
wangjiaming0909 38ed0317e7 testing 2024-04-16 14:18:11 +08:00
wangjiaming0909 c9be37bdc6 fix norm_tb child tb tsma query 2024-04-16 14:18:11 +08:00
wangjiaming0909 79b726fdbc fix vgroupd num 1 2024-04-16 14:18:11 +08:00
wangjiaming0909 cf750bfdd4 fix split windows 2024-04-16 14:18:11 +08:00
wangjiaming0909 db00faeb02 fix split window 2024-04-16 14:18:11 +08:00
wangjiaming0909 f5f6306277 fix split window bug 2024-04-16 14:18:11 +08:00
wangjiaming0909 3c870acb16 add tests 2024-04-16 14:18:11 +08:00
wangjiaming0909 9625ce7cdf add tests 2024-04-16 14:18:11 +08:00
wangjiaming0909 ab60fbfdc3 add tsma test 2024-04-16 14:18:10 +08:00
wangjiaming0909 846de7780b add tests 2024-04-16 14:18:10 +08:00
wangjiaming0909 a1054234e2 fix query tsma child table 2024-04-16 14:18:10 +08:00
wangjiaming0909 dff0449474 start to support select child table using tsma 2024-04-16 14:18:10 +08:00
wangjiaming0909 c3e73d9168 fix recursive tsma 2024-04-16 14:18:10 +08:00