Commit Graph

2433 Commits

Author SHA1 Message Date
dm chen 1196ea72da
Merge branch '3.0' into feat/TD-24834 2024-04-17 17:13:29 +08:00
Yihao Deng 07008747ed add compress 2024-04-17 09:09:30 +00:00
Yihao Deng 2547f29de9 add compress 2024-04-17 08:59:38 +00:00
Yihao Deng f8dcf806d2 add compress 2024-04-17 08:58:10 +00:00
Yihao Deng 7cec8836b1 add compress 2024-04-17 08:39:43 +00:00
Yihao Deng 15f9e1e29e add compress 2024-04-17 08:38:46 +00:00
Yihao Deng 1363cd0a71 add compress 2024-04-17 08:33:40 +00:00
Yihao Deng 0f629bebda add compress 2024-04-17 07:35:00 +00:00
Yihao Deng 1d9b65226e add compress 2024-04-17 07:02:55 +00:00
kailixu 74afb8deae chore: solve conflicts 2024-04-17 10:52:34 +08:00
Haojun Liao 13e14d0f55 fix(stream): add return. 2024-04-17 10:48:22 +08:00
yihaoDeng 40390ad918 add compress 2024-04-17 10:23:17 +08:00
yihaoDeng 2da8645d36 add compress 2024-04-17 10:22:54 +08:00
yihaoDeng 469e9ba069 add compress 2024-04-17 10:20:11 +08:00
Haojun Liao 8bdd43c305 fix(stream): wait for 50ms when no token in bucket for sink task. 2024-04-16 14:42:21 +08:00
dm chen aedec5ead7
Merge branch '3.0' into feat/TD-24834 2024-04-16 11:35:49 +08:00
Haojun Liao 13bd296d58 Merge branch '3.0' into fix/3_liaohj 2024-04-15 18:53:48 +08:00
Haojun Liao 1ac192c069 fix(stream): keep the original tsdb scan version range. 2024-04-15 18:41:38 +08:00
dm chen 4d660d89c0
Merge branch '3.0' into feat/TD-24834 2024-04-15 15:12:32 +08:00
Haojun Liao 665107ad3a enh(stream): add more info in meta table. 2024-04-15 14:23:37 +08:00
Haojun Liao 15c18af221 fix(stream): fix init error. 2024-04-13 18:27:38 +08:00
54liuyao 1d42e927c6 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TS-4243-3.0 2024-04-11 15:35:42 +08:00
Haojun Liao 5fac6ea9c1
Merge pull request #25327 from taosdata/fix/TD-29516
set ts column index for function
2024-04-11 15:28:11 +08:00
kailixu 3738ce9e10 chore: solve conflicts of sql.c 2024-04-11 11:05:58 +08:00
54liuyao b2cefa8039 release state buff 2024-04-11 09:10:16 +08:00
Haojun Liao fabb986aa8 fix(stream): fix stack overflow, caused by print epset. 2024-04-10 19:54:33 +08:00
Haojun Liao e261023ee6 fix(stream): add lock, and fix race condition. 2024-04-10 18:42:44 +08:00
54liuyao c6d492d3fd set ts column index for function 2024-04-10 17:41:59 +08:00
Haojun Liao f23a8a37bc refactor: do some internal refactor. 2024-04-10 16:43:02 +08:00
54liuyao e161556f51 set ts column index for function 2024-04-10 15:35:25 +08:00
54liuyao 53265e9e09 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/ly-TS-4243-3.0 2024-04-08 17:24:09 +08:00
Haojun Liao fb58ca8592 fix(stream): not wait for the timer stopped. 2024-04-07 18:53:25 +08:00
kailixu b4c8375cb9 chore: solve conflicts 2024-04-07 14:53:05 +08:00
Haojun Liao f82505ba16 fix(stream): remove invalid assert 2024-04-07 14:06:25 +08:00
Haojun Liao 1b343e662c fix(stream): retry stop timer for trigger tmr. 2024-04-07 10:18:01 +08:00
Haojun Liao 94f703889d fix(stream): remove invalid assert. 2024-04-03 12:42:53 +08:00
54liuyao 537395e845 Merge branch 'feat/TS-4243-3.0' of https://github.com/taosdata/TDengine into feat/ly-TS-4243-3.0 2024-04-03 09:54:10 +08:00
Haojun Liao 3619518d54 fix(stream): add logs. 2024-04-02 21:57:21 +08:00
Haojun Liao dcc97472d3 fix(stream): add strict check for checkpoint-trigger msg dispatach rsp confirmation flag. 2024-04-02 21:53:50 +08:00
Haojun Liao 5184e444df Merge branch '3.0' into fix/3_liaohj 2024-04-02 18:45:49 +08:00
Haojun Liao 24559725da fix(stream): add lock for when set checkpoint dispatch msg. 2024-04-02 18:45:30 +08:00
Haojun Liao bcb4d62996
Merge pull request #25229 from taosdata/fix/3_liaohj
fix(stream): reset the ready upstream counter after task-reset.
2024-04-02 10:05:33 +08:00
54liuyao 204c5acefe Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/ly-TS-4243-3.0 2024-04-02 09:10:52 +08:00
Haojun Liao 9ca84091df fix(stream): reset the ready upstream counter after task-reset. 2024-04-01 16:31:10 +08:00
Haojun Liao c6294200ea
Merge pull request #25211 from taosdata/fix/TD-28032
fix:same subtable same partition by leads to same table name in stream
2024-04-01 15:49:47 +08:00
dmchen b9deb71fc5 basic function 2024-03-29 02:48:49 +00:00
wangmm0220 8e2a2414c0 fix:same subtable same partition by leads to same table name in stream 2024-03-28 13:48:46 +08:00
dapan1121 ca0f790f3e
Merge pull request #25179 from taosdata/mark/3.0
fix:decode task error if task version is smaller than 2
2024-03-28 13:19:45 +08:00
Haojun Liao 5157d5b97d fix(stream): fix invalid read. 2024-03-27 15:53:24 +08:00
wangmm0220 c2ef380166 Merge branch 'mark/3.0' of https://github.com/taosdata/TDengine into mark/3.0 2024-03-27 15:05:04 +08:00
wangmm0220 8e45bebd66 fix:decode task error if task version is smaller than 2 2024-03-26 15:16:09 +08:00
Haojun Liao a11b2c614e fix(stream): not return error when failing to load stream task meta. 2024-03-25 23:49:26 +08:00
wangmm0220 6aaac7c0dc fix:decode task error if task version is smaller than 2 2024-03-25 17:57:13 +08:00
54liuyao a02535c3ab Merge branch 'feat/TS-4243-3.0' of https://github.com/taosdata/TDengine into feat/ly-TS-4243-3.0 2024-03-25 11:15:21 +08:00
54liuyao a60f390cdc stream primary key 2024-03-21 10:50:07 +08:00
Haojun Liao 65e4048f5d Merge branch '3.0' into fix/3_liaohj 2024-03-19 15:36:07 +08:00
Haojun Liao 7bdabc309b Merge branch '3.0' into fix/3_liaohj 2024-03-18 14:16:15 +08:00
Haojun Liao 6763ac9110 fix(stream):adjust current offset by using the scanning version, not the processed version in WAL. 2024-03-18 09:12:53 +08:00
Haojun Liao f28e994409
Merge pull request #25091 from taosdata/fix/3_liaohj
fix(stream): transfer state before do checkpoint
2024-03-14 17:59:13 +08:00
Haojun Liao cc0b32b1f8 fix(stream): transfer state before do checkpoint, to avoid the retrieve and deadlock by using waiting . 2024-03-14 16:13:41 +08:00
Haojun Liao 15663ab450
Merge pull request #25084 from taosdata/fix/3_liaohj
fix(tsdb): set strict varchar length check.
2024-03-14 11:16:03 +08:00
Haojun Liao 190b02dd1a fix(stream):set correct version for sink/agg tasks. 2024-03-14 10:04:43 +08:00
54liuyao ef32863f07 stream event window mem leak 2024-03-13 19:44:59 +08:00
54liuyao c13338d965 stream event window mem leak 2024-03-13 16:16:44 +08:00
Haojun Liao aef11bf3a8 fix(stream): add one more status for check. 2024-03-08 00:25:08 +08:00
yihaoDeng 3416d68433 add coverity scan 2024-03-05 21:02:20 +08:00
Haojun Liao 3aa2e24d78
Merge pull request #25006 from taosdata/fix/nullcheck
fix(stream): set the dest epset from mnode, and set the retry error
2024-03-05 19:46:41 +08:00
Haojun Liao 45e779d464 refactor: do some internal refactor. 2024-03-05 15:48:58 +08:00
Haojun Liao cdfbbc2985 fix(stream): set the dest epset from mnode, and set the retry error code for trans. 2024-03-05 13:28:34 +08:00
Haojun Liao 4d10f28a00
Merge pull request #24999 from taosdata/fix/nullcheck
fix(stream): remove related fill-history if task in stop status.
2024-03-05 09:15:21 +08:00
Haojun Liao a38161299b fix(stream): add clear msgData buf impl. 2024-03-04 19:51:01 +08:00
Haojun Liao ad1780dbdc fix(stream): reset the pData after transferring state. 2024-03-04 19:32:22 +08:00
Haojun Liao 80fd3e0445 fix(stream): remove related fill-history if task in stop status. 2024-03-04 19:31:47 +08:00
54liuyao 9859e86d5a Merge branch '3.0' of https://github.com/taosdata/TDengine into 3.0 2024-03-04 09:10:41 +08:00
Haojun Liao daa6eab287 Merge branch '3.0' into fix/nullcheck 2024-03-03 16:49:43 +08:00
Haojun Liao 550d0fe5ae fix(stream): add an assert. 2024-03-03 16:46:13 +08:00
54liuyao 3febcb96a0 reset flush state 2024-03-01 10:57:57 +08:00
Haojun Liao 8791a163f8 other: merge 3.0 2024-02-29 22:31:52 +08:00
Haojun Liao db92bf84d8 other: merge 3.0 2024-02-29 22:21:50 +08:00
54liuyao 4c47332098 opt bloom filter 2024-02-29 11:17:29 +08:00
54liuyao 6619175fde opt bloom filter 2024-02-29 11:17:29 +08:00
Hongze Cheng d9095d80de
Merge pull request #24916 from taosdata/addBackendTest
Add backend test
2024-02-28 19:16:14 +08:00
yihaoDeng b3c18c31da add test case to stream backend 2024-02-27 12:19:37 +00:00
Haojun Liao aee0460daf enh(stream):rsp the checkpoint ready msg. 2024-02-27 11:15:09 +08:00
Haojun Liao dafac591f7 enh(stream): add rsp for req-checkpoint 2024-02-27 10:53:25 +08:00
Haojun Liao 2800454c35 Merge branch '3.0' into fix/nullcheck 2024-02-24 01:46:15 +08:00
Haojun Liao df2488431e fix(stream): add logs. 2024-02-24 00:40:26 +08:00
Haojun Liao 98ff21c879
Merge pull request #24840 from taosdata/fix/nullcheck
fix(stream): fix the compatible issue when the fill-history exists.
2024-02-24 00:40:09 +08:00
yihaoDeng c54e4aeaad add test case 2024-02-23 09:30:53 +00:00
Haojun Liao d8ffa65b62 fix(stream): fix the compatible issue when the fill-history exists. 2024-02-23 09:12:27 +08:00
54liuyao c7a50acd63 rebuild sliding window 2024-02-23 09:05:30 +08:00
Haojun Liao af1f61cd39 fix(stream): fix the compatible issue when the fill-history exists. 2024-02-22 19:05:30 +08:00
54liuyao 8c6ea4079c delete invalid result 2024-02-22 14:15:35 +08:00
Haojun Liao b27b635c10 fix(stream): allow hb message rsp. 2024-02-21 13:55:06 +08:00
Haojun Liao d6f5ae226b refactor: do some internal refactor. 2024-02-21 09:42:23 +08:00
Haojun Liao 8d848a5bf0 fix(stream): add null ptr check. 2024-02-21 09:40:22 +08:00
Haojun Liao 13c3654bf5 other: merge 3.0 2024-02-20 10:51:04 +08:00
54liuyao 0e8170de49 remove invalid code 2024-02-20 10:17:47 +08:00
Haojun Liao 46b1fe520f
Merge pull request #24538 from taosdata/feat/TD-22023
stream count window
2024-02-20 08:50:25 +08:00
54liuyao af1893d109 merge 3.0 2024-02-19 18:30:12 +08:00
Haojun Liao 931b9f0b51 other: merge 3.0 2024-02-19 18:27:18 +08:00
dapan1121 1bf885d810
Merge pull request #24771 from taosdata/fix/TD-28567
fix:[TD-28567] do not add md5 to the end of subtable if create stream…
2024-02-19 17:23:09 +08:00
Haojun Liao bf242a4f64 fix(stream): handle pause event in waiting list. 2024-02-19 15:57:21 +08:00
wangmm0220 ac9582b24a fix:[TD-28567] do not add md5 to the end of subtable if create stream by sma 2024-02-19 13:58:58 +08:00
Haojun Liao c5b26b406f fix(stream): fix syntax error. 2024-02-19 13:38:56 +08:00
Haojun Liao 730edf24f9 fix(stream): fix syntax error. 2024-02-19 13:38:14 +08:00
Haojun Liao d3e8adf2eb enh(stream): async handle pause event 2024-02-19 13:36:57 +08:00
54liuyao 94542dfcd3 free close window sbf 2024-02-19 13:30:26 +08:00
Haojun Liao 7e866c5527 refactor: do some internal refactor. 2024-02-19 11:32:04 +08:00
54liuyao b53dc5602e Merge branch '3.0' of https://github.com/taosdata/TDengine into 3.0 2024-02-19 10:58:20 +08:00
Haojun Liao e62dd2ff5c refactor: do some internal refactor. 2024-02-19 10:31:25 +08:00
54liuyao 637ac543c8 free close window sbf 2024-02-19 10:29:59 +08:00
Haojun Liao cf571e4f1f refactor: do some internal refactor. 2024-02-19 09:52:22 +08:00
Haojun Liao d5b316839d refactor: do some internal refactor. 2024-02-19 09:14:21 +08:00
wangmm0220 a8e45440c0 fix:conflicts from 3.0 2024-02-18 18:02:14 +08:00
Haojun Liao 245f0ef806 fix(stream): fix deadlock. 2024-02-18 17:05:00 +08:00
Haojun Liao dbea34ce0e fix(stream): set the callback function for handle event. 2024-02-18 14:34:42 +08:00
Haojun Liao 472020a2b9 enh(stream): handle event async function. 2024-02-18 14:07:15 +08:00
54liuyao eaf10fcb43 count window fill history 2024-02-05 18:37:24 +08:00
Haojun Liao 2bba011e4e Merge remote-tracking branch 'origin/feat/TD-22023' into feat/TD-22023 2024-02-05 17:51:23 +08:00
Haojun Liao 7a18e5910c enh(stream): halt the initial stream tasks when fill-history is set for count window agg 2024-02-05 17:51:09 +08:00
54liuyao 08cb46ac3e stream count window check point 2024-02-05 15:10:03 +08:00
54liuyao b16fc7d9df Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-22023 2024-02-05 10:15:59 +08:00
54liuyao ea9353b9fd merge 3.0 2024-02-04 16:04:23 +08:00
Haojun Liao 3236ef7bae feat(stream): return the stream source task exec delay, and do some internal refactor. 2024-02-02 11:26:47 +08:00
Haojun Liao 87e543c824 fix(stream): pass down the transId of checkpoint, to make sure the downstream task can report the error transId successfully. 2024-02-01 17:14:36 +08:00
Haojun Liao cb2ea4a721 fix(stream): take ver snapshot for all vgroups before launching stream with fill-history option opened. 2024-02-01 11:37:57 +08:00
wangmm0220 a9fcc67321 fix:conflicts from 3.0 2024-02-01 11:13:03 +08:00
Haojun Liao 556baed25d other: merge 3.0 2024-01-30 18:35:59 +08:00
Haojun Liao 1d110953c9 refactor: do some internal refactor. 2024-01-30 15:23:54 +08:00
Haojun Liao 4970040459 refactor: do some internal refactor. 2024-01-30 15:22:49 +08:00
Haojun Liao 45891babd3
Merge pull request #24655 from taosdata/fix/3_liaohj
refactor: do some internal refactor.
2024-01-30 09:15:10 +08:00
Haojun Liao 3730e43f0e refactor: disable some logs. 2024-01-29 17:24:58 +08:00
54liuyao d7fb8db086 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-22023 2024-01-29 16:13:39 +08:00
Haojun Liao bfbd61a02f
Merge pull request #24634 from taosdata/fix/3_liaohj
refactor: do some internal refactor.
2024-01-26 18:08:54 +08:00
Haojun Liao ac08f659c3 refactor: remove invalid procedure in fill-history. 2024-01-26 16:20:43 +08:00
54liuyao bc4f3d1296 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-22023 2024-01-26 15:55:06 +08:00
Haojun Liao db117a3ac7
Merge pull request #24628 from taosdata/fix/3_liaohj
refactor: do some internal refactor.
2024-01-26 09:09:44 +08:00
Haojun Liao 3751e11394 fix(stream): fix dead lock. 2024-01-25 17:11:16 +08:00
Haojun Liao d4bab8c09b refactor: do some internal refactor. 2024-01-25 16:53:30 +08:00
Haojun Liao 834f08a2e0
Merge pull request #24552 from taosdata/fix/3_liaohj
fix(stream): do checkpoint after fill-history task completed.
2024-01-25 16:53:11 +08:00
Haojun Liao 49bc3924fb fix(stream): update the check order. 2024-01-25 15:17:14 +08:00
Haojun Liao 2ecc202cb3 fix(stream): remove invalid assert. 2024-01-24 17:10:45 +08:00
Haojun Liao dc1ea9f9a1 fix(stream): clear htask info when unregistering the task. 2024-01-24 16:23:47 +08:00
Haojun Liao 1a45d40607 fix(stream): fix deadlock. 2024-01-24 14:37:46 +08:00
Haojun Liao b8856931d8 fix(stream): fix syntax error. 2024-01-24 13:11:36 +08:00
Haojun Liao 8a7e38ad15 fix(stream): fix checkpoint failure check. 2024-01-24 13:10:53 +08:00
yihaoDeng b1ac1deedb change db opt 2024-01-19 17:39:02 +08:00
Haojun Liao d973f66cea fix(stream): do checkpoint after fill-history task completed. 2024-01-19 16:18:02 +08:00
54liuyao bbabf91566 Merge branch '3.0' of https://github.com/taosdata/TDengine into 3.0 2024-01-19 14:50:16 +08:00