Commit Graph

71 Commits

Author SHA1 Message Date
liuyao 2de6736160
feat(stream): add new trigger continuous_window_close (#30125)
* opt stream build twa result

* opt force window close memory

* feat(stream):optimize new interval and scan operator

* adj log

* opt code

* opt code

* fill history

* fix issue for fill history

* add ci

* feat(stream): add new stream nonblock interval operator

* adjust code

* use new scan operator

* use new scan operator

* add log

* fix issue

* recover stream scan next function

* fix issue

* fix issue

* fix issue

* ignore disorder data

* fix issue

* fix issue for interval sliding

* fix issue

* fix ci issue

* fix ci issue

* fix ci issue

* add semi && final nonblock interval operator

* fix issue

* fix issue

* fix issue

* fix issue

* fix issue

* fix issue

* fix issue

* fix issue

* refactor(stream): track the msgId for each upstream tasks.

* fix(stream): fix race condition.

* fix(stream): update the task last msgId when putting into input queue succ.

* fix issue

* fix issue

* put recalculate data to rocksdb

* fix issue

* fix issue

* enh(query)[TD-33071]: add support for saving and restoring tsdbReader scan progress

- Implement functionality to save scan progress during tsdbReader operations
- Enable resuming scans from the last saved position

* fix issue

* fix issue

* fix issue

* fix issue

* fix issue

* add rec interval check

* enh(stream):add recalculate tasks.

* enh(stream): support the re-calculate the tasks.

* fix issue && do refactor

* do refactor

* fix issue

* fix issue

* update backend opt

* add new interface

* add new session operator

* support blob

* add new session operator

* fix issue

* add rec state for rec task

* fix invalid read

* add new session window

* enh(stream): update the stream tasks backend.

* new session operator

* add pull data

* fix(stream): fix error in expand stream backend.

* fix issue

* fix issue

* fix issue

* merge code

* fix issue

* fix(stream): check for null ptr.

* fix(stream): add more check.

* fix issue

* fix issue

* fix issue

* add debug code

* fix issue

* fix issue

* fix issue

* set rec end flag

* fix(stream): opt re-calculate stream tasks.

* fix issue

* fix issue

* add new operator

* enh(stream): dispatch recalculate block to agg tasks.

* fix issue

* fix issue

* fix(stream): adjust filter.

* fix issue

* refactor

* refactor(stream): adjust the recalculate end block.

* fix issue

* fix(stream): set correct create trigger block.

* fix issue

* fix(stream): fix error in build recalculate end block.

* fix(stream): check null ptr.

* add stream client && fix issue

* fix mem leak

* fix(stream): free msg.

* add stream client

* fix(stream): fix error.

* add stream client && fix issue

* add stream client

* refactor(stream): set the recalculate task complete.

* add wend and group_id for session window dest table

* feat(stream): refactor and set the recalcul agg task complete.

* add cfg for adapter

* fix issue

* add state && event operator

* feat(stream): support fill-history task.

* add new fill operator

* fix(stream): set correct backend when updating fill-history task to recalculate task.

* add new fill operator

* fix(stream): s2025-03-06 11:10:31.272
et ops always open in scan tsdb

* fix(stream):set the correct taskType for sink task.

* new fill operator

* adj stream fill operator

* fix issue

* fix issue

* fix issue

* fix issue

* fix issue

* fix issue

* fix issue

* fix issue

* adj test

* fix issue

* fix(stream): fix issue

* fix(steam): fix issue

* fix(steam): fix issue

* fix(steam): fix issue

* fix(steam): fix issue

* fix(stream): fix issue

* fix(stream): fix issue

* fix(stream): fix issue

* fix: ut com error

* fix(stream): fix mem leak and adjust operator type check rule

* fix(stream): fix mem leak and adjust test case

* refactor code

* fix(stream): free items.

* fix(stream): free fix memory leak.

* fix(stream): fix syntax error.

* fix: ignore unexpect block

* fix: adjust op type

---------

Co-authored-by: Haojun Liao <hjliao@taosdata.com>
Co-authored-by: Jinqing Kuang <kuangjinqingcn@gmail.com>
Co-authored-by: yihaoDeng <luomoxyz@126.com>
2025-03-14 20:14:01 +08:00
54liuyao ff7a2ebe6b ci(test):delete invalid code&& add ci 2024-12-26 13:35:50 +08:00
54liuyao f6500b3551 ci(test):delete invalid code&& add ci 2024-12-26 11:16:02 +08:00
54liuyao 7e21747c4f ci(test):add slice state ut 2024-12-24 14:17:37 +08:00
54liuyao 0452c21ff6 ci(stream):add stream unit test 2024-12-23 19:10:10 +08:00
54liuyao 4adf24b466 ci(stream):add stream unit test 2024-12-23 18:25:25 +08:00
54liuyao 89dc02012b try fix window com error 2024-12-20 14:23:04 +08:00
54liuyao 5212710947 try fix window com error 2024-12-20 13:33:32 +08:00
54liuyao 9866b9437d try fix window com error 2024-12-20 11:27:29 +08:00
54liuyao 5b1368db2f adj ci 2024-12-20 08:46:57 +08:00
54liuyao b89532c83c add ut 2024-12-19 19:24:41 +08:00
54liuyao 5b10753ac0 add ut 2024-12-19 18:23:57 +08:00
Shengliang Guan 81c30ab7c0 fix: format cmake file 2024-10-24 10:10:07 +08:00
Minglei Jin fe8b6c823e
Merge branch '3.0' into feat/TS-5215-2 2024-10-22 10:12:34 +08:00
Minglei Jin d81fa80865 az: remove unused key newing 2024-10-16 17:27:32 +08:00
yihaoDeng 193220aa88 add interface 2024-10-14 11:00:20 +08:00
Minglei Jin 49a6bf4c23 void sync query return val 2024-09-25 18:25:40 +08:00
Haojun Liao d698e4107c fix(stream): fix syntax error. 2024-09-19 10:21:34 +08:00
Haojun Liao 839590348f fix(test): fix syntax error in the unit tests. 2024-09-19 09:43:35 +08:00
Haojun Liao 47a2a8528c fix(stream): fix syntax error in unit test. 2024-09-19 09:04:29 +08:00
yihaoDeng f58fabb15b Merge remote-tracking branch 'origin/3.0' into fix/refactorTqBackend 2024-07-29 08:50:09 +08:00
Haojun Liao 848b4aab4f fix(util): fix error 2024-07-28 15:46:19 +08:00
Yihao Deng 1bfb8692eb refactor tq backend 2024-07-23 11:36:11 +00:00
Yihao Deng 533e3f0da6 refactor tq backend 2024-07-23 07:40:00 +00:00
Haojun Liao 0b6a49ac7d fix(stream): fix error and do some internal refactor. 2024-07-17 19:17:53 +08:00
Yihao Deng 7cab27110a add self check info 2024-06-24 12:26:10 +00:00
Haojun Liao 2534ce5071 fix(stream): fix a typo. 2024-06-19 10:29:01 +08:00
Haojun Liao bca3cf4e9e fix(stream): fix error in unit test. 2024-06-17 23:51:25 +08:00
Haojun Liao b44d87475d fix(test): fix syntax error. 2024-06-14 17:54:44 +08:00
Haojun Liao 629502e12e refactor: do some internal refactor. 2024-04-30 17:00:51 +08:00
yihaoDeng 3416d68433 add coverity scan 2024-03-05 21:02:20 +08:00
yihaoDeng 17e9f1d747 add test case 2024-02-28 09:33:48 +00:00
yihaoDeng 8c46c71c98 add test case 2024-02-28 09:02:55 +00:00
yihaoDeng 249141a9a2 add compress dict 2024-02-28 08:16:02 +00:00
yihaoDeng d5c5dc7026 add test case 2024-02-28 06:45:35 +00:00
yihaoDeng d7f14e916d add test case 2024-02-28 06:01:50 +00:00
yihaoDeng 9f983a07d7 add test case 2024-02-28 10:48:24 +08:00
yihaoDeng e1f11d1639 add test case to stream backend 2024-02-28 00:48:20 +00:00
yihaoDeng b3c18c31da add test case to stream backend 2024-02-27 12:19:37 +00:00
yihaoDeng 6b6f5aa5d1 add test case 2024-02-27 05:51:32 +00:00
yihaoDeng 8d36445bb5 add stream backend test 2024-02-27 05:29:58 +00:00
yihaoDeng e41e10bf35 add stream backend test 2024-02-26 11:51:46 +00:00
yihaoDeng c54e4aeaad add test case 2024-02-23 09:30:53 +00:00
Alex Duan 524ebca16a coverage: add schUtil.c and schedulerTest 2024-02-18 11:35:08 +08:00
Alex Duan 22595e6432 coverage: delete checkpointTest since ci failed 2024-02-17 11:33:11 +08:00
Alex Duan 818e9254ad fix: need cleanup 2024-02-15 22:48:51 +08:00
Alex Duan 2287317da2 coverage: add checkpointTest uint test 2024-02-15 22:38:27 +08:00
Haojun Liao 9ee9174608 other: merge 3.0 2023-11-11 15:48:31 +08:00
Haojun Liao 8e5db21c3f fix(test): fix syntax error. 2023-11-11 15:40:13 +08:00
wangmm0220 c4c1423243 fix:error 2023-11-08 15:01:04 +08:00