Commit Graph

36 Commits

Author SHA1 Message Date
liuyao 2de6736160
feat(stream): add new trigger continuous_window_close (#30125)
* opt stream build twa result

* opt force window close memory

* feat(stream):optimize new interval and scan operator

* adj log

* opt code

* opt code

* fill history

* fix issue for fill history

* add ci

* feat(stream): add new stream nonblock interval operator

* adjust code

* use new scan operator

* use new scan operator

* add log

* fix issue

* recover stream scan next function

* fix issue

* fix issue

* fix issue

* ignore disorder data

* fix issue

* fix issue for interval sliding

* fix issue

* fix ci issue

* fix ci issue

* fix ci issue

* add semi && final nonblock interval operator

* fix issue

* fix issue

* fix issue

* fix issue

* fix issue

* fix issue

* fix issue

* fix issue

* refactor(stream): track the msgId for each upstream tasks.

* fix(stream): fix race condition.

* fix(stream): update the task last msgId when putting into input queue succ.

* fix issue

* fix issue

* put recalculate data to rocksdb

* fix issue

* fix issue

* enh(query)[TD-33071]: add support for saving and restoring tsdbReader scan progress

- Implement functionality to save scan progress during tsdbReader operations
- Enable resuming scans from the last saved position

* fix issue

* fix issue

* fix issue

* fix issue

* fix issue

* add rec interval check

* enh(stream):add recalculate tasks.

* enh(stream): support the re-calculate the tasks.

* fix issue && do refactor

* do refactor

* fix issue

* fix issue

* update backend opt

* add new interface

* add new session operator

* support blob

* add new session operator

* fix issue

* add rec state for rec task

* fix invalid read

* add new session window

* enh(stream): update the stream tasks backend.

* new session operator

* add pull data

* fix(stream): fix error in expand stream backend.

* fix issue

* fix issue

* fix issue

* merge code

* fix issue

* fix(stream): check for null ptr.

* fix(stream): add more check.

* fix issue

* fix issue

* fix issue

* add debug code

* fix issue

* fix issue

* fix issue

* set rec end flag

* fix(stream): opt re-calculate stream tasks.

* fix issue

* fix issue

* add new operator

* enh(stream): dispatch recalculate block to agg tasks.

* fix issue

* fix issue

* fix(stream): adjust filter.

* fix issue

* refactor

* refactor(stream): adjust the recalculate end block.

* fix issue

* fix(stream): set correct create trigger block.

* fix issue

* fix(stream): fix error in build recalculate end block.

* fix(stream): check null ptr.

* add stream client && fix issue

* fix mem leak

* fix(stream): free msg.

* add stream client

* fix(stream): fix error.

* add stream client && fix issue

* add stream client

* refactor(stream): set the recalculate task complete.

* add wend and group_id for session window dest table

* feat(stream): refactor and set the recalcul agg task complete.

* add cfg for adapter

* fix issue

* add state && event operator

* feat(stream): support fill-history task.

* add new fill operator

* fix(stream): set correct backend when updating fill-history task to recalculate task.

* add new fill operator

* fix(stream): s2025-03-06 11:10:31.272
et ops always open in scan tsdb

* fix(stream):set the correct taskType for sink task.

* new fill operator

* adj stream fill operator

* fix issue

* fix issue

* fix issue

* fix issue

* fix issue

* fix issue

* fix issue

* fix issue

* adj test

* fix issue

* fix(stream): fix issue

* fix(steam): fix issue

* fix(steam): fix issue

* fix(steam): fix issue

* fix(steam): fix issue

* fix(stream): fix issue

* fix(stream): fix issue

* fix(stream): fix issue

* fix: ut com error

* fix(stream): fix mem leak and adjust operator type check rule

* fix(stream): fix mem leak and adjust test case

* refactor code

* fix(stream): free items.

* fix(stream): free fix memory leak.

* fix(stream): fix syntax error.

* fix: ignore unexpect block

* fix: adjust op type

---------

Co-authored-by: Haojun Liao <hjliao@taosdata.com>
Co-authored-by: Jinqing Kuang <kuangjinqingcn@gmail.com>
Co-authored-by: yihaoDeng <luomoxyz@126.com>
2025-03-14 20:14:01 +08:00
54liuyao 22023575ba opt stream force fill op 2024-11-26 19:46:36 +08:00
54liuyao 5b9f434532 fix issue for value 2024-10-31 17:47:54 +08:00
54liuyao cea454b002 Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/TD-30837 2024-10-24 19:24:55 +08:00
wangjiaming0909 d1d6689684 add not fill exprs for fill operator 2024-10-23 15:16:16 +08:00
54liuyao 4fe68034cf fix issue 2024-08-16 17:46:14 +08:00
54liuyao ebb5c41d7f Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/TD-30837 2024-08-15 13:20:54 +08:00
54liuyao 6ab21a0d17 fix issue 2024-08-15 13:20:42 +08:00
54liuyao 057f09ffbf fix issue && add ci 2024-08-14 19:20:21 +08:00
54liuyao 235a082406 fix issue 2024-08-14 18:17:22 +08:00
54liuyao 216c53f0ae fix issue 2024-08-14 15:22:42 +08:00
54liuyao b1a4ea9472 adj operator result 2024-07-24 19:10:39 +08:00
54liuyao 1d35ea137a adj query operator result 2024-07-23 10:50:16 +08:00
54liuyao d02617aaf6 adj operator result 2024-07-22 14:42:50 +08:00
Haojun Liao 706e350217 fix(query): fix error in fill and partition. 2023-06-01 14:36:42 +08:00
liuyao d429e070da fix fill bug 2023-04-24 18:23:35 +08:00
Ganlin Zhao ea6c96df32 fix memory leak 2023-04-11 11:13:23 +08:00
54liuyao a614ef777f fix: modify pull linear 2023-03-21 18:19:45 +08:00
Haojun Liao 2c8b962b5a refactor: do some internal refactor. 2022-11-30 21:04:58 +08:00
54liuyao 2020ea0a76 fix:stream fill crash 2022-11-22 16:28:55 +08:00
Ganlin Zhao c8f069c647 change interp linear behavior 2022-11-18 09:43:40 +08:00
Ganlin Zhao 6aca4b8a5c enh: interp fill linear ignore null values during calculation 2022-11-08 14:51:32 +08:00
54liuyao 747297bd28 feat(stream): stream fill 2022-09-27 18:11:44 +08:00
Haojun Liao dc991a9040 other:merge 3.0 2022-08-12 14:51:52 +08:00
Haojun Liao 166cdcec7c fix(query): fix bug in fill. 2022-08-12 14:04:43 +08:00
Ganlin Zhao 6fc38165fb fix(query): fix linear interpolation issue between two blocks
TD-18309
2022-08-10 16:29:55 +08:00
Ganlin Zhao 26648a909f fix(query): interp + fill(linear) not working
TD-18220
2022-08-08 20:09:20 +08:00
Ganlin Zhao 1ee558fb63 fix(query): interp + fill(linear) not working
TD-18220
2022-08-08 15:20:12 +08:00
Haojun Liao a74c830125 fix(query): support scalar function in fill operator. 2022-08-06 19:34:15 +08:00
Haojun Liao bf08d7dd0b fix(query): fix bug in fill 2022-08-06 15:23:03 +08:00
Haojun Liao 0ff775c46f fix(query): keep order info in fill operator. 2022-07-29 14:33:50 +08:00
Haojun Liao 915e4e40c7 fix(query): add attribute to control output order. 2022-07-29 11:00:36 +08:00
Haojun Liao 4d73720fb8 fix(query): set the ts to be the time window start key value when filling timestamp column. 2022-07-12 13:45:41 +08:00
Haojun Liao c56be8f871 enh(query): add interp function. 2022-06-14 14:45:17 +08:00
Haojun Liao ffbf455fee enh(query): time window interpolation for interval query. 2022-05-02 23:52:32 +08:00
Haojun Liao 343988beeb refactor: do some internal refactor. 2022-04-20 14:59:06 +08:00