dfe32225de
chore: merge main.
2025-03-17 14:51:11 +08:00
ab92886820
fix(stream): reduce the consensus checkpoint id trans. ( #30105 )
...
* fix(stream): reduce the consensus checkpoint id trans.
* refactor(stream): add some logs.
* refactor(stream): set the max checkpoint exec time 30min.
* refactor(stream): add checkpoint-consensus trans conflict check.
* refactor(stream): remove unused local variables.
* fix(stream): fix syntax error.
* fix(stream): 1. fix free memory error 2. continue if put result into dst hashmap failed.
* fix issue
* fix issue
* fix(mnd): follower mnode not processes the timer event.
* fix(stream): print correct error msg.
* fix(stream): add some logs.
* fix(stream): add some logs.
* fix(stream): add some logs.
* fix(stream): add some logs.
* fix(stream): add some logs.
* fix(stream): add some logs.
* fix(stream): add some logs.
* fix(stream): add some logs.
* fix(stream): truncate long subtable name
* fix(stream): add buffer len.
* refactor(stream): update some logs.
* fix issue
* refactor(stream): update some logs.
* refactor(stream): update some logs.
* fix(stream): check return value.
* fix(stream): fix syntax error.
* fix(stream): check return value.
* fix(stream): update the timer check in mnode.
* fix(stream): add restart stage tracking.
* fix(stream): track the start task stage for meta.
* fix(stream): fix error in log.
* refactor(stream): adjust log info.
* fix mem issue
* fix(stream): check the number of required tasks for consensus checkpointId.
* fix(stream): lock the whole start procedure.
* fix(stream): add lock during start all tasks.
* fix(stream): update logs.
* fix(stream): update logs.
* fix(stream): update logs.
* fix(stream): fix dead-lock.
* fix(stream): fix syntax error.
* fix(stream): not drop the scan-history task.
* fix(stream): fix syntax error.
* fix(stream): wait for executor stop before restarting.
* fix(stream): add some logs.
* fix(stream): add some logs.
* fix(stream): add some logs.
* fix(stream): disable some logs.
* fix(stream): reset the start info if no task left.
---------
Co-authored-by: 54liuyao <54liuyao@163.com>
Co-authored-by: Jinqing Kuang <kuangjinqingcn@gmail.com>
2025-03-17 10:20:17 +08:00
2de6736160
feat(stream): add new trigger continuous_window_close ( #30125 )
...
* opt stream build twa result
* opt force window close memory
* feat(stream):optimize new interval and scan operator
* adj log
* opt code
* opt code
* fill history
* fix issue for fill history
* add ci
* feat(stream): add new stream nonblock interval operator
* adjust code
* use new scan operator
* use new scan operator
* add log
* fix issue
* recover stream scan next function
* fix issue
* fix issue
* fix issue
* ignore disorder data
* fix issue
* fix issue for interval sliding
* fix issue
* fix ci issue
* fix ci issue
* fix ci issue
* add semi && final nonblock interval operator
* fix issue
* fix issue
* fix issue
* fix issue
* fix issue
* fix issue
* fix issue
* fix issue
* refactor(stream): track the msgId for each upstream tasks.
* fix(stream): fix race condition.
* fix(stream): update the task last msgId when putting into input queue succ.
* fix issue
* fix issue
* put recalculate data to rocksdb
* fix issue
* fix issue
* enh(query)[TD-33071]: add support for saving and restoring tsdbReader scan progress
- Implement functionality to save scan progress during tsdbReader operations
- Enable resuming scans from the last saved position
* fix issue
* fix issue
* fix issue
* fix issue
* fix issue
* add rec interval check
* enh(stream):add recalculate tasks.
* enh(stream): support the re-calculate the tasks.
* fix issue && do refactor
* do refactor
* fix issue
* fix issue
* update backend opt
* add new interface
* add new session operator
* support blob
* add new session operator
* fix issue
* add rec state for rec task
* fix invalid read
* add new session window
* enh(stream): update the stream tasks backend.
* new session operator
* add pull data
* fix(stream): fix error in expand stream backend.
* fix issue
* fix issue
* fix issue
* merge code
* fix issue
* fix(stream): check for null ptr.
* fix(stream): add more check.
* fix issue
* fix issue
* fix issue
* add debug code
* fix issue
* fix issue
* fix issue
* set rec end flag
* fix(stream): opt re-calculate stream tasks.
* fix issue
* fix issue
* add new operator
* enh(stream): dispatch recalculate block to agg tasks.
* fix issue
* fix issue
* fix(stream): adjust filter.
* fix issue
* refactor
* refactor(stream): adjust the recalculate end block.
* fix issue
* fix(stream): set correct create trigger block.
* fix issue
* fix(stream): fix error in build recalculate end block.
* fix(stream): check null ptr.
* add stream client && fix issue
* fix mem leak
* fix(stream): free msg.
* add stream client
* fix(stream): fix error.
* add stream client && fix issue
* add stream client
* refactor(stream): set the recalculate task complete.
* add wend and group_id for session window dest table
* feat(stream): refactor and set the recalcul agg task complete.
* add cfg for adapter
* fix issue
* add state && event operator
* feat(stream): support fill-history task.
* add new fill operator
* fix(stream): set correct backend when updating fill-history task to recalculate task.
* add new fill operator
* fix(stream): s2025-03-06 11:10:31.272
et ops always open in scan tsdb
* fix(stream):set the correct taskType for sink task.
* new fill operator
* adj stream fill operator
* fix issue
* fix issue
* fix issue
* fix issue
* fix issue
* fix issue
* fix issue
* fix issue
* adj test
* fix issue
* fix(stream): fix issue
* fix(steam): fix issue
* fix(steam): fix issue
* fix(steam): fix issue
* fix(steam): fix issue
* fix(stream): fix issue
* fix(stream): fix issue
* fix(stream): fix issue
* fix: ut com error
* fix(stream): fix mem leak and adjust operator type check rule
* fix(stream): fix mem leak and adjust test case
* refactor code
* fix(stream): free items.
* fix(stream): free fix memory leak.
* fix(stream): fix syntax error.
* fix: ignore unexpect block
* fix: adjust op type
---------
Co-authored-by: Haojun Liao <hjliao@taosdata.com>
Co-authored-by: Jinqing Kuang <kuangjinqingcn@gmail.com>
Co-authored-by: yihaoDeng <luomoxyz@126.com>
2025-03-14 20:14:01 +08:00
fc2d2672b9
feat(stream)[TS-5469]: add more stream event notifications
...
- Add event notifications for all window types
- Implement window invalidation notifications
- Add statistics for event notification delivery
2025-02-16 11:07:16 +08:00
eb5d463490
feat(stream)[TS-5469]. add support for window event notifications in stream processing
...
- Introduce new syntax to specify notification type and destination address
- Collect relevant event information during window computations
- Implement websocket-based notification delivery to the specified address
2025-01-21 17:39:46 +08:00
f3b38edb98
add stream event notify
2025-01-21 11:18:49 +08:00
22023575ba
opt stream force fill op
2024-11-26 19:46:36 +08:00
f37ae57a87
opt stream row buff
2024-11-26 15:23:57 +08:00
48d5f0e7cd
fix issue
2024-11-05 18:14:35 +08:00
5158bf6b96
fix issue
2024-10-31 15:50:56 +08:00
3e49f40c74
stream twa
2024-10-16 12:16:59 +08:00
669c3aa4db
fix windows ci issue
2024-10-09 19:48:24 +08:00
69b8505a8d
fix ci issue
2024-10-09 17:49:24 +08:00
8709a12ce2
fix ci issue
2024-10-09 17:00:09 +08:00
e6f11c180c
fix ci issue
2024-10-09 16:03:09 +08:00
d13819bbf4
Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/TD-30837
2024-09-30 09:05:46 +08:00
7517228dde
fix(stream):fix issue for stream count window state buff
2024-09-29 14:16:16 +08:00
b8cd739383
add ci and fix issue
2024-09-18 11:08:47 +08:00
4fe68034cf
fix issue
2024-08-16 17:46:14 +08:00
d59eb19c37
add ci
2024-08-16 10:54:52 +08:00
057f09ffbf
fix issue && add ci
2024-08-14 19:20:21 +08:00
5a2b89c357
fix issue
2024-08-13 14:05:16 +08:00
3a14454fb5
add ci
2024-08-08 19:30:18 +08:00
b26750c200
add ci
2024-08-02 13:22:14 +08:00
fe9d61b243
add node to json
2024-07-29 14:14:34 +08:00
b5f432bd50
Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/TD-30837
2024-07-26 16:44:18 +08:00
3cdb957f22
adj function of stream operator result
2024-07-15 15:32:11 +08:00
1c9011e820
stream time slice
2024-07-12 11:03:45 +08:00
7b50663240
optimize stream operator checkpoint
2024-05-16 16:24:58 +08:00
Haojun Liao
Haojun Liao
liuyao
Jinqing Kuang
54liuyao