890b8cfee2
Merge pull request #29938 from taosdata/fix/analysis
...
fix(stream): fix memory leak.
2025-02-28 11:00:44 +08:00
f5429637fa
Merge branch 'main' into merge/mainto3.0
2025-02-28 09:11:10 +08:00
8c671f51fb
refactor(stream): move the generate checkpoint procedure out of lock, to avoid blocking heartbeat, and resulting in leader/follower switch.
2025-02-27 19:54:46 +08:00
b6707fbbd2
refactor(stream): move the generate checkpoint procedure out of lock, to avoid blocking heartbeat, and resulting in leader/follower switch.
2025-02-27 19:53:53 +08:00
76ad364b93
enh: adjust some logs
2025-02-27 09:55:11 +08:00
b91dd10846
enh: add log level to each log entry
2025-02-27 09:55:11 +08:00
644d9b98ba
refactor(stream): remove unused variables.
2025-02-27 00:46:42 +08:00
786ee101cd
other: merge main.
2025-02-27 00:18:25 +08:00
bf1f162aa0
fix(stream): drop task in synch model in write thread.
2025-02-27 00:15:36 +08:00
012ee53d35
fix(stream): drop task in synch model in write thread.
2025-02-27 00:15:31 +08:00
45b0e47a19
refactor(stream): add long exec stream queue for history tasks in step1 and re-calculate task execution.
2025-02-27 00:15:03 +08:00
c14ba08d7c
refactor(stream): drop task in async ways
2025-02-27 00:12:11 +08:00
3923707826
fix(stream): fix memory leak.
2025-02-26 01:33:40 +08:00
7ff3a5968a
fix(stream): fix memory leak.
2025-02-26 00:13:44 +08:00
e46a063c2f
fix(stream): fix memory leak in checkpt queue.
2025-02-25 14:29:49 +08:00
e429264432
Merge pull request #29884 from taosdata/enh/killtrans
...
enh(stream): auto kill checkpoint trans that last long time
2025-02-25 11:29:49 +08:00
8bcc8399e6
fix(stream): reset value.
2025-02-23 16:27:35 +08:00
a98d839c01
fix(stream): reset value.
2025-02-23 15:36:26 +08:00
2fdb31a41a
fix(stream): adjust scan timer
2025-02-23 10:49:13 +08:00
e378b5cb8a
fix(stream): adjust scan timer
2025-02-23 03:42:44 +08:00
9018970135
refactor: do some internal refactor.
2025-02-23 01:39:00 +08:00
034c907ee1
refactor: do some internal refactor.
2025-02-23 01:38:05 +08:00
3a739beaa5
Merge branch 'main' into merge/mainto3.0
2025-02-22 20:07:40 +08:00
0f89421b62
refactor(stream): scan wal is driven by time, instead of insert events.
2025-02-22 12:38:03 +08:00
09b6642e45
refactor(stream): scan wal is driven by time, instead of insert events.
2025-02-22 12:33:32 +08:00
2228a9fc33
Merge branch 'main' into fix/checkfh
2025-02-21 11:11:36 +08:00
45e027d612
fix(stream): update the checkpoint info for follower anyway.
2025-02-21 11:09:23 +08:00
24cce3477f
fix(stream): update the checkpoint info for follower anyway.
2025-02-21 10:00:55 +08:00
ecc667c22b
Revert "refactor(stream): drop task in async ways"
2025-02-21 01:10:18 +08:00
bd232016bd
Merge branch 'fix/checkfh' into fix/checkpoint
2025-02-20 23:56:16 +08:00
306f6ebc93
fix(stream): clear start task info if no tasks exist.
2025-02-20 23:54:06 +08:00
2bee60a41a
Merge branch 'main' into merge/mainto3.0
2025-02-20 18:12:02 +08:00
4edc21e446
refactor(stream): disable error injection.
2025-02-20 17:42:50 +08:00
3f70661dcf
refactor(stream): disable error injection.
2025-02-20 17:39:46 +08:00
85c164c855
other: merge main.
2025-02-20 17:25:48 +08:00
0a672f1b96
refactor(stream): update logs.
2025-02-20 16:55:10 +08:00
0600fcceeb
refactor(stream): idle for 1s when exec for 5s.
2025-02-20 16:16:53 +08:00
cc62216c14
refactor(stream): add some logs.
2025-02-20 16:14:58 +08:00
6766e6db53
refactor(stream): add checkpoint queue to handle chkpt.
2025-02-20 16:13:33 +08:00
5f9ce8826d
fix(stream): remove invalid assert.
2025-02-20 16:08:38 +08:00
1c0a0443c5
fix(stream): fix error in the check of continuing execution condition.
2025-02-20 16:07:17 +08:00
8636856ef6
fix(stream): fix error in the check of continuing execution condition.
2025-02-20 16:07:15 +08:00
b27a7f275e
refactor: update some logs.
2025-02-20 16:07:10 +08:00
256d497fd9
fix(stream): fix error in deciding exec should quit or not.
2025-02-20 16:06:56 +08:00
189a7f44ab
refactor(stream): do some internal refactor.
2025-02-20 16:06:49 +08:00
4298522792
enh(stream): add checkpoint queue for source tasks.
2025-02-20 16:06:34 +08:00
42bafc0d47
Merge pull request #29848 from taosdata/fix/ly_stream
...
fix(tsma):drop invalid state for tsma
2025-02-20 15:04:03 +08:00
0a9f5086f0
Merge pull request #29775 from taosdata/fix/analysis
...
refactor(stream): drop task in async ways
2025-02-20 13:38:53 +08:00
870fe1c071
fix(tsma):drop invalid state for tsma
2025-02-20 11:52:04 +08:00
f16ae7abe1
Merge pull request #29809 from taosdata/merge/mainto3.0
...
merge: from main to 3.0 branch
2025-02-20 10:27:20 +08:00
92eb6038e2
Merge pull request #29762 from taosdata/feat/TS-5469-3.0
...
feat(stream)[TS-5469]: add more stream event notifications
2025-02-18 15:14:58 +08:00
63fc5dea34
Merge branch '3.0' into merge/mainto3.0
2025-02-18 10:29:16 +08:00
c4cd6dd62d
fix(stream): drop task in synch model in write thread.
2025-02-17 10:06:09 +08:00
596e381e0e
Merge pull request #29779 from taosdata/fix/metanull
...
fix(stream): access value after null ptr check.
2025-02-17 09:36:09 +08:00
fc2d2672b9
feat(stream)[TS-5469]: add more stream event notifications
...
- Add event notifications for all window types
- Implement window invalidation notifications
- Add statistics for event notification delivery
2025-02-16 11:07:16 +08:00
465e5eabd7
fix(stream): drop task in synch model in write thread.
2025-02-15 23:20:05 +08:00
25cdfa5ee9
refactor(stream): add long exec stream queue for history tasks in step1 and re-calculate task execution.
2025-02-14 18:34:20 +08:00
73ec4af4a7
Merge branch 'main' into fix/analysis
2025-02-14 15:37:11 +08:00
89d5444ed1
fix(stream): access value after null ptr check.
2025-02-14 14:46:19 +08:00
297f248203
fix(stream): access value after null ptr check.
2025-02-14 14:34:08 +08:00
fd96b096ea
refactor(stream): drop task in async ways
2025-02-13 23:41:06 +08:00
d4b19169ea
fix(stream): fix double free when failed to send msg.
2025-02-12 15:33:50 +08:00
78e976caff
refactor(stream): limit stream input q size.
2025-02-11 22:57:28 +08:00
9d0a4f88f3
refactor(stream): idle for 1s when exec for 5s.
2025-02-11 22:57:23 +08:00
cd52401303
Merge branch 'main' into merge/mainto3.02
2025-02-11 15:15:35 +08:00
a2dcba10a7
refactor(stream): 1) notify closing in main thread. 2) not saving the halt status.
2025-02-09 01:42:24 +08:00
a004d95996
Merge branch '3.0' into merge/mainto3.02
2025-02-06 13:46:36 +08:00
093233203d
Revert "refactor(stream): do some internal refactor ."
2025-01-24 17:11:15 +08:00
3089e3d904
Merge pull request #29544 from taosdata/fix/tag
...
refactor(stream): do some internal refactor .
2025-01-24 16:27:22 +08:00
8c0600649f
Merge pull request #29623 from taosdata/merge/mainto3.0
...
merge: from main to 3.0 branch
2025-01-22 16:36:17 +08:00
eb5d463490
feat(stream)[TS-5469]. add support for window event notifications in stream processing
...
- Introduce new syntax to specify notification type and destination address
- Collect relevant event information during window computations
- Implement websocket-based notification delivery to the specified address
2025-01-21 17:39:46 +08:00
3206c688ed
fix(stream): fix syntax error.
2025-01-21 16:30:43 +08:00
0ea46585f4
fix(stream): update checkpoint-info after check the failed checkpointId, and update the consensus-checkpoint id in mnode.
2025-01-21 16:29:00 +08:00
c93fe999ba
refactor(stream): injection error.
2025-01-18 01:26:49 +08:00
6274eea7c4
fix(stream): adjust the free stream meta position and check the close flag of streamMeta before starting scan wal.
2025-01-17 19:15:08 +08:00
29421c17d8
fix(stream): fix syntax error.
2025-01-16 17:48:26 +08:00
eff1aff58e
fix(stream): update the task last msgId when putting into input queue succ.
2025-01-16 17:16:31 +08:00
a3eea6fe1c
fix(stream): fix race condition.
2025-01-10 14:11:15 +08:00
737138856c
refactor(stream): track the msgId for each upstream tasks.
2025-01-10 11:29:17 +08:00
d344228242
enh(stream): reduce the in-queue size to be 10MiB.
2025-01-08 19:11:41 +08:00
c372b5da51
fix invalid lock
2025-01-03 16:09:32 +08:00
94ea52ad9d
Merge pull request #29404 from taosdata/fix/tag
...
fix(stream): replace functions with safty ones.
2024-12-31 15:49:06 +08:00
1d0ab80e75
fix(stream): check return value for snprintf
2024-12-31 11:59:13 +08:00
5a1e5b1549
fix(stream): check return value for snprintf
2024-12-31 11:52:06 +08:00
44cfecc402
refactor: remove unused codes.
2024-12-30 13:41:34 +08:00
8c7ee17dd1
fix(stream): replace functions with safty ones.
2024-12-30 13:36:57 +08:00
0c8ac0f2ec
enh(stream): inc the timeout threshold to be 600s.
2024-12-29 00:42:39 +08:00
ba4d47b8b6
enh(stream): extend wait time upto 300s
2024-12-29 00:15:58 +08:00
912fcb13bf
Merge pull request #29351 from taosdata/merge/mainto3.0
...
merge: from main to 3.0 branch
2024-12-27 09:06:35 +08:00
030bcbf487
Merge pull request #29340 from taosdata/fix/liaohj
...
fix(stream): log error and continue running
2024-12-26 14:41:32 +08:00
ff7a2ebe6b
ci(test):delete invalid code&& add ci
2024-12-26 13:35:50 +08:00
f6500b3551
ci(test):delete invalid code&& add ci
2024-12-26 11:16:02 +08:00
090ce021ac
fix(stream): check error and continue computing, fix memory leak.
2024-12-26 10:42:34 +08:00
7e21747c4f
ci(test):add slice state ut
2024-12-24 14:17:37 +08:00
0452c21ff6
ci(stream):add stream unit test
2024-12-23 19:10:10 +08:00
4adf24b466
ci(stream):add stream unit test
2024-12-23 18:25:25 +08:00
89dc02012b
try fix window com error
2024-12-20 14:23:04 +08:00
5212710947
try fix window com error
2024-12-20 13:33:32 +08:00
9866b9437d
try fix window com error
2024-12-20 11:27:29 +08:00
979a669ecd
try fix window com error
2024-12-20 09:37:14 +08:00
Simon Guan
dmchen
Haojun Liao
Haojun Liao
54liuyao
Jinqing Kuang
yihaoDeng