Commit Graph

175 Commits

Author SHA1 Message Date
54liuyao f6500b3551 ci(test):delete invalid code&& add ci 2024-12-26 11:16:02 +08:00
54liuyao 4adf24b466 ci(stream):add stream unit test 2024-12-23 18:25:25 +08:00
54liuyao 9866b9437d try fix window com error 2024-12-20 11:27:29 +08:00
54liuyao 979a669ecd try fix window com error 2024-12-20 09:37:14 +08:00
54liuyao 5b10753ac0 add ut 2024-12-19 18:23:57 +08:00
Shengliang Guan f9124dad6c
Merge pull request #28623 from taosdata/fix/reset
fix(stream): record the failed checkpointId, after receive reset task info.
2024-12-17 18:16:36 +08:00
Haojun Liao daecc4a290 other: merge main 2024-12-17 17:31:56 +08:00
Haojun Liao d2146a2efb other: merge main 2024-12-17 09:23:13 +08:00
Haojun Liao aa12038fc4 fix(stream): record the failure of dispatch msg, and set the update node id. 2024-12-10 17:58:53 +08:00
Shengliang Guan e99b888654 Merge branch 'main' into merge/mainto3.0 2024-12-09 19:06:06 +08:00
Haojun Liao cea647daf6 refactor: limit the number of items in inputq to be 5120 2024-12-07 12:21:28 +08:00
Haojun Liao 187997d5f0 fix(stream): record the failed checkpointId, after receive reset task info. 2024-11-14 17:40:37 +08:00
Haojun Liao b2b5a14d9d fix(stream): reset task add the failed chkptId info. 2024-11-14 17:38:40 +08:00
Haojun Liao 06c02c14c2 other: merge main 2024-11-11 15:27:53 +08:00
54liuyao ba31bf2c52 Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/TD-30837 2024-11-06 09:42:50 +08:00
Haojun Liao bb05b9b912 fix(stream): record the failed checkpointId, after receive reset task info. 2024-11-04 10:11:22 +08:00
Haojun Liao e7b3a3aec8 fix(stream): reset task add the failed chkptId info. 2024-11-01 18:58:22 +08:00
Haojun Liao cacc7db61c fix(stream): set the correct start ts. 2024-10-28 19:33:11 +08:00
Haojun Liao c0932d419d fix(stream): fix error in pause/resume for force_window_close 2024-10-28 18:07:11 +08:00
Haojun Liao 380f433499 fix(stream): use the refId in stream meta list, in order to avoid access already freed stream tasks. 2024-10-27 15:40:17 +08:00
54liuyao d13819bbf4 Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/TD-30837 2024-09-30 09:05:46 +08:00
Haojun Liao 4c98786352 fix(stream): use meta id instead of ptr. 2024-09-29 16:12:46 +08:00
Haojun Liao c5eca0486e Merge remote-tracking branch 'origin/fix/TD-30837' into fix/TD-30837
# Conflicts:
#	source/dnode/vnode/src/tq/tq.c
#	source/libs/stream/inc/streamInt.h
#	source/libs/stream/src/streamSched.c
2024-09-19 16:39:54 +08:00
Haojun Liao e1d8e98b11 feat(stream): support the force_window_close trigger. 2024-09-19 16:23:51 +08:00
Haojun Liao b494163f28 refactor: check return value. 2024-09-14 13:39:23 +08:00
Haojun Liao 6ba428fbf8 other: merge 3.0. 2024-08-01 11:15:49 +08:00
Haojun Liao 7201526674 fix(stream): check return value. 2024-07-22 09:13:39 +08:00
Haojun Liao 2ca6726922 refactor: check return value for each function. 2024-07-18 22:52:32 +08:00
Haojun Liao fb3fe03c1f fix(stream): to avoid repeatly start checkpoint timer if previous timer is not started yet. 2024-07-18 14:57:39 +08:00
Haojun Liao b35d107bf9 refactor: check return value for each function. 2024-07-17 18:55:04 +08:00
Haojun Liao 2b00d6549d refactor: check return value for each function. 2024-07-17 17:57:08 +08:00
Haojun Liao 2aa4d6028b refactor: check return value for each function. 2024-07-17 16:56:36 +08:00
Haojun Liao c4cde6f268 fix(stream): mark the timer launched by which checkpoint procedure. 2024-07-15 14:23:33 +08:00
Haojun Liao 6d64d0e081 fix(stream): fix memory leak. 2024-07-01 15:34:04 +08:00
Haojun Liao 025437df0c fix(stream): fix error in checkpoint consensus. 2024-06-27 19:25:18 +08:00
Haojun Liao 48bf5eb4d8 other: merge 3.0 2024-06-27 19:23:06 +08:00
Hongze Cheng b761bd2e38 enh: port main change to 3.0 2024-06-26 10:32:15 +08:00
Haojun Liao 1818edcb2b fix(stream): consensus the start checkpoint id, and extract the streamhb related functions into a new file. 2024-06-26 10:18:32 +08:00
Haojun Liao 21e1763ff4 fix(stream): set correct flag for checkpoint. 2024-06-22 11:16:20 +08:00
Haojun Liao 4490f40c96 fix(stream): do some internal refactor. 2024-06-14 14:43:57 +08:00
Haojun Liao 0f8c0fa8cb fix(stream): add dispatch data monitor to handle the network broken problem that may cause the stream process frozen. 2024-06-13 14:56:20 +08:00
Haojun Liao c4447d6873 fix(stream): flush executor state for those with only one task for a stream. 2024-06-07 12:44:38 +08:00
Haojun Liao 52e090634e fix(stream): transfer state before send checkpoint-trigger msg to downstream tasks. 2024-06-06 17:21:23 +08:00
Haojun Liao 3b3ed1c30c fix(stream): add monitor for checkpoint-ready msg recv status. 2024-06-03 16:45:37 +08:00
Haojun Liao 31317c4895 fix(stream): set the checkpoint ready info for only one task in stream. 2024-06-01 23:20:43 +08:00
Haojun Liao 2a8270f9c8 fix(stream): track the checkpoint-ready msg on the upstream tasks. 2024-06-01 18:26:45 +08:00
Haojun Liao 76b43dc072 fix(stream): 1. check the checkpoint-trigger rsp, 2. set the error code in the message body, 3. follower nodes not handle the checkpoint-trigger retrieve request. 2024-05-31 14:32:55 +08:00
Haojun Liao ee4e4c0e6d refactor: do some internal refactor. 2024-05-31 09:17:20 +08:00
Haojun Liao 225dfb1a93 enh(stream): check checkpoint-trigger msg every 100ms. 2024-05-29 00:30:42 +08:00
Haojun Liao be107b204c enh(stream): support retrieve checkpoint data remotely when start stream tasks in vnodes. 2024-05-28 09:54:22 +08:00