Commit Graph

204 Commits

Author SHA1 Message Date
Haojun Liao c4447d6873 fix(stream): flush executor state for those with only one task for a stream. 2024-06-07 12:44:38 +08:00
Haojun Liao 88e77d6bc6 fix(stream): remove expired stream in buf. 2024-06-06 23:54:48 +08:00
Haojun Liao 420cbc36e5 other: fix syntax error. 2024-06-06 17:40:17 +08:00
Haojun Liao 52e090634e fix(stream): transfer state before send checkpoint-trigger msg to downstream tasks. 2024-06-06 17:21:23 +08:00
Haojun Liao 29d34200b5 other: fix coverity issues. 2024-06-05 13:39:46 +08:00
Haojun Liao 407f79cfa6 fix(stream): fix dead-lock. 2024-06-03 19:14:45 +08:00
Haojun Liao 3b3ed1c30c fix(stream): add monitor for checkpoint-ready msg recv status. 2024-06-03 16:45:37 +08:00
Haojun Liao 31317c4895 fix(stream): set the checkpoint ready info for only one task in stream. 2024-06-01 23:20:43 +08:00
Haojun Liao 2a8270f9c8 fix(stream): track the checkpoint-ready msg on the upstream tasks. 2024-06-01 18:26:45 +08:00
Haojun Liao 76b43dc072 fix(stream): 1. check the checkpoint-trigger rsp, 2. set the error code in the message body, 3. follower nodes not handle the checkpoint-trigger retrieve request. 2024-05-31 14:32:55 +08:00
Haojun Liao becc4cb368 enh(stream): limit the concurrent started checkpoint tasks. 2024-05-29 19:29:26 +08:00
Haojun Liao 46ca55ac74 fix(stream): avoid deadlock. 2024-05-29 15:20:35 +08:00
Haojun Liao 27ac6ca16e fix(stream): desc the ref for checkpoint-trigger timer. 2024-05-29 14:12:14 +08:00
Haojun Liao 09efbad117 fix(stream): drop related fill history task. 2024-05-29 11:16:26 +08:00
Haojun Liao a9abe78eab other: comment invalid sleep for test purpose 2024-05-29 09:16:37 +08:00
Haojun Liao 225dfb1a93 enh(stream): check checkpoint-trigger msg every 100ms. 2024-05-29 00:30:42 +08:00
Haojun Liao d1d868f239 refactor: do some internal refactor and set the pActiveInfo for rsma. 2024-05-29 00:08:29 +08:00
Haojun Liao 8d54d45054 fix(stream): fix error found by CI. 2024-05-28 17:30:14 +08:00
Haojun Liao be107b204c enh(stream): support retrieve checkpoint data remotely when start stream tasks in vnodes. 2024-05-28 09:54:22 +08:00
Haojun Liao 6898eba6ed fix(stream): expand stream tasks are divided into two phase, the first is to build stream task and then expand stream task before start stream tasks. 2024-05-14 14:34:31 +08:00
Haojun Liao fb248b2682 fix(stream): not save the stream task for rsma. 2024-05-13 17:26:39 +08:00
Haojun Liao 3dfffe9113 fix(stream): async load and start stream tasks. 2024-05-13 15:31:26 +08:00
Haojun Liao 370c255128 refactor: do some internal refactor. 2024-05-11 10:27:55 +08:00
Haojun Liao 11ed1f54b3 refactor: do some internal refactor. 2024-05-11 10:09:23 +08:00
Haojun Liao 7f93ec2c53 fix(stream): update the checkpoint info for followers, and some internal refactor. 2024-05-11 09:37:02 +08:00
Haojun Liao 6693efaa85 refactor: do some internal refactor. 2024-05-09 10:11:37 +08:00
Haojun Liao 9ce8f6953d refactor: do some internal refactor. 2024-05-08 13:52:20 +08:00
Haojun Liao 18c66a5491 refactor: do some internal refactor. 2024-05-06 18:17:38 +08:00
Haojun Liao 7ad7ef7cfc refactor: do some internal refactor. 2024-05-06 17:03:41 +08:00
Haojun Liao 94a0f9ab8f other: merge 3.0 2024-04-30 17:12:46 +08:00
Haojun Liao 629502e12e refactor: do some internal refactor. 2024-04-30 17:00:51 +08:00
Yihao Deng 3fd6770c81 avoid invalid read 2024-04-29 05:52:54 +00:00
Yihao Deng b54198ba4a avoid invalid read 2024-04-29 03:18:38 +00:00
Yihao Deng 97aadd3aa7 avoid invalid read 2024-04-29 03:17:33 +00:00
Yihao Deng 2beb46c9df Merge branch '3.0' into fix/TD-29844 2024-04-29 01:27:20 +00:00
Yihao Deng 9e19c52924 Remove unnecessary memory free in uploadCheckpointData function 2024-04-28 06:50:54 +00:00
Yihao Deng fac8530580 fix invalid read 2024-04-28 06:50:33 +00:00
Yihao Deng af567ea2cb fix invalid read 2024-04-28 06:47:31 +00:00
Haojun Liao b2d8260f14 refactor: do some internal refactor. 2024-04-28 10:05:22 +08:00
Haojun Liao 8adaeb59a3 refactor: do some internal refactor. 2024-04-28 09:50:21 +08:00
Haojun Liao 8b53f76691 fix(stream): discard the repeatly recv checkpoint-source msg. 2024-04-26 15:56:34 +08:00
Haojun Liao d1ecfe5cf3 refactor: do some internal refactor. 2024-04-25 14:24:20 +08:00
Haojun Liao 82cde46614 fix(stream): fix memory leak. 2024-04-23 19:48:50 +08:00
Haojun Liao e7dee4ac63 refactor(stream): refactor check msg retry procedure and be tolerant to the dnode disconnection during check downstream tasks. 2024-04-18 15:55:21 +08:00
Haojun Liao 665107ad3a enh(stream): add more info in meta table. 2024-04-15 14:23:37 +08:00
Haojun Liao 9ca84091df fix(stream): reset the ready upstream counter after task-reset. 2024-04-01 16:31:10 +08:00
Haojun Liao cc0b32b1f8 fix(stream): transfer state before do checkpoint, to avoid the retrieve and deadlock by using waiting . 2024-03-14 16:13:41 +08:00
54liuyao 0e8170de49 remove invalid code 2024-02-20 10:17:47 +08:00
Haojun Liao 2bba011e4e Merge remote-tracking branch 'origin/feat/TD-22023' into feat/TD-22023 2024-02-05 17:51:23 +08:00
Haojun Liao 7a18e5910c enh(stream): halt the initial stream tasks when fill-history is set for count window agg 2024-02-05 17:51:09 +08:00