Commit Graph

137 Commits

Author SHA1 Message Date
Haojun Liao 21e1763ff4 fix(stream): set correct flag for checkpoint. 2024-06-22 11:16:20 +08:00
Haojun Liao 4490f40c96 fix(stream): do some internal refactor. 2024-06-14 14:43:57 +08:00
Haojun Liao 0f8c0fa8cb fix(stream): add dispatch data monitor to handle the network broken problem that may cause the stream process frozen. 2024-06-13 14:56:20 +08:00
Haojun Liao c4447d6873 fix(stream): flush executor state for those with only one task for a stream. 2024-06-07 12:44:38 +08:00
Haojun Liao 52e090634e fix(stream): transfer state before send checkpoint-trigger msg to downstream tasks. 2024-06-06 17:21:23 +08:00
Haojun Liao 3b3ed1c30c fix(stream): add monitor for checkpoint-ready msg recv status. 2024-06-03 16:45:37 +08:00
Haojun Liao 31317c4895 fix(stream): set the checkpoint ready info for only one task in stream. 2024-06-01 23:20:43 +08:00
Haojun Liao 2a8270f9c8 fix(stream): track the checkpoint-ready msg on the upstream tasks. 2024-06-01 18:26:45 +08:00
Haojun Liao 76b43dc072 fix(stream): 1. check the checkpoint-trigger rsp, 2. set the error code in the message body, 3. follower nodes not handle the checkpoint-trigger retrieve request. 2024-05-31 14:32:55 +08:00
Haojun Liao ee4e4c0e6d refactor: do some internal refactor. 2024-05-31 09:17:20 +08:00
Haojun Liao 225dfb1a93 enh(stream): check checkpoint-trigger msg every 100ms. 2024-05-29 00:30:42 +08:00
Haojun Liao be107b204c enh(stream): support retrieve checkpoint data remotely when start stream tasks in vnodes. 2024-05-28 09:54:22 +08:00
Haojun Liao 610aa80e65 fix(stream): init backend for fill-history task. 2024-05-15 00:08:38 +08:00
Haojun Liao 6898eba6ed fix(stream): expand stream tasks are divided into two phase, the first is to build stream task and then expand stream task before start stream tasks. 2024-05-14 14:34:31 +08:00
Haojun Liao 7f93ec2c53 fix(stream): update the checkpoint info for followers, and some internal refactor. 2024-05-11 09:37:02 +08:00
Haojun Liao c43fbf6fee refactor: do some internal refactor. 2024-05-08 11:21:24 +08:00
Haojun Liao cdeb4462fb refactor: do some internal refactor. 2024-05-07 23:43:21 +08:00
Haojun Liao bbd423f666 refactor: do some internal refactor. 2024-05-07 09:46:12 +08:00
Haojun Liao 629502e12e refactor: do some internal refactor. 2024-04-30 17:00:51 +08:00
Haojun Liao b2d8260f14 refactor: do some internal refactor. 2024-04-28 10:05:22 +08:00
Haojun Liao 8adaeb59a3 refactor: do some internal refactor. 2024-04-28 09:50:21 +08:00
Haojun Liao a33e7b2eb3 refactor: do some internal refactor. 2024-04-26 22:22:54 +08:00
Haojun Liao 8b53f76691 fix(stream): discard the repeatly recv checkpoint-source msg. 2024-04-26 15:56:34 +08:00
Haojun Liao 3769da535e fix(stream): re-send checkmsg to downstream for fixed dispatch type. 2024-04-19 10:00:47 +08:00
Haojun Liao e7dee4ac63 refactor(stream): refactor check msg retry procedure and be tolerant to the dnode disconnection during check downstream tasks. 2024-04-18 15:55:21 +08:00
Haojun Liao 8bdd43c305 fix(stream): wait for 50ms when no token in bucket for sink task. 2024-04-16 14:42:21 +08:00
Haojun Liao f28e994409
Merge pull request #25091 from taosdata/fix/3_liaohj
fix(stream): transfer state before do checkpoint
2024-03-14 17:59:13 +08:00
Haojun Liao cc0b32b1f8 fix(stream): transfer state before do checkpoint, to avoid the retrieve and deadlock by using waiting . 2024-03-14 16:13:41 +08:00
Haojun Liao ad1780dbdc fix(stream): reset the pData after transferring state. 2024-03-04 19:32:22 +08:00
Haojun Liao cf571e4f1f refactor: do some internal refactor. 2024-02-19 09:52:22 +08:00
wangmm0220 a8e45440c0 fix:conflicts from 3.0 2024-02-18 18:02:14 +08:00
Haojun Liao cb2ea4a721 fix(stream): take ver snapshot for all vgroups before launching stream with fill-history option opened. 2024-02-01 11:37:57 +08:00
wangmm0220 a9fcc67321 fix:conflicts from 3.0 2024-02-01 11:13:03 +08:00
Haojun Liao bfbd61a02f
Merge pull request #24634 from taosdata/fix/3_liaohj
refactor: do some internal refactor.
2024-01-26 18:08:54 +08:00
Haojun Liao ac08f659c3 refactor: remove invalid procedure in fill-history. 2024-01-26 16:20:43 +08:00
wangmm0220 7246fedfef Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/ly_multi_marks 2024-01-18 19:08:35 +08:00
Yihao Deng f27b69f0c2 fix debug log err 2024-01-17 04:46:54 +00:00
wangmm0220 2ab54a1335 fix:conflicts from 3.0 2024-01-15 16:54:52 +08:00
Haojun Liao e012bc4bde refactor: do some internal refactor. 2024-01-15 11:28:36 +08:00
Haojun Liao f9d5c0d403 fix(stream): fix error in tq timer. 2024-01-09 09:13:53 +08:00
Haojun Liao cd85dae3fd fix(stream): fix the dead lock. 2023-12-24 23:30:00 +08:00
Haojun Liao 8a8ddf5699 fix(stream): record the checkpoint failure when nodeEp changed. 2023-12-21 10:30:44 +08:00
wangmm0220 de8ce3f7ec fix:send stream retrieve msg to source task 2023-12-20 16:01:17 +08:00
yihaoDeng 547d797a26 fix stream backend crash when transfer 2023-12-16 15:05:27 +08:00
wangmm0220 f06117dbc9 fix:[TD-27644]heartbeat closed before snode close leading to snode is hanged 2023-12-01 17:32:29 +08:00
yihaoDeng e9bec34c44 Merge branch '3.0' into enh/refactorBackend 2023-11-27 10:01:12 +08:00
yihaoDeng 6129ebc294 Merge branch '3.0' into enh/refactorBackend 2023-11-23 17:41:37 +08:00
Haojun Liao de47ea6c81 other: merge 3.0. 2023-11-23 15:42:40 +08:00
Haojun Liao 1a1319908d refactor: do some internal refactor. 2023-11-23 14:25:52 +08:00
yihaoDeng 6a0501967d Merge branch '3.0' into fix/fixChkpRespMemleak 2023-11-23 14:06:04 +08:00