Yihao Deng
|
33aef6ddc5
|
add self check info
|
2024-06-25 07:12:09 +00:00 |
|
Yihao Deng
|
7cab27110a
|
add self check info
|
2024-06-24 12:26:10 +00:00 |
Haojun Liao
|
21e1763ff4
|
fix(stream): set correct flag for checkpoint.
|
2024-06-22 11:16:20 +08:00 |
|
Haojun Liao
|
2cb9644471
|
fix(stream): update the checkpoint info only when the status is normal.
|
2024-06-21 09:23:29 +08:00 |
|
Haojun Liao
|
4490f40c96
|
fix(stream): do some internal refactor.
|
2024-06-14 14:43:57 +08:00 |
|
Haojun Liao
|
0f8c0fa8cb
|
fix(stream): add dispatch data monitor to handle the network broken problem that may cause the stream process frozen.
|
2024-06-13 14:56:20 +08:00 |
|
Haojun Liao
|
c4447d6873
|
fix(stream): flush executor state for those with only one task for a stream.
|
2024-06-07 12:44:38 +08:00 |
|
Haojun Liao
|
52e090634e
|
fix(stream): transfer state before send checkpoint-trigger msg to downstream tasks.
|
2024-06-06 17:21:23 +08:00 |
|
Haojun Liao
|
3b3ed1c30c
|
fix(stream): add monitor for checkpoint-ready msg recv status.
|
2024-06-03 16:45:37 +08:00 |
|
Haojun Liao
|
31317c4895
|
fix(stream): set the checkpoint ready info for only one task in stream.
|
2024-06-01 23:20:43 +08:00 |
|
Haojun Liao
|
2a8270f9c8
|
fix(stream): track the checkpoint-ready msg on the upstream tasks.
|
2024-06-01 18:26:45 +08:00 |
|
Haojun Liao
|
76b43dc072
|
fix(stream): 1. check the checkpoint-trigger rsp, 2. set the error code in the message body, 3. follower nodes not handle the checkpoint-trigger retrieve request.
|
2024-05-31 14:32:55 +08:00 |
|
Haojun Liao
|
ee4e4c0e6d
|
refactor: do some internal refactor.
|
2024-05-31 09:17:20 +08:00 |
|
Haojun Liao
|
225dfb1a93
|
enh(stream): check checkpoint-trigger msg every 100ms.
|
2024-05-29 00:30:42 +08:00 |
|
Haojun Liao
|
be107b204c
|
enh(stream): support retrieve checkpoint data remotely when start stream tasks in vnodes.
|
2024-05-28 09:54:22 +08:00 |
|
Haojun Liao
|
3baa4169e6
|
Merge branch '3.0' into fix/3_liaohj
|
2024-05-20 10:31:53 +08:00 |
|
Yihao Deng
|
a7b434075b
|
opt checkpoint
|
2024-05-16 20:16:59 +08:00 |
|
Haojun Liao
|
610aa80e65
|
fix(stream): init backend for fill-history task.
|
2024-05-15 00:08:38 +08:00 |
|
Haojun Liao
|
6898eba6ed
|
fix(stream): expand stream tasks are divided into two phase, the first is to build stream task and then expand stream task before start stream tasks.
|
2024-05-14 14:34:31 +08:00 |
|
Haojun Liao
|
7f93ec2c53
|
fix(stream): update the checkpoint info for followers, and some internal refactor.
|
2024-05-11 09:37:02 +08:00 |
|
Haojun Liao
|
c43fbf6fee
|
refactor: do some internal refactor.
|
2024-05-08 11:21:24 +08:00 |
|
Haojun Liao
|
cdeb4462fb
|
refactor: do some internal refactor.
|
2024-05-07 23:43:21 +08:00 |
|
Haojun Liao
|
bbd423f666
|
refactor: do some internal refactor.
|
2024-05-07 09:46:12 +08:00 |
|
Haojun Liao
|
94a0f9ab8f
|
other: merge 3.0
|
2024-04-30 17:12:46 +08:00 |
|
Haojun Liao
|
629502e12e
|
refactor: do some internal refactor.
|
2024-04-30 17:00:51 +08:00 |
|
Yihao Deng
|
97aadd3aa7
|
avoid invalid read
|
2024-04-29 03:17:33 +00:00 |
|
Haojun Liao
|
b2d8260f14
|
refactor: do some internal refactor.
|
2024-04-28 10:05:22 +08:00 |
|
Haojun Liao
|
8adaeb59a3
|
refactor: do some internal refactor.
|
2024-04-28 09:50:21 +08:00 |
|
Haojun Liao
|
a33e7b2eb3
|
refactor: do some internal refactor.
|
2024-04-26 22:22:54 +08:00 |
|
Haojun Liao
|
8b53f76691
|
fix(stream): discard the repeatly recv checkpoint-source msg.
|
2024-04-26 15:56:34 +08:00 |
|
Haojun Liao
|
3769da535e
|
fix(stream): re-send checkmsg to downstream for fixed dispatch type.
|
2024-04-19 10:00:47 +08:00 |
|
Haojun Liao
|
e7dee4ac63
|
refactor(stream): refactor check msg retry procedure and be tolerant to the dnode disconnection during check downstream tasks.
|
2024-04-18 15:55:21 +08:00 |
|
Haojun Liao
|
8bdd43c305
|
fix(stream): wait for 50ms when no token in bucket for sink task.
|
2024-04-16 14:42:21 +08:00 |
Haojun Liao
|
f28e994409
|
Merge pull request #25091 from taosdata/fix/3_liaohj
fix(stream): transfer state before do checkpoint
|
2024-03-14 17:59:13 +08:00 |
|
Haojun Liao
|
cc0b32b1f8
|
fix(stream): transfer state before do checkpoint, to avoid the retrieve and deadlock by using waiting .
|
2024-03-14 16:13:41 +08:00 |
|
Haojun Liao
|
4d10f28a00
|
Merge pull request #24999 from taosdata/fix/nullcheck
fix(stream): remove related fill-history if task in stop status.
|
2024-03-05 09:15:21 +08:00 |
|
Haojun Liao
|
ad1780dbdc
|
fix(stream): reset the pData after transferring state.
|
2024-03-04 19:32:22 +08:00 |
|
Haojun Liao
|
8791a163f8
|
other: merge 3.0
|
2024-02-29 22:31:52 +08:00 |
|
Haojun Liao
|
db92bf84d8
|
other: merge 3.0
|
2024-02-29 22:21:50 +08:00 |
|
yihaoDeng
|
b3c18c31da
|
add test case to stream backend
|
2024-02-27 12:19:37 +00:00 |
|
yihaoDeng
|
e41e10bf35
|
add stream backend test
|
2024-02-26 11:51:46 +00:00 |
|
yihaoDeng
|
c54e4aeaad
|
add test case
|
2024-02-23 09:30:53 +00:00 |
|
Haojun Liao
|
13c3654bf5
|
other: merge 3.0
|
2024-02-20 10:51:04 +08:00 |
|
Haojun Liao
|
46b1fe520f
|
Merge pull request #24538 from taosdata/feat/TD-22023
stream count window
|
2024-02-20 08:50:25 +08:00 |
54liuyao
|
b53dc5602e
|
Merge branch '3.0' of https://github.com/taosdata/TDengine into 3.0
|
2024-02-19 10:58:20 +08:00 |
|
Haojun Liao
|
cf571e4f1f
|
refactor: do some internal refactor.
|
2024-02-19 09:52:22 +08:00 |
wangmm0220
|
a8e45440c0
|
fix:conflicts from 3.0
|
2024-02-18 18:02:14 +08:00 |
|
Haojun Liao
|
472020a2b9
|
enh(stream): handle event async function.
|
2024-02-18 14:07:15 +08:00 |
|
54liuyao
|
ea9353b9fd
|
merge 3.0
|
2024-02-04 16:04:23 +08:00 |
|
Haojun Liao
|
cb2ea4a721
|
fix(stream): take ver snapshot for all vgroups before launching stream with fill-history option opened.
|
2024-02-01 11:37:57 +08:00 |
|
wangmm0220
|
a9fcc67321
|
fix:conflicts from 3.0
|
2024-02-01 11:13:03 +08:00 |
|
Haojun Liao
|
bfbd61a02f
|
Merge pull request #24634 from taosdata/fix/3_liaohj
refactor: do some internal refactor.
|
2024-01-26 18:08:54 +08:00 |
|
Haojun Liao
|
ac08f659c3
|
refactor: remove invalid procedure in fill-history.
|
2024-01-26 16:20:43 +08:00 |
|
Haojun Liao
|
834f08a2e0
|
Merge pull request #24552 from taosdata/fix/3_liaohj
fix(stream): do checkpoint after fill-history task completed.
|
2024-01-25 16:53:11 +08:00 |
|
Haojun Liao
|
d973f66cea
|
fix(stream): do checkpoint after fill-history task completed.
|
2024-01-19 16:18:02 +08:00 |
|
wangmm0220
|
7246fedfef
|
Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/ly_multi_marks
|
2024-01-18 19:08:35 +08:00 |
|
Yihao Deng
|
f27b69f0c2
|
fix debug log err
|
2024-01-17 04:46:54 +00:00 |
|
wangmm0220
|
2ab54a1335
|
fix:conflicts from 3.0
|
2024-01-15 16:54:52 +08:00 |
|
Haojun Liao
|
e012bc4bde
|
refactor: do some internal refactor.
|
2024-01-15 11:28:36 +08:00 |
|
Haojun Liao
|
9d0d0d9ddc
|
Merge branch '3.0' into fix/3_liaohj
|
2024-01-10 09:57:46 +08:00 |
|
Haojun Liao
|
f9d5c0d403
|
fix(stream): fix error in tq timer.
|
2024-01-09 09:13:53 +08:00 |
|
Yihao Deng
|
1c28f53525
|
refactor stream code
|
2024-01-08 08:28:00 +00:00 |
|
Haojun Liao
|
6d37e596ec
|
refactor: do some internal refactor.
|
2024-01-04 18:47:49 +08:00 |
|
Haojun Liao
|
2387d5bade
|
refactor: do some internal refactor.
|
2024-01-02 17:10:12 +08:00 |
|
Haojun Liao
|
cd85dae3fd
|
fix(stream): fix the dead lock.
|
2023-12-24 23:30:00 +08:00 |
|
Haojun Liao
|
8a8ddf5699
|
fix(stream): record the checkpoint failure when nodeEp changed.
|
2023-12-21 10:30:44 +08:00 |
|
wangmm0220
|
de8ce3f7ec
|
fix:send stream retrieve msg to source task
|
2023-12-20 16:01:17 +08:00 |
yihaoDeng
|
547d797a26
|
fix stream backend crash when transfer
|
2023-12-16 15:05:27 +08:00 |
|
wangmm0220
|
f06117dbc9
|
fix:[TD-27644]heartbeat closed before snode close leading to snode is hanged
|
2023-12-01 17:32:29 +08:00 |
|
yihaoDeng
|
a4d475b582
|
fix rsma
|
2023-11-27 20:27:53 +08:00 |
|
yihaoDeng
|
e9bec34c44
|
Merge branch '3.0' into enh/refactorBackend
|
2023-11-27 10:01:12 +08:00 |
|
yihaoDeng
|
6416a6153a
|
Merge branch '3.0' into enh/refactorBackend
|
2023-11-24 16:29:09 +08:00 |
|
yihaoDeng
|
6129ebc294
|
Merge branch '3.0' into enh/refactorBackend
|
2023-11-23 17:41:37 +08:00 |
|
Haojun Liao
|
de47ea6c81
|
other: merge 3.0.
|
2023-11-23 15:42:40 +08:00 |
|
Haojun Liao
|
1a1319908d
|
refactor: do some internal refactor.
|
2023-11-23 14:25:52 +08:00 |
|
yihaoDeng
|
6a0501967d
|
Merge branch '3.0' into fix/fixChkpRespMemleak
|
2023-11-23 14:06:04 +08:00 |
|
Haojun Liao
|
c96f7cf182
|
fix(stream): scheduler the checkpoint generating.
|
2023-11-22 15:17:21 +08:00 |
|
yihaoDeng
|
a92602b667
|
fix mem leak
|
2023-11-21 15:23:28 +08:00 |
|
Haojun Liao
|
9f8a63099c
|
fix(stream): fix error in generating token in bucket.
|
2023-11-20 15:26:50 +08:00 |
|
yihaoDeng
|
20de2f3cb5
|
Merge branch '3.0' into enh/refactorBackend
|
2023-11-17 17:15:14 +08:00 |
|
yihaoDeng
|
f5ef2e727f
|
fix stream backend convert
|
2023-11-16 14:41:04 +08:00 |
|
yihaoDeng
|
4476e46a5f
|
rm dup data
|
2023-11-14 17:43:13 +08:00 |
|
yihaoDeng
|
4104840cea
|
Merge branch '3.0' into enh/refactorBackend
|
2023-11-13 18:07:38 +08:00 |
liuyao
|
37c102a115
|
Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898
|
2023-11-13 16:06:17 +08:00 |
|
yihaoDeng
|
de7f2a2d1a
|
Merge branch '3.0' into enh/refactorBackend
|
2023-11-13 11:11:28 +08:00 |
|
Haojun Liao
|
9ee9174608
|
other: merge 3.0
|
2023-11-11 15:48:31 +08:00 |
|
Haojun Liao
|
af08a189c1
|
fix(stream): disable concurrently restart stream tasks.
|
2023-11-11 15:40:10 +08:00 |
|
yihaoDeng
|
a3fdb6dd59
|
Merge branch '3.0' into enh/refactorBackend
|
2023-11-10 16:06:08 +08:00 |
|
liuyao
|
6d2d5823dc
|
Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898
|
2023-11-10 09:24:05 +08:00 |
|
yihaoDeng
|
5f9b922a04
|
support s3
|
2023-11-09 20:15:08 +08:00 |
|
yihaoDeng
|
757425bff8
|
Merge branch '3.0' into enh/refactorBackend
|
2023-11-09 17:58:49 +08:00 |
|
yihaoDeng
|
dd2252598e
|
upload by rsync
|
2023-11-09 17:39:34 +08:00 |
dapan1121
|
8314cb6013
|
Merge pull request #23494 from taosdata/enh/TD-23769-3.0x
enh: checkpoint for rsma
|
2023-11-09 14:51:37 +08:00 |
|
liuyao
|
e56a3e8a1e
|
Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898
|
2023-11-09 13:59:39 +08:00 |
|
yihaoDeng
|
3abf0ae4b2
|
Merge branch 'feat/TD-26060' into enh/refactorBackend
|
2023-11-08 17:31:16 +08:00 |
|
yihaoDeng
|
92fa1043b8
|
Merge branch 'enh/refactorBackend' of https://github.com/taosdata/TDengine into enh/refactorBackend
|
2023-11-08 17:12:32 +08:00 |
|
yihaoDeng
|
76fcc49c6d
|
fix stream transfer error
|
2023-11-08 17:10:54 +08:00 |
|
Haojun Liao
|
470f244032
|
Merge remote-tracking branch 'origin/enh/refactorBackend' into enh/refactorBackend
# Conflicts:
# include/libs/stream/tstream.h
|
2023-11-08 15:21:21 +08:00 |
|
Haojun Liao
|
99dbbe61d7
|
refactor(stream): do some internal refactor.
|
2023-11-08 15:20:47 +08:00 |
|
wangmm0220
|
c4c1423243
|
fix:error
|
2023-11-08 15:01:04 +08:00 |