Yihao Deng
|
7290920c6f
|
add self check
|
2024-06-29 04:35:54 +00:00 |
|
Yihao Deng
|
f023e7780c
|
add self check
|
2024-06-29 04:33:14 +00:00 |
Haojun Liao
|
1f8991ec91
|
fix(stream): set the correct rsp msg position.
|
2024-06-29 00:40:57 +08:00 |
|
Haojun Liao
|
e74b8473f1
|
fix(stream): clear the active checkpoint info after report to mnode.
|
2024-06-28 23:40:05 +08:00 |
|
Haojun Liao
|
5585a141d5
|
fix(stream): set the failed id before clear the checkpoint info.
|
2024-06-28 23:16:03 +08:00 |
|
Yihao Deng
|
bf656ec80f
|
fix merge conflict
|
2024-06-28 08:23:09 +00:00 |
|
Yihao Deng
|
8fe57c1669
|
add self check
|
2024-06-28 03:08:02 +00:00 |
|
Haojun Liao
|
025437df0c
|
fix(stream): fix error in checkpoint consensus.
|
2024-06-27 19:25:18 +08:00 |
|
Haojun Liao
|
48bf5eb4d8
|
other: merge 3.0
|
2024-06-27 19:23:06 +08:00 |
|
Yihao Deng
|
de77ce6480
|
add self check
|
2024-06-27 09:51:49 +00:00 |
|
Yihao Deng
|
0a35d7ef6b
|
add self check
|
2024-06-27 01:33:25 +00:00 |
Hongze Cheng
|
b761bd2e38
|
enh: port main change to 3.0
|
2024-06-26 10:32:15 +08:00 |
|
Haojun Liao
|
1818edcb2b
|
fix(stream): consensus the start checkpoint id, and extract the streamhb related functions into a new file.
|
2024-06-26 10:18:32 +08:00 |
|
Haojun Liao
|
195469f1dd
|
fix(stream): disable the checkpoint-info-update for tasks in non-checkpoint status
|
2024-06-25 12:57:50 +08:00 |
|
Yihao Deng
|
7cab27110a
|
add self check info
|
2024-06-24 12:26:10 +00:00 |
|
Haojun Liao
|
6b0b65527f
|
fix(stream): do update the checkpoint info if not in checkpoint status.
|
2024-06-24 19:18:31 +08:00 |
|
Haojun Liao
|
393369fcd8
|
fix(stream):clear checkpoint-ready msg.
|
2024-06-23 00:40:12 +08:00 |
|
Haojun Liao
|
21e1763ff4
|
fix(stream): set correct flag for checkpoint.
|
2024-06-22 11:16:20 +08:00 |
|
Haojun Liao
|
94f3c6ec2d
|
fix(stream): fix deadlock
|
2024-06-21 23:40:03 +08:00 |
|
Haojun Liao
|
5a9500055d
|
fix(stream): check the task status checkpoint-ready msg send timer.
|
2024-06-21 18:44:54 +08:00 |
|
Haojun Liao
|
5966b4f83f
|
fix(stream): fix error in assert.
|
2024-06-21 17:17:39 +08:00 |
|
Haojun Liao
|
53f9af06ff
|
fix(stream): fix invalid write.
|
2024-06-21 15:44:38 +08:00 |
|
Haojun Liao
|
119001e30b
|
fix(stream): update the retrieve checkpoint-trigger msg.
|
2024-06-21 15:11:48 +08:00 |
|
Haojun Liao
|
aea4254d40
|
fix(stream): async start task.
|
2024-06-21 10:37:06 +08:00 |
|
Haojun Liao
|
f8578b4a69
|
fix(stream): fix syntax error.
|
2024-06-21 09:34:18 +08:00 |
|
Haojun Liao
|
2cb9644471
|
fix(stream): update the checkpoint info only when the status is normal.
|
2024-06-21 09:23:29 +08:00 |
|
Haojun Liao
|
8fd9baf6f5
|
fix(stream):synchronized upload checkpoint data to snode.
|
2024-06-21 09:11:16 +08:00 |
|
Haojun Liao
|
d06e1549f1
|
fix(stream): add fill-history task id in msg.
|
2024-06-12 15:27:19 +08:00 |
|
Haojun Liao
|
a41a04dc37
|
fix(stream): remove the related history task correctly.
|
2024-06-11 18:35:59 +08:00 |
|
Haojun Liao
|
00eb621825
|
fix(stream): do scan checkpoint-report in write queue.
|
2024-06-11 14:09:50 +08:00 |
|
Haojun Liao
|
cbf8b363fc
|
fix(stream): update checkpoint info by using trans.
|
2024-06-10 00:46:01 +08:00 |
|
Haojun Liao
|
c4447d6873
|
fix(stream): flush executor state for those with only one task for a stream.
|
2024-06-07 12:44:38 +08:00 |
|
Haojun Liao
|
88e77d6bc6
|
fix(stream): remove expired stream in buf.
|
2024-06-06 23:54:48 +08:00 |
|
Haojun Liao
|
420cbc36e5
|
other: fix syntax error.
|
2024-06-06 17:40:17 +08:00 |
|
Haojun Liao
|
52e090634e
|
fix(stream): transfer state before send checkpoint-trigger msg to downstream tasks.
|
2024-06-06 17:21:23 +08:00 |
|
Haojun Liao
|
29d34200b5
|
other: fix coverity issues.
|
2024-06-05 13:39:46 +08:00 |
|
Haojun Liao
|
407f79cfa6
|
fix(stream): fix dead-lock.
|
2024-06-03 19:14:45 +08:00 |
|
Haojun Liao
|
3b3ed1c30c
|
fix(stream): add monitor for checkpoint-ready msg recv status.
|
2024-06-03 16:45:37 +08:00 |
|
Haojun Liao
|
31317c4895
|
fix(stream): set the checkpoint ready info for only one task in stream.
|
2024-06-01 23:20:43 +08:00 |
|
Haojun Liao
|
2a8270f9c8
|
fix(stream): track the checkpoint-ready msg on the upstream tasks.
|
2024-06-01 18:26:45 +08:00 |
|
Haojun Liao
|
76b43dc072
|
fix(stream): 1. check the checkpoint-trigger rsp, 2. set the error code in the message body, 3. follower nodes not handle the checkpoint-trigger retrieve request.
|
2024-05-31 14:32:55 +08:00 |
|
Haojun Liao
|
becc4cb368
|
enh(stream): limit the concurrent started checkpoint tasks.
|
2024-05-29 19:29:26 +08:00 |
|
Haojun Liao
|
46ca55ac74
|
fix(stream): avoid deadlock.
|
2024-05-29 15:20:35 +08:00 |
|
Haojun Liao
|
27ac6ca16e
|
fix(stream): desc the ref for checkpoint-trigger timer.
|
2024-05-29 14:12:14 +08:00 |
|
Haojun Liao
|
09efbad117
|
fix(stream): drop related fill history task.
|
2024-05-29 11:16:26 +08:00 |
|
Haojun Liao
|
a9abe78eab
|
other: comment invalid sleep for test purpose
|
2024-05-29 09:16:37 +08:00 |
|
Haojun Liao
|
225dfb1a93
|
enh(stream): check checkpoint-trigger msg every 100ms.
|
2024-05-29 00:30:42 +08:00 |
|
Haojun Liao
|
d1d868f239
|
refactor: do some internal refactor and set the pActiveInfo for rsma.
|
2024-05-29 00:08:29 +08:00 |
|
Haojun Liao
|
8d54d45054
|
fix(stream): fix error found by CI.
|
2024-05-28 17:30:14 +08:00 |
|
Haojun Liao
|
be107b204c
|
enh(stream): support retrieve checkpoint data remotely when start stream tasks in vnodes.
|
2024-05-28 09:54:22 +08:00 |
|
Haojun Liao
|
6898eba6ed
|
fix(stream): expand stream tasks are divided into two phase, the first is to build stream task and then expand stream task before start stream tasks.
|
2024-05-14 14:34:31 +08:00 |
|
Haojun Liao
|
fb248b2682
|
fix(stream): not save the stream task for rsma.
|
2024-05-13 17:26:39 +08:00 |
|
Haojun Liao
|
3dfffe9113
|
fix(stream): async load and start stream tasks.
|
2024-05-13 15:31:26 +08:00 |
|
Haojun Liao
|
370c255128
|
refactor: do some internal refactor.
|
2024-05-11 10:27:55 +08:00 |
|
Haojun Liao
|
11ed1f54b3
|
refactor: do some internal refactor.
|
2024-05-11 10:09:23 +08:00 |
|
Haojun Liao
|
7f93ec2c53
|
fix(stream): update the checkpoint info for followers, and some internal refactor.
|
2024-05-11 09:37:02 +08:00 |
|
Haojun Liao
|
6693efaa85
|
refactor: do some internal refactor.
|
2024-05-09 10:11:37 +08:00 |
|
Haojun Liao
|
9ce8f6953d
|
refactor: do some internal refactor.
|
2024-05-08 13:52:20 +08:00 |
|
Haojun Liao
|
18c66a5491
|
refactor: do some internal refactor.
|
2024-05-06 18:17:38 +08:00 |
|
Haojun Liao
|
7ad7ef7cfc
|
refactor: do some internal refactor.
|
2024-05-06 17:03:41 +08:00 |
|
Haojun Liao
|
94a0f9ab8f
|
other: merge 3.0
|
2024-04-30 17:12:46 +08:00 |
|
Haojun Liao
|
629502e12e
|
refactor: do some internal refactor.
|
2024-04-30 17:00:51 +08:00 |
|
Yihao Deng
|
3fd6770c81
|
avoid invalid read
|
2024-04-29 05:52:54 +00:00 |
|
Yihao Deng
|
b54198ba4a
|
avoid invalid read
|
2024-04-29 03:18:38 +00:00 |
|
Yihao Deng
|
97aadd3aa7
|
avoid invalid read
|
2024-04-29 03:17:33 +00:00 |
|
Yihao Deng
|
2beb46c9df
|
Merge branch '3.0' into fix/TD-29844
|
2024-04-29 01:27:20 +00:00 |
|
Yihao Deng
|
9e19c52924
|
Remove unnecessary memory free in uploadCheckpointData function
|
2024-04-28 06:50:54 +00:00 |
|
Yihao Deng
|
fac8530580
|
fix invalid read
|
2024-04-28 06:50:33 +00:00 |
|
Yihao Deng
|
af567ea2cb
|
fix invalid read
|
2024-04-28 06:47:31 +00:00 |
|
Haojun Liao
|
b2d8260f14
|
refactor: do some internal refactor.
|
2024-04-28 10:05:22 +08:00 |
|
Haojun Liao
|
8adaeb59a3
|
refactor: do some internal refactor.
|
2024-04-28 09:50:21 +08:00 |
|
Haojun Liao
|
8b53f76691
|
fix(stream): discard the repeatly recv checkpoint-source msg.
|
2024-04-26 15:56:34 +08:00 |
|
Haojun Liao
|
d1ecfe5cf3
|
refactor: do some internal refactor.
|
2024-04-25 14:24:20 +08:00 |
|
Haojun Liao
|
82cde46614
|
fix(stream): fix memory leak.
|
2024-04-23 19:48:50 +08:00 |
|
Haojun Liao
|
e7dee4ac63
|
refactor(stream): refactor check msg retry procedure and be tolerant to the dnode disconnection during check downstream tasks.
|
2024-04-18 15:55:21 +08:00 |
|
Haojun Liao
|
665107ad3a
|
enh(stream): add more info in meta table.
|
2024-04-15 14:23:37 +08:00 |
|
Haojun Liao
|
9ca84091df
|
fix(stream): reset the ready upstream counter after task-reset.
|
2024-04-01 16:31:10 +08:00 |
|
Haojun Liao
|
cc0b32b1f8
|
fix(stream): transfer state before do checkpoint, to avoid the retrieve and deadlock by using waiting .
|
2024-03-14 16:13:41 +08:00 |
54liuyao
|
0e8170de49
|
remove invalid code
|
2024-02-20 10:17:47 +08:00 |
|
Haojun Liao
|
2bba011e4e
|
Merge remote-tracking branch 'origin/feat/TD-22023' into feat/TD-22023
|
2024-02-05 17:51:23 +08:00 |
|
Haojun Liao
|
7a18e5910c
|
enh(stream): halt the initial stream tasks when fill-history is set for count window agg
|
2024-02-05 17:51:09 +08:00 |
|
Haojun Liao
|
3236ef7bae
|
feat(stream): return the stream source task exec delay, and do some internal refactor.
|
2024-02-02 11:26:47 +08:00 |
|
Haojun Liao
|
87e543c824
|
fix(stream): pass down the transId of checkpoint, to make sure the downstream task can report the error transId successfully.
|
2024-02-01 17:14:36 +08:00 |
|
Haojun Liao
|
3751e11394
|
fix(stream): fix dead lock.
|
2024-01-25 17:11:16 +08:00 |
|
Haojun Liao
|
8a7e38ad15
|
fix(stream): fix checkpoint failure check.
|
2024-01-24 13:10:53 +08:00 |
|
Haojun Liao
|
d973f66cea
|
fix(stream): do checkpoint after fill-history task completed.
|
2024-01-19 16:18:02 +08:00 |
|
Haojun Liao
|
76e6c453e7
|
enh(stream): send msg to mnode when the transferring state completed.
|
2024-01-18 15:43:36 +08:00 |
|
Haojun Liao
|
8ede6d87ce
|
refactor: do some internal refactor.
|
2024-01-16 15:40:40 +08:00 |
|
Haojun Liao
|
63494de7f9
|
refactor: do some internal refactor.
|
2024-01-16 10:28:07 +08:00 |
|
Haojun Liao
|
cacbb4e369
|
fix(stream): save the checkpoint info for sink tasks.
|
2024-01-15 17:40:35 +08:00 |
|
Haojun Liao
|
d46b5e6c9a
|
fix(stream): enable sink tasks handle the checkpoint.
|
2024-01-15 09:53:15 +08:00 |
|
Haojun Liao
|
ce855bc493
|
refactor: do some internal refactor.
|
2024-01-15 09:21:31 +08:00 |
|
Haojun Liao
|
9703018f56
|
fix(stream): add checkpoint status check.
|
2024-01-11 16:47:51 +08:00 |
|
Haojun Liao
|
6d37e596ec
|
refactor: do some internal refactor.
|
2024-01-04 18:47:49 +08:00 |
|
Haojun Liao
|
cd85dae3fd
|
fix(stream): fix the dead lock.
|
2023-12-24 23:30:00 +08:00 |
|
Haojun Liao
|
84583580e2
|
fix(stream): transfer the checkpoint trans id.
|
2023-12-21 19:12:49 +08:00 |
|
Haojun Liao
|
8a8ddf5699
|
fix(stream): record the checkpoint failure when nodeEp changed.
|
2023-12-21 10:30:44 +08:00 |
yihaoDeng
|
d8093d9f21
|
not do chkp when pbackend not inited
|
2023-12-15 11:47:44 +08:00 |
|
yihaoDeng
|
5189f3d15b
|
not do chkp when pbackend not inited
|
2023-12-15 09:18:37 +08:00 |
Minglei Jin
|
49ecb1093f
|
cos/put: new arg withcp to control resumable uploading
|
2023-11-30 17:20:21 +08:00 |