Haojun Liao
|
3ed78ddadd
|
Merge pull request #22662 from taosdata/fix/3_liaohj
refactor: do some internal refactor.
|
2023-08-31 13:46:14 +08:00 |
|
Haojun Liao
|
8645f763b5
|
Merge pull request #22661 from taosdata/enh/reserve
stream change ver
|
2023-08-31 13:35:23 +08:00 |
yihaoDeng
|
83a5e2be4c
|
stream change ver
|
2023-08-31 11:42:12 +08:00 |
Haojun Liao
|
e53b5d4392
|
refactor: do some internal refactor.
|
2023-08-31 11:01:53 +08:00 |
|
yihaoDeng
|
05ca71d5de
|
stream change ver
|
2023-08-31 09:28:43 +08:00 |
|
Haojun Liao
|
d99d8875e1
|
fix(stream): if stream task is running, do not recheck its status.
|
2023-08-30 17:24:13 +08:00 |
liuyao
|
0a72e576bd
|
op stream pause
pause data dispatch
opt stream pause
|
2023-08-30 14:53:49 +08:00 |
|
Haojun Liao
|
3a7a220d43
|
fix(stream): fix error found by ci.
|
2023-08-30 10:14:01 +08:00 |
|
Haojun Liao
|
204fb97f68
|
fix(stream): fix error in snode, fix memory leaks, fix repeatly create bug in sink task.
|
2023-08-29 17:34:31 +08:00 |
|
Haojun Liao
|
391103bc5a
|
fix(stream): do dome internal refactor.
|
2023-08-28 15:54:01 +08:00 |
|
Haojun Liao
|
b75ae217f6
|
fix(stream): notify close for snode.
|
2023-08-28 09:53:08 +08:00 |
|
yihaoDeng
|
998dac0ffb
|
fix mem leak
|
2023-08-26 21:54:36 +08:00 |
|
yihaoDeng
|
7d237d4310
|
fix UAF
|
2023-08-26 17:37:09 +08:00 |
|
Haojun Liao
|
60d1df0e25
|
Merge branch '3.0' into enh/triggerCheckPoint2
|
2023-08-25 15:49:28 +08:00 |
|
Haojun Liao
|
ce1a3a379c
|
fix(stream): handle the case when the task not in ready state, and the checkpoint msg arrived.
|
2023-08-25 10:12:12 +08:00 |
|
Haojun Liao
|
70396aa5a5
|
fix(stream): wakeup the hb timer every 200ms, to speeup the close db procedure.
|
2023-08-24 17:54:50 +08:00 |
|
Haojun Liao
|
af80d94a88
|
refactor: do some internal refactor.
|
2023-08-22 15:43:50 +08:00 |
|
Haojun Liao
|
cc8b2263cb
|
fix(stream): fix error in heartbeat from vnode.
|
2023-08-22 13:37:38 +08:00 |
|
Haojun Liao
|
def0877980
|
fix(stream): add timer to check stream task status.
|
2023-08-22 10:46:49 +08:00 |
|
Haojun Liao
|
b8101afbe2
|
fix(stream): refactor the tasks restart mechanism.
|
2023-08-18 22:36:38 +08:00 |
|
Haojun Liao
|
4b10393c81
|
fix(stream): fix memory leak and do some internal refactor.
|
2023-08-18 18:02:08 +08:00 |
|
Haojun Liao
|
6746339609
|
Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2
# Conflicts:
# source/libs/stream/src/streamSnapshot.c
|
2023-08-17 00:08:44 +08:00 |
|
Haojun Liao
|
ea6574b3c7
|
other: merge 3.0
|
2023-08-17 00:07:55 +08:00 |
yihaoDeng
|
ab7e2b3122
|
Merge branch 'enh/chkpTransfer' into enh/triggerCheckPoint2
|
2023-08-16 09:00:30 +00:00 |
|
Haojun Liao
|
d63758a1c5
|
fix(stream): fix error in execute task on a tranferred node.
|
2023-08-16 15:24:24 +08:00 |
|
Haojun Liao
|
39079ab64a
|
fix(stream): load term from sync model to decide if the node is restart or not
|
2023-08-15 15:52:06 +08:00 |
|
Haojun Liao
|
b1d35f43ba
|
enh(stream): using term from sync module to denote the upstream node is restarted/replica-modified/vnode-transferred or not.
|
2023-08-15 09:25:05 +08:00 |
|
Haojun Liao
|
e8c9a019a4
|
fix(stream): remove the invalid set of scheduler status.
|
2023-08-14 11:41:24 +08:00 |
|
Haojun Liao
|
0d38f389ab
|
refactor: do some internal refactor.
|
2023-08-13 16:25:35 +08:00 |
|
Haojun Liao
|
afe9b848a5
|
fix(tsdb): check the
|
2023-08-12 18:54:39 +08:00 |
|
Haojun Liao
|
09da6c6840
|
refactor: do some internal refactor.
|
2023-08-12 18:51:20 +08:00 |
|
Haojun Liao
|
75e6fb0f16
|
refactor: do some internal refactor.
|
2023-08-12 18:47:01 +08:00 |
|
Haojun Liao
|
8f9de93cf0
|
refactor: do some internal refactor.
|
2023-08-12 18:37:36 +08:00 |
|
Haojun Liao
|
ce721a0146
|
fix(stream): fix error.
|
2023-08-12 16:32:05 +08:00 |
|
Haojun Liao
|
a89ce1a20b
|
fix(stream): transfer state by using data block.
|
2023-08-12 01:24:07 +08:00 |
|
yihaoDeng
|
6e6eb05d5c
|
Merge branch 'enh/triggerCheckPoint2' into enh/chkpTransfer
|
2023-08-11 08:03:02 +00:00 |
|
Haojun Liao
|
e984affe90
|
fix(stream): disable the stream in the followers nodes.
|
2023-08-11 15:58:15 +08:00 |
|
yihaoDeng
|
99be2836b2
|
Merge branch 'enh/triggerCheckPoint2' into enh/chkpTransfer
|
2023-08-11 02:50:12 +00:00 |
|
Haojun Liao
|
6a9826cf6e
|
enh(stream): update the stream task epset.
|
2023-08-11 10:37:25 +08:00 |
|
yihaoDeng
|
ba4ce9db02
|
Merge branch 'enh/triggerCheckPoint2' into enh/chkpTransfer
|
2023-08-11 02:15:07 +00:00 |
|
Haojun Liao
|
f633c7fe2b
|
other: merge 3.0.
|
2023-08-10 11:56:30 +08:00 |
|
yihaoDeng
|
ef247cdb1d
|
support reopen stream state
|
2023-08-10 01:49:26 +00:00 |
|
Haojun Liao
|
1e8579e8c5
|
fix(stream): fix other cases.
|
2023-08-09 16:04:48 +08:00 |
|
Haojun Liao
|
4c92997328
|
fix(stream): use streamId&taskId to identify the stream task in the stream meta.
|
2023-08-09 15:52:23 +08:00 |
|
Haojun Liao
|
f3c5f20ee2
|
enh(stream): add timer to check the node changing.
|
2023-08-09 10:25:16 +08:00 |
|
Haojun Liao
|
af3a87560a
|
refactor: do some refactor.
|
2023-08-08 09:11:41 +08:00 |
|
yihaoDeng
|
b6c991f896
|
support reopen stream state
|
2023-08-07 08:59:04 +00:00 |
|
yihaoDeng
|
eeb97351e8
|
support reopen stream state
|
2023-08-07 08:51:01 +00:00 |
|
Haojun Liao
|
225c0e61dc
|
hen(stream): support the rollback and checkdown stream tasks.
|
2023-08-07 16:13:39 +08:00 |
|
Haojun Liao
|
8a11a0418f
|
other: merge 3.0
|
2023-08-07 09:19:26 +08:00 |
|
yihaoDeng
|
6dc93a8dec
|
add stream ver
|
2023-08-04 13:52:20 +08:00 |
|
yihaoDeng
|
f9d0874e45
|
support reopen stream state
|
2023-08-03 08:24:50 +00:00 |
|
Haojun Liao
|
13543f7daa
|
feature(stream): handle task update in tq module.
|
2023-08-02 10:33:41 +08:00 |
|
Haojun Liao
|
ad4c5916e7
|
enh(stream): update the stream task.
|
2023-08-01 18:14:58 +08:00 |
|
Haojun Liao
|
164bfd5408
|
enh(stream): prepare update trans.
|
2023-08-01 16:12:35 +08:00 |
|
Haojun Liao
|
75b1520be0
|
enh(stream): create task update info
|
2023-08-01 14:04:07 +08:00 |
|
Haojun Liao
|
f6ae9cf9bb
|
fix(stream): fetch all data before paused and dump to sink node.
|
2023-08-01 10:16:14 +08:00 |
|
Haojun Liao
|
d45596bb33
|
fix(stream): kill task when pause the stream execution.
|
2023-07-31 18:07:37 +08:00 |
|
Haojun Liao
|
9981cecbed
|
refactor: do some internal refactor.
|
2023-07-31 15:24:35 +08:00 |
|
Haojun Liao
|
e61aa83594
|
enh(stream): handle the stream hb.
|
2023-07-31 14:07:18 +08:00 |
|
Haojun Liao
|
8dfef8768a
|
other: merge 3.0
|
2023-07-29 22:54:16 +08:00 |
|
Haojun Liao
|
936afeb5ac
|
refactor: do internal refactor to simple the pause/resume in case of fill history exists.
|
2023-07-28 19:13:03 +08:00 |
|
Haojun Liao
|
d5974a8f25
|
refactor(stream): refactor the pause/resume for fill history execution.
|
2023-07-28 18:05:32 +08:00 |
|
Haojun Liao
|
9f943213ed
|
enh(stream): update the hb info.
|
2023-07-28 14:23:53 +08:00 |
|
Haojun Liao
|
74834aea11
|
enh(stream): prepare hb to mnode from stream meta.
|
2023-07-28 13:07:16 +08:00 |
|
Haojun Liao
|
22a5a18fff
|
fix(stream): 1. set correct timewindow after step2. 2. handle the case when the task is failed to be added into the meta store.
|
2023-07-27 18:57:36 +08:00 |
|
Haojun Liao
|
40fe3ef4f6
|
fix(stream): refactor the step2 wal scan.
|
2023-07-27 14:49:20 +08:00 |
|
Haojun Liao
|
e89f530db2
|
fix(stream): scan wal in step2
|
2023-07-27 10:55:59 +08:00 |
|
Haojun Liao
|
728112ed89
|
fix(stream): set correct upstream epinfo.
|
2023-07-26 10:26:59 +08:00 |
|
Haojun Liao
|
1c1bf63e1f
|
other: merge 3.0
|
2023-07-25 18:17:11 +08:00 |
|
Haojun Liao
|
0bdccd2681
|
refactor: do some internal refactor.
|
2023-07-25 17:31:54 +08:00 |
|
Haojun Liao
|
a2694b9ce9
|
fix(stream): fix the invalid check of step2 .
|
2023-07-24 19:44:28 +08:00 |
|
Haojun Liao
|
1e34f84f78
|
other: merge 3.0
|
2023-07-24 15:23:03 +08:00 |
|
Haojun Liao
|
1367552f38
|
fix(stream): refactor the halt status to check more status.
|
2023-07-24 10:04:15 +08:00 |
|
Haojun Liao
|
4e0f7ffbf8
|
fix(stream): set the correct flag of pause/resume.
|
2023-07-23 18:49:56 +08:00 |
|
Haojun Liao
|
1b2636028a
|
fix(stream): fix memory leak.
|
2023-07-21 23:05:42 +08:00 |
|
Haojun Liao
|
16d7707b90
|
fix(stream): align the scan real time data for stream task.
|
2023-07-21 19:33:43 +08:00 |
|
Haojun Liao
|
db46d31ca5
|
fix(stream): refactor the halt function.
|
2023-07-21 01:32:42 +08:00 |
|
Haojun Liao
|
aed99da6c1
|
refactor: refactor the stream task starting order.
|
2023-07-20 12:14:53 +08:00 |
|
yihaoDeng
|
6e5be0d30e
|
fix stream state transfer
|
2023-07-20 03:49:32 +00:00 |
|
Haojun Liao
|
97c44e7c18
|
refactor: do some internal refactor.
|
2023-07-19 18:42:02 +08:00 |
|
Haojun Liao
|
2ae95217bd
|
fix(stream): open inputQ by default for task deployed on snode.
|
2023-07-19 10:05:35 +08:00 |
|
Haojun Liao
|
d2c875e774
|
Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2
|
2023-07-18 15:19:09 +08:00 |
|
Haojun Liao
|
901b7d8ecc
|
fix(stream): if a source task is set to be non-normal, no data should be put into inputQ anymore.
|
2023-07-18 15:18:57 +08:00 |
|
yihaoDeng
|
40d59990d8
|
fix mem leak
|
2023-07-18 04:01:20 +00:00 |
|
Haojun Liao
|
08f43b9d00
|
fix(stream): fix checkpoint block not fetched bug.
|
2023-07-17 15:31:54 +08:00 |
|
Haojun Liao
|
b2a905bd91
|
Merge branch '3.0' into enh/triggerCheckPoint2
|
2023-07-17 11:50:12 +08:00 |
|
Haojun Liao
|
a9757637d9
|
Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2
|
2023-07-16 12:47:24 +08:00 |
|
Haojun Liao
|
c6a322e0ef
|
refactor(stream): back pressure is active, which is trigger by dispatch rsp.
|
2023-07-16 12:47:08 +08:00 |
|
yihaoDeng
|
e18c9ea672
|
add checkpoint
|
2023-07-15 04:26:34 +00:00 |
|
yihaoDeng
|
ed931c1100
|
Merge branch 'fix/newCheckpoint' into enh/triggerCheckPoint2
|
2023-07-14 10:11:20 +00:00 |
|
yihaoDeng
|
3c4631ef1f
|
add checkpoint
|
2023-07-14 10:06:24 +00:00 |
|
Haojun Liao
|
2b85ea62aa
|
refactor: do some internal refactor.
|
2023-07-14 17:48:47 +08:00 |
|
Haojun Liao
|
eb7e6152ae
|
refactor(stream): do some internal refactor.
|
2023-07-14 17:21:20 +08:00 |
|
Haojun Liao
|
813f4cb363
|
refactor: do some internal refactor.
|
2023-07-13 16:32:25 +08:00 |
|
Haojun Liao
|
2f90a53548
|
fix(stream): set checkpoint id when expanding task.
|
2023-07-13 10:16:57 +08:00 |
|
Haojun Liao
|
fed3803739
|
fix(stream): fix memory leak.
|
2023-07-11 19:29:52 +08:00 |
|
Haojun Liao
|
09b764494d
|
fix(stream): set correct checkpoint version when starting stream tasks.
|
2023-07-11 14:03:43 +08:00 |
|
Haojun Liao
|
87bedef2cd
|
fix(stream): fix error in checkpointing.
|
2023-07-10 19:20:05 +08:00 |
|
Haojun Liao
|
4f534ce6e9
|
fix(stream): fix error in generating checkpoint.
|
2023-07-08 10:29:09 +08:00 |