Haojun Liao
|
7ccc273206
|
other: merge stream fix in main.
|
2023-10-09 20:05:29 +08:00 |
|
Haojun Liao
|
98ef566eb4
|
fix(stream): remove fill-history sink task.
|
2023-10-09 20:04:17 +08:00 |
|
Haojun Liao
|
e84eeee6b8
|
refactor: do some internal refactor.
|
2023-10-09 20:04:17 +08:00 |
|
Haojun Liao
|
6fa54789cb
|
fix(stream): disable follower send hb to mnode. and do some internal refactor.
|
2023-10-09 19:59:31 +08:00 |
|
Haojun Liao
|
1256eafddb
|
other: merge stream fix.
|
2023-10-09 19:59:24 +08:00 |
|
Haojun Liao
|
aaa12ed4f8
|
refactor: do some internal refactor about the sched status set
|
2023-10-09 19:56:17 +08:00 |
|
Haojun Liao
|
f6a097d96f
|
refactor: do some internal refactor.
|
2023-09-12 21:58:22 +08:00 |
|
Haojun Liao
|
e457d94ac6
|
refactor: do some internal refactor.
|
2023-09-12 18:09:02 +08:00 |
|
Haojun Liao
|
85a5c45098
|
fix(stream): limit the already processed data.
|
2023-09-10 00:01:25 +08:00 |
|
Haojun Liao
|
b317c8ebff
|
fix(stream): disable merge submit blocks.
|
2023-09-08 12:46:15 +08:00 |
|
Haojun Liao
|
b240e91c91
|
enh(stream): add token bucket to limit the rate of sink operation.
|
2023-09-07 09:58:48 +08:00 |
|
Haojun Liao
|
8edf86b3bb
|
fix(stream): add some logs.
|
2023-09-06 19:08:09 +08:00 |
|
Haojun Liao
|
8783ebcb02
|
enh(stream): add some logs and record the submit package performance.
|
2023-09-06 14:34:36 +08:00 |
|
Haojun Liao
|
aeea699c9c
|
Merge branch '3.0' into fix/3_liaohj
|
2023-09-04 15:53:39 +08:00 |
|
Haojun Liao
|
037a232bfa
|
refactor: do some internal refactor.
|
2023-09-01 17:05:36 +08:00 |
Haojun Liao
|
e816d0efa5
|
Merge pull request #22669 from taosdata/fix/TD-26069
fix invalid insert
|
2023-08-31 18:29:25 +08:00 |
yihaoDeng
|
1833be028f
|
fix invalid insert
|
2023-08-31 15:28:31 +08:00 |
|
Haojun Liao
|
e2bb64eb18
|
refactor: do some internal refactor.
|
2023-08-31 14:23:46 +08:00 |
|
Haojun Liao
|
69f95f9324
|
other: merge 3.0
|
2023-08-31 13:56:34 +08:00 |
|
Haojun Liao
|
2285b834b0
|
refactor: do some internal refactor.
|
2023-08-31 13:53:12 +08:00 |
|
Haojun Liao
|
3fc3dafca6
|
refactor: do some internal refactor.
|
2023-08-31 13:46:48 +08:00 |
|
Haojun Liao
|
3ed78ddadd
|
Merge pull request #22662 from taosdata/fix/3_liaohj
refactor: do some internal refactor.
|
2023-08-31 13:46:14 +08:00 |
|
Haojun Liao
|
8645f763b5
|
Merge pull request #22661 from taosdata/enh/reserve
stream change ver
|
2023-08-31 13:35:23 +08:00 |
|
yihaoDeng
|
83a5e2be4c
|
stream change ver
|
2023-08-31 11:42:12 +08:00 |
|
Haojun Liao
|
e53b5d4392
|
refactor: do some internal refactor.
|
2023-08-31 11:01:53 +08:00 |
|
yihaoDeng
|
05ca71d5de
|
stream change ver
|
2023-08-31 09:28:43 +08:00 |
|
Haojun Liao
|
d99d8875e1
|
fix(stream): if stream task is running, do not recheck its status.
|
2023-08-30 17:24:13 +08:00 |
liuyao
|
0a72e576bd
|
op stream pause
pause data dispatch
opt stream pause
|
2023-08-30 14:53:49 +08:00 |
|
Haojun Liao
|
3a7a220d43
|
fix(stream): fix error found by ci.
|
2023-08-30 10:14:01 +08:00 |
|
Haojun Liao
|
204fb97f68
|
fix(stream): fix error in snode, fix memory leaks, fix repeatly create bug in sink task.
|
2023-08-29 17:34:31 +08:00 |
|
Haojun Liao
|
391103bc5a
|
fix(stream): do dome internal refactor.
|
2023-08-28 15:54:01 +08:00 |
|
Haojun Liao
|
b75ae217f6
|
fix(stream): notify close for snode.
|
2023-08-28 09:53:08 +08:00 |
|
yihaoDeng
|
998dac0ffb
|
fix mem leak
|
2023-08-26 21:54:36 +08:00 |
|
yihaoDeng
|
7d237d4310
|
fix UAF
|
2023-08-26 17:37:09 +08:00 |
|
Haojun Liao
|
60d1df0e25
|
Merge branch '3.0' into enh/triggerCheckPoint2
|
2023-08-25 15:49:28 +08:00 |
|
Haojun Liao
|
ce1a3a379c
|
fix(stream): handle the case when the task not in ready state, and the checkpoint msg arrived.
|
2023-08-25 10:12:12 +08:00 |
|
Haojun Liao
|
70396aa5a5
|
fix(stream): wakeup the hb timer every 200ms, to speeup the close db procedure.
|
2023-08-24 17:54:50 +08:00 |
|
Haojun Liao
|
af80d94a88
|
refactor: do some internal refactor.
|
2023-08-22 15:43:50 +08:00 |
|
Haojun Liao
|
cc8b2263cb
|
fix(stream): fix error in heartbeat from vnode.
|
2023-08-22 13:37:38 +08:00 |
|
Haojun Liao
|
def0877980
|
fix(stream): add timer to check stream task status.
|
2023-08-22 10:46:49 +08:00 |
|
Haojun Liao
|
b8101afbe2
|
fix(stream): refactor the tasks restart mechanism.
|
2023-08-18 22:36:38 +08:00 |
|
Haojun Liao
|
4b10393c81
|
fix(stream): fix memory leak and do some internal refactor.
|
2023-08-18 18:02:08 +08:00 |
|
Haojun Liao
|
6746339609
|
Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2
# Conflicts:
# source/libs/stream/src/streamSnapshot.c
|
2023-08-17 00:08:44 +08:00 |
|
Haojun Liao
|
ea6574b3c7
|
other: merge 3.0
|
2023-08-17 00:07:55 +08:00 |
yihaoDeng
|
ab7e2b3122
|
Merge branch 'enh/chkpTransfer' into enh/triggerCheckPoint2
|
2023-08-16 09:00:30 +00:00 |
|
Haojun Liao
|
d63758a1c5
|
fix(stream): fix error in execute task on a tranferred node.
|
2023-08-16 15:24:24 +08:00 |
|
Haojun Liao
|
39079ab64a
|
fix(stream): load term from sync model to decide if the node is restart or not
|
2023-08-15 15:52:06 +08:00 |
|
Haojun Liao
|
b1d35f43ba
|
enh(stream): using term from sync module to denote the upstream node is restarted/replica-modified/vnode-transferred or not.
|
2023-08-15 09:25:05 +08:00 |
|
Haojun Liao
|
e8c9a019a4
|
fix(stream): remove the invalid set of scheduler status.
|
2023-08-14 11:41:24 +08:00 |
|
Haojun Liao
|
0d38f389ab
|
refactor: do some internal refactor.
|
2023-08-13 16:25:35 +08:00 |
|
Haojun Liao
|
afe9b848a5
|
fix(tsdb): check the
|
2023-08-12 18:54:39 +08:00 |
|
Haojun Liao
|
09da6c6840
|
refactor: do some internal refactor.
|
2023-08-12 18:51:20 +08:00 |
|
Haojun Liao
|
75e6fb0f16
|
refactor: do some internal refactor.
|
2023-08-12 18:47:01 +08:00 |
|
Haojun Liao
|
8f9de93cf0
|
refactor: do some internal refactor.
|
2023-08-12 18:37:36 +08:00 |
|
Haojun Liao
|
ce721a0146
|
fix(stream): fix error.
|
2023-08-12 16:32:05 +08:00 |
|
Haojun Liao
|
a89ce1a20b
|
fix(stream): transfer state by using data block.
|
2023-08-12 01:24:07 +08:00 |
|
yihaoDeng
|
6e6eb05d5c
|
Merge branch 'enh/triggerCheckPoint2' into enh/chkpTransfer
|
2023-08-11 08:03:02 +00:00 |
|
Haojun Liao
|
e984affe90
|
fix(stream): disable the stream in the followers nodes.
|
2023-08-11 15:58:15 +08:00 |
|
yihaoDeng
|
99be2836b2
|
Merge branch 'enh/triggerCheckPoint2' into enh/chkpTransfer
|
2023-08-11 02:50:12 +00:00 |
|
Haojun Liao
|
6a9826cf6e
|
enh(stream): update the stream task epset.
|
2023-08-11 10:37:25 +08:00 |
|
yihaoDeng
|
ba4ce9db02
|
Merge branch 'enh/triggerCheckPoint2' into enh/chkpTransfer
|
2023-08-11 02:15:07 +00:00 |
|
Haojun Liao
|
f633c7fe2b
|
other: merge 3.0.
|
2023-08-10 11:56:30 +08:00 |
|
yihaoDeng
|
ef247cdb1d
|
support reopen stream state
|
2023-08-10 01:49:26 +00:00 |
|
Haojun Liao
|
1e8579e8c5
|
fix(stream): fix other cases.
|
2023-08-09 16:04:48 +08:00 |
|
Haojun Liao
|
4c92997328
|
fix(stream): use streamId&taskId to identify the stream task in the stream meta.
|
2023-08-09 15:52:23 +08:00 |
|
Haojun Liao
|
f3c5f20ee2
|
enh(stream): add timer to check the node changing.
|
2023-08-09 10:25:16 +08:00 |
|
Haojun Liao
|
af3a87560a
|
refactor: do some refactor.
|
2023-08-08 09:11:41 +08:00 |
|
yihaoDeng
|
b6c991f896
|
support reopen stream state
|
2023-08-07 08:59:04 +00:00 |
|
yihaoDeng
|
eeb97351e8
|
support reopen stream state
|
2023-08-07 08:51:01 +00:00 |
|
Haojun Liao
|
225c0e61dc
|
hen(stream): support the rollback and checkdown stream tasks.
|
2023-08-07 16:13:39 +08:00 |
|
Haojun Liao
|
8a11a0418f
|
other: merge 3.0
|
2023-08-07 09:19:26 +08:00 |
|
yihaoDeng
|
6dc93a8dec
|
add stream ver
|
2023-08-04 13:52:20 +08:00 |
|
yihaoDeng
|
f9d0874e45
|
support reopen stream state
|
2023-08-03 08:24:50 +00:00 |
|
Haojun Liao
|
13543f7daa
|
feature(stream): handle task update in tq module.
|
2023-08-02 10:33:41 +08:00 |
|
Haojun Liao
|
ad4c5916e7
|
enh(stream): update the stream task.
|
2023-08-01 18:14:58 +08:00 |
|
Haojun Liao
|
164bfd5408
|
enh(stream): prepare update trans.
|
2023-08-01 16:12:35 +08:00 |
|
Haojun Liao
|
75b1520be0
|
enh(stream): create task update info
|
2023-08-01 14:04:07 +08:00 |
|
Haojun Liao
|
f6ae9cf9bb
|
fix(stream): fetch all data before paused and dump to sink node.
|
2023-08-01 10:16:14 +08:00 |
|
Haojun Liao
|
d45596bb33
|
fix(stream): kill task when pause the stream execution.
|
2023-07-31 18:07:37 +08:00 |
|
Haojun Liao
|
9981cecbed
|
refactor: do some internal refactor.
|
2023-07-31 15:24:35 +08:00 |
|
Haojun Liao
|
e61aa83594
|
enh(stream): handle the stream hb.
|
2023-07-31 14:07:18 +08:00 |
|
Haojun Liao
|
8dfef8768a
|
other: merge 3.0
|
2023-07-29 22:54:16 +08:00 |
|
Haojun Liao
|
936afeb5ac
|
refactor: do internal refactor to simple the pause/resume in case of fill history exists.
|
2023-07-28 19:13:03 +08:00 |
|
Haojun Liao
|
d5974a8f25
|
refactor(stream): refactor the pause/resume for fill history execution.
|
2023-07-28 18:05:32 +08:00 |
|
Haojun Liao
|
9f943213ed
|
enh(stream): update the hb info.
|
2023-07-28 14:23:53 +08:00 |
|
Haojun Liao
|
74834aea11
|
enh(stream): prepare hb to mnode from stream meta.
|
2023-07-28 13:07:16 +08:00 |
|
Haojun Liao
|
22a5a18fff
|
fix(stream): 1. set correct timewindow after step2. 2. handle the case when the task is failed to be added into the meta store.
|
2023-07-27 18:57:36 +08:00 |
|
Haojun Liao
|
40fe3ef4f6
|
fix(stream): refactor the step2 wal scan.
|
2023-07-27 14:49:20 +08:00 |
|
Haojun Liao
|
e89f530db2
|
fix(stream): scan wal in step2
|
2023-07-27 10:55:59 +08:00 |
|
Haojun Liao
|
728112ed89
|
fix(stream): set correct upstream epinfo.
|
2023-07-26 10:26:59 +08:00 |
|
Haojun Liao
|
1c1bf63e1f
|
other: merge 3.0
|
2023-07-25 18:17:11 +08:00 |
|
Haojun Liao
|
0bdccd2681
|
refactor: do some internal refactor.
|
2023-07-25 17:31:54 +08:00 |
|
Haojun Liao
|
a2694b9ce9
|
fix(stream): fix the invalid check of step2 .
|
2023-07-24 19:44:28 +08:00 |
|
Haojun Liao
|
1e34f84f78
|
other: merge 3.0
|
2023-07-24 15:23:03 +08:00 |
|
Haojun Liao
|
1367552f38
|
fix(stream): refactor the halt status to check more status.
|
2023-07-24 10:04:15 +08:00 |
|
Haojun Liao
|
4e0f7ffbf8
|
fix(stream): set the correct flag of pause/resume.
|
2023-07-23 18:49:56 +08:00 |
|
Haojun Liao
|
1b2636028a
|
fix(stream): fix memory leak.
|
2023-07-21 23:05:42 +08:00 |
|
Haojun Liao
|
16d7707b90
|
fix(stream): align the scan real time data for stream task.
|
2023-07-21 19:33:43 +08:00 |
|
Haojun Liao
|
db46d31ca5
|
fix(stream): refactor the halt function.
|
2023-07-21 01:32:42 +08:00 |
|
Haojun Liao
|
aed99da6c1
|
refactor: refactor the stream task starting order.
|
2023-07-20 12:14:53 +08:00 |