Haojun Liao
|
f24b22000f
|
enh(stream): stop stream task before redistribute vnodes.
|
2023-08-11 23:46:53 +08:00 |
|
Haojun Liao
|
8890fa5781
|
fix(stream): execute the stream task directly, instead of executing it in a asynchronized way.
|
2023-08-10 15:13:49 +08:00 |
|
Haojun Liao
|
f633c7fe2b
|
other: merge 3.0.
|
2023-08-10 11:56:30 +08:00 |
|
Haojun Liao
|
d34b9af054
|
enh(stream): create update stream trans.
|
2023-08-09 19:38:13 +08:00 |
|
Haojun Liao
|
1e8579e8c5
|
fix(stream): fix other cases.
|
2023-08-09 16:04:48 +08:00 |
|
Haojun Liao
|
4c92997328
|
fix(stream): use streamId&taskId to identify the stream task in the stream meta.
|
2023-08-09 15:52:23 +08:00 |
|
Haojun Liao
|
17c6143471
|
fix(stream): check more status when handling the state transfer.
|
2023-08-08 15:08:11 +08:00 |
|
Haojun Liao
|
db8ce3de3b
|
other: merge main.
|
2023-08-08 10:17:51 +08:00 |
|
Haojun Liao
|
d6d63ec54c
|
fix(stream): add more check.
|
2023-08-08 09:54:49 +08:00 |
|
Haojun Liao
|
e89d3c18d6
|
fix(stream): remove invalid check.
|
2023-08-08 09:54:46 +08:00 |
|
Haojun Liao
|
ac00e1d520
|
fix(stream): fetch all data before paused and dump to sink node.
|
2023-08-08 09:54:43 +08:00 |
|
Haojun Liao
|
0e3fd5277d
|
fix(stream): dump results to sink node before paused.
|
2023-08-08 09:54:39 +08:00 |
|
Haojun Liao
|
1e680d4df1
|
fix(stream): ignore the sink task transfer state.
|
2023-08-08 09:52:19 +08:00 |
|
Haojun Liao
|
3bcc7ed83e
|
fix(stream): transfer the state for agg tasks.
|
2023-08-08 09:52:04 +08:00 |
|
Haojun Liao
|
d43cb3fcdf
|
fix(stream): kill task when pause the stream execution.
|
2023-08-08 09:51:21 +08:00 |
|
Haojun Liao
|
ca2183acfd
|
refactor: do some internal refactor.
|
2023-08-08 09:50:40 +08:00 |
|
Haojun Liao
|
51e0b903b0
|
refactor: do some internal refactor.
|
2023-08-08 09:36:42 +08:00 |
|
Haojun Liao
|
225c0e61dc
|
hen(stream): support the rollback and checkdown stream tasks.
|
2023-08-07 16:13:39 +08:00 |
|
Haojun Liao
|
8a11a0418f
|
other: merge 3.0
|
2023-08-07 09:19:26 +08:00 |
liuyao
|
9cb481dd6e
|
use stream task
|
2023-08-04 11:01:36 +08:00 |
|
liuyao
|
3464979489
|
set dummy delete data request
|
2023-08-03 09:03:48 +08:00 |
|
liuyao
|
71b000f08c
|
reload state window state
|
2023-08-01 18:22:40 +08:00 |
|
Haojun Liao
|
f1e0e64918
|
fix(stream): add more check.
|
2023-08-01 14:31:41 +08:00 |
|
Haojun Liao
|
e11cda17c0
|
fix(stream): remove invalid check.
|
2023-08-01 10:30:24 +08:00 |
|
Haojun Liao
|
f6ae9cf9bb
|
fix(stream): fetch all data before paused and dump to sink node.
|
2023-08-01 10:16:14 +08:00 |
|
Haojun Liao
|
b83860372c
|
fix(stream): dump results to sink node before paused.
|
2023-08-01 00:50:30 +08:00 |
|
Haojun Liao
|
8c1c17e31e
|
fix(stream): ignore the sink task transfer state.
|
2023-07-31 19:23:53 +08:00 |
|
Haojun Liao
|
d72580dad7
|
fix(stream): transfer the state for agg tasks.
|
2023-07-31 19:12:23 +08:00 |
|
Haojun Liao
|
d45596bb33
|
fix(stream): kill task when pause the stream execution.
|
2023-07-31 18:07:37 +08:00 |
|
Haojun Liao
|
9981cecbed
|
refactor: do some internal refactor.
|
2023-07-31 15:24:35 +08:00 |
|
Haojun Liao
|
8dfef8768a
|
other: merge 3.0
|
2023-07-29 22:54:16 +08:00 |
|
Haojun Liao
|
6c9fa4d7c8
|
fix(stream): check for pause when handling the fill history data.
|
2023-07-28 19:58:52 +08:00 |
|
Haojun Liao
|
936afeb5ac
|
refactor: do internal refactor to simple the pause/resume in case of fill history exists.
|
2023-07-28 19:13:03 +08:00 |
|
Haojun Liao
|
d5974a8f25
|
refactor(stream): refactor the pause/resume for fill history execution.
|
2023-07-28 18:05:32 +08:00 |
|
Haojun Liao
|
6ff50d4eaf
|
fix(stream): update the step2 scan wal files.
|
2023-07-27 16:10:55 +08:00 |
|
Haojun Liao
|
40fe3ef4f6
|
fix(stream): refactor the step2 wal scan.
|
2023-07-27 14:49:20 +08:00 |
|
Haojun Liao
|
e89f530db2
|
fix(stream): scan wal in step2
|
2023-07-27 10:55:59 +08:00 |
|
Haojun Liao
|
cdffabcdad
|
fix(stream): fix memory leak.
|
2023-07-26 14:37:04 +08:00 |
|
Haojun Liao
|
12986ff594
|
fix(stream): fix memory leaks.
|
2023-07-26 09:25:30 +08:00 |
|
Haojun Liao
|
1c1bf63e1f
|
other: merge 3.0
|
2023-07-25 18:17:11 +08:00 |
|
Haojun Liao
|
0bdccd2681
|
refactor: do some internal refactor.
|
2023-07-25 17:31:54 +08:00 |
|
Haojun Liao
|
d29f835a63
|
fix(stream): set the correct step2 scan time window range.
|
2023-07-25 15:09:22 +08:00 |
|
Haojun Liao
|
1e34f84f78
|
other: merge 3.0
|
2023-07-24 15:23:03 +08:00 |
|
Haojun Liao
|
9bae91bcba
|
fix(stream): add some logs, and remove the invalid loop.
|
2023-07-24 13:37:44 +08:00 |
|
Haojun Liao
|
1367552f38
|
fix(stream): refactor the halt status to check more status.
|
2023-07-24 10:04:15 +08:00 |
|
Haojun Liao
|
e387b2f932
|
refactor: do some internal refactor.
|
2023-07-23 18:59:34 +08:00 |
|
Haojun Liao
|
4e0f7ffbf8
|
fix(stream): set the correct flag of pause/resume.
|
2023-07-23 18:49:56 +08:00 |
|
Haojun Liao
|
db46d31ca5
|
fix(stream): refactor the halt function.
|
2023-07-21 01:32:42 +08:00 |
|
Haojun Liao
|
c9fa170e65
|
refactor: do some internal refactor.
|
2023-07-20 16:31:46 +08:00 |
|
Haojun Liao
|
97c44e7c18
|
refactor: do some internal refactor.
|
2023-07-19 18:42:02 +08:00 |
|
Haojun Liao
|
902f9d1f94
|
fix(stream): set not-ready initial value.
|
2023-07-18 18:29:35 +08:00 |
|
Haojun Liao
|
901b7d8ecc
|
fix(stream): if a source task is set to be non-normal, no data should be put into inputQ anymore.
|
2023-07-18 15:18:57 +08:00 |
|
Haojun Liao
|
92106312d2
|
fix(stream): not dispatch checkpoint block result to downstream.
|
2023-07-18 09:43:38 +08:00 |
|
Haojun Liao
|
08f43b9d00
|
fix(stream): fix checkpoint block not fetched bug.
|
2023-07-17 15:31:54 +08:00 |
|
Haojun Liao
|
d7f7a7d6cf
|
fix(stream): fix syntax error
|
2023-07-17 12:53:36 +08:00 |
Haojun Liao
|
b2a905bd91
|
Merge branch '3.0' into enh/triggerCheckPoint2
|
2023-07-17 11:50:12 +08:00 |
|
Haojun Liao
|
c6a322e0ef
|
refactor(stream): back pressure is active, which is trigger by dispatch rsp.
|
2023-07-16 12:47:08 +08:00 |
|
Haojun Liao
|
725db16af9
|
fix(stream): set save checkpoint ver.
|
2023-07-14 19:47:19 +08:00 |
|
Haojun Liao
|
eb7e6152ae
|
refactor(stream): do some internal refactor.
|
2023-07-14 17:21:20 +08:00 |
|
Haojun Liao
|
e0ea0f2df4
|
Merge pull request #22020 from taosdata/fix/liaohj
other: merge main
|
2023-07-13 17:55:28 +08:00 |
|
Haojun Liao
|
2f90a53548
|
fix(stream): set checkpoint id when expanding task.
|
2023-07-13 10:16:57 +08:00 |
|
Haojun Liao
|
08a4fb06ae
|
fix(stream): dispatch checkpoint msg to downstream by puting message into input queue.
|
2023-07-13 09:17:20 +08:00 |
|
Haojun Liao
|
9484f3da94
|
Merge branch '3.0' into enh/triggerCheckPoint2
|
2023-07-12 10:20:18 +08:00 |
|
Haojun Liao
|
a049e310f6
|
Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2
|
2023-07-12 10:16:26 +08:00 |
|
Haojun Liao
|
6f2fc4fab3
|
fix(stream): commit task meta after do vnode-wide checkpoint.
|
2023-07-12 10:16:14 +08:00 |
|
Haojun Liao
|
fed3803739
|
fix(stream): fix memory leak.
|
2023-07-11 19:29:52 +08:00 |
|
liuyao
|
6298f17c45
|
delete invalid code
|
2023-07-11 19:21:27 +08:00 |
|
Haojun Liao
|
09b764494d
|
fix(stream): set correct checkpoint version when starting stream tasks.
|
2023-07-11 14:03:43 +08:00 |
|
Haojun Liao
|
571cccd737
|
refactor: do some internal refactor.
|
2023-07-11 11:41:37 +08:00 |
|
Haojun Liao
|
62a763ead3
|
fix(stream): fix invalid assert.
|
2023-07-11 11:22:48 +08:00 |
|
Haojun Liao
|
a571663a5d
|
Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2
# Conflicts:
# source/libs/stream/src/streamExec.c
|
2023-07-11 09:53:41 +08:00 |
|
Haojun Liao
|
cbda61c7f9
|
fix(stream): fix error in checkpointing.
|
2023-07-11 09:53:08 +08:00 |
yihaoDeng
|
c056e34534
|
fix compile error
|
2023-07-11 09:39:58 +08:00 |
|
Haojun Liao
|
3ffdbe923d
|
other: merge 3.0
|
2023-07-11 09:12:57 +08:00 |
|
Haojun Liao
|
8a6a876f67
|
fix(stream): fix error in generating checkpoint.
|
2023-07-10 22:53:15 +08:00 |
|
Haojun Liao
|
87bedef2cd
|
fix(stream): fix error in checkpointing.
|
2023-07-10 19:20:05 +08:00 |
|
Haojun Liao
|
9ad5e05751
|
fix(stream): fix error in checking status.
|
2023-07-10 10:24:04 +08:00 |
|
Haojun Liao
|
e8eba3175a
|
fix(stream): fix error in checking status.
|
2023-07-10 10:23:05 +08:00 |
|
Haojun Liao
|
dd15ca6103
|
fix(stream): add missing status check.
|
2023-07-10 10:06:21 +08:00 |
|
Haojun Liao
|
ed1181a1d1
|
fix(stream): fix invalid read bug.
|
2023-07-10 09:55:29 +08:00 |
|
Haojun Liao
|
a5c19427e7
|
fix(stream): send correct rsp to mnode.
|
2023-07-08 09:39:44 +08:00 |
|
Haojun Liao
|
ab4e2ebc3a
|
fix(stream): fix bug that causes the endless loop.
|
2023-07-07 21:45:22 +08:00 |
|
Haojun Liao
|
9c30abf95b
|
fix(stream): fix error in generating checkpoint.
|
2023-07-07 21:38:53 +08:00 |
|
Haojun Liao
|
b03ca31a7f
|
fix(stream): fix error in generating checkpoint.
|
2023-07-07 17:21:46 +08:00 |
|
Haojun Liao
|
8298f30e56
|
fix(stream): fix bug in checkpoint.
|
2023-07-07 17:16:08 +08:00 |
|
Haojun Liao
|
47877898d0
|
enh(stream): generate the checkpoint framework.
|
2023-07-07 16:07:52 +08:00 |
|
Haojun Liao
|
4f814db5d5
|
fix(stream): fix error during transferring executor state, while a task is not in normal status.
|
2023-07-06 18:34:01 +08:00 |
|
Haojun Liao
|
7a417a33b0
|
Merge pull request #21960 from taosdata/fix/3_liaohj
fix(stream): fix error for extract msg from inputQ
|
2023-07-05 17:47:18 +08:00 |
|
Haojun Liao
|
1855a16981
|
other: merge 3.0
|
2023-07-05 16:12:32 +08:00 |
|
Haojun Liao
|
03dbcbf055
|
refactor: do some internal refactor.
|
2023-07-05 15:55:55 +08:00 |
|
Haojun Liao
|
42e1cd741a
|
Merge pull request #21935 from taosdata/fix/3_liaohj
fix(stream): fix message lost bug during pause stream.
|
2023-07-03 17:37:56 +08:00 |
|
Haojun Liao
|
9e62b9d0d2
|
fix(stream): fix error in extract data from inputQ.
|
2023-07-03 15:33:08 +08:00 |
|
Haojun Liao
|
ceb06635fe
|
fix(stream): fix error in pause stream.
|
2023-07-03 15:12:35 +08:00 |
|
Haojun Liao
|
f84bfc96fb
|
fix(stream): fix error in pause in stream.
|
2023-07-03 14:30:11 +08:00 |
|
Haojun Liao
|
5d4efe1198
|
fix(stream): fix error in pause.
|
2023-07-03 11:46:05 +08:00 |
|
Haojun Liao
|
317a7c83c7
|
fix(stream): fix message lost bug during pause stream.
|
2023-07-03 10:55:45 +08:00 |
|
Haojun Liao
|
622e1cb608
|
fix: fix coverity issue.
|
2023-06-29 15:54:09 +08:00 |
|
Haojun Liao
|
3710ea4aca
|
refactor: do some internal refactor.
|
2023-06-28 09:41:08 +08:00 |
|
Haojun Liao
|
a19e63fd23
|
fix(stream): fix error in handling fill history.
|
2023-06-27 23:00:14 +08:00 |
|
Haojun Liao
|
32fddeff18
|
fix(stream): fix error retrieve data from source task.And optimize the test cases.
|
2023-06-27 16:24:47 +08:00 |
|
Haojun Liao
|
437eb93a4d
|
fix(stream): fix error while fill history exists.
|
2023-06-26 18:44:59 +08:00 |
|
Haojun Liao
|
daafe240ed
|
fix(stream): fix memory leak.
|
2023-06-26 14:18:47 +08:00 |
|
liuyao
|
870d75bf82
|
fill history pause&resume
|
2023-06-20 11:34:09 +08:00 |
|
liuyao
|
41c193945f
|
fill history pause&resume
|
2023-06-19 17:28:19 +08:00 |
|
liuyao
|
693942b821
|
trans state
|
2023-06-15 14:13:17 +08:00 |
|
Haojun Liao
|
13028744df
|
refactor: do some internal refactor.
|
2023-06-15 10:24:21 +08:00 |
|
Haojun Liao
|
53377c2c1f
|
fix(stream): wait for stream task completed.
|
2023-06-15 01:14:41 +08:00 |
|
Haojun Liao
|
5282492663
|
refactor: do some internal refactor.
|
2023-06-14 10:35:03 +08:00 |
|
Haojun Liao
|
b44447e6f3
|
enh(stream): support restore from disk.
|
2023-06-14 10:19:03 +08:00 |
|
Haojun Liao
|
97da2a8fac
|
fix(stream): set the fill history status.
|
2023-06-13 16:10:55 +08:00 |
|
Haojun Liao
|
fb24ed161d
|
enh(stream): set correct task status.
|
2023-06-12 22:48:23 +08:00 |
|
Haojun Liao
|
78a240be8f
|
enh(stream): add dispatch msg.
|
2023-06-12 13:12:45 +08:00 |
|
Haojun Liao
|
69c9eda7af
|
fix(stream): fix race condition.
|
2023-06-09 11:37:38 +08:00 |
|
Haojun Liao
|
0fd11aaefe
|
other: add some logs.
|
2023-06-08 19:14:36 +08:00 |
|
Haojun Liao
|
cb26dd9fa2
|
refactor(stream): do some internal refactor.
|
2023-06-08 10:17:21 +08:00 |
|
Haojun Liao
|
06cf3588da
|
refactor: do some internal refactor.
|
2023-06-07 15:03:04 +08:00 |
|
Haojun Liao
|
044e56fc97
|
Merge branch '3.0' into fix/resume_mem
|
2023-06-03 12:19:17 +08:00 |
|
yihaoDeng
|
9e0392ff59
|
fix mem leak
|
2023-06-03 09:17:05 +08:00 |
|
yihaoDeng
|
7244ab1f6b
|
fix mem leak
|
2023-06-03 08:28:21 +08:00 |
|
yihaoDeng
|
81fe174aa2
|
fix mem leak
|
2023-06-03 08:19:59 +08:00 |
|
Haojun Liao
|
f1bd829977
|
refactor: do some internal refactor.
|
2023-06-02 13:10:54 +08:00 |
|
Haojun Liao
|
27b7d1ec88
|
refactor: do some internal refactor.
|
2023-06-02 11:17:44 +08:00 |
|
Haojun Liao
|
91de00597d
|
refactor: do some internal refactor.
|
2023-05-31 22:12:14 +08:00 |
|
Haojun Liao
|
ccc86f9916
|
refactor: do some internal refactor.
|
2023-05-31 19:36:34 +08:00 |
|
Haojun Liao
|
87deb36f8a
|
refactor: do some internal refactor.
|
2023-05-31 19:36:02 +08:00 |
|
Haojun Liao
|
a3abe25539
|
refactor: do some internal refactor.
|
2023-05-31 19:03:37 +08:00 |
|
liuyao
|
5ebe75599e
|
fix pause issue
|
2023-05-26 14:58:39 +08:00 |
|
Haojun Liao
|
f520de0dab
|
refactor: adjust the module dependency.
|
2023-05-22 10:07:01 +08:00 |
|
Haojun Liao
|
dcb91082f9
|
fix(stream): fix error.
|
2023-05-20 23:37:40 +08:00 |
|
Haojun Liao
|
de44c9160c
|
refactor: do some internal refactor.
|
2023-05-20 18:05:39 +08:00 |
|
Haojun Liao
|
3cef1e7c42
|
fix(stream): add some logs.
|
2023-05-20 15:45:07 +08:00 |
|
Haojun Liao
|
aa7ea60bca
|
fix(stream): update the free strategy.
|
2023-05-20 15:43:48 +08:00 |
|
Haojun Liao
|
84146e6aaa
|
other: merge main.
|
2023-05-20 15:16:51 +08:00 |
|
Haojun Liao
|
6932c59510
|
other: merge main.
|
2023-05-20 15:09:30 +08:00 |
|
Haojun Liao
|
10692fde5e
|
other: merge main.
|
2023-05-20 14:53:28 +08:00 |
|
Haojun Liao
|
afc384bead
|
fix:remove invalid assert.
|
2023-05-20 14:44:34 +08:00 |
|
Haojun Liao
|
484788a60f
|
fix:add null ptr check.
|
2023-05-20 14:29:51 +08:00 |
|
Haojun Liao
|
336102b8c5
|
refactor: do some internal refactor.
|
2023-05-20 13:34:49 +08:00 |
|
Haojun Liao
|
5cbad1da3e
|
refactor: do some internal refactor.
|
2023-05-20 12:20:04 +08:00 |
|
Haojun Liao
|
6ded3284da
|
refactor: do some internal refactor.
|
2023-05-20 11:37:17 +08:00 |
|
Haojun Liao
|
8ab065d01e
|
other: update some logs.
|
2023-05-19 23:53:23 +08:00 |
|
Haojun Liao
|
56e5a483dd
|
other: update log.
|
2023-05-19 20:00:32 +08:00 |
|
Haojun Liao
|
a9b7b8a5fd
|
other: add some logs.
|
2023-05-19 19:26:15 +08:00 |
|
Haojun Liao
|
e2ec8d738c
|
other: add some logs.
|
2023-05-19 18:08:01 +08:00 |
|
Haojun Liao
|
90687bae1c
|
refactor: do some internal refactor.
|
2023-05-19 15:30:50 +08:00 |
|
Haojun Liao
|
dbd52ecffa
|
Merge pull request #21364 from taosdata/enh/rocksdbSstate
state merge into 3.0
|
2023-05-18 17:25:44 +08:00 |
|
liuyao
|
da3fc5111e
|
fix pause agg task
|
2023-05-18 15:29:41 +08:00 |
yihaoDeng
|
9380b22394
|
merge 3.0
|
2023-05-18 05:46:38 +00:00 |
|
Haojun Liao
|
ffee5ebc61
|
Merge branch '3.0' into feature/3_liaohj
|
2023-05-17 17:47:44 +08:00 |
|
Haojun Liao
|
041ffa91bd
|
other: merge main.
|
2023-05-17 15:42:15 +08:00 |