Haojun Liao
|
7f8da725bc
|
enh(stream): add quota limitation for sink task.
|
2023-10-09 20:08:13 +08:00 |
|
Haojun Liao
|
a248f3d088
|
refactor: do some internal refactor.
|
2023-10-09 20:08:12 +08:00 |
|
Haojun Liao
|
52763ca2a3
|
refactor: do some internal refactor.
|
2023-10-09 20:08:07 +08:00 |
|
Haojun Liao
|
ef9efc8a8e
|
refactor: do refactor the sink task.
|
2023-10-09 20:07:53 +08:00 |
|
Haojun Liao
|
e4ac835554
|
fix(stream): disable token bucket.
|
2023-10-09 20:07:53 +08:00 |
|
Haojun Liao
|
1f45bd82d2
|
other: merge stream fix in main.
|
2023-10-09 20:07:01 +08:00 |
|
Haojun Liao
|
ce85945583
|
fix(stream): set correct size for results generated by scan history stream tasks.
|
2023-10-09 20:06:05 +08:00 |
|
Haojun Liao
|
b38f9e0288
|
fix(stream): update logs.
|
2023-10-09 20:06:05 +08:00 |
|
Haojun Liao
|
636eccc160
|
fix(stream): add null check
|
2023-10-09 20:05:37 +08:00 |
|
Haojun Liao
|
7ccc273206
|
other: merge stream fix in main.
|
2023-10-09 20:05:29 +08:00 |
|
Haojun Liao
|
98ef566eb4
|
fix(stream): remove fill-history sink task.
|
2023-10-09 20:04:17 +08:00 |
|
Haojun Liao
|
e84eeee6b8
|
refactor: do some internal refactor.
|
2023-10-09 20:04:17 +08:00 |
|
Haojun Liao
|
3d1f29ff21
|
fix(stream): fix memory leak.
|
2023-10-09 20:04:16 +08:00 |
|
Haojun Liao
|
283118bf68
|
fix(stream):fix missing unlock.
|
2023-10-09 19:56:17 +08:00 |
|
Haojun Liao
|
aaa12ed4f8
|
refactor: do some internal refactor about the sched status set
|
2023-10-09 19:56:17 +08:00 |
|
Haojun Liao
|
01d104706e
|
refactor(stream): remove unnecessary streamschedTask function to improve the performance.
|
2023-10-09 19:56:17 +08:00 |
|
Haojun Liao
|
f6a097d96f
|
refactor: do some internal refactor.
|
2023-09-12 21:58:22 +08:00 |
|
Haojun Liao
|
e457d94ac6
|
refactor: do some internal refactor.
|
2023-09-12 18:09:02 +08:00 |
|
Haojun Liao
|
85a5c45098
|
fix(stream): limit the already processed data.
|
2023-09-10 00:01:25 +08:00 |
|
Haojun Liao
|
6f5c855a4b
|
fix(stream): fix msg lost bug.
|
2023-09-09 15:08:36 +08:00 |
|
Haojun Liao
|
35b97cbd19
|
fix(stream): set correct token in bucket.
|
2023-09-08 23:50:41 +08:00 |
|
Haojun Liao
|
2285b834b0
|
refactor: do some internal refactor.
|
2023-08-31 13:53:12 +08:00 |
|
Haojun Liao
|
3fc3dafca6
|
refactor: do some internal refactor.
|
2023-08-31 13:46:48 +08:00 |
|
Haojun Liao
|
e53b5d4392
|
refactor: do some internal refactor.
|
2023-08-31 11:01:53 +08:00 |
|
Haojun Liao
|
391103bc5a
|
fix(stream): do dome internal refactor.
|
2023-08-28 15:54:01 +08:00 |
|
Haojun Liao
|
b7c36bbfe4
|
fix(stream): fix the status error.
|
2023-08-26 00:49:23 +08:00 |
|
Haojun Liao
|
35193020dd
|
fix(stream): add logs.
|
2023-08-25 10:18:06 +08:00 |
|
Haojun Liao
|
957c7f872b
|
fix(stream): update the agg task status check, when transferring state.
|
2023-08-24 11:43:18 +08:00 |
|
Haojun Liao
|
af80d94a88
|
refactor: do some internal refactor.
|
2023-08-22 15:43:50 +08:00 |
Haojun Liao
|
c26d625152
|
Merge branch '3.0' into enh/triggerCheckPoint2
|
2023-08-18 15:51:07 +08:00 |
liuyao
|
87c65f3b68
|
Merge remote-tracking branch 'origin/3.0' into enh/triggerCheckPoint2
|
2023-08-18 15:27:02 +08:00 |
|
Haojun Liao
|
10872240ae
|
Merge pull request #22476 from taosdata/fix/3_liaohj
fix(stream): pause when outputQ is blocked.
|
2023-08-18 15:12:54 +08:00 |
|
Haojun Liao
|
87785b1d9c
|
refactor: add some logs.
|
2023-08-18 10:30:00 +08:00 |
|
Haojun Liao
|
9e9d83d4a1
|
refactor: do some internal refactor
|
2023-08-17 11:57:04 +08:00 |
|
Haojun Liao
|
bb4f8515bd
|
fix(stream): pause when outputQ is blocked.
|
2023-08-17 11:53:17 +08:00 |
|
liuyao
|
5ce7688a93
|
Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/ly_refactor
|
2023-08-17 09:06:46 +08:00 |
|
Haojun Liao
|
ea6574b3c7
|
other: merge 3.0
|
2023-08-17 00:07:55 +08:00 |
|
Haojun Liao
|
59d5858b95
|
fix(stream): fix a typo
|
2023-08-16 19:22:45 +08:00 |
|
Haojun Liao
|
9a76ae72d6
|
fix(stream): add the back pressure for sink node.
|
2023-08-16 19:11:43 +08:00 |
|
liuyao
|
19dfcf3a59
|
refactor stream scan log
|
2023-08-15 16:29:48 +08:00 |
|
Haojun Liao
|
71c3c710e6
|
fix(stream): continue process when met with trans-state msg.
|
2023-08-15 14:23:20 +08:00 |
|
Haojun Liao
|
0acb00c516
|
fix(stream): add log.
|
2023-08-15 11:48:56 +08:00 |
|
Haojun Liao
|
5d3232d275
|
fix(stream): fix an syntax error.
|
2023-08-14 18:14:32 +08:00 |
|
Haojun Liao
|
2e6263b43f
|
fix(stream): fix memory leak.
|
2023-08-14 17:16:11 +08:00 |
|
Haojun Liao
|
a1e554fbf3
|
refactor: exec directly not asynchnoized.
|
2023-08-14 15:05:13 +08:00 |
|
Haojun Liao
|
e8c9a019a4
|
fix(stream): remove the invalid set of scheduler status.
|
2023-08-14 11:41:24 +08:00 |
|
Haojun Liao
|
2806fe1c56
|
fix(stream): ignore the related stream task destory msg in transfer state.
|
2023-08-14 10:58:24 +08:00 |
|
Haojun Liao
|
98f40325e9
|
fix(stream): fix memory leak.
|
2023-08-13 20:02:15 +08:00 |
|
Haojun Liao
|
a81cc9aebf
|
fix(stream): fix the error when no agg tasks exist.
|
2023-08-13 17:31:09 +08:00 |
|
Haojun Liao
|
0d38f389ab
|
refactor: do some internal refactor.
|
2023-08-13 16:25:35 +08:00 |
|
Haojun Liao
|
0d0e30b764
|
fix(stream): fix the error.
|
2023-08-12 17:20:10 +08:00 |
|
Haojun Liao
|
ce721a0146
|
fix(stream): fix error.
|
2023-08-12 16:32:05 +08:00 |
|
Haojun Liao
|
a89ce1a20b
|
fix(stream): transfer state by using data block.
|
2023-08-12 01:24:07 +08:00 |
|
Haojun Liao
|
f24b22000f
|
enh(stream): stop stream task before redistribute vnodes.
|
2023-08-11 23:46:53 +08:00 |
|
Haojun Liao
|
8890fa5781
|
fix(stream): execute the stream task directly, instead of executing it in a asynchronized way.
|
2023-08-10 15:13:49 +08:00 |
|
Haojun Liao
|
f633c7fe2b
|
other: merge 3.0.
|
2023-08-10 11:56:30 +08:00 |
|
Haojun Liao
|
d34b9af054
|
enh(stream): create update stream trans.
|
2023-08-09 19:38:13 +08:00 |
|
Haojun Liao
|
1e8579e8c5
|
fix(stream): fix other cases.
|
2023-08-09 16:04:48 +08:00 |
|
Haojun Liao
|
4c92997328
|
fix(stream): use streamId&taskId to identify the stream task in the stream meta.
|
2023-08-09 15:52:23 +08:00 |
|
Haojun Liao
|
17c6143471
|
fix(stream): check more status when handling the state transfer.
|
2023-08-08 15:08:11 +08:00 |
|
Haojun Liao
|
db8ce3de3b
|
other: merge main.
|
2023-08-08 10:17:51 +08:00 |
|
Haojun Liao
|
d6d63ec54c
|
fix(stream): add more check.
|
2023-08-08 09:54:49 +08:00 |
|
Haojun Liao
|
e89d3c18d6
|
fix(stream): remove invalid check.
|
2023-08-08 09:54:46 +08:00 |
|
Haojun Liao
|
ac00e1d520
|
fix(stream): fetch all data before paused and dump to sink node.
|
2023-08-08 09:54:43 +08:00 |
|
Haojun Liao
|
0e3fd5277d
|
fix(stream): dump results to sink node before paused.
|
2023-08-08 09:54:39 +08:00 |
|
Haojun Liao
|
1e680d4df1
|
fix(stream): ignore the sink task transfer state.
|
2023-08-08 09:52:19 +08:00 |
|
Haojun Liao
|
3bcc7ed83e
|
fix(stream): transfer the state for agg tasks.
|
2023-08-08 09:52:04 +08:00 |
|
Haojun Liao
|
d43cb3fcdf
|
fix(stream): kill task when pause the stream execution.
|
2023-08-08 09:51:21 +08:00 |
|
Haojun Liao
|
ca2183acfd
|
refactor: do some internal refactor.
|
2023-08-08 09:50:40 +08:00 |
|
Haojun Liao
|
51e0b903b0
|
refactor: do some internal refactor.
|
2023-08-08 09:36:42 +08:00 |
|
Haojun Liao
|
225c0e61dc
|
hen(stream): support the rollback and checkdown stream tasks.
|
2023-08-07 16:13:39 +08:00 |
|
Haojun Liao
|
8a11a0418f
|
other: merge 3.0
|
2023-08-07 09:19:26 +08:00 |
|
liuyao
|
9cb481dd6e
|
use stream task
|
2023-08-04 11:01:36 +08:00 |
|
liuyao
|
3464979489
|
set dummy delete data request
|
2023-08-03 09:03:48 +08:00 |
|
liuyao
|
71b000f08c
|
reload state window state
|
2023-08-01 18:22:40 +08:00 |
|
Haojun Liao
|
f1e0e64918
|
fix(stream): add more check.
|
2023-08-01 14:31:41 +08:00 |
|
Haojun Liao
|
e11cda17c0
|
fix(stream): remove invalid check.
|
2023-08-01 10:30:24 +08:00 |
|
Haojun Liao
|
f6ae9cf9bb
|
fix(stream): fetch all data before paused and dump to sink node.
|
2023-08-01 10:16:14 +08:00 |
|
Haojun Liao
|
b83860372c
|
fix(stream): dump results to sink node before paused.
|
2023-08-01 00:50:30 +08:00 |
|
Haojun Liao
|
8c1c17e31e
|
fix(stream): ignore the sink task transfer state.
|
2023-07-31 19:23:53 +08:00 |
|
Haojun Liao
|
d72580dad7
|
fix(stream): transfer the state for agg tasks.
|
2023-07-31 19:12:23 +08:00 |
|
Haojun Liao
|
d45596bb33
|
fix(stream): kill task when pause the stream execution.
|
2023-07-31 18:07:37 +08:00 |
|
Haojun Liao
|
9981cecbed
|
refactor: do some internal refactor.
|
2023-07-31 15:24:35 +08:00 |
|
Haojun Liao
|
8dfef8768a
|
other: merge 3.0
|
2023-07-29 22:54:16 +08:00 |
|
Haojun Liao
|
6c9fa4d7c8
|
fix(stream): check for pause when handling the fill history data.
|
2023-07-28 19:58:52 +08:00 |
|
Haojun Liao
|
936afeb5ac
|
refactor: do internal refactor to simple the pause/resume in case of fill history exists.
|
2023-07-28 19:13:03 +08:00 |
|
Haojun Liao
|
d5974a8f25
|
refactor(stream): refactor the pause/resume for fill history execution.
|
2023-07-28 18:05:32 +08:00 |
|
Haojun Liao
|
6ff50d4eaf
|
fix(stream): update the step2 scan wal files.
|
2023-07-27 16:10:55 +08:00 |
|
Haojun Liao
|
40fe3ef4f6
|
fix(stream): refactor the step2 wal scan.
|
2023-07-27 14:49:20 +08:00 |
|
Haojun Liao
|
e89f530db2
|
fix(stream): scan wal in step2
|
2023-07-27 10:55:59 +08:00 |
|
Haojun Liao
|
cdffabcdad
|
fix(stream): fix memory leak.
|
2023-07-26 14:37:04 +08:00 |
|
Haojun Liao
|
12986ff594
|
fix(stream): fix memory leaks.
|
2023-07-26 09:25:30 +08:00 |
|
Haojun Liao
|
1c1bf63e1f
|
other: merge 3.0
|
2023-07-25 18:17:11 +08:00 |
|
Haojun Liao
|
0bdccd2681
|
refactor: do some internal refactor.
|
2023-07-25 17:31:54 +08:00 |
|
Haojun Liao
|
d29f835a63
|
fix(stream): set the correct step2 scan time window range.
|
2023-07-25 15:09:22 +08:00 |
|
Haojun Liao
|
1e34f84f78
|
other: merge 3.0
|
2023-07-24 15:23:03 +08:00 |
|
Haojun Liao
|
9bae91bcba
|
fix(stream): add some logs, and remove the invalid loop.
|
2023-07-24 13:37:44 +08:00 |
|
Haojun Liao
|
1367552f38
|
fix(stream): refactor the halt status to check more status.
|
2023-07-24 10:04:15 +08:00 |
|
Haojun Liao
|
e387b2f932
|
refactor: do some internal refactor.
|
2023-07-23 18:59:34 +08:00 |
|
Haojun Liao
|
4e0f7ffbf8
|
fix(stream): set the correct flag of pause/resume.
|
2023-07-23 18:49:56 +08:00 |
|
Haojun Liao
|
db46d31ca5
|
fix(stream): refactor the halt function.
|
2023-07-21 01:32:42 +08:00 |
|
Haojun Liao
|
c9fa170e65
|
refactor: do some internal refactor.
|
2023-07-20 16:31:46 +08:00 |
|
Haojun Liao
|
97c44e7c18
|
refactor: do some internal refactor.
|
2023-07-19 18:42:02 +08:00 |
|
Haojun Liao
|
902f9d1f94
|
fix(stream): set not-ready initial value.
|
2023-07-18 18:29:35 +08:00 |
|
Haojun Liao
|
901b7d8ecc
|
fix(stream): if a source task is set to be non-normal, no data should be put into inputQ anymore.
|
2023-07-18 15:18:57 +08:00 |
|
Haojun Liao
|
92106312d2
|
fix(stream): not dispatch checkpoint block result to downstream.
|
2023-07-18 09:43:38 +08:00 |
|
Haojun Liao
|
08f43b9d00
|
fix(stream): fix checkpoint block not fetched bug.
|
2023-07-17 15:31:54 +08:00 |
|
Haojun Liao
|
d7f7a7d6cf
|
fix(stream): fix syntax error
|
2023-07-17 12:53:36 +08:00 |
|
Haojun Liao
|
b2a905bd91
|
Merge branch '3.0' into enh/triggerCheckPoint2
|
2023-07-17 11:50:12 +08:00 |
|
Haojun Liao
|
c6a322e0ef
|
refactor(stream): back pressure is active, which is trigger by dispatch rsp.
|
2023-07-16 12:47:08 +08:00 |
|
Haojun Liao
|
725db16af9
|
fix(stream): set save checkpoint ver.
|
2023-07-14 19:47:19 +08:00 |
|
Haojun Liao
|
eb7e6152ae
|
refactor(stream): do some internal refactor.
|
2023-07-14 17:21:20 +08:00 |
|
Haojun Liao
|
e0ea0f2df4
|
Merge pull request #22020 from taosdata/fix/liaohj
other: merge main
|
2023-07-13 17:55:28 +08:00 |
|
Haojun Liao
|
2f90a53548
|
fix(stream): set checkpoint id when expanding task.
|
2023-07-13 10:16:57 +08:00 |
|
Haojun Liao
|
08a4fb06ae
|
fix(stream): dispatch checkpoint msg to downstream by puting message into input queue.
|
2023-07-13 09:17:20 +08:00 |
|
Haojun Liao
|
9484f3da94
|
Merge branch '3.0' into enh/triggerCheckPoint2
|
2023-07-12 10:20:18 +08:00 |
|
Haojun Liao
|
a049e310f6
|
Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2
|
2023-07-12 10:16:26 +08:00 |
|
Haojun Liao
|
6f2fc4fab3
|
fix(stream): commit task meta after do vnode-wide checkpoint.
|
2023-07-12 10:16:14 +08:00 |
|
Haojun Liao
|
fed3803739
|
fix(stream): fix memory leak.
|
2023-07-11 19:29:52 +08:00 |
|
liuyao
|
6298f17c45
|
delete invalid code
|
2023-07-11 19:21:27 +08:00 |
|
Haojun Liao
|
09b764494d
|
fix(stream): set correct checkpoint version when starting stream tasks.
|
2023-07-11 14:03:43 +08:00 |
|
Haojun Liao
|
571cccd737
|
refactor: do some internal refactor.
|
2023-07-11 11:41:37 +08:00 |
|
Haojun Liao
|
62a763ead3
|
fix(stream): fix invalid assert.
|
2023-07-11 11:22:48 +08:00 |
|
Haojun Liao
|
a571663a5d
|
Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2
# Conflicts:
# source/libs/stream/src/streamExec.c
|
2023-07-11 09:53:41 +08:00 |
|
Haojun Liao
|
cbda61c7f9
|
fix(stream): fix error in checkpointing.
|
2023-07-11 09:53:08 +08:00 |
yihaoDeng
|
c056e34534
|
fix compile error
|
2023-07-11 09:39:58 +08:00 |
|
Haojun Liao
|
3ffdbe923d
|
other: merge 3.0
|
2023-07-11 09:12:57 +08:00 |
|
Haojun Liao
|
8a6a876f67
|
fix(stream): fix error in generating checkpoint.
|
2023-07-10 22:53:15 +08:00 |
|
Haojun Liao
|
87bedef2cd
|
fix(stream): fix error in checkpointing.
|
2023-07-10 19:20:05 +08:00 |
|
Haojun Liao
|
9ad5e05751
|
fix(stream): fix error in checking status.
|
2023-07-10 10:24:04 +08:00 |
|
Haojun Liao
|
e8eba3175a
|
fix(stream): fix error in checking status.
|
2023-07-10 10:23:05 +08:00 |
|
Haojun Liao
|
dd15ca6103
|
fix(stream): add missing status check.
|
2023-07-10 10:06:21 +08:00 |
|
Haojun Liao
|
ed1181a1d1
|
fix(stream): fix invalid read bug.
|
2023-07-10 09:55:29 +08:00 |
|
Haojun Liao
|
a5c19427e7
|
fix(stream): send correct rsp to mnode.
|
2023-07-08 09:39:44 +08:00 |
|
Haojun Liao
|
ab4e2ebc3a
|
fix(stream): fix bug that causes the endless loop.
|
2023-07-07 21:45:22 +08:00 |
|
Haojun Liao
|
9c30abf95b
|
fix(stream): fix error in generating checkpoint.
|
2023-07-07 21:38:53 +08:00 |
|
Haojun Liao
|
b03ca31a7f
|
fix(stream): fix error in generating checkpoint.
|
2023-07-07 17:21:46 +08:00 |
|
Haojun Liao
|
8298f30e56
|
fix(stream): fix bug in checkpoint.
|
2023-07-07 17:16:08 +08:00 |
|
Haojun Liao
|
47877898d0
|
enh(stream): generate the checkpoint framework.
|
2023-07-07 16:07:52 +08:00 |
|
Haojun Liao
|
4f814db5d5
|
fix(stream): fix error during transferring executor state, while a task is not in normal status.
|
2023-07-06 18:34:01 +08:00 |
|
Haojun Liao
|
7a417a33b0
|
Merge pull request #21960 from taosdata/fix/3_liaohj
fix(stream): fix error for extract msg from inputQ
|
2023-07-05 17:47:18 +08:00 |
|
Haojun Liao
|
1855a16981
|
other: merge 3.0
|
2023-07-05 16:12:32 +08:00 |
|
Haojun Liao
|
03dbcbf055
|
refactor: do some internal refactor.
|
2023-07-05 15:55:55 +08:00 |
|
Haojun Liao
|
42e1cd741a
|
Merge pull request #21935 from taosdata/fix/3_liaohj
fix(stream): fix message lost bug during pause stream.
|
2023-07-03 17:37:56 +08:00 |
|
Haojun Liao
|
9e62b9d0d2
|
fix(stream): fix error in extract data from inputQ.
|
2023-07-03 15:33:08 +08:00 |
|
Haojun Liao
|
ceb06635fe
|
fix(stream): fix error in pause stream.
|
2023-07-03 15:12:35 +08:00 |
|
Haojun Liao
|
f84bfc96fb
|
fix(stream): fix error in pause in stream.
|
2023-07-03 14:30:11 +08:00 |
|
Haojun Liao
|
5d4efe1198
|
fix(stream): fix error in pause.
|
2023-07-03 11:46:05 +08:00 |
|
Haojun Liao
|
317a7c83c7
|
fix(stream): fix message lost bug during pause stream.
|
2023-07-03 10:55:45 +08:00 |
|
Haojun Liao
|
622e1cb608
|
fix: fix coverity issue.
|
2023-06-29 15:54:09 +08:00 |