Haojun Liao
|
1c1bf63e1f
|
other: merge 3.0
|
2023-07-25 18:17:11 +08:00 |
|
Haojun Liao
|
0bdccd2681
|
refactor: do some internal refactor.
|
2023-07-25 17:31:54 +08:00 |
|
Haojun Liao
|
d29f835a63
|
fix(stream): set the correct step2 scan time window range.
|
2023-07-25 15:09:22 +08:00 |
|
Haojun Liao
|
1e34f84f78
|
other: merge 3.0
|
2023-07-24 15:23:03 +08:00 |
|
Haojun Liao
|
9bae91bcba
|
fix(stream): add some logs, and remove the invalid loop.
|
2023-07-24 13:37:44 +08:00 |
|
Haojun Liao
|
1367552f38
|
fix(stream): refactor the halt status to check more status.
|
2023-07-24 10:04:15 +08:00 |
|
Haojun Liao
|
e387b2f932
|
refactor: do some internal refactor.
|
2023-07-23 18:59:34 +08:00 |
|
Haojun Liao
|
4e0f7ffbf8
|
fix(stream): set the correct flag of pause/resume.
|
2023-07-23 18:49:56 +08:00 |
|
Haojun Liao
|
db46d31ca5
|
fix(stream): refactor the halt function.
|
2023-07-21 01:32:42 +08:00 |
|
Haojun Liao
|
c9fa170e65
|
refactor: do some internal refactor.
|
2023-07-20 16:31:46 +08:00 |
|
Haojun Liao
|
97c44e7c18
|
refactor: do some internal refactor.
|
2023-07-19 18:42:02 +08:00 |
|
Haojun Liao
|
902f9d1f94
|
fix(stream): set not-ready initial value.
|
2023-07-18 18:29:35 +08:00 |
|
Haojun Liao
|
901b7d8ecc
|
fix(stream): if a source task is set to be non-normal, no data should be put into inputQ anymore.
|
2023-07-18 15:18:57 +08:00 |
|
Haojun Liao
|
92106312d2
|
fix(stream): not dispatch checkpoint block result to downstream.
|
2023-07-18 09:43:38 +08:00 |
|
Haojun Liao
|
08f43b9d00
|
fix(stream): fix checkpoint block not fetched bug.
|
2023-07-17 15:31:54 +08:00 |
|
Haojun Liao
|
d7f7a7d6cf
|
fix(stream): fix syntax error
|
2023-07-17 12:53:36 +08:00 |
Haojun Liao
|
b2a905bd91
|
Merge branch '3.0' into enh/triggerCheckPoint2
|
2023-07-17 11:50:12 +08:00 |
|
Haojun Liao
|
c6a322e0ef
|
refactor(stream): back pressure is active, which is trigger by dispatch rsp.
|
2023-07-16 12:47:08 +08:00 |
|
Haojun Liao
|
725db16af9
|
fix(stream): set save checkpoint ver.
|
2023-07-14 19:47:19 +08:00 |
|
Haojun Liao
|
eb7e6152ae
|
refactor(stream): do some internal refactor.
|
2023-07-14 17:21:20 +08:00 |
|
Haojun Liao
|
e0ea0f2df4
|
Merge pull request #22020 from taosdata/fix/liaohj
other: merge main
|
2023-07-13 17:55:28 +08:00 |
|
Haojun Liao
|
2f90a53548
|
fix(stream): set checkpoint id when expanding task.
|
2023-07-13 10:16:57 +08:00 |
|
Haojun Liao
|
08a4fb06ae
|
fix(stream): dispatch checkpoint msg to downstream by puting message into input queue.
|
2023-07-13 09:17:20 +08:00 |
|
Haojun Liao
|
9484f3da94
|
Merge branch '3.0' into enh/triggerCheckPoint2
|
2023-07-12 10:20:18 +08:00 |
|
Haojun Liao
|
a049e310f6
|
Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2
|
2023-07-12 10:16:26 +08:00 |
|
Haojun Liao
|
6f2fc4fab3
|
fix(stream): commit task meta after do vnode-wide checkpoint.
|
2023-07-12 10:16:14 +08:00 |
|
Haojun Liao
|
fed3803739
|
fix(stream): fix memory leak.
|
2023-07-11 19:29:52 +08:00 |
liuyao
|
6298f17c45
|
delete invalid code
|
2023-07-11 19:21:27 +08:00 |
|
Haojun Liao
|
09b764494d
|
fix(stream): set correct checkpoint version when starting stream tasks.
|
2023-07-11 14:03:43 +08:00 |
|
Haojun Liao
|
571cccd737
|
refactor: do some internal refactor.
|
2023-07-11 11:41:37 +08:00 |
|
Haojun Liao
|
62a763ead3
|
fix(stream): fix invalid assert.
|
2023-07-11 11:22:48 +08:00 |
|
Haojun Liao
|
a571663a5d
|
Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2
# Conflicts:
# source/libs/stream/src/streamExec.c
|
2023-07-11 09:53:41 +08:00 |
|
Haojun Liao
|
cbda61c7f9
|
fix(stream): fix error in checkpointing.
|
2023-07-11 09:53:08 +08:00 |
yihaoDeng
|
c056e34534
|
fix compile error
|
2023-07-11 09:39:58 +08:00 |
|
Haojun Liao
|
3ffdbe923d
|
other: merge 3.0
|
2023-07-11 09:12:57 +08:00 |
|
Haojun Liao
|
8a6a876f67
|
fix(stream): fix error in generating checkpoint.
|
2023-07-10 22:53:15 +08:00 |
|
Haojun Liao
|
87bedef2cd
|
fix(stream): fix error in checkpointing.
|
2023-07-10 19:20:05 +08:00 |
|
Haojun Liao
|
9ad5e05751
|
fix(stream): fix error in checking status.
|
2023-07-10 10:24:04 +08:00 |
|
Haojun Liao
|
e8eba3175a
|
fix(stream): fix error in checking status.
|
2023-07-10 10:23:05 +08:00 |
|
Haojun Liao
|
dd15ca6103
|
fix(stream): add missing status check.
|
2023-07-10 10:06:21 +08:00 |
|
Haojun Liao
|
ed1181a1d1
|
fix(stream): fix invalid read bug.
|
2023-07-10 09:55:29 +08:00 |
|
Haojun Liao
|
a5c19427e7
|
fix(stream): send correct rsp to mnode.
|
2023-07-08 09:39:44 +08:00 |
|
Haojun Liao
|
ab4e2ebc3a
|
fix(stream): fix bug that causes the endless loop.
|
2023-07-07 21:45:22 +08:00 |
|
Haojun Liao
|
9c30abf95b
|
fix(stream): fix error in generating checkpoint.
|
2023-07-07 21:38:53 +08:00 |
|
Haojun Liao
|
b03ca31a7f
|
fix(stream): fix error in generating checkpoint.
|
2023-07-07 17:21:46 +08:00 |
|
Haojun Liao
|
8298f30e56
|
fix(stream): fix bug in checkpoint.
|
2023-07-07 17:16:08 +08:00 |
|
Haojun Liao
|
47877898d0
|
enh(stream): generate the checkpoint framework.
|
2023-07-07 16:07:52 +08:00 |
|
Haojun Liao
|
4f814db5d5
|
fix(stream): fix error during transferring executor state, while a task is not in normal status.
|
2023-07-06 18:34:01 +08:00 |
|
Haojun Liao
|
7a417a33b0
|
Merge pull request #21960 from taosdata/fix/3_liaohj
fix(stream): fix error for extract msg from inputQ
|
2023-07-05 17:47:18 +08:00 |
|
Haojun Liao
|
1855a16981
|
other: merge 3.0
|
2023-07-05 16:12:32 +08:00 |
|
Haojun Liao
|
03dbcbf055
|
refactor: do some internal refactor.
|
2023-07-05 15:55:55 +08:00 |
|
Haojun Liao
|
42e1cd741a
|
Merge pull request #21935 from taosdata/fix/3_liaohj
fix(stream): fix message lost bug during pause stream.
|
2023-07-03 17:37:56 +08:00 |
|
Haojun Liao
|
9e62b9d0d2
|
fix(stream): fix error in extract data from inputQ.
|
2023-07-03 15:33:08 +08:00 |
|
Haojun Liao
|
ceb06635fe
|
fix(stream): fix error in pause stream.
|
2023-07-03 15:12:35 +08:00 |
|
Haojun Liao
|
f84bfc96fb
|
fix(stream): fix error in pause in stream.
|
2023-07-03 14:30:11 +08:00 |
|
Haojun Liao
|
5d4efe1198
|
fix(stream): fix error in pause.
|
2023-07-03 11:46:05 +08:00 |
|
Haojun Liao
|
317a7c83c7
|
fix(stream): fix message lost bug during pause stream.
|
2023-07-03 10:55:45 +08:00 |
|
Haojun Liao
|
622e1cb608
|
fix: fix coverity issue.
|
2023-06-29 15:54:09 +08:00 |
|
Haojun Liao
|
3710ea4aca
|
refactor: do some internal refactor.
|
2023-06-28 09:41:08 +08:00 |
|
Haojun Liao
|
a19e63fd23
|
fix(stream): fix error in handling fill history.
|
2023-06-27 23:00:14 +08:00 |
|
Haojun Liao
|
32fddeff18
|
fix(stream): fix error retrieve data from source task.And optimize the test cases.
|
2023-06-27 16:24:47 +08:00 |
|
Haojun Liao
|
437eb93a4d
|
fix(stream): fix error while fill history exists.
|
2023-06-26 18:44:59 +08:00 |
|
Haojun Liao
|
daafe240ed
|
fix(stream): fix memory leak.
|
2023-06-26 14:18:47 +08:00 |
|
liuyao
|
870d75bf82
|
fill history pause&resume
|
2023-06-20 11:34:09 +08:00 |
|
liuyao
|
41c193945f
|
fill history pause&resume
|
2023-06-19 17:28:19 +08:00 |
|
liuyao
|
693942b821
|
trans state
|
2023-06-15 14:13:17 +08:00 |
|
Haojun Liao
|
13028744df
|
refactor: do some internal refactor.
|
2023-06-15 10:24:21 +08:00 |
|
Haojun Liao
|
53377c2c1f
|
fix(stream): wait for stream task completed.
|
2023-06-15 01:14:41 +08:00 |
|
Haojun Liao
|
5282492663
|
refactor: do some internal refactor.
|
2023-06-14 10:35:03 +08:00 |
|
Haojun Liao
|
b44447e6f3
|
enh(stream): support restore from disk.
|
2023-06-14 10:19:03 +08:00 |
|
Haojun Liao
|
97da2a8fac
|
fix(stream): set the fill history status.
|
2023-06-13 16:10:55 +08:00 |
|
Haojun Liao
|
fb24ed161d
|
enh(stream): set correct task status.
|
2023-06-12 22:48:23 +08:00 |
|
Haojun Liao
|
78a240be8f
|
enh(stream): add dispatch msg.
|
2023-06-12 13:12:45 +08:00 |
|
Haojun Liao
|
69c9eda7af
|
fix(stream): fix race condition.
|
2023-06-09 11:37:38 +08:00 |
|
Haojun Liao
|
0fd11aaefe
|
other: add some logs.
|
2023-06-08 19:14:36 +08:00 |
|
Haojun Liao
|
cb26dd9fa2
|
refactor(stream): do some internal refactor.
|
2023-06-08 10:17:21 +08:00 |
|
Haojun Liao
|
06cf3588da
|
refactor: do some internal refactor.
|
2023-06-07 15:03:04 +08:00 |
|
Haojun Liao
|
044e56fc97
|
Merge branch '3.0' into fix/resume_mem
|
2023-06-03 12:19:17 +08:00 |
|
yihaoDeng
|
9e0392ff59
|
fix mem leak
|
2023-06-03 09:17:05 +08:00 |
|
yihaoDeng
|
7244ab1f6b
|
fix mem leak
|
2023-06-03 08:28:21 +08:00 |
|
yihaoDeng
|
81fe174aa2
|
fix mem leak
|
2023-06-03 08:19:59 +08:00 |
|
Haojun Liao
|
f1bd829977
|
refactor: do some internal refactor.
|
2023-06-02 13:10:54 +08:00 |
|
Haojun Liao
|
27b7d1ec88
|
refactor: do some internal refactor.
|
2023-06-02 11:17:44 +08:00 |
|
Haojun Liao
|
91de00597d
|
refactor: do some internal refactor.
|
2023-05-31 22:12:14 +08:00 |
|
Haojun Liao
|
ccc86f9916
|
refactor: do some internal refactor.
|
2023-05-31 19:36:34 +08:00 |
|
Haojun Liao
|
87deb36f8a
|
refactor: do some internal refactor.
|
2023-05-31 19:36:02 +08:00 |
|
Haojun Liao
|
a3abe25539
|
refactor: do some internal refactor.
|
2023-05-31 19:03:37 +08:00 |
|
liuyao
|
5ebe75599e
|
fix pause issue
|
2023-05-26 14:58:39 +08:00 |
|
Haojun Liao
|
f520de0dab
|
refactor: adjust the module dependency.
|
2023-05-22 10:07:01 +08:00 |
|
Haojun Liao
|
dcb91082f9
|
fix(stream): fix error.
|
2023-05-20 23:37:40 +08:00 |
|
Haojun Liao
|
de44c9160c
|
refactor: do some internal refactor.
|
2023-05-20 18:05:39 +08:00 |
|
Haojun Liao
|
3cef1e7c42
|
fix(stream): add some logs.
|
2023-05-20 15:45:07 +08:00 |
|
Haojun Liao
|
aa7ea60bca
|
fix(stream): update the free strategy.
|
2023-05-20 15:43:48 +08:00 |
|
Haojun Liao
|
84146e6aaa
|
other: merge main.
|
2023-05-20 15:16:51 +08:00 |
|
Haojun Liao
|
6932c59510
|
other: merge main.
|
2023-05-20 15:09:30 +08:00 |
|
Haojun Liao
|
10692fde5e
|
other: merge main.
|
2023-05-20 14:53:28 +08:00 |
|
Haojun Liao
|
afc384bead
|
fix:remove invalid assert.
|
2023-05-20 14:44:34 +08:00 |
|
Haojun Liao
|
484788a60f
|
fix:add null ptr check.
|
2023-05-20 14:29:51 +08:00 |
|
Haojun Liao
|
336102b8c5
|
refactor: do some internal refactor.
|
2023-05-20 13:34:49 +08:00 |
|
Haojun Liao
|
5cbad1da3e
|
refactor: do some internal refactor.
|
2023-05-20 12:20:04 +08:00 |
|
Haojun Liao
|
6ded3284da
|
refactor: do some internal refactor.
|
2023-05-20 11:37:17 +08:00 |
|
Haojun Liao
|
8ab065d01e
|
other: update some logs.
|
2023-05-19 23:53:23 +08:00 |
|
Haojun Liao
|
56e5a483dd
|
other: update log.
|
2023-05-19 20:00:32 +08:00 |
|
Haojun Liao
|
a9b7b8a5fd
|
other: add some logs.
|
2023-05-19 19:26:15 +08:00 |
|
Haojun Liao
|
e2ec8d738c
|
other: add some logs.
|
2023-05-19 18:08:01 +08:00 |
|
Haojun Liao
|
90687bae1c
|
refactor: do some internal refactor.
|
2023-05-19 15:30:50 +08:00 |
|
Haojun Liao
|
dbd52ecffa
|
Merge pull request #21364 from taosdata/enh/rocksdbSstate
state merge into 3.0
|
2023-05-18 17:25:44 +08:00 |
|
liuyao
|
da3fc5111e
|
fix pause agg task
|
2023-05-18 15:29:41 +08:00 |
yihaoDeng
|
9380b22394
|
merge 3.0
|
2023-05-18 05:46:38 +00:00 |
|
Haojun Liao
|
ffee5ebc61
|
Merge branch '3.0' into feature/3_liaohj
|
2023-05-17 17:47:44 +08:00 |
|
Haojun Liao
|
041ffa91bd
|
other: merge main.
|
2023-05-17 15:42:15 +08:00 |
|
Haojun Liao
|
f3f52c0232
|
fix(stream): add some logs and set the wal offset to be the ended version when finishing the step2 recover stage.
|
2023-05-17 10:43:23 +08:00 |
|
liuyao
|
3c81137ffe
|
pause source task
|
2023-05-16 13:43:46 +08:00 |
|
yihaoDeng
|
4015f544db
|
refactor code
|
2023-05-15 05:45:17 +00:00 |
|
yihaoDeng
|
42562d388f
|
refactor code
|
2023-05-15 05:29:56 +00:00 |
|
liuyao
|
a6570a4327
|
Merge branch 'enh/rocksdbSstate' of https://github.com/taosdata/TDengine into enh/rocksdbSstate
|
2023-05-15 11:19:55 +08:00 |
|
liuyao
|
9258dcd740
|
fix:mem leak
|
2023-05-15 11:19:17 +08:00 |
|
Haojun Liao
|
8e15c64499
|
refactor: do some internal refactor.
|
2023-05-13 23:22:36 +08:00 |
|
Haojun Liao
|
b2d141fe40
|
fix(stream): limit the batch size.
|
2023-05-11 15:07:07 +08:00 |
|
Haojun Liao
|
b02b3117b5
|
refactor: do some internal refactor.
|
2023-05-11 10:14:29 +08:00 |
|
Haojun Liao
|
dbd79cc80c
|
refactor: do some internal refactor.
|
2023-05-10 22:22:01 +08:00 |
|
liuyao
|
62ccd4bf16
|
avoid delete data
|
2023-05-10 09:11:04 +08:00 |
|
Yihao Deng
|
cb223acf82
|
Merge branch 'main' into enh/rocksdbSstate
|
2023-05-08 09:45:27 +08:00 |
|
Haojun Liao
|
31ac1e3eaa
|
fix(stream): revise the input queue capacity.
|
2023-05-08 00:00:55 +08:00 |
|
Haojun Liao
|
da6212bab0
|
other: merge main.
|
2023-05-06 12:51:38 +08:00 |
|
Haojun Liao
|
1fa4327f6c
|
Merge branch 'main' into fix/liaohj_main
|
2023-05-06 10:15:23 +08:00 |
|
liuyao
|
76bf0aea56
|
opt stream input queue
|
2023-05-06 10:14:27 +08:00 |
|
Haojun Liao
|
3afc5bdfcf
|
refactor: add some logs.
|
2023-05-06 10:09:51 +08:00 |
|
Haojun Liao
|
29fcd1b83a
|
refactor: do some internal refactor.
|
2023-05-06 10:08:05 +08:00 |
|
Haojun Liao
|
8b12d4d3da
|
fix(stream): secure the delete task operation. TD-1198
|
2023-05-05 15:02:03 +08:00 |
|
liuyao
|
74ab689719
|
opt batch num
|
2023-05-05 08:59:07 +08:00 |
|
liuyao
|
d8a1f15d10
|
fix resum bug
|
2023-05-04 09:28:06 +08:00 |
|
Haojun Liao
|
3c61932ecc
|
refactor: do some internal refactor.
|
2023-05-01 19:28:54 +08:00 |
|
Haojun Liao
|
b7c8346b44
|
other: merge other branch.
|
2023-04-28 13:06:47 +08:00 |
|
Haojun Liao
|
f9a64cbcd6
|
other: add some logs.
|
2023-04-28 12:58:03 +08:00 |
jiajingbin
|
ebf9a13fe7
|
inc batch num
|
2023-04-27 18:15:17 +08:00 |
|
liuyao
|
863d30e5a9
|
opt tq read
|
2023-04-26 18:58:19 +08:00 |
|
liuyao
|
2533b5c5c2
|
op stream
|
2023-04-26 17:00:33 +08:00 |
|
yihaoDeng
|
917b07348c
|
Merge branch 'fix/rocksdbState' into enh/rocksRevert
|
2023-04-23 02:37:26 +00:00 |
|
Haojun Liao
|
b6f4cac619
|
fix(stream): set the correct offset version.
|
2023-04-21 13:35:24 +08:00 |
|
Haojun Liao
|
5e6c06e253
|
fix(stream): fix the race condition during create new stream tasks.
|
2023-04-20 23:21:18 +08:00 |
|
Haojun Liao
|
8323ad8670
|
enh(stream): add more check to stop stream asap.
|
2023-04-20 17:29:08 +08:00 |
|
Haojun Liao
|
930b267a75
|
fix(stream): set the correct start offset for stream task.
|
2023-04-17 22:59:00 +08:00 |
|
Haojun Liao
|
b57c813681
|
other: merge feature/3_liaohj
|
2023-04-14 10:36:54 +08:00 |
|
Haojun Liao
|
70b45a4cf0
|
fix(stream): all data should be extracted from wal.
|
2023-04-13 23:22:09 +08:00 |
|
Haojun Liao
|
5ab54481f0
|
refactor: do some internal refactor.
|
2023-04-11 19:24:34 +08:00 |
|
yihaoDeng
|
b24b91886a
|
Merge branch 'dev3' into enh/rocksRevert
|
2023-04-11 10:59:00 +00:00 |
|
Haojun Liao
|
18479d8115
|
refactor: do some internall refactor.
|
2023-04-11 15:42:24 +08:00 |
|
Haojun Liao
|
15cceb5a5a
|
refactor: do some internal refactors.
|
2023-04-11 11:53:10 +08:00 |
|
liuyao
|
74da3c05bc
|
feat:set check point id
|
2023-04-11 10:33:10 +08:00 |