Haojun Liao
|
0bdccd2681
|
refactor: do some internal refactor.
|
2023-07-25 17:31:54 +08:00 |
|
Haojun Liao
|
a2694b9ce9
|
fix(stream): fix the invalid check of step2 .
|
2023-07-24 19:44:28 +08:00 |
|
Haojun Liao
|
1e34f84f78
|
other: merge 3.0
|
2023-07-24 15:23:03 +08:00 |
|
Haojun Liao
|
1367552f38
|
fix(stream): refactor the halt status to check more status.
|
2023-07-24 10:04:15 +08:00 |
|
Haojun Liao
|
0b6e1a12bb
|
refactor: do some internal refactor.
|
2023-07-23 19:09:43 +08:00 |
|
Haojun Liao
|
4e0f7ffbf8
|
fix(stream): set the correct flag of pause/resume.
|
2023-07-23 18:49:56 +08:00 |
|
Haojun Liao
|
bfc4a07207
|
fix(stream): fix memory leak.
|
2023-07-22 00:20:02 +08:00 |
|
Haojun Liao
|
16d7707b90
|
fix(stream): align the scan real time data for stream task.
|
2023-07-21 19:33:43 +08:00 |
|
Haojun Liao
|
39ca9b537f
|
fix(stream): fix syntax error
|
2023-07-21 09:43:08 +08:00 |
|
Haojun Liao
|
bd8b811b9d
|
refactor: do some internal refactor.
|
2023-07-21 09:14:25 +08:00 |
|
Haojun Liao
|
0d1c4f9ee2
|
fix(stream): fix syntax error
|
2023-07-21 09:13:06 +08:00 |
|
Haojun Liao
|
db46d31ca5
|
fix(stream): refactor the halt function.
|
2023-07-21 01:32:42 +08:00 |
|
Haojun Liao
|
c9fa170e65
|
refactor: do some internal refactor.
|
2023-07-20 16:31:46 +08:00 |
|
Haojun Liao
|
45cb478b31
|
refactor: do some internal refactor.
|
2023-07-20 15:36:46 +08:00 |
|
Haojun Liao
|
aed99da6c1
|
refactor: refactor the stream task starting order.
|
2023-07-20 12:14:53 +08:00 |
|
Haojun Liao
|
97c44e7c18
|
refactor: do some internal refactor.
|
2023-07-19 18:42:02 +08:00 |
|
Haojun Liao
|
a32c650248
|
Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2
|
2023-07-19 10:05:48 +08:00 |
|
Haojun Liao
|
2ae95217bd
|
fix(stream): open inputQ by default for task deployed on snode.
|
2023-07-19 10:05:35 +08:00 |
liuyao
|
fd02b9a71e
|
Merge branch '3.0' into enh/triggerCheckPoint2
|
2023-07-19 10:02:06 +08:00 |
|
Haojun Liao
|
9513f76172
|
fix(stream): set downstream task ready state.
|
2023-07-18 19:02:24 +08:00 |
Haojun Liao
|
b2a905bd91
|
Merge branch '3.0' into enh/triggerCheckPoint2
|
2023-07-17 11:50:12 +08:00 |
|
Haojun Liao
|
8c8b1a6d79
|
fix(stream): handle block before checkpoint msg in the inputQ.
|
2023-07-17 10:47:05 +08:00 |
|
Haojun Liao
|
eb7e6152ae
|
refactor(stream): do some internal refactor.
|
2023-07-14 17:21:20 +08:00 |
|
Haojun Liao
|
813f4cb363
|
refactor: do some internal refactor.
|
2023-07-13 16:32:25 +08:00 |
|
Haojun Liao
|
fed3803739
|
fix(stream): fix memory leak.
|
2023-07-11 19:29:52 +08:00 |
|
Haojun Liao
|
da6a4de021
|
fix(stream): disable invalid set normal task status.
|
2023-07-11 15:12:34 +08:00 |
|
Haojun Liao
|
a803eaee3e
|
fix(stream): fix concurrent bug in save task meta.
|
2023-07-11 10:01:43 +08:00 |
|
Haojun Liao
|
9c30abf95b
|
fix(stream): fix error in generating checkpoint.
|
2023-07-07 21:38:53 +08:00 |
|
Haojun Liao
|
47877898d0
|
enh(stream): generate the checkpoint framework.
|
2023-07-07 16:07:52 +08:00 |
|
Haojun Liao
|
d7101f7109
|
enh(stream): support dispatch checkpoint msg.
|
2023-07-06 18:26:22 +08:00 |
|
Haojun Liao
|
03dbcbf055
|
refactor: do some internal refactor.
|
2023-07-05 15:55:55 +08:00 |
|
Haojun Liao
|
ff2bf35603
|
fix(stream): fix error in set the version range for secondary scan.
|
2023-07-04 15:08:39 +08:00 |
|
Haojun Liao
|
57fcd553f8
|
refactor: do some internal refactor.
|
2023-06-28 13:13:13 +08:00 |
|
Haojun Liao
|
a19e63fd23
|
fix(stream): fix error in handling fill history.
|
2023-06-27 23:00:14 +08:00 |
|
Haojun Liao
|
b73444b291
|
fix(stream): start stream task in case of scan history completing.
|
2023-06-27 09:44:51 +08:00 |
|
Haojun Liao
|
437eb93a4d
|
fix(stream): fix error while fill history exists.
|
2023-06-26 18:44:59 +08:00 |
|
Haojun Liao
|
daafe240ed
|
fix(stream): fix memory leak.
|
2023-06-26 14:18:47 +08:00 |
|
Haojun Liao
|
402c091df0
|
fix(stream): fix sma error.
|
2023-06-25 19:41:44 +08:00 |
liuyao
|
41c193945f
|
fill history pause&resume
|
2023-06-19 17:28:19 +08:00 |
|
Haojun Liao
|
64365666b7
|
fix(stream): update the info, and do some internal refactor.
|
2023-06-16 16:04:43 +08:00 |
|
Haojun Liao
|
53377c2c1f
|
fix(stream): wait for stream task completed.
|
2023-06-15 01:14:41 +08:00 |
|
liuyao
|
9a3708e17b
|
pause&resume fill history
|
2023-06-14 15:54:07 +08:00 |
|
Haojun Liao
|
7c6fbd7772
|
enh(stream): do some internal refactor and support secondary scan for history data.
|
2023-06-14 14:10:09 +08:00 |
|
Haojun Liao
|
11f0c3b336
|
refactor: do some internal refactor.
|
2023-06-14 10:46:46 +08:00 |
|
Haojun Liao
|
b44447e6f3
|
enh(stream): support restore from disk.
|
2023-06-14 10:19:03 +08:00 |
|
Haojun Liao
|
97da2a8fac
|
fix(stream): set the fill history status.
|
2023-06-13 16:10:55 +08:00 |
|
Haojun Liao
|
fb24ed161d
|
enh(stream): set correct task status.
|
2023-06-12 22:48:23 +08:00 |
|
Haojun Liao
|
78a240be8f
|
enh(stream): add dispatch msg.
|
2023-06-12 13:12:45 +08:00 |
|
Haojun Liao
|
2b6ace653a
|
refactor: do some internal refactor.
|
2023-06-08 16:14:27 +08:00 |
|
Haojun Liao
|
06cf3588da
|
refactor: do some internal refactor.
|
2023-06-07 15:03:04 +08:00 |
|
Haojun Liao
|
6a3c935b4a
|
fix(stream): fix error in fill history scan.
|
2023-06-07 09:15:55 +08:00 |
|
Haojun Liao
|
0dd933013c
|
enh(stream): make history task for stream running.
|
2023-06-05 17:58:00 +08:00 |
|
Haojun Liao
|
e8549ce511
|
refactor: do some internal refactor.
|
2023-06-05 16:19:37 +08:00 |
|
Haojun Liao
|
fcc706c45c
|
enh(stream): refactor the fill history task.
|
2023-06-05 15:59:01 +08:00 |
|
Haojun Liao
|
de44c9160c
|
refactor: do some internal refactor.
|
2023-05-20 18:05:39 +08:00 |
|
Haojun Liao
|
d8525123a2
|
enh(stream): add API to retrieve last ts for multi-tables.
|
2023-05-19 11:03:41 +08:00 |
|
Haojun Liao
|
041ffa91bd
|
other: merge main.
|
2023-05-17 15:42:15 +08:00 |
|
Haojun Liao
|
f3f52c0232
|
fix(stream): add some logs and set the wal offset to be the ended version when finishing the step2 recover stage.
|
2023-05-17 10:43:23 +08:00 |
|
Haojun Liao
|
da6212bab0
|
other: merge main.
|
2023-05-06 12:51:38 +08:00 |
|
Haojun Liao
|
a1263b8b04
|
fix(query):fix syntax error.
|
2023-05-01 19:40:26 +08:00 |
|
Haojun Liao
|
3c61932ecc
|
refactor: do some internal refactor.
|
2023-05-01 19:28:54 +08:00 |
|
Haojun Liao
|
6c86847b12
|
refactor: do some internal refactor.
|
2023-05-01 14:58:59 +08:00 |
|
Haojun Liao
|
bbb8aaa0dc
|
refactor: add some logs.
|
2023-04-29 02:37:10 +08:00 |
|
Haojun Liao
|
c647ded0da
|
fix(stream): add some logs.
|
2023-04-28 19:47:49 +08:00 |
|
Haojun Liao
|
f9a64cbcd6
|
other: add some logs.
|
2023-04-28 12:58:03 +08:00 |
|
Haojun Liao
|
930b267a75
|
fix(stream): set the correct start offset for stream task.
|
2023-04-17 22:59:00 +08:00 |
|
Haojun Liao
|
e0cb8aa534
|
fix(stream): don't the initial task status and do some internal refactor.
|
2023-04-14 17:43:37 +08:00 |
|
Haojun Liao
|
eb0e1f848a
|
fix(stream): remove unused tqreader, do some internal refactor, set the meta value for streamtask.
|
2023-04-14 12:00:09 +08:00 |
|
Haojun Liao
|
5ab54481f0
|
refactor: do some internal refactor.
|
2023-04-11 19:24:34 +08:00 |
|
Haojun Liao
|
f5b52749c2
|
refactor: do some internal refactor.
|
2023-04-09 01:39:09 +08:00 |
|
54liuyao
|
0cd871010f
|
fix:fix fill history bug
|
2023-03-07 13:34:26 +08:00 |
Liu Jicong
|
66b9fa01f7
|
enh: optimize drop when scan exec
|
2022-12-29 15:51:12 +08:00 |
|
Liu Jicong
|
bbab03274a
|
fix memory leak
|
2022-12-27 18:02:43 +08:00 |
|
Liu Jicong
|
3424b184d3
|
refactor(stream): distributed checkpoint
|
2022-12-02 03:48:45 +08:00 |
|
Liu Jicong
|
548684e5ac
|
fix(stream): delete multiple row
|
2022-11-29 23:39:58 +08:00 |
|
Liu Jicong
|
2fbc8e6306
|
refactor(stream): stream deploy and state transfer
|
2022-11-03 13:22:23 +08:00 |
|
Liu Jicong
|
5e253cc8ea
|
refactor(stream): fill history
|
2022-11-01 11:56:14 +08:00 |
|
Liu Jicong
|
2e640c38a2
|
refactor: stream and tmq message
|
2022-10-31 18:37:28 +08:00 |
|
Liu Jicong
|
8d8fd2b2bc
|
refactor(stream): recover and fill history
|
2022-10-26 10:20:33 +08:00 |
|
Liu Jicong
|
75e5e490fd
|
refactor(stream): recover and fill history
|
2022-10-26 00:31:00 +08:00 |
|
Liu Jicong
|
2d628491b2
|
feat(stream): support tdb state backend
|
2022-08-23 19:30:04 +08:00 |
|
Liu Jicong
|
fc225a580d
|
enh(stream): recover process
|
2022-08-09 21:37:21 +08:00 |
|
Liu Jicong
|
d9a4ea305d
|
fix(stream): memory error
|
2022-08-09 14:11:41 +08:00 |
|
Liu Jicong
|
ad032a0a90
|
enh(stream): stream recover
|
2022-08-09 10:36:27 +08:00 |
|
Liu Jicong
|
c411b9aebb
|
fix(stream): memory leak
|
2022-08-08 18:09:36 +08:00 |
|
Liu Jicong
|
43026ac31d
|
refactor(stream)
|
2022-08-08 11:29:50 +08:00 |
|
Liu Jicong
|
7c9d57bd89
|
refactor(stream): unify sink and dispatch
|
2022-08-05 20:16:47 +08:00 |
|
Liu Jicong
|
a9d11b58ad
|
enh(stream): recover
|
2022-07-28 16:19:50 +08:00 |
|
Liu Jicong
|
280ed4f65d
|
feat(stream): pipelined exec for recovering
|
2022-07-15 21:29:53 +08:00 |
|
Liu Jicong
|
9394e3380f
|
feat(stream): recover from failure
|
2022-07-15 17:58:53 +08:00 |