Haojun Liao
|
1367552f38
|
fix(stream): refactor the halt status to check more status.
|
2023-07-24 10:04:15 +08:00 |
|
Haojun Liao
|
4e0f7ffbf8
|
fix(stream): set the correct flag of pause/resume.
|
2023-07-23 18:49:56 +08:00 |
|
Haojun Liao
|
1b2636028a
|
fix(stream): fix memory leak.
|
2023-07-21 23:05:42 +08:00 |
|
Haojun Liao
|
16d7707b90
|
fix(stream): align the scan real time data for stream task.
|
2023-07-21 19:33:43 +08:00 |
|
Haojun Liao
|
db46d31ca5
|
fix(stream): refactor the halt function.
|
2023-07-21 01:32:42 +08:00 |
|
Haojun Liao
|
aed99da6c1
|
refactor: refactor the stream task starting order.
|
2023-07-20 12:14:53 +08:00 |
yihaoDeng
|
6e5be0d30e
|
fix stream state transfer
|
2023-07-20 03:49:32 +00:00 |
|
Haojun Liao
|
97c44e7c18
|
refactor: do some internal refactor.
|
2023-07-19 18:42:02 +08:00 |
|
Haojun Liao
|
2ae95217bd
|
fix(stream): open inputQ by default for task deployed on snode.
|
2023-07-19 10:05:35 +08:00 |
|
Haojun Liao
|
d2c875e774
|
Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2
|
2023-07-18 15:19:09 +08:00 |
|
Haojun Liao
|
901b7d8ecc
|
fix(stream): if a source task is set to be non-normal, no data should be put into inputQ anymore.
|
2023-07-18 15:18:57 +08:00 |
|
yihaoDeng
|
40d59990d8
|
fix mem leak
|
2023-07-18 04:01:20 +00:00 |
|
Haojun Liao
|
08f43b9d00
|
fix(stream): fix checkpoint block not fetched bug.
|
2023-07-17 15:31:54 +08:00 |
Haojun Liao
|
b2a905bd91
|
Merge branch '3.0' into enh/triggerCheckPoint2
|
2023-07-17 11:50:12 +08:00 |
|
Haojun Liao
|
a9757637d9
|
Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2
|
2023-07-16 12:47:24 +08:00 |
|
Haojun Liao
|
c6a322e0ef
|
refactor(stream): back pressure is active, which is trigger by dispatch rsp.
|
2023-07-16 12:47:08 +08:00 |
|
yihaoDeng
|
e18c9ea672
|
add checkpoint
|
2023-07-15 04:26:34 +00:00 |
|
yihaoDeng
|
ed931c1100
|
Merge branch 'fix/newCheckpoint' into enh/triggerCheckPoint2
|
2023-07-14 10:11:20 +00:00 |
|
yihaoDeng
|
3c4631ef1f
|
add checkpoint
|
2023-07-14 10:06:24 +00:00 |
|
Haojun Liao
|
2b85ea62aa
|
refactor: do some internal refactor.
|
2023-07-14 17:48:47 +08:00 |
|
Haojun Liao
|
eb7e6152ae
|
refactor(stream): do some internal refactor.
|
2023-07-14 17:21:20 +08:00 |
|
Haojun Liao
|
813f4cb363
|
refactor: do some internal refactor.
|
2023-07-13 16:32:25 +08:00 |
|
Haojun Liao
|
2f90a53548
|
fix(stream): set checkpoint id when expanding task.
|
2023-07-13 10:16:57 +08:00 |
liuyao
|
7d4bb1b932
|
add checkpoint id for recover
|
2023-07-12 10:48:58 +08:00 |
|
Haojun Liao
|
fed3803739
|
fix(stream): fix memory leak.
|
2023-07-11 19:29:52 +08:00 |
|
Haojun Liao
|
09b764494d
|
fix(stream): set correct checkpoint version when starting stream tasks.
|
2023-07-11 14:03:43 +08:00 |
|
Haojun Liao
|
87bedef2cd
|
fix(stream): fix error in checkpointing.
|
2023-07-10 19:20:05 +08:00 |
|
Haojun Liao
|
4f534ce6e9
|
fix(stream): fix error in generating checkpoint.
|
2023-07-08 10:29:09 +08:00 |
|
Haojun Liao
|
a5c19427e7
|
fix(stream): send correct rsp to mnode.
|
2023-07-08 09:39:44 +08:00 |
|
Haojun Liao
|
9c30abf95b
|
fix(stream): fix error in generating checkpoint.
|
2023-07-07 21:38:53 +08:00 |
|
Haojun Liao
|
8298f30e56
|
fix(stream): fix bug in checkpoint.
|
2023-07-07 17:16:08 +08:00 |
|
Haojun Liao
|
47877898d0
|
enh(stream): generate the checkpoint framework.
|
2023-07-07 16:07:52 +08:00 |
|
Haojun Liao
|
d7101f7109
|
enh(stream): support dispatch checkpoint msg.
|
2023-07-06 18:26:22 +08:00 |
|
liuyao
|
0e914a19c6
|
stream operartor checkpoint
|
2023-07-06 14:28:34 +08:00 |
|
Haojun Liao
|
5a9461a69a
|
other: merge 3.0
|
2023-07-06 11:52:21 +08:00 |
|
Haojun Liao
|
f4a3567935
|
other: merge 3.0
|
2023-07-06 11:24:30 +08:00 |
|
Haojun Liao
|
03dbcbf055
|
refactor: do some internal refactor.
|
2023-07-05 15:55:55 +08:00 |
|
yihaoDeng
|
7d30a6e27a
|
vnode snapshot read
|
2023-06-30 11:48:46 +00:00 |
|
yihaoDeng
|
6b6e237079
|
add checkpoint
|
2023-06-28 09:57:08 +00:00 |
|
Haojun Liao
|
57fcd553f8
|
refactor: do some internal refactor.
|
2023-06-28 13:13:13 +08:00 |
|
Haojun Liao
|
a19e63fd23
|
fix(stream): fix error in handling fill history.
|
2023-06-27 23:00:14 +08:00 |
|
Haojun Liao
|
b73444b291
|
fix(stream): start stream task in case of scan history completing.
|
2023-06-27 09:44:51 +08:00 |
|
Haojun Liao
|
402c091df0
|
fix(stream): fix sma error.
|
2023-06-25 19:41:44 +08:00 |
yihaoDeng
|
0330f3b2db
|
add checkpoint
|
2023-06-25 17:03:01 +08:00 |
|
yihaoDeng
|
e36de5edf7
|
add checkpoint
|
2023-06-25 14:35:20 +08:00 |
|
yihaoDeng
|
d9e24566c0
|
add checkpoint
|
2023-06-20 18:32:56 +08:00 |
|
yihaoDeng
|
548e439aa2
|
add checkpoint
|
2023-06-19 20:48:49 +08:00 |
|
liuyao
|
41c193945f
|
fill history pause&resume
|
2023-06-19 17:28:19 +08:00 |
|
yihaoDeng
|
0eeaab9cd3
|
Merge branch 'refact/fillhistory1' into refact/fillhistory
|
2023-06-19 13:53:37 +08:00 |
|
yihaoDeng
|
b6fe5d917b
|
refactor checkpoint
|
2023-06-17 14:05:49 +08:00 |
|
Haojun Liao
|
64365666b7
|
fix(stream): update the info, and do some internal refactor.
|
2023-06-16 16:04:43 +08:00 |
|
yihaoDeng
|
9f9171719a
|
support fill history
|
2023-06-15 21:29:52 +08:00 |
|
liuyao
|
693942b821
|
trans state
|
2023-06-15 14:13:17 +08:00 |
|
Haojun Liao
|
53377c2c1f
|
fix(stream): wait for stream task completed.
|
2023-06-15 01:14:41 +08:00 |
|
liuyao
|
9a3708e17b
|
pause&resume fill history
|
2023-06-14 15:54:07 +08:00 |
|
Haojun Liao
|
7c6fbd7772
|
enh(stream): do some internal refactor and support secondary scan for history data.
|
2023-06-14 14:10:09 +08:00 |
|
Haojun Liao
|
11f0c3b336
|
refactor: do some internal refactor.
|
2023-06-14 10:46:46 +08:00 |
|
Haojun Liao
|
b44447e6f3
|
enh(stream): support restore from disk.
|
2023-06-14 10:19:03 +08:00 |
|
Haojun Liao
|
97da2a8fac
|
fix(stream): set the fill history status.
|
2023-06-13 16:10:55 +08:00 |
|
Haojun Liao
|
fb24ed161d
|
enh(stream): set correct task status.
|
2023-06-12 22:48:23 +08:00 |
|
Haojun Liao
|
78a240be8f
|
enh(stream): add dispatch msg.
|
2023-06-12 13:12:45 +08:00 |
|
yihaoDeng
|
a2030dc378
|
add trigger checkpoint
|
2023-06-09 12:12:51 +00:00 |
|
Haojun Liao
|
69c9eda7af
|
fix(stream): fix race condition.
|
2023-06-09 11:37:38 +08:00 |
|
Haojun Liao
|
53246ed6bb
|
other: merge other branch.
|
2023-06-09 09:41:10 +08:00 |
|
Haojun Liao
|
c9aa59cbb9
|
refactor: do some internal refactor.
|
2023-06-08 18:59:25 +08:00 |
|
Haojun Liao
|
6c13491428
|
refactor: do some internal refactor.
|
2023-06-08 16:55:41 +08:00 |
|
yihaoDeng
|
8b91617145
|
Merge branch 'enh/dv3' into enh/triggerCheckpoint
|
2023-06-08 07:20:41 +00:00 |
|
yihaoDeng
|
77f287d9be
|
add trigger checkpoint
|
2023-06-08 07:19:59 +00:00 |
|
Haojun Liao
|
30eba472c3
|
Merge pull request #21602 from taosdata/fix/TD-24600-dv3
fix/td-24600-dv3
|
2023-06-08 13:42:02 +08:00 |
|
Haojun Liao
|
cb26dd9fa2
|
refactor(stream): do some internal refactor.
|
2023-06-08 10:17:21 +08:00 |
|
Haojun Liao
|
06cf3588da
|
refactor: do some internal refactor.
|
2023-06-07 15:03:04 +08:00 |
|
liuyao
|
1e9c4d5fac
|
opt stream block dispatch
|
2023-06-07 10:45:27 +08:00 |
|
Haojun Liao
|
6a3c935b4a
|
fix(stream): fix error in fill history scan.
|
2023-06-07 09:15:55 +08:00 |
|
Haojun Liao
|
0dd933013c
|
enh(stream): make history task for stream running.
|
2023-06-05 17:58:00 +08:00 |
|
Haojun Liao
|
fcc706c45c
|
enh(stream): refactor the fill history task.
|
2023-06-05 15:59:01 +08:00 |
|
yihaoDeng
|
74d5f02969
|
fix invalid free
|
2023-06-05 04:56:07 +00:00 |
|
Haojun Liao
|
077e1a1ed4
|
Merge branch '3.0' into refact/fillhistory
|
2023-06-05 11:41:13 +08:00 |
|
yihaoDeng
|
32c3cfd51a
|
Avoid creating the same ID task multiple times
|
2023-06-01 11:13:27 +00:00 |
|
Haojun Liao
|
eda06081ff
|
enh(stream): refactor and serialize the attributes of history tasks.
|
2023-05-30 16:55:37 +08:00 |
|
Haojun Liao
|
d9c364d663
|
Merge branch '3.0' into refact/fillhistory
|
2023-05-30 15:51:12 +08:00 |
|
Haojun Liao
|
be8fd9e48b
|
enh(stream): create additional task for history data processing.
|
2023-05-30 14:47:10 +08:00 |
|
Haojun Liao
|
20a0054c4a
|
Merge pull request #21472 from taosdata/enh/addCompileError
change parameter
|
2023-05-30 09:36:36 +08:00 |
|
Haojun Liao
|
3628888ecc
|
refactor: do some internal refactor.
|
2023-05-29 18:02:45 +08:00 |
|
Haojun Liao
|
f2887278e2
|
refactor: do some internal refactor.
|
2023-05-29 15:44:45 +08:00 |
|
yihaoDeng
|
a71bffd719
|
Merge branch 'enh/dev3.0' into enh/addCompileError
|
2023-05-26 13:03:35 +00:00 |
|
yihaoDeng
|
34d21bc03f
|
change parameter
|
2023-05-26 20:11:33 +08:00 |
|
Haojun Liao
|
0966213847
|
fix(arch): set the correct module api dependency.
|
2023-05-25 14:21:40 +08:00 |
|
Haojun Liao
|
1f7f326bed
|
refactor: do some internal refactor and set the api function ptr.
|
2023-05-24 13:22:05 +08:00 |
|
Haojun Liao
|
e67b532d8a
|
refactor: refactor the module dependency.
|
2023-05-23 18:29:23 +08:00 |
|
Haojun Liao
|
de44c9160c
|
refactor: do some internal refactor.
|
2023-05-20 18:05:39 +08:00 |
|
Haojun Liao
|
6ded3284da
|
refactor: do some internal refactor.
|
2023-05-20 11:37:17 +08:00 |
|
yihaoDeng
|
9380b22394
|
merge 3.0
|
2023-05-18 05:46:38 +00:00 |
|
Haojun Liao
|
ffee5ebc61
|
Merge branch '3.0' into feature/3_liaohj
|
2023-05-17 17:47:44 +08:00 |
|
Haojun Liao
|
041ffa91bd
|
other: merge main.
|
2023-05-17 15:42:15 +08:00 |
|
Haojun Liao
|
e35d145734
|
fix(stream): fix memory leak.
|
2023-05-16 13:59:13 +08:00 |
|
liuyao
|
502efb3d01
|
op stream selectivity buff
|
2023-05-15 16:26:24 +08:00 |
|
yihaoDeng
|
9c0d2c87c6
|
Merge branch 'enh/3.0' into enh/rocksdbSstateMerge
|
2023-05-15 01:52:42 +00:00 |
|
Haojun Liao
|
8e15c64499
|
refactor: do some internal refactor.
|
2023-05-13 23:22:36 +08:00 |
|
Haojun Liao
|
236926b9ee
|
other: merge enh/rocksdbstate
|
2023-05-13 19:49:28 +08:00 |
|
liuyao
|
8b7b804606
|
opt partition by tbname
|
2023-05-11 18:47:27 +08:00 |
|
yihaoDeng
|
b91981af59
|
factor code
|
2023-05-11 10:09:09 +00:00 |
|
yihaoDeng
|
4e8f5f5d32
|
factor code
|
2023-05-11 09:58:53 +00:00 |
|
yihaoDeng
|
afaee9c386
|
factor code
|
2023-05-11 09:51:01 +00:00 |
|
yihaoDeng
|
4715aacd41
|
factor code
|
2023-05-11 09:44:40 +00:00 |
|
yihaoDeng
|
f652f71d68
|
factor code
|
2023-05-11 06:37:57 +00:00 |
|
Haojun Liao
|
dbd79cc80c
|
refactor: do some internal refactor.
|
2023-05-10 22:22:01 +08:00 |
|
yihaoDeng
|
55014aa003
|
Merge branch 'enh/rocksdbSstate' into enh/rocksdbSstateMerge
|
2023-05-09 08:58:51 +00:00 |
|
yihaoDeng
|
08c3a63341
|
Merge branch 'enh/standVer' into enh/rocksdbSstateMerge
|
2023-05-06 12:37:54 +00:00 |
|
Haojun Liao
|
da6212bab0
|
other: merge main.
|
2023-05-06 12:51:38 +08:00 |
|
yihaoDeng
|
d7e86aca05
|
fix case failure
|
2023-05-05 15:14:16 +00:00 |
|
Haojun Liao
|
8958aabe4b
|
fix(stream): opt task scan performance.
|
2023-05-05 19:33:30 +08:00 |
|
yihaoDeng
|
f7a7743af7
|
fix case failure
|
2023-05-05 08:32:33 +00:00 |
|
Haojun Liao
|
23c49594b7
|
other: merge main.
|
2023-05-04 16:41:53 +08:00 |
|
yihaoDeng
|
c27d01a510
|
Merge branch 'enh/addTtlToStream' into enh/rocksdbSstateMerge
|
2023-05-04 08:22:31 +00:00 |
|
liuyao
|
d8a1f15d10
|
fix resum bug
|
2023-05-04 09:28:06 +08:00 |
|
Haojun Liao
|
3c61932ecc
|
refactor: do some internal refactor.
|
2023-05-01 19:28:54 +08:00 |
|
yihaoDeng
|
dda1c8803c
|
Merge branch 'enh/rocksdbSstate' into enh/rocksdbSstateMerge
|
2023-04-28 09:17:22 +00:00 |
|
yihaoDeng
|
afc6023a8a
|
merge rocksdb inst
|
2023-04-28 06:32:33 +00:00 |
|
yihaoDeng
|
36a4413bf1
|
merge rocksdb inst
|
2023-04-27 14:38:33 +00:00 |
|
Haojun Liao
|
b7040ed15e
|
enh(stream): support resume from the latest data, and do some internal refactor.
|
2023-04-27 15:07:54 +08:00 |
|
liuyao
|
863d30e5a9
|
opt tq read
|
2023-04-26 18:58:19 +08:00 |
|
yihaoDeng
|
81bd7661bd
|
add ttl to stream state key
|
2023-04-24 14:20:01 +00:00 |
|
yihaoDeng
|
ae3730c318
|
add ttl to stream state key
|
2023-04-23 13:29:18 +00:00 |
|
liuyao
|
641c707b37
|
pause&resume
|
2023-04-23 17:37:10 +08:00 |
|
54liuyao
|
5089528a02
|
feat:stream pause&resume
|
2023-04-23 15:08:51 +08:00 |
|
yihaoDeng
|
917b07348c
|
Merge branch 'fix/rocksdbState' into enh/rocksRevert
|
2023-04-23 02:37:26 +00:00 |
|
Haojun Liao
|
5e6c06e253
|
fix(stream): fix the race condition during create new stream tasks.
|
2023-04-20 23:21:18 +08:00 |
|
yihaoDeng
|
3272d14e33
|
change write opt
|
2023-04-20 04:05:35 +00:00 |
|
Haojun Liao
|
fb32ffd960
|
fix(stream): update the reference count value to be int32, insead of int8
|
2023-04-18 18:06:03 +08:00 |
|
Haojun Liao
|
1f3c8c3d80
|
fix(stream): update the ref type.
|
2023-04-18 17:15:31 +08:00 |
|
Haojun Liao
|
ac137b4b33
|
refactor: do some internal refactor.
|
2023-04-17 09:46:58 +08:00 |
|
Haojun Liao
|
be90d2c511
|
fix(stream): disable stream task when no tasks exist.
|
2023-04-16 23:07:54 +08:00 |
|
Haojun Liao
|
d420734971
|
Merge remote-tracking branch 'origin/enh/rocksRevert' into enh/rocksRevert
|
2023-04-14 18:03:19 +08:00 |
|
Haojun Liao
|
ab4b08a4b5
|
Merge branch 'feature/3_liaohj' into enh/rocksRevert
|
2023-04-14 17:44:50 +08:00 |
|
Haojun Liao
|
e0cb8aa534
|
fix(stream): don't the initial task status and do some internal refactor.
|
2023-04-14 17:43:37 +08:00 |
|
liuyao
|
b8ac811f20
|
fix bug
|
2023-04-14 17:35:17 +08:00 |
|
Haojun Liao
|
eb0e1f848a
|
fix(stream): remove unused tqreader, do some internal refactor, set the meta value for streamtask.
|
2023-04-14 12:00:09 +08:00 |
|
Haojun Liao
|
5850a3ab01
|
Merge remote-tracking branch 'origin/enh/rocksRevert' into enh/rocksRevert
|
2023-04-14 10:37:17 +08:00 |
|
Haojun Liao
|
b57c813681
|
other: merge feature/3_liaohj
|
2023-04-14 10:36:54 +08:00 |
|
Haojun Liao
|
70b45a4cf0
|
fix(stream): all data should be extracted from wal.
|
2023-04-13 23:22:09 +08:00 |
|
liuyao
|
34bf638f19
|
fix bug
|
2023-04-13 16:21:57 +08:00 |
|
liuyao
|
9be89ce00a
|
delete expired check point
|
2023-04-12 17:33:58 +08:00 |
|
yihaoDeng
|
ed4aaade8c
|
add backend
|
2023-04-12 03:03:51 +00:00 |
|
yihaoDeng
|
a3836b2363
|
fix invalid free
|
2023-04-11 12:52:03 +00:00 |
|
Haojun Liao
|
5ab54481f0
|
refactor: do some internal refactor.
|
2023-04-11 19:24:34 +08:00 |
|
yihaoDeng
|
b24b91886a
|
Merge branch 'dev3' into enh/rocksRevert
|
2023-04-11 10:59:00 +00:00 |
|
yihaoDeng
|
ff8cb09f63
|
refactor backend
|
2023-04-11 10:47:15 +00:00 |
|
Haojun Liao
|
18479d8115
|
refactor: do some internall refactor.
|
2023-04-11 15:42:24 +08:00 |
|
liuyao
|
95d81604c7
|
feat:encode&&decode stream scan op
|
2023-04-11 14:34:31 +08:00 |
|
Haojun Liao
|
15cceb5a5a
|
refactor: do some internal refactors.
|
2023-04-11 11:53:10 +08:00 |