kailixu
|
77eadc59dc
|
Merge branch '3.0' into enh/TD-23769-3.0x
|
2023-11-03 16:26:07 +08:00 |
yihaoDeng
|
24e961976f
|
Merge branch 'enh/new3.0' into enh/refactorBackend
|
2023-11-03 09:31:57 +08:00 |
Haojun Liao
|
7cf90dde5c
|
refactor: do some internal refactor.
|
2023-11-01 19:38:13 +08:00 |
|
Haojun Liao
|
00f029e44f
|
refactor: add some logs.
|
2023-11-01 19:38:12 +08:00 |
|
yihaoDeng
|
4c8edb5545
|
Merge branch 'enh/new3.0' into enh/refactorBackend
|
2023-11-01 16:07:49 +08:00 |
|
kailixu
|
1530fe0c49
|
Merge branch '3.0' into enh/TD-23769-3.0x
|
2023-11-01 09:52:16 +08:00 |
|
kailixu
|
ad1e6accd4
|
chore: build checkpoint for rsma
|
2023-11-01 09:45:58 +08:00 |
|
Haojun Liao
|
0b18192b23
|
fix(stream): fix error in finishing event handling.
|
2023-10-31 16:40:16 +08:00 |
|
Haojun Liao
|
86dfc52a6e
|
fix(stream): add event check when handling the end of event.
|
2023-10-31 10:45:12 +08:00 |
|
Haojun Liao
|
c7285c0ede
|
fix(stream): add expired epset node list for stream tasks in hb to mnode.
|
2023-10-27 23:41:57 +08:00 |
|
Haojun Liao
|
454624516c
|
fix(stream): handle the repeatly issued nodeUpdate msg from dnode.
|
2023-10-27 09:59:51 +08:00 |
|
Haojun Liao
|
1ccbb77981
|
fix(stream): fix dead lock when shutdown all tasks.
|
2023-10-27 09:59:37 +08:00 |
|
Haojun Liao
|
b0ef072556
|
fix(stream): clear flag for checkpoint.
|
2023-10-27 09:55:07 +08:00 |
|
Haojun Liao
|
091238e7be
|
fix(stream): fix bugs caused by refactor sm.
|
2023-10-27 09:54:58 +08:00 |
|
Haojun Liao
|
e1f6043eed
|
fix(stream): fix bugs caused by refactor sm.
|
2023-10-27 09:54:57 +08:00 |
|
Haojun Liao
|
1eac7f44c0
|
fix(stream): fix error in stream.
|
2023-10-27 09:54:56 +08:00 |
|
Haojun Liao
|
579dd8e6b2
|
refactor(stream): do some internal refactor.
|
2023-10-27 09:54:56 +08:00 |
|
Haojun Liao
|
6f3c0d17cc
|
refactor(stream): add state machine to manage the state of stream tasks.
|
2023-10-27 09:54:49 +08:00 |
|
Haojun Liao
|
596eb073b7
|
refactor(stream): do some internal refactor.
|
2023-10-27 09:54:48 +08:00 |
|
Haojun Liao
|
2409a17517
|
refactor(stream): do some internal refactor.
|
2023-10-27 09:54:44 +08:00 |
|
Haojun Liao
|
164159f293
|
enh(stream): add parameter to limit the stream sink task.
|
2023-10-27 09:54:07 +08:00 |
|
yihaoDeng
|
db0f6258fe
|
fix stream case error
|
2023-10-25 19:38:22 +08:00 |
|
yihaoDeng
|
1a4cfd11a5
|
Merge branch 'enh/new3.0' into enh/refactorBackend
|
2023-10-20 15:28:10 +08:00 |
|
yihaoDeng
|
2004c1a346
|
fix transfer crash
|
2023-10-17 18:19:52 +08:00 |
|
yihaoDeng
|
a56d831a14
|
refactor backend
|
2023-10-12 20:16:41 +08:00 |
|
yihaoDeng
|
f264ffdcd6
|
refactor backend
|
2023-10-11 20:12:07 +08:00 |
|
yihaoDeng
|
031506aef8
|
refactor backend
|
2023-10-11 19:46:35 +08:00 |
|
Haojun Liao
|
05dfadd8f8
|
fix(stream): set initial version for fill-history task. disable reentry of scan-history task function.
|
2023-10-10 15:52:48 +08:00 |
|
Haojun Liao
|
adf6f65d09
|
fix(stream): set initial version for fill-history task. disable reentry of scan-history task function.
|
2023-10-10 14:00:30 +08:00 |
|
Haojun Liao
|
847baa8b71
|
fix(stream): fix the pause failure bug.
|
2023-10-09 20:10:27 +08:00 |
|
Haojun Liao
|
21fb502690
|
enh(stream): add trans to reset task status to avoid being frozen in checkpoint status due to doing checkpoint failure of partial tasks.
|
2023-10-09 20:10:26 +08:00 |
|
Haojun Liao
|
9a7167aaba
|
fix(stream): sleep for 10ms
|
2023-10-09 20:10:24 +08:00 |
|
Haojun Liao
|
af2c0c95e9
|
refactor: do some internal refactor.
|
2023-10-09 20:10:22 +08:00 |
|
Haojun Liao
|
28008f8263
|
enh(stream): add more info for sink task.
|
2023-10-09 20:09:22 +08:00 |
|
Haojun Liao
|
cf14772dd9
|
enh(stream): optimize the scan wal perf
|
2023-10-09 20:09:21 +08:00 |
|
Haojun Liao
|
c295ec322a
|
refactor: do some internal refactor.
|
2023-10-09 20:09:20 +08:00 |
|
Haojun Liao
|
583ac1fc45
|
refactor: do some internal refactor.
|
2023-10-09 20:09:20 +08:00 |
|
Haojun Liao
|
bb4ba54f28
|
fix(stream): enable new time range for stream task.
|
2023-10-09 20:09:09 +08:00 |
|
Haojun Liao
|
c759d90bf6
|
enh(stream): optimize the stream status when creating without fill-history option.
|
2023-10-09 20:09:09 +08:00 |
|
Haojun Liao
|
db897fb03a
|
fix(stream): opt perf.
|
2023-10-09 20:09:09 +08:00 |
|
Haojun Liao
|
dfe8641c0c
|
refactor: optimize the fill-history task launch policy, and do some other internal refactor.
|
2023-10-09 20:08:52 +08:00 |
|
Haojun Liao
|
a248f3d088
|
refactor: do some internal refactor.
|
2023-10-09 20:08:12 +08:00 |
|
Haojun Liao
|
0db357401d
|
fix(stream): add new status for meta.
|
2023-10-09 20:08:12 +08:00 |
|
Haojun Liao
|
3912d80c02
|
fix(stream): do some internal refactor.
|
2023-10-09 20:08:11 +08:00 |
|
Haojun Liao
|
feb09c8361
|
fix(stream): fix error in pause scan-history data.
|
2023-10-09 20:08:11 +08:00 |
|
Haojun Liao
|
4af7812f0b
|
fix(stream): fix the invalid counter for ready tasks in vnode, fix an invalid read.
|
2023-10-09 20:08:10 +08:00 |
|
Haojun Liao
|
f4f55fcbce
|
fix(stream): record the tasks started info, and do some internal refactor.
|
2023-10-09 20:08:09 +08:00 |
|
Haojun Liao
|
68b003c804
|
fix(stream): fix race condition.
|
2023-10-09 20:08:09 +08:00 |
|
Haojun Liao
|
52763ca2a3
|
refactor: do some internal refactor.
|
2023-10-09 20:08:07 +08:00 |
|
Haojun Liao
|
c05a8de3e8
|
fix(stream): rsp when checkpoint source failed.
|
2023-10-09 20:08:06 +08:00 |
|
Haojun Liao
|
5eee76df65
|
fix(stream): add msg identifier check.
|
2023-10-09 20:08:05 +08:00 |
|
Haojun Liao
|
e0d19af000
|
fix(stream): refactor re-try dispatch msg for stream tasks.
|
2023-10-09 20:08:03 +08:00 |
|
Haojun Liao
|
2b16976902
|
refactor(stream): refactor send msg.
|
2023-10-09 20:08:03 +08:00 |
|
Haojun Liao
|
27e00b1f19
|
fix(stream): add some logs, and remove invalid assert.
|
2023-10-09 20:08:02 +08:00 |
|
Haojun Liao
|
12687eb287
|
fix(stream): add check info detailed information.
|
2023-10-09 20:08:02 +08:00 |
|
Haojun Liao
|
ef9efc8a8e
|
refactor: do refactor the sink task.
|
2023-10-09 20:07:53 +08:00 |
|
Haojun Liao
|
1f45bd82d2
|
other: merge stream fix in main.
|
2023-10-09 20:07:01 +08:00 |
|
Haojun Liao
|
e27111ecd1
|
enh(stream): add node stage check.
|
2023-10-09 20:06:09 +08:00 |
|
Haojun Liao
|
5c0b8ea804
|
enh(stream): log the checkpoint time.
|
2023-10-09 20:06:04 +08:00 |
|
Haojun Liao
|
b95ad74c7f
|
fix(stream): not handle the check msg for follower tasks.
|
2023-10-09 20:06:04 +08:00 |
|
Haojun Liao
|
636eccc160
|
fix(stream): add null check
|
2023-10-09 20:05:37 +08:00 |
|
Haojun Liao
|
0459a4628c
|
fix(stream): fix stream task id error.
|
2023-10-09 20:05:36 +08:00 |
|
Haojun Liao
|
7ccc273206
|
other: merge stream fix in main.
|
2023-10-09 20:05:29 +08:00 |
|
Haojun Liao
|
98ef566eb4
|
fix(stream): remove fill-history sink task.
|
2023-10-09 20:04:17 +08:00 |
|
Haojun Liao
|
e84eeee6b8
|
refactor: do some internal refactor.
|
2023-10-09 20:04:17 +08:00 |
|
Haojun Liao
|
6fa54789cb
|
fix(stream): disable follower send hb to mnode. and do some internal refactor.
|
2023-10-09 19:59:31 +08:00 |
|
Haojun Liao
|
1256eafddb
|
other: merge stream fix.
|
2023-10-09 19:59:24 +08:00 |
|
Haojun Liao
|
aaa12ed4f8
|
refactor: do some internal refactor about the sched status set
|
2023-10-09 19:56:17 +08:00 |
|
Haojun Liao
|
d87db2f829
|
fix(stream): fix the pause failure bug.
|
2023-10-09 14:48:11 +08:00 |
|
Haojun Liao
|
ee6516f3c4
|
enh(stream): add trans to reset task status to avoid being frozen in checkpoint status due to doing checkpoint failure of partial tasks.
|
2023-10-09 10:13:53 +08:00 |
|
Haojun Liao
|
23fb26798f
|
fix(stream): sleep for 10ms
|
2023-10-07 19:47:49 +08:00 |
|
Haojun Liao
|
ab17bfdf09
|
refactor: do some internal refactor.
|
2023-10-07 19:16:55 +08:00 |
|
yihaoDeng
|
c146327da8
|
refact task backend
|
2023-10-07 16:48:36 +08:00 |
|
yihaoDeng
|
fa70221238
|
refact task backend
|
2023-10-07 12:17:55 +08:00 |
|
Haojun Liao
|
c20dd002fb
|
enh(stream): add more info for sink task.
|
2023-10-07 01:14:00 +08:00 |
|
Haojun Liao
|
41ef1a45c1
|
enh(stream): optimize the scan wal perf
|
2023-10-04 22:06:46 +08:00 |
|
Haojun Liao
|
a543f4ca97
|
refactor: do some internal refactor.
|
2023-10-03 01:52:03 +08:00 |
|
Haojun Liao
|
5718158fc0
|
refactor: do some internal refactor.
|
2023-10-01 22:27:29 +08:00 |
|
Haojun Liao
|
f2d8431619
|
fix(stream): enable new time range for stream task.
|
2023-09-28 18:26:52 +08:00 |
|
yihaoDeng
|
54e3ac2c1e
|
refact task backend
|
2023-09-28 15:46:12 +08:00 |
|
Haojun Liao
|
80ec77cbb6
|
enh(stream): optimize the stream status when creating without fill-history option.
|
2023-09-28 11:23:03 +08:00 |
|
Haojun Liao
|
22e485d132
|
fix(stream): opt perf.
|
2023-09-28 09:25:23 +08:00 |
|
Haojun Liao
|
e13efd5b04
|
refactor: optimize the fill-history task launch policy, and do some other internal refactor.
|
2023-09-27 14:00:48 +08:00 |
|
Haojun Liao
|
890d658aea
|
refactor: do some internal refactor.
|
2023-09-26 14:11:45 +08:00 |
|
Haojun Liao
|
f3f18b0fa3
|
fix(stream): add new status for meta.
|
2023-09-26 12:15:12 +08:00 |
|
Haojun Liao
|
d214a2f6bd
|
fix(stream): do some internal refactor.
|
2023-09-26 09:32:57 +08:00 |
|
Haojun Liao
|
6cc3618ed9
|
fix(stream): fix error in pause scan-history data.
|
2023-09-26 01:09:55 +08:00 |
|
Haojun Liao
|
fcf4cc7169
|
fix(stream): fix the invalid counter for ready tasks in vnode, fix an invalid read.
|
2023-09-25 15:58:24 +08:00 |
|
Haojun Liao
|
eb4078b7f3
|
fix(stream): record the tasks started info, and do some internal refactor.
|
2023-09-25 09:59:05 +08:00 |
|
Haojun Liao
|
c987f61300
|
fix(stream): fix race condition.
|
2023-09-25 01:37:27 +08:00 |
|
Haojun Liao
|
4ea737571d
|
refactor: do some internal refactor.
|
2023-09-24 01:26:51 +08:00 |
|
Haojun Liao
|
acd3321494
|
fix(stream): rsp when checkpoint source failed.
|
2023-09-23 14:13:33 +08:00 |
|
Haojun Liao
|
5b12e276cf
|
fix(stream): add msg identifier check.
|
2023-09-22 18:13:18 +08:00 |
yihaoDeng
|
11da631bb5
|
add cvt state
|
2023-09-22 09:08:42 +00:00 |
|
Haojun Liao
|
619a9f6d08
|
fix(stream): refactor re-try dispatch msg for stream tasks.
|
2023-09-22 15:57:55 +08:00 |
|
Haojun Liao
|
898aea5cfb
|
refactor(stream): refactor send msg.
|
2023-09-22 14:52:18 +08:00 |
|
Haojun Liao
|
87ea745861
|
fix(stream): add some logs, and remove invalid assert.
|
2023-09-22 10:53:03 +08:00 |
|
Haojun Liao
|
f7bcff862d
|
fix(stream): add check info detailed information.
|
2023-09-22 10:23:56 +08:00 |
|
yihaoDeng
|
470849982e
|
add cvt func
|
2023-09-21 09:41:30 +00:00 |
|
Haojun Liao
|
17586af0ce
|
refactor: do refactor the sink task.
|
2023-09-21 13:32:57 +08:00 |