Haojun Liao
|
4af7812f0b
|
fix(stream): fix the invalid counter for ready tasks in vnode, fix an invalid read.
|
2023-10-09 20:08:10 +08:00 |
|
Haojun Liao
|
f4f55fcbce
|
fix(stream): record the tasks started info, and do some internal refactor.
|
2023-10-09 20:08:09 +08:00 |
|
Haojun Liao
|
68b003c804
|
fix(stream): fix race condition.
|
2023-10-09 20:08:09 +08:00 |
|
Haojun Liao
|
52763ca2a3
|
refactor: do some internal refactor.
|
2023-10-09 20:08:07 +08:00 |
|
Haojun Liao
|
c05a8de3e8
|
fix(stream): rsp when checkpoint source failed.
|
2023-10-09 20:08:06 +08:00 |
|
Haojun Liao
|
5eee76df65
|
fix(stream): add msg identifier check.
|
2023-10-09 20:08:05 +08:00 |
|
Haojun Liao
|
e0d19af000
|
fix(stream): refactor re-try dispatch msg for stream tasks.
|
2023-10-09 20:08:03 +08:00 |
|
Haojun Liao
|
2b16976902
|
refactor(stream): refactor send msg.
|
2023-10-09 20:08:03 +08:00 |
|
Haojun Liao
|
27e00b1f19
|
fix(stream): add some logs, and remove invalid assert.
|
2023-10-09 20:08:02 +08:00 |
|
Haojun Liao
|
12687eb287
|
fix(stream): add check info detailed information.
|
2023-10-09 20:08:02 +08:00 |
|
Haojun Liao
|
ef9efc8a8e
|
refactor: do refactor the sink task.
|
2023-10-09 20:07:53 +08:00 |
|
Haojun Liao
|
1f45bd82d2
|
other: merge stream fix in main.
|
2023-10-09 20:07:01 +08:00 |
|
Haojun Liao
|
e27111ecd1
|
enh(stream): add node stage check.
|
2023-10-09 20:06:09 +08:00 |
|
Haojun Liao
|
5c0b8ea804
|
enh(stream): log the checkpoint time.
|
2023-10-09 20:06:04 +08:00 |
|
Haojun Liao
|
b95ad74c7f
|
fix(stream): not handle the check msg for follower tasks.
|
2023-10-09 20:06:04 +08:00 |
|
Haojun Liao
|
636eccc160
|
fix(stream): add null check
|
2023-10-09 20:05:37 +08:00 |
|
Haojun Liao
|
0459a4628c
|
fix(stream): fix stream task id error.
|
2023-10-09 20:05:36 +08:00 |
|
Haojun Liao
|
7ccc273206
|
other: merge stream fix in main.
|
2023-10-09 20:05:29 +08:00 |
|
Haojun Liao
|
98ef566eb4
|
fix(stream): remove fill-history sink task.
|
2023-10-09 20:04:17 +08:00 |
|
Haojun Liao
|
e84eeee6b8
|
refactor: do some internal refactor.
|
2023-10-09 20:04:17 +08:00 |
|
Haojun Liao
|
6fa54789cb
|
fix(stream): disable follower send hb to mnode. and do some internal refactor.
|
2023-10-09 19:59:31 +08:00 |
|
Haojun Liao
|
1256eafddb
|
other: merge stream fix.
|
2023-10-09 19:59:24 +08:00 |
|
Haojun Liao
|
aaa12ed4f8
|
refactor: do some internal refactor about the sched status set
|
2023-10-09 19:56:17 +08:00 |
|
Haojun Liao
|
d87db2f829
|
fix(stream): fix the pause failure bug.
|
2023-10-09 14:48:11 +08:00 |
|
Haojun Liao
|
ee6516f3c4
|
enh(stream): add trans to reset task status to avoid being frozen in checkpoint status due to doing checkpoint failure of partial tasks.
|
2023-10-09 10:13:53 +08:00 |
|
Haojun Liao
|
23fb26798f
|
fix(stream): sleep for 10ms
|
2023-10-07 19:47:49 +08:00 |
|
Haojun Liao
|
ab17bfdf09
|
refactor: do some internal refactor.
|
2023-10-07 19:16:55 +08:00 |
|
Haojun Liao
|
c20dd002fb
|
enh(stream): add more info for sink task.
|
2023-10-07 01:14:00 +08:00 |
|
Haojun Liao
|
41ef1a45c1
|
enh(stream): optimize the scan wal perf
|
2023-10-04 22:06:46 +08:00 |
|
Haojun Liao
|
a543f4ca97
|
refactor: do some internal refactor.
|
2023-10-03 01:52:03 +08:00 |
|
Haojun Liao
|
5718158fc0
|
refactor: do some internal refactor.
|
2023-10-01 22:27:29 +08:00 |
|
Haojun Liao
|
f2d8431619
|
fix(stream): enable new time range for stream task.
|
2023-09-28 18:26:52 +08:00 |
|
Haojun Liao
|
80ec77cbb6
|
enh(stream): optimize the stream status when creating without fill-history option.
|
2023-09-28 11:23:03 +08:00 |
|
Haojun Liao
|
22e485d132
|
fix(stream): opt perf.
|
2023-09-28 09:25:23 +08:00 |
|
Haojun Liao
|
e13efd5b04
|
refactor: optimize the fill-history task launch policy, and do some other internal refactor.
|
2023-09-27 14:00:48 +08:00 |
|
Haojun Liao
|
890d658aea
|
refactor: do some internal refactor.
|
2023-09-26 14:11:45 +08:00 |
|
Haojun Liao
|
f3f18b0fa3
|
fix(stream): add new status for meta.
|
2023-09-26 12:15:12 +08:00 |
|
Haojun Liao
|
d214a2f6bd
|
fix(stream): do some internal refactor.
|
2023-09-26 09:32:57 +08:00 |
|
Haojun Liao
|
6cc3618ed9
|
fix(stream): fix error in pause scan-history data.
|
2023-09-26 01:09:55 +08:00 |
|
Haojun Liao
|
fcf4cc7169
|
fix(stream): fix the invalid counter for ready tasks in vnode, fix an invalid read.
|
2023-09-25 15:58:24 +08:00 |
|
Haojun Liao
|
eb4078b7f3
|
fix(stream): record the tasks started info, and do some internal refactor.
|
2023-09-25 09:59:05 +08:00 |
|
Haojun Liao
|
c987f61300
|
fix(stream): fix race condition.
|
2023-09-25 01:37:27 +08:00 |
|
Haojun Liao
|
4ea737571d
|
refactor: do some internal refactor.
|
2023-09-24 01:26:51 +08:00 |
|
Haojun Liao
|
acd3321494
|
fix(stream): rsp when checkpoint source failed.
|
2023-09-23 14:13:33 +08:00 |
|
Haojun Liao
|
5b12e276cf
|
fix(stream): add msg identifier check.
|
2023-09-22 18:13:18 +08:00 |
|
Haojun Liao
|
619a9f6d08
|
fix(stream): refactor re-try dispatch msg for stream tasks.
|
2023-09-22 15:57:55 +08:00 |
|
Haojun Liao
|
898aea5cfb
|
refactor(stream): refactor send msg.
|
2023-09-22 14:52:18 +08:00 |
|
Haojun Liao
|
87ea745861
|
fix(stream): add some logs, and remove invalid assert.
|
2023-09-22 10:53:03 +08:00 |
|
Haojun Liao
|
f7bcff862d
|
fix(stream): add check info detailed information.
|
2023-09-22 10:23:56 +08:00 |
|
Haojun Liao
|
17586af0ce
|
refactor: do refactor the sink task.
|
2023-09-21 13:32:57 +08:00 |
|
Haojun Liao
|
6633fb971b
|
fix(stream): update logs.
|
2023-09-20 18:18:31 +08:00 |
|
Haojun Liao
|
b4419bda65
|
enh(stream): add node stage check.
|
2023-09-20 10:35:01 +08:00 |
|
Haojun Liao
|
b7efedf4aa
|
enh(stream): log the checkpoint time.
|
2023-09-19 09:53:33 +08:00 |
|
Haojun Liao
|
e76bab7122
|
fix(stream): not handle the check msg for follower tasks.
|
2023-09-19 09:43:14 +08:00 |
|
Haojun Liao
|
c33ef4ce88
|
fix(stream): add null check
|
2023-09-18 15:14:51 +08:00 |
|
Haojun Liao
|
01144c58a7
|
fix(stream): fix stream task id error.
|
2023-09-17 01:19:59 +08:00 |
|
Haojun Liao
|
4846194bbb
|
refactor: do some internal refactor, remove the related fill-history task by sending mesg to replay it in follower node.
|
2023-09-16 21:37:30 +08:00 |
|
Haojun Liao
|
91e3d70796
|
fix(stream): remove fill-history sink task.
|
2023-09-15 17:46:17 +08:00 |
|
Haojun Liao
|
2bfd6e3355
|
refactor: do some internal refactor.
|
2023-09-15 09:25:22 +08:00 |
|
Haojun Liao
|
f2c3e0a6e8
|
fix(stream): disable follower send hb to mnode. and do some internal refactor.
|
2023-09-14 17:22:31 +08:00 |
|
Haojun Liao
|
fce5be0eb4
|
fix(stream): fix dead lock.
|
2023-09-14 14:09:05 +08:00 |
|
Haojun Liao
|
7305c8dbe1
|
refactor: do some internal refactor about the sched status set
|
2023-09-13 14:00:34 +08:00 |
|
Haojun Liao
|
09a15bf340
|
refactor: do some internal refactor.
|
2023-09-12 22:07:52 +08:00 |
|
Haojun Liao
|
f6a097d96f
|
refactor: do some internal refactor.
|
2023-09-12 21:58:22 +08:00 |
|
Haojun Liao
|
e457d94ac6
|
refactor: do some internal refactor.
|
2023-09-12 18:09:02 +08:00 |
|
Haojun Liao
|
85a5c45098
|
fix(stream): limit the already processed data.
|
2023-09-10 00:01:25 +08:00 |
|
Haojun Liao
|
b317c8ebff
|
fix(stream): disable merge submit blocks.
|
2023-09-08 12:46:15 +08:00 |
|
Haojun Liao
|
b240e91c91
|
enh(stream): add token bucket to limit the rate of sink operation.
|
2023-09-07 09:58:48 +08:00 |
|
Haojun Liao
|
8edf86b3bb
|
fix(stream): add some logs.
|
2023-09-06 19:08:09 +08:00 |
|
Haojun Liao
|
8783ebcb02
|
enh(stream): add some logs and record the submit package performance.
|
2023-09-06 14:34:36 +08:00 |
|
Haojun Liao
|
aeea699c9c
|
Merge branch '3.0' into fix/3_liaohj
|
2023-09-04 15:53:39 +08:00 |
|
Haojun Liao
|
037a232bfa
|
refactor: do some internal refactor.
|
2023-09-01 17:05:36 +08:00 |
Haojun Liao
|
e816d0efa5
|
Merge pull request #22669 from taosdata/fix/TD-26069
fix invalid insert
|
2023-08-31 18:29:25 +08:00 |
yihaoDeng
|
1833be028f
|
fix invalid insert
|
2023-08-31 15:28:31 +08:00 |
|
Haojun Liao
|
e2bb64eb18
|
refactor: do some internal refactor.
|
2023-08-31 14:23:46 +08:00 |
|
Haojun Liao
|
69f95f9324
|
other: merge 3.0
|
2023-08-31 13:56:34 +08:00 |
|
Haojun Liao
|
2285b834b0
|
refactor: do some internal refactor.
|
2023-08-31 13:53:12 +08:00 |
|
Haojun Liao
|
3fc3dafca6
|
refactor: do some internal refactor.
|
2023-08-31 13:46:48 +08:00 |
|
Haojun Liao
|
3ed78ddadd
|
Merge pull request #22662 from taosdata/fix/3_liaohj
refactor: do some internal refactor.
|
2023-08-31 13:46:14 +08:00 |
|
Haojun Liao
|
8645f763b5
|
Merge pull request #22661 from taosdata/enh/reserve
stream change ver
|
2023-08-31 13:35:23 +08:00 |
|
yihaoDeng
|
83a5e2be4c
|
stream change ver
|
2023-08-31 11:42:12 +08:00 |
|
Haojun Liao
|
e53b5d4392
|
refactor: do some internal refactor.
|
2023-08-31 11:01:53 +08:00 |
|
yihaoDeng
|
05ca71d5de
|
stream change ver
|
2023-08-31 09:28:43 +08:00 |
|
Haojun Liao
|
d99d8875e1
|
fix(stream): if stream task is running, do not recheck its status.
|
2023-08-30 17:24:13 +08:00 |
liuyao
|
0a72e576bd
|
op stream pause
pause data dispatch
opt stream pause
|
2023-08-30 14:53:49 +08:00 |
|
Haojun Liao
|
3a7a220d43
|
fix(stream): fix error found by ci.
|
2023-08-30 10:14:01 +08:00 |
|
Haojun Liao
|
204fb97f68
|
fix(stream): fix error in snode, fix memory leaks, fix repeatly create bug in sink task.
|
2023-08-29 17:34:31 +08:00 |
|
Haojun Liao
|
391103bc5a
|
fix(stream): do dome internal refactor.
|
2023-08-28 15:54:01 +08:00 |
|
Haojun Liao
|
b75ae217f6
|
fix(stream): notify close for snode.
|
2023-08-28 09:53:08 +08:00 |
|
yihaoDeng
|
998dac0ffb
|
fix mem leak
|
2023-08-26 21:54:36 +08:00 |
|
yihaoDeng
|
7d237d4310
|
fix UAF
|
2023-08-26 17:37:09 +08:00 |
|
Haojun Liao
|
60d1df0e25
|
Merge branch '3.0' into enh/triggerCheckPoint2
|
2023-08-25 15:49:28 +08:00 |
|
Haojun Liao
|
ce1a3a379c
|
fix(stream): handle the case when the task not in ready state, and the checkpoint msg arrived.
|
2023-08-25 10:12:12 +08:00 |
|
Haojun Liao
|
70396aa5a5
|
fix(stream): wakeup the hb timer every 200ms, to speeup the close db procedure.
|
2023-08-24 17:54:50 +08:00 |
|
Haojun Liao
|
af80d94a88
|
refactor: do some internal refactor.
|
2023-08-22 15:43:50 +08:00 |
|
Haojun Liao
|
cc8b2263cb
|
fix(stream): fix error in heartbeat from vnode.
|
2023-08-22 13:37:38 +08:00 |
|
Haojun Liao
|
def0877980
|
fix(stream): add timer to check stream task status.
|
2023-08-22 10:46:49 +08:00 |
|
Haojun Liao
|
b8101afbe2
|
fix(stream): refactor the tasks restart mechanism.
|
2023-08-18 22:36:38 +08:00 |
|
Haojun Liao
|
4b10393c81
|
fix(stream): fix memory leak and do some internal refactor.
|
2023-08-18 18:02:08 +08:00 |
|
Haojun Liao
|
6746339609
|
Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2
# Conflicts:
# source/libs/stream/src/streamSnapshot.c
|
2023-08-17 00:08:44 +08:00 |