Haojun Liao
|
ee6516f3c4
|
enh(stream): add trans to reset task status to avoid being frozen in checkpoint status due to doing checkpoint failure of partial tasks.
|
2023-10-09 10:13:53 +08:00 |
|
Haojun Liao
|
4b8cd3bccd
|
fix(stream): not idle for sink task when no tokens are available.
|
2023-10-09 10:07:19 +08:00 |
liuyao
|
1cbb8ef444
|
init bloomfilter array
|
2023-10-08 14:43:44 +08:00 |
yihaoDeng
|
b5994b31e2
|
fix mem leak
|
2023-10-08 13:33:02 +08:00 |
|
yihaoDeng
|
e3f18495e0
|
fix mem leak
|
2023-10-08 11:22:26 +08:00 |
|
Haojun Liao
|
23fb26798f
|
fix(stream): sleep for 10ms
|
2023-10-07 19:47:49 +08:00 |
|
Haojun Liao
|
e4e4c5a36e
|
fix(stream): wait for a while when no available token.
|
2023-10-07 19:41:49 +08:00 |
|
Haojun Liao
|
45bb3f50d7
|
fix(stream): continue
|
2023-10-07 19:25:40 +08:00 |
|
liuyao
|
95ffe6fa23
|
stream recover
|
2023-10-07 19:24:21 +08:00 |
|
Haojun Liao
|
62cdcbc7e3
|
refactor: inc the dump batch.
|
2023-10-07 19:20:48 +08:00 |
|
Haojun Liao
|
4d6f143146
|
fix(stream): add missing refactor.
|
2023-10-07 19:18:26 +08:00 |
|
Haojun Liao
|
ab17bfdf09
|
refactor: do some internal refactor.
|
2023-10-07 19:16:55 +08:00 |
|
Haojun Liao
|
0e8a8aabc1
|
fix(stream): check items in queue and qall, stead of only the queue items.
|
2023-10-07 19:16:25 +08:00 |
|
liuyao
|
1e323c0408
|
fix issue
|
2023-10-07 19:11:46 +08:00 |
|
liuyao
|
19bbf10579
|
fix issue
|
2023-10-07 17:59:53 +08:00 |
|
yihaoDeng
|
97fdcbc60b
|
fix mem leak
|
2023-10-07 17:48:24 +08:00 |
|
liuyao
|
1aaf873134
|
fix issue
|
2023-10-07 17:43:50 +08:00 |
|
Haojun Liao
|
d11c0a113c
|
fix(stream): fix syntax error.
|
2023-10-07 14:56:09 +08:00 |
|
Haojun Liao
|
7ce3d2c200
|
fix(stream): quit from loop when input queue is full.
|
2023-10-07 14:54:11 +08:00 |
|
liuyao
|
460ee86fdf
|
fix issue
|
2023-10-07 11:55:40 +08:00 |
|
liuyao
|
59d47e1e1f
|
fix issuse
|
2023-10-07 10:34:35 +08:00 |
|
Haojun Liao
|
115a284ac0
|
enh(stream): update the checkpoint interval
|
2023-10-07 09:56:03 +08:00 |
|
Haojun Liao
|
011627d50a
|
fix(stream): update the current processing version.
|
2023-10-07 09:07:44 +08:00 |
|
Haojun Liao
|
c20dd002fb
|
enh(stream): add more info for sink task.
|
2023-10-07 01:14:00 +08:00 |
|
Haojun Liao
|
98659ad323
|
fix(stream): fix the invalid check.
|
2023-10-05 00:09:47 +08:00 |
|
Haojun Liao
|
41ef1a45c1
|
enh(stream): optimize the scan wal perf
|
2023-10-04 22:06:46 +08:00 |
|
Haojun Liao
|
45e413f8d5
|
refactor: wait for 100ms before scan wal again.
|
2023-10-03 20:57:19 +08:00 |
|
Haojun Liao
|
132fb8e82e
|
refactor: wait for more time for future data
|
2023-10-03 15:42:00 +08:00 |
|
Haojun Liao
|
38aff641ee
|
fix(stream): add null check.
|
2023-10-03 02:39:57 +08:00 |
|
Haojun Liao
|
58f410a9df
|
refactor: do some internal refactor.
|
2023-10-03 02:37:52 +08:00 |
|
Haojun Liao
|
a543f4ca97
|
refactor: do some internal refactor.
|
2023-10-03 01:52:03 +08:00 |
|
Haojun Liao
|
5564eb215c
|
fix(stream): fix invalid check.
|
2023-10-03 00:38:24 +08:00 |
|
Haojun Liao
|
5718158fc0
|
refactor: do some internal refactor.
|
2023-10-01 22:27:29 +08:00 |
|
Haojun Liao
|
31acbc6fe2
|
refactor: do some internal refactor (discard the checkpoint source msg during restoring).
|
2023-09-28 22:44:13 +08:00 |
|
Haojun Liao
|
f2d8431619
|
fix(stream): enable new time range for stream task.
|
2023-09-28 18:26:52 +08:00 |
|
Haojun Liao
|
80ec77cbb6
|
enh(stream): optimize the stream status when creating without fill-history option.
|
2023-09-28 11:23:03 +08:00 |
|
Haojun Liao
|
22e485d132
|
fix(stream): opt perf.
|
2023-09-28 09:25:23 +08:00 |
|
Haojun Liao
|
f525778aef
|
fix(stream): fix syntax error.
|
2023-09-28 00:53:36 +08:00 |
|
Haojun Liao
|
8c998673ad
|
fix(stream): fix dead lock.
|
2023-09-27 17:15:49 +08:00 |
|
Haojun Liao
|
2dade996bb
|
log(stream): update logs.
|
2023-09-27 15:37:12 +08:00 |
|
Haojun Liao
|
8f2d217834
|
log: update logs.
|
2023-09-27 14:48:53 +08:00 |
|
Haojun Liao
|
11641e1115
|
refactor: do some internal refactor.
|
2023-09-27 14:18:01 +08:00 |
|
Haojun Liao
|
34d547bfff
|
fix(stream): avoid repeatly free obj.
|
2023-09-27 14:05:14 +08:00 |
|
Haojun Liao
|
ae020fcd2d
|
log(stream): update the log.
|
2023-09-27 14:03:57 +08:00 |
|
Haojun Liao
|
e13efd5b04
|
refactor: optimize the fill-history task launch policy, and do some other internal refactor.
|
2023-09-27 14:00:48 +08:00 |
|
Haojun Liao
|
a7e6933ce7
|
refactor: do some internal refactor.
|
2023-09-27 09:46:15 +08:00 |
|
Haojun Liao
|
37bf387453
|
fix(stream): reduce the counter when remove stream tasks.
|
2023-09-27 09:36:20 +08:00 |
|
Haojun Liao
|
9ab9de0ad3
|
fix(stream): limit sink quota.
|
2023-09-27 00:30:38 +08:00 |
|
Haojun Liao
|
27dcbcb96f
|
fix(stream): update the retry interval.
|
2023-09-26 23:42:02 +08:00 |
|
Haojun Liao
|
aec15ae39f
|
enh(stream): add quota limitation for sink task.
|
2023-09-26 23:29:54 +08:00 |
|
liuyao
|
c95dc167b7
|
add ci
|
2023-09-26 17:19:21 +08:00 |
|
Haojun Liao
|
890d658aea
|
refactor: do some internal refactor.
|
2023-09-26 14:11:45 +08:00 |
|
Haojun Liao
|
f3f18b0fa3
|
fix(stream): add new status for meta.
|
2023-09-26 12:15:12 +08:00 |
|
liuyao
|
82e18e32b0
|
add ci
|
2023-09-26 10:41:12 +08:00 |
|
Haojun Liao
|
d214a2f6bd
|
fix(stream): do some internal refactor.
|
2023-09-26 09:32:57 +08:00 |
|
Haojun Liao
|
6cc3618ed9
|
fix(stream): fix error in pause scan-history data.
|
2023-09-26 01:09:55 +08:00 |
|
Haojun Liao
|
5a4a0aa0e3
|
fix(stream): fix invalid read and memory leak.
|
2023-09-25 23:10:33 +08:00 |
|
Haojun Liao
|
c9576d7a85
|
fix(stream): transfer state when all downstream rsp already.
|
2023-09-25 17:31:38 +08:00 |
|
Haojun Liao
|
c615c513e8
|
fix(stream): fix memory leak.
|
2023-09-25 16:01:17 +08:00 |
|
Haojun Liao
|
fcf4cc7169
|
fix(stream): fix the invalid counter for ready tasks in vnode, fix an invalid read.
|
2023-09-25 15:58:24 +08:00 |
|
Haojun Liao
|
1af95969b2
|
fix(stream): adjust nodeUpdate check interval.
|
2023-09-25 10:40:30 +08:00 |
|
Haojun Liao
|
eb4078b7f3
|
fix(stream): record the tasks started info, and do some internal refactor.
|
2023-09-25 09:59:05 +08:00 |
|
Haojun Liao
|
c987f61300
|
fix(stream): fix race condition.
|
2023-09-25 01:37:27 +08:00 |
|
Haojun Liao
|
da82a5f19e
|
fix(stream): do not wait for the checkpoint finish before stop tasks.
|
2023-09-24 22:03:07 +08:00 |
|
Haojun Liao
|
a74b462ffb
|
fix(stream): add new timer for each task.
|
2023-09-24 02:25:53 +08:00 |
|
Haojun Liao
|
b7dcd94c64
|
refactor: do some internal refactor.
|
2023-09-24 01:56:52 +08:00 |
|
Haojun Liao
|
3a75c21e66
|
refactor: do some internal refactor.
|
2023-09-24 01:55:59 +08:00 |
|
Haojun Liao
|
4ea737571d
|
refactor: do some internal refactor.
|
2023-09-24 01:26:51 +08:00 |
|
Haojun Liao
|
7f265e181d
|
fix(stream): update the checkpoint record start time.
|
2023-09-23 18:05:14 +08:00 |
|
Haojun Liao
|
6ef68fdf06
|
fix(stream): fix invalid checkpoint start time.
|
2023-09-23 17:57:09 +08:00 |
|
Haojun Liao
|
acd3321494
|
fix(stream): rsp when checkpoint source failed.
|
2023-09-23 14:13:33 +08:00 |
|
Haojun Liao
|
7d5f76c6f1
|
fix(stream): disable auto rsp for checkpoint source.
|
2023-09-23 11:31:14 +08:00 |
|
Haojun Liao
|
5155519559
|
fix(stream): fix invalid assert.
|
2023-09-22 23:06:48 +08:00 |
|
Haojun Liao
|
cf6c255f22
|
refactor: do some internal refactor.
|
2023-09-22 22:50:21 +08:00 |
|
Haojun Liao
|
fcbd747afc
|
fix(stream): fix race condition.
|
2023-09-22 19:35:12 +08:00 |
|
liuyao
|
5cc1ae1266
|
fix issue
|
2023-09-22 19:25:19 +08:00 |
|
Haojun Liao
|
1ca05fb3af
|
fix(stream): add some logs.
|
2023-09-22 18:56:31 +08:00 |
|
Haojun Liao
|
5b12e276cf
|
fix(stream): add msg identifier check.
|
2023-09-22 18:13:18 +08:00 |
|
Haojun Liao
|
bb1a2322ca
|
fix(stream): add some logs.
|
2023-09-22 17:27:10 +08:00 |
|
Haojun Liao
|
07ec6f38b8
|
fix(stream): remove invalid free.
|
2023-09-22 16:53:22 +08:00 |
|
Haojun Liao
|
5a695f632c
|
fix(stream): remove the blocking flag after successfully retry sending msg.
|
2023-09-22 16:44:55 +08:00 |
|
Haojun Liao
|
6c357104a5
|
fix(stream): clear the failure vnode id list before send msg.
|
2023-09-22 16:19:25 +08:00 |
|
Haojun Liao
|
0f5f21ba09
|
fix(stream): fix invalid read.
|
2023-09-22 16:05:12 +08:00 |
|
Haojun Liao
|
619a9f6d08
|
fix(stream): refactor re-try dispatch msg for stream tasks.
|
2023-09-22 15:57:55 +08:00 |
|
liuyao
|
4f8e6d7795
|
Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26174
|
2023-09-22 15:00:52 +08:00 |
|
liuyao
|
410a177637
|
fix issue
|
2023-09-22 15:00:26 +08:00 |
|
Haojun Liao
|
898aea5cfb
|
refactor(stream): refactor send msg.
|
2023-09-22 14:52:18 +08:00 |
|
Haojun Liao
|
87ea745861
|
fix(stream): add some logs, and remove invalid assert.
|
2023-09-22 10:53:03 +08:00 |
|
Haojun Liao
|
f7bcff862d
|
fix(stream): add check info detailed information.
|
2023-09-22 10:23:56 +08:00 |
wangmm0220
|
5555371fbc
|
fix:memory leak
|
2023-09-22 10:04:53 +08:00 |
|
liuyao
|
4979fc5283
|
fix issue
|
2023-09-22 09:40:08 +08:00 |
|
wangmm0220
|
803b17a2db
|
fix:memory leak
|
2023-09-22 09:31:58 +08:00 |
|
Haojun Liao
|
b1ba716299
|
refactor: do some internal refactor.
|
2023-09-22 09:24:36 +08:00 |
|
Haojun Liao
|
b075b4438b
|
fix(stream): handle dispatch checkpoint-trigger failure.
|
2023-09-21 23:15:18 +08:00 |
|
Haojun Liao
|
50d5fb6641
|
fix(stream): update logs.
|
2023-09-21 19:14:34 +08:00 |
|
Haojun Liao
|
4925b67d4a
|
fix(stream): ignore the dispatch failure, and set the correct rsp counter.
|
2023-09-21 17:22:09 +08:00 |
|
Haojun Liao
|
2efd155adf
|
fix(stream): wait for the task checkpoint before stop.
|
2023-09-21 15:53:21 +08:00 |
|
Haojun Liao
|
17586af0ce
|
refactor: do refactor the sink task.
|
2023-09-21 13:32:57 +08:00 |
yihaoDeng
|
77ef632233
|
refactor code
|
2023-09-21 01:36:12 +00:00 |
|
Haojun Liao
|
9f9b712332
|
fix(stream): disable token bucket.
|
2023-09-21 01:19:58 +08:00 |