Haojun Liao
|
e38e526dda
|
fix(stream):reset the starting flag for the followers.
|
2023-11-07 16:39:12 +08:00 |
yihaoDeng
|
f038f88c07
|
Merge branch 'feat/TD-26060' into enh/refactorBackend
|
2023-11-03 18:29:18 +08:00 |
wangmm0220
|
0a1f1085fc
|
Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26060
|
2023-11-03 11:33:50 +08:00 |
|
wangmm0220
|
3ac11eba0e
|
fix:modify upload checkpoint interface
|
2023-11-03 11:33:18 +08:00 |
|
wangmm0220
|
159873692c
|
feat:checkpoint bakeup using rsync
|
2023-11-02 20:13:29 +08:00 |
liuyao
|
505c44d9aa
|
Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898
|
2023-11-01 16:50:46 +08:00 |
|
yihaoDeng
|
4c8edb5545
|
Merge branch 'enh/new3.0' into enh/refactorBackend
|
2023-11-01 16:07:49 +08:00 |
kailixu
|
1530fe0c49
|
Merge branch '3.0' into enh/TD-23769-3.0x
|
2023-11-01 09:52:16 +08:00 |
|
kailixu
|
ad1e6accd4
|
chore: build checkpoint for rsma
|
2023-11-01 09:45:58 +08:00 |
|
Haojun Liao
|
1ccbb77981
|
fix(stream): fix dead lock when shutdown all tasks.
|
2023-10-27 09:59:37 +08:00 |
|
Haojun Liao
|
e359da7b19
|
fix(stream): fix bugs caused by refactor.
|
2023-10-27 09:54:57 +08:00 |
|
Haojun Liao
|
8729bdac1e
|
fix(stream): fix bugs caused by refactor.
|
2023-10-27 09:54:57 +08:00 |
|
Haojun Liao
|
579dd8e6b2
|
refactor(stream): do some internal refactor.
|
2023-10-27 09:54:56 +08:00 |
|
Haojun Liao
|
6f3c0d17cc
|
refactor(stream): add state machine to manage the state of stream tasks.
|
2023-10-27 09:54:49 +08:00 |
|
Haojun Liao
|
596eb073b7
|
refactor(stream): do some internal refactor.
|
2023-10-27 09:54:48 +08:00 |
|
Haojun Liao
|
91e3fd66e6
|
enh(stream): sm for stream tasks.
|
2023-10-27 09:54:44 +08:00 |
|
Haojun Liao
|
2409a17517
|
refactor(stream): do some internal refactor.
|
2023-10-27 09:54:44 +08:00 |
|
Haojun Liao
|
164159f293
|
enh(stream): add parameter to limit the stream sink task.
|
2023-10-27 09:54:07 +08:00 |
|
liuyao
|
f51c985914
|
stream event window
|
2023-10-25 17:50:16 +08:00 |
|
yihaoDeng
|
1a4cfd11a5
|
Merge branch 'enh/new3.0' into enh/refactorBackend
|
2023-10-20 15:28:10 +08:00 |
|
yihaoDeng
|
2004c1a346
|
fix transfer crash
|
2023-10-17 18:19:52 +08:00 |
|
yihaoDeng
|
77542cc461
|
fix stream snap deadlock
|
2023-10-17 11:23:39 +08:00 |
|
Haojun Liao
|
84c5359d5b
|
other: merge 3.0
|
2023-10-13 08:58:26 +08:00 |
|
yihaoDeng
|
a56d831a14
|
refactor backend
|
2023-10-12 20:16:41 +08:00 |
|
Haojun Liao
|
eb4449999f
|
other: merge 3.0
|
2023-10-12 10:33:48 +08:00 |
|
yihaoDeng
|
4c94fbb44f
|
refactor backend
|
2023-10-11 20:26:19 +08:00 |
|
yihaoDeng
|
f264ffdcd6
|
refactor backend
|
2023-10-11 20:12:07 +08:00 |
|
yihaoDeng
|
28421cd35e
|
refactor backend
|
2023-10-10 20:51:41 +08:00 |
|
yihaoDeng
|
b36163a197
|
add session iter
|
2023-10-10 15:12:21 +08:00 |
|
yihaoDeng
|
825341d90a
|
add sess iter
|
2023-10-10 14:35:02 +08:00 |
|
Haojun Liao
|
59e284c332
|
fix(stream): quit from loop when input queue is full.
|
2023-10-09 20:10:21 +08:00 |
|
Haojun Liao
|
28008f8263
|
enh(stream): add more info for sink task.
|
2023-10-09 20:09:22 +08:00 |
|
Haojun Liao
|
cf14772dd9
|
enh(stream): optimize the scan wal perf
|
2023-10-09 20:09:21 +08:00 |
|
Haojun Liao
|
583ac1fc45
|
refactor: do some internal refactor.
|
2023-10-09 20:09:20 +08:00 |
|
Haojun Liao
|
d10b07d23d
|
refactor: do some internal refactor.
|
2023-10-09 20:08:53 +08:00 |
|
Haojun Liao
|
dfe8641c0c
|
refactor: optimize the fill-history task launch policy, and do some other internal refactor.
|
2023-10-09 20:08:52 +08:00 |
|
Haojun Liao
|
7f8da725bc
|
enh(stream): add quota limitation for sink task.
|
2023-10-09 20:08:13 +08:00 |
|
Haojun Liao
|
7167c3c5de
|
fix(stream): add new timer for each task.
|
2023-10-09 20:08:08 +08:00 |
|
Haojun Liao
|
52763ca2a3
|
refactor: do some internal refactor.
|
2023-10-09 20:08:07 +08:00 |
|
Haojun Liao
|
2b16976902
|
refactor(stream): refactor send msg.
|
2023-10-09 20:08:03 +08:00 |
|
Haojun Liao
|
ef9efc8a8e
|
refactor: do refactor the sink task.
|
2023-10-09 20:07:53 +08:00 |
|
Haojun Liao
|
1f45bd82d2
|
other: merge stream fix in main.
|
2023-10-09 20:07:01 +08:00 |
|
Haojun Liao
|
7ccc273206
|
other: merge stream fix in main.
|
2023-10-09 20:05:29 +08:00 |
|
Haojun Liao
|
e84eeee6b8
|
refactor: do some internal refactor.
|
2023-10-09 20:04:17 +08:00 |
|
yihaoDeng
|
2aa88dfe9b
|
fix mem leak
|
2023-10-09 15:53:42 +08:00 |
|
yihaoDeng
|
c146327da8
|
refact task backend
|
2023-10-07 16:48:36 +08:00 |
|
Haojun Liao
|
7ce3d2c200
|
fix(stream): quit from loop when input queue is full.
|
2023-10-07 14:54:11 +08:00 |
|
yihaoDeng
|
fa70221238
|
refact task backend
|
2023-10-07 12:17:55 +08:00 |
|
Haojun Liao
|
c20dd002fb
|
enh(stream): add more info for sink task.
|
2023-10-07 01:14:00 +08:00 |
|
Haojun Liao
|
41ef1a45c1
|
enh(stream): optimize the scan wal perf
|
2023-10-04 22:06:46 +08:00 |
|
Haojun Liao
|
5718158fc0
|
refactor: do some internal refactor.
|
2023-10-01 22:27:29 +08:00 |
yihaoDeng
|
4f66dc538f
|
add cvt state
|
2023-09-28 11:52:18 +00:00 |
|
yihaoDeng
|
54e3ac2c1e
|
refact task backend
|
2023-09-28 15:46:12 +08:00 |
|
Haojun Liao
|
11641e1115
|
refactor: do some internal refactor.
|
2023-09-27 14:18:01 +08:00 |
|
Haojun Liao
|
e13efd5b04
|
refactor: optimize the fill-history task launch policy, and do some other internal refactor.
|
2023-09-27 14:00:48 +08:00 |
|
Haojun Liao
|
aec15ae39f
|
enh(stream): add quota limitation for sink task.
|
2023-09-26 23:29:54 +08:00 |
|
Haojun Liao
|
a74b462ffb
|
fix(stream): add new timer for each task.
|
2023-09-24 02:25:53 +08:00 |
|
Haojun Liao
|
4ea737571d
|
refactor: do some internal refactor.
|
2023-09-24 01:26:51 +08:00 |
|
yihaoDeng
|
19e52c364e
|
add cvt state
|
2023-09-22 08:26:03 +00:00 |
|
Haojun Liao
|
898aea5cfb
|
refactor(stream): refactor send msg.
|
2023-09-22 14:52:18 +08:00 |
|
yihaoDeng
|
470849982e
|
add cvt func
|
2023-09-21 09:41:30 +00:00 |
|
Haojun Liao
|
17586af0ce
|
refactor: do refactor the sink task.
|
2023-09-21 13:32:57 +08:00 |
|
Haojun Liao
|
6633fb971b
|
fix(stream): update logs.
|
2023-09-20 18:18:31 +08:00 |
|
Haojun Liao
|
4846194bbb
|
refactor: do some internal refactor, remove the related fill-history task by sending mesg to replay it in follower node.
|
2023-09-16 21:37:30 +08:00 |
|
Haojun Liao
|
2bfd6e3355
|
refactor: do some internal refactor.
|
2023-09-15 09:25:22 +08:00 |
|
Haojun Liao
|
b240e91c91
|
enh(stream): add token bucket to limit the rate of sink operation.
|
2023-09-07 09:58:48 +08:00 |
|
Haojun Liao
|
3fc3dafca6
|
refactor: do some internal refactor.
|
2023-08-31 13:46:48 +08:00 |
|
Haojun Liao
|
e53b5d4392
|
refactor: do some internal refactor.
|
2023-08-31 11:01:53 +08:00 |
yihaoDeng
|
8ed2836a2b
|
refactor code
|
2023-08-29 09:52:03 +08:00 |
|
yihaoDeng
|
a2901411b0
|
refactor code
|
2023-08-28 18:52:10 +08:00 |
|
yihaoDeng
|
0959758bd5
|
fix transfer error
|
2023-08-23 21:43:10 +08:00 |
|
Haojun Liao
|
b0c5fa8290
|
fix(stream): reset the task status.
|
2023-08-23 14:10:41 +08:00 |
Haojun Liao
|
c26d625152
|
Merge branch '3.0' into enh/triggerCheckPoint2
|
2023-08-18 15:51:07 +08:00 |
|
Haojun Liao
|
edbad45772
|
other: add logs.
|
2023-08-18 13:45:08 +08:00 |
|
Haojun Liao
|
bb4f8515bd
|
fix(stream): pause when outputQ is blocked.
|
2023-08-17 11:53:17 +08:00 |
|
Haojun Liao
|
ea6574b3c7
|
other: merge 3.0
|
2023-08-17 00:07:55 +08:00 |
|
Haojun Liao
|
0d38f389ab
|
refactor: do some internal refactor.
|
2023-08-13 16:25:35 +08:00 |
|
Haojun Liao
|
03c26a9d6d
|
refactor
|
2023-08-12 19:16:20 +08:00 |
|
Haojun Liao
|
30c2a9c619
|
refactor: do some internal refactor.
|
2023-08-12 18:27:51 +08:00 |
|
Haojun Liao
|
8a11a0418f
|
other: merge 3.0
|
2023-08-07 09:19:26 +08:00 |
|
Haojun Liao
|
d45596bb33
|
fix(stream): kill task when pause the stream execution.
|
2023-07-31 18:07:37 +08:00 |
|
Haojun Liao
|
8dfef8768a
|
other: merge 3.0
|
2023-07-29 22:54:16 +08:00 |
|
Haojun Liao
|
1e34f84f78
|
other: merge 3.0
|
2023-07-24 15:23:03 +08:00 |
|
Haojun Liao
|
f4864b8713
|
fix(stream): fix memory leak.
|
2023-07-22 01:02:58 +08:00 |
|
Haojun Liao
|
16d7707b90
|
fix(stream): align the scan real time data for stream task.
|
2023-07-21 19:33:43 +08:00 |
|
yihaoDeng
|
aad669e33c
|
add checkpoint
|
2023-07-14 14:46:13 +00:00 |
|
Haojun Liao
|
2b85ea62aa
|
refactor: do some internal refactor.
|
2023-07-14 17:48:47 +08:00 |
|
Haojun Liao
|
eb7e6152ae
|
refactor(stream): do some internal refactor.
|
2023-07-14 17:21:20 +08:00 |
|
Haojun Liao
|
08a4fb06ae
|
fix(stream): dispatch checkpoint msg to downstream by puting message into input queue.
|
2023-07-13 09:17:20 +08:00 |
|
Haojun Liao
|
d392bb60ba
|
refactor(stream): set the initial version from the checkpoint.
|
2023-07-12 11:38:13 +08:00 |
|
Haojun Liao
|
a049e310f6
|
Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2
|
2023-07-12 10:16:26 +08:00 |
|
Haojun Liao
|
6f2fc4fab3
|
fix(stream): commit task meta after do vnode-wide checkpoint.
|
2023-07-12 10:16:14 +08:00 |
|
yihaoDeng
|
e547ed3699
|
rm expire checkpoint
|
2023-07-11 16:30:14 +08:00 |
|
Haojun Liao
|
87bedef2cd
|
fix(stream): fix error in checkpointing.
|
2023-07-10 19:20:05 +08:00 |
|
Haojun Liao
|
a5c19427e7
|
fix(stream): send correct rsp to mnode.
|
2023-07-08 09:39:44 +08:00 |
|
Haojun Liao
|
47877898d0
|
enh(stream): generate the checkpoint framework.
|
2023-07-07 16:07:52 +08:00 |
|
Haojun Liao
|
d7101f7109
|
enh(stream): support dispatch checkpoint msg.
|
2023-07-06 18:26:22 +08:00 |
|
Haojun Liao
|
5a9461a69a
|
other: merge 3.0
|
2023-07-06 11:52:21 +08:00 |
|
Haojun Liao
|
f4a3567935
|
other: merge 3.0
|
2023-07-06 11:24:30 +08:00 |
|
Haojun Liao
|
03dbcbf055
|
refactor: do some internal refactor.
|
2023-07-05 15:55:55 +08:00 |