Haojun Liao
|
95da66e3e8
|
fix(stream): fix error.
|
2023-08-31 20:50:12 +08:00 |
|
Haojun Liao
|
3fc3dafca6
|
refactor: do some internal refactor.
|
2023-08-31 13:46:48 +08:00 |
|
Haojun Liao
|
d99d8875e1
|
fix(stream): if stream task is running, do not recheck its status.
|
2023-08-30 17:24:13 +08:00 |
yihaoDeng
|
57608e7fff
|
fix merge error
|
2023-08-30 17:12:37 +08:00 |
|
Haojun Liao
|
997d247aa6
|
fix(stream): remove invalid memset.
|
2023-08-30 16:58:22 +08:00 |
|
Haojun Liao
|
c5b279f045
|
Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2
|
2023-08-30 16:01:08 +08:00 |
|
Haojun Liao
|
24b1a050fc
|
other: merge 3.0
|
2023-08-30 16:00:14 +08:00 |
liuyao
|
0a72e576bd
|
op stream pause
pause data dispatch
opt stream pause
|
2023-08-30 14:53:49 +08:00 |
dapan1121
|
f6321d0c4f
|
Merge remote-tracking branch 'origin/main' into fix/m23.1
|
2023-08-30 11:03:33 +08:00 |
|
Haojun Liao
|
3a7a220d43
|
fix(stream): fix error found by ci.
|
2023-08-30 10:14:01 +08:00 |
|
Haojun Liao
|
204fb97f68
|
fix(stream): fix error in snode, fix memory leaks, fix repeatly create bug in sink task.
|
2023-08-29 17:34:31 +08:00 |
|
yihaoDeng
|
8ed2836a2b
|
refactor code
|
2023-08-29 09:52:03 +08:00 |
|
yihaoDeng
|
a2901411b0
|
refactor code
|
2023-08-28 18:52:10 +08:00 |
|
yihaoDeng
|
1687f68156
|
refactor code
|
2023-08-28 16:13:27 +08:00 |
|
Haojun Liao
|
391103bc5a
|
fix(stream): do dome internal refactor.
|
2023-08-28 15:54:01 +08:00 |
|
Haojun Liao
|
b75ae217f6
|
fix(stream): notify close for snode.
|
2023-08-28 09:53:08 +08:00 |
|
yihaoDeng
|
998dac0ffb
|
fix mem leak
|
2023-08-26 21:54:36 +08:00 |
|
yihaoDeng
|
7d237d4310
|
fix UAF
|
2023-08-26 17:37:09 +08:00 |
|
yihaoDeng
|
bed5765013
|
fix UAF
|
2023-08-26 16:15:26 +08:00 |
|
yihaoDeng
|
0348ef6e22
|
fix UAF
|
2023-08-26 16:13:17 +08:00 |
Ganlin Zhao
|
af130cc92f
|
Revert "add seperate function for createLogs"
This reverts commit 13d2d72bb6.
|
2023-08-25 09:55:50 +08:00 |
|
Haojun Liao
|
218e2cc5f3
|
fix(stream): invoke the timer when not sending hb.
|
2023-08-24 18:27:09 +08:00 |
|
Haojun Liao
|
82e356a9b5
|
Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2
# Conflicts:
# source/dnode/vnode/src/tq/tq.c
|
2023-08-24 18:04:44 +08:00 |
|
Haojun Liao
|
70396aa5a5
|
fix(stream): wakeup the hb timer every 200ms, to speeup the close db procedure.
|
2023-08-24 17:54:50 +08:00 |
|
yihaoDeng
|
090515c684
|
refactor code
|
2023-08-24 17:20:04 +08:00 |
|
Ganlin Zhao
|
13d2d72bb6
|
add seperate function for createLogs
|
2023-08-24 14:56:14 +08:00 |
|
Ganlin Zhao
|
962a0cd403
|
fix
|
2023-08-23 23:34:02 +08:00 |
|
yihaoDeng
|
0959758bd5
|
fix transfer error
|
2023-08-23 21:43:10 +08:00 |
|
Haojun Liao
|
230d8c2d80
|
fix(stream): fix error in stream computing after vnode is transferred to other dnodes.
|
2023-08-23 17:50:44 +08:00 |
|
yihaoDeng
|
12b10dfc76
|
fix mem leak
|
2023-08-23 09:08:37 +08:00 |
|
yihaoDeng
|
5fe7563a13
|
fix mem leak
|
2023-08-22 21:13:02 +08:00 |
|
yihaoDeng
|
ba5c3648db
|
fix mem leak
|
2023-08-22 21:12:54 +08:00 |
|
yihaoDeng
|
ab9490101f
|
Merge branch 'enh/3.0' into enh/triggerCheckPoint2
|
2023-08-22 18:04:04 +08:00 |
|
Haojun Liao
|
af80d94a88
|
refactor: do some internal refactor.
|
2023-08-22 15:43:50 +08:00 |
|
Haojun Liao
|
e6b49b45d9
|
Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2
|
2023-08-22 13:37:50 +08:00 |
|
Haojun Liao
|
cc8b2263cb
|
fix(stream): fix error in heartbeat from vnode.
|
2023-08-22 13:37:38 +08:00 |
|
yihaoDeng
|
d106b5a87e
|
Merge branch 'enh/triggerCheckPoint2' of https://github.com/taosdata/TDengine into enh/triggerCheckPoint2
|
2023-08-22 10:48:30 +08:00 |
|
yihaoDeng
|
a0fd56c84f
|
fix invalid cmp
|
2023-08-22 10:48:15 +08:00 |
|
Haojun Liao
|
def0877980
|
fix(stream): add timer to check stream task status.
|
2023-08-22 10:46:49 +08:00 |
|
Haojun Liao
|
082882b71e
|
fix(stream): reset the upstream stage info.
|
2023-08-21 19:29:03 +08:00 |
|
yihaoDeng
|
387b4d365e
|
refactor checkpoint
|
2023-08-21 19:07:15 +08:00 |
|
Haojun Liao
|
29bb5854cc
|
fix(stream): fix error in check stream state.
|
2023-08-21 11:48:55 +08:00 |
|
yihaoDeng
|
8e4411c144
|
fix checkpoint error
|
2023-08-18 21:42:35 +08:00 |
yihaoDeng
|
114df7c349
|
fix transfer error
|
2023-08-16 11:37:15 +00:00 |
|
yihaoDeng
|
ab7e2b3122
|
Merge branch 'enh/chkpTransfer' into enh/triggerCheckPoint2
|
2023-08-16 09:00:30 +00:00 |
|
Haojun Liao
|
d63758a1c5
|
fix(stream): fix error in execute task on a tranferred node.
|
2023-08-16 15:24:24 +08:00 |
|
yihaoDeng
|
993ae84398
|
close backend
|
2023-08-16 07:17:15 +00:00 |
|
Haojun Liao
|
39079ab64a
|
fix(stream): load term from sync model to decide if the node is restart or not
|
2023-08-15 15:52:06 +08:00 |
|
Haojun Liao
|
b1d35f43ba
|
enh(stream): using term from sync module to denote the upstream node is restarted/replica-modified/vnode-transferred or not.
|
2023-08-15 09:25:05 +08:00 |
|
yihaoDeng
|
99be2836b2
|
Merge branch 'enh/triggerCheckPoint2' into enh/chkpTransfer
|
2023-08-11 02:50:12 +00:00 |
|
Haojun Liao
|
1e636a2ef9
|
Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2
|
2023-08-11 10:37:40 +08:00 |
|
Haojun Liao
|
6a9826cf6e
|
enh(stream): update the stream task epset.
|
2023-08-11 10:37:25 +08:00 |
|
yihaoDeng
|
ba4ce9db02
|
Merge branch 'enh/triggerCheckPoint2' into enh/chkpTransfer
|
2023-08-11 02:15:07 +00:00 |
|
yihaoDeng
|
32983a11e1
|
add log and fix crash
|
2023-08-10 20:34:00 +08:00 |
|
Haojun Liao
|
a713b37f35
|
fix(stream): add more logs.
|
2023-08-10 14:07:29 +08:00 |
|
Haojun Liao
|
f633c7fe2b
|
other: merge 3.0.
|
2023-08-10 11:56:30 +08:00 |
|
yihaoDeng
|
ef247cdb1d
|
support reopen stream state
|
2023-08-10 01:49:26 +00:00 |
|
Haojun Liao
|
c10b323188
|
other: merge main.
|
2023-08-10 09:26:33 +08:00 |
|
Haojun Liao
|
0cf8144952
|
fix(stream): fix the invalid key used by remove data in stream meta hash table.
|
2023-08-09 22:28:23 +08:00 |
|
Haojun Liao
|
d34b9af054
|
enh(stream): create update stream trans.
|
2023-08-09 19:38:13 +08:00 |
|
Haojun Liao
|
1e8579e8c5
|
fix(stream): fix other cases.
|
2023-08-09 16:04:48 +08:00 |
|
Haojun Liao
|
4c92997328
|
fix(stream): use streamId&taskId to identify the stream task in the stream meta.
|
2023-08-09 15:52:23 +08:00 |
|
Haojun Liao
|
f3c5f20ee2
|
enh(stream): add timer to check the node changing.
|
2023-08-09 10:25:16 +08:00 |
|
Haojun Liao
|
17c6143471
|
fix(stream): check more status when handling the state transfer.
|
2023-08-08 15:08:11 +08:00 |
|
Haojun Liao
|
a0dcec5890
|
enh(stream): add function handler for hb message.
|
2023-08-08 11:23:19 +08:00 |
|
Haojun Liao
|
f8ee055641
|
other: merge 3.0
|
2023-08-08 00:19:08 +08:00 |
|
yihaoDeng
|
80e78e054d
|
support reopen stream state
|
2023-08-07 11:39:32 +00:00 |
|
yihaoDeng
|
6c8c575549
|
support reopen stream state
|
2023-08-07 10:48:04 +00:00 |
|
Haojun Liao
|
aea1690cd1
|
fix(stream): fix the stream task after checking if it is in the timer activities.
|
2023-08-07 17:49:36 +08:00 |
|
yihaoDeng
|
b6c991f896
|
support reopen stream state
|
2023-08-07 08:59:04 +00:00 |
|
yihaoDeng
|
eeb97351e8
|
support reopen stream state
|
2023-08-07 08:51:01 +00:00 |
|
Haojun Liao
|
225c0e61dc
|
hen(stream): support the rollback and checkdown stream tasks.
|
2023-08-07 16:13:39 +08:00 |
|
yihaoDeng
|
a4da6e9a88
|
fix mem leak
|
2023-08-04 15:59:34 +08:00 |
|
yihaoDeng
|
81908be32f
|
add stream ver
|
2023-08-04 14:02:03 +08:00 |
|
yihaoDeng
|
6dc93a8dec
|
add stream ver
|
2023-08-04 13:52:20 +08:00 |
|
yihaoDeng
|
f9d0874e45
|
support reopen stream state
|
2023-08-03 08:24:50 +00:00 |
|
Haojun Liao
|
ad4c5916e7
|
enh(stream): update the stream task.
|
2023-08-01 18:14:58 +08:00 |
|
Haojun Liao
|
cc5ff44604
|
enh(stream): handle the stream hb.
|
2023-07-30 19:25:00 +08:00 |
|
Haojun Liao
|
8dfef8768a
|
other: merge 3.0
|
2023-07-29 22:54:16 +08:00 |
|
Haojun Liao
|
9f943213ed
|
enh(stream): update the hb info.
|
2023-07-28 14:23:53 +08:00 |
|
Haojun Liao
|
74834aea11
|
enh(stream): prepare hb to mnode from stream meta.
|
2023-07-28 13:07:16 +08:00 |
|
Haojun Liao
|
22a5a18fff
|
fix(stream): 1. set correct timewindow after step2. 2. handle the case when the task is failed to be added into the meta store.
|
2023-07-27 18:57:36 +08:00 |
|
Haojun Liao
|
cdffabcdad
|
fix(stream): fix memory leak.
|
2023-07-26 14:37:04 +08:00 |
|
Haojun Liao
|
063673726a
|
fix(stream): fix syntax error
|
2023-07-25 18:08:22 +08:00 |
|
Haojun Liao
|
2cc4e0a727
|
fix(stream): fix syntax error
|
2023-07-25 17:56:40 +08:00 |
|
Haojun Liao
|
0bdccd2681
|
refactor: do some internal refactor.
|
2023-07-25 17:31:54 +08:00 |
|
Haojun Liao
|
aed99da6c1
|
refactor: refactor the stream task starting order.
|
2023-07-20 12:14:53 +08:00 |
|
yihaoDeng
|
40d59990d8
|
fix mem leak
|
2023-07-18 04:01:20 +00:00 |
|
Haojun Liao
|
2f24f776fb
|
fix(stream): fix error in generating checkpoint for state_window.
|
2023-07-18 09:04:28 +08:00 |
Haojun Liao
|
b2a905bd91
|
Merge branch '3.0' into enh/triggerCheckPoint2
|
2023-07-17 11:50:12 +08:00 |
|
yihaoDeng
|
dea2e73d2e
|
add checkpoint
|
2023-07-17 02:22:21 +00:00 |
|
yihaoDeng
|
b4de0892e6
|
add checkpoint
|
2023-07-15 09:35:33 +00:00 |
|
yihaoDeng
|
e18c9ea672
|
add checkpoint
|
2023-07-15 04:26:34 +00:00 |
|
yihaoDeng
|
aad669e33c
|
add checkpoint
|
2023-07-14 14:46:13 +00:00 |
|
yihaoDeng
|
3020e27114
|
fix mem leak
|
2023-07-14 10:20:37 +00:00 |
|
yihaoDeng
|
3c4631ef1f
|
add checkpoint
|
2023-07-14 10:06:24 +00:00 |
|
Haojun Liao
|
2f90a53548
|
fix(stream): set checkpoint id when expanding task.
|
2023-07-13 10:16:57 +08:00 |
|
yihaoDeng
|
bb72f07a94
|
rm expire checkpoint
|
2023-07-12 16:38:46 +08:00 |
|
Haojun Liao
|
fed3803739
|
fix(stream): fix memory leak.
|
2023-07-11 19:29:52 +08:00 |
|
yihaoDeng
|
e547ed3699
|
rm expire checkpoint
|
2023-07-11 16:30:14 +08:00 |
|
Haojun Liao
|
d7101f7109
|
enh(stream): support dispatch checkpoint msg.
|
2023-07-06 18:26:22 +08:00 |
|
Haojun Liao
|
5a9461a69a
|
other: merge 3.0
|
2023-07-06 11:52:21 +08:00 |
|
Haojun Liao
|
f4a3567935
|
other: merge 3.0
|
2023-07-06 11:24:30 +08:00 |
|
Haojun Liao
|
03dbcbf055
|
refactor: do some internal refactor.
|
2023-07-05 15:55:55 +08:00 |
|
yihaoDeng
|
247d3ac7ee
|
vnode snapshot read
|
2023-06-30 12:05:05 +00:00 |
|
yihaoDeng
|
7d30a6e27a
|
vnode snapshot read
|
2023-06-30 11:48:46 +00:00 |
|
Haojun Liao
|
57fcd553f8
|
refactor: do some internal refactor.
|
2023-06-28 13:13:13 +08:00 |
|
Haojun Liao
|
a19e63fd23
|
fix(stream): fix error in handling fill history.
|
2023-06-27 23:00:14 +08:00 |
|
Haojun Liao
|
402c091df0
|
fix(stream): fix sma error.
|
2023-06-25 19:41:44 +08:00 |
|
yihaoDeng
|
0eeaab9cd3
|
Merge branch 'refact/fillhistory1' into refact/fillhistory
|
2023-06-19 13:53:37 +08:00 |
|
yihaoDeng
|
fd85a8495a
|
Merge branch 'dev30' into enh/triggerCheckPoint2
|
2023-06-17 14:17:21 +08:00 |
|
yihaoDeng
|
b6fe5d917b
|
refactor checkpoint
|
2023-06-17 14:05:49 +08:00 |
|
yihaoDeng
|
1e05f5c693
|
support fill history
|
2023-06-16 10:00:16 +08:00 |
|
yihaoDeng
|
0ef8afbdaa
|
support fill history
|
2023-06-16 09:32:38 +08:00 |
|
yihaoDeng
|
9f9171719a
|
support fill history
|
2023-06-15 21:29:52 +08:00 |
|
Haojun Liao
|
74e0138f72
|
Merge branch '3.0' into refact/fillhistory
|
2023-06-15 15:25:00 +08:00 |
|
yihaoDeng
|
52ca94ea6d
|
trigger checkpoint
|
2023-06-14 16:20:14 +08:00 |
|
Haojun Liao
|
b44447e6f3
|
enh(stream): support restore from disk.
|
2023-06-14 10:19:03 +08:00 |
|
Haojun Liao
|
53246ed6bb
|
other: merge other branch.
|
2023-06-09 09:41:10 +08:00 |
|
yihaoDeng
|
9828ca9d7f
|
add trigger checkpoint
|
2023-06-08 09:28:34 +00:00 |
|
Haojun Liao
|
06cf3588da
|
refactor: do some internal refactor.
|
2023-06-07 15:03:04 +08:00 |
|
yihaoDeng
|
66f483e51a
|
fix invalid free
|
2023-06-06 02:32:06 +00:00 |
|
Haojun Liao
|
0dd933013c
|
enh(stream): make history task for stream running.
|
2023-06-05 17:58:00 +08:00 |
|
Haojun Liao
|
fcc706c45c
|
enh(stream): refactor the fill history task.
|
2023-06-05 15:59:01 +08:00 |
|
yihaoDeng
|
74d5f02969
|
fix invalid free
|
2023-06-05 04:56:07 +00:00 |
|
yihaoDeng
|
1571ea844a
|
Avoid creating the same ID task multiple times
|
2023-06-01 11:25:55 +00:00 |
|
yihaoDeng
|
0315e89591
|
Avoid creating the same ID task multiple times
|
2023-06-01 11:13:01 +00:00 |
|
Haojun Liao
|
1e845acabe
|
fix(tmq): allow seek before get assignment
|
2023-05-26 11:34:12 +08:00 |
|
Haojun Liao
|
899e4d3350
|
refactor: do some internal refactor.
|
2023-05-20 18:13:58 +08:00 |
|
Haojun Liao
|
6ded3284da
|
refactor: do some internal refactor.
|
2023-05-20 11:37:17 +08:00 |
|
yihaoDeng
|
9c0d2c87c6
|
Merge branch 'enh/3.0' into enh/rocksdbSstateMerge
|
2023-05-15 01:52:42 +00:00 |
|
Haojun Liao
|
236926b9ee
|
other: merge enh/rocksdbstate
|
2023-05-13 19:49:28 +08:00 |
|
yihaoDeng
|
6cf1adf1b1
|
factor code
|
2023-05-11 13:01:45 +00:00 |
|
yihaoDeng
|
0710fc39af
|
factor code
|
2023-05-11 09:04:14 +00:00 |
|
yihaoDeng
|
f652f71d68
|
factor code
|
2023-05-11 06:37:57 +00:00 |
|
Haojun Liao
|
2b736ffd60
|
fix(stream): avoid duplicated task id in task id list.
|
2023-05-11 11:47:57 +08:00 |
|
Yihao Deng
|
c6e5879f44
|
Merge branch 'main' into enh/rocksdbSstate
|
2023-05-10 10:04:28 +08:00 |
|
yihaoDeng
|
8356533eb1
|
Merge branch 'enh/standVer' into enh/rocksdbSstateMerge
|
2023-05-09 12:13:16 +00:00 |
|
liuyao
|
8224d49702
|
fix:after restarting taosd, stream does not work.
|
2023-05-09 17:24:11 +08:00 |
|
yihaoDeng
|
55014aa003
|
Merge branch 'enh/rocksdbSstate' into enh/rocksdbSstateMerge
|
2023-05-09 08:58:51 +00:00 |
|
yihaoDeng
|
b5fdaa327d
|
avoid deadlock
|
2023-05-09 07:00:29 +00:00 |
|
yihaoDeng
|
08c3a63341
|
Merge branch 'enh/standVer' into enh/rocksdbSstateMerge
|
2023-05-06 12:37:54 +00:00 |
|
yihaoDeng
|
8be29dc98e
|
failed to open rocksdb cf
|
2023-05-06 10:35:23 +00:00 |
|
Haojun Liao
|
aca5760ceb
|
fix(query): fix syntax error.
|
2023-05-06 13:17:31 +08:00 |
|
Haojun Liao
|
da6212bab0
|
other: merge main.
|
2023-05-06 12:51:38 +08:00 |
|
Haojun Liao
|
8958aabe4b
|
fix(stream): opt task scan performance.
|
2023-05-05 19:33:30 +08:00 |
|
yihaoDeng
|
f7a7743af7
|
fix case failure
|
2023-05-05 08:32:33 +00:00 |
|
Haojun Liao
|
8b12d4d3da
|
fix(stream): secure the delete task operation. TD-1198
|
2023-05-05 15:02:03 +08:00 |
|
Haojun Liao
|
2b7a816b86
|
fix(tmq): fix syntax error.
|
2023-05-04 16:59:26 +08:00 |
|
Haojun Liao
|
23c49594b7
|
other: merge main.
|
2023-05-04 16:41:53 +08:00 |