Haojun Liao
|
4490f40c96
|
fix(stream): do some internal refactor.
|
2024-06-14 14:43:57 +08:00 |
Haojun Liao
|
0f8c0fa8cb
|
fix(stream): add dispatch data monitor to handle the network broken problem that may cause the stream process frozen.
|
2024-06-13 14:56:20 +08:00 |
Haojun Liao
|
cbf8b363fc
|
fix(stream): update checkpoint info by using trans.
|
2024-06-10 00:46:01 +08:00 |
Haojun Liao
|
1e47cb7eba
|
other: update the test case.
|
2024-06-07 11:15:23 +08:00 |
Haojun Liao
|
4fc21cc8b0
|
refactor: do some internal refactor.
|
2024-06-04 10:08:18 +08:00 |
Haojun Liao
|
3b3ed1c30c
|
fix(stream): add monitor for checkpoint-ready msg recv status.
|
2024-06-03 16:45:37 +08:00 |
Haojun Liao
|
31317c4895
|
fix(stream): set the checkpoint ready info for only one task in stream.
|
2024-06-01 23:20:43 +08:00 |
Haojun Liao
|
2a8270f9c8
|
fix(stream): track the checkpoint-ready msg on the upstream tasks.
|
2024-06-01 18:26:45 +08:00 |
Haojun Liao
|
76b43dc072
|
fix(stream): 1. check the checkpoint-trigger rsp, 2. set the error code in the message body, 3. follower nodes not handle the checkpoint-trigger retrieve request.
|
2024-05-31 14:32:55 +08:00 |
Haojun Liao
|
ee4e4c0e6d
|
refactor: do some internal refactor.
|
2024-05-31 09:17:20 +08:00 |
Haojun Liao
|
d1d868f239
|
refactor: do some internal refactor and set the pActiveInfo for rsma.
|
2024-05-29 00:08:29 +08:00 |
Haojun Liao
|
be107b204c
|
enh(stream): support retrieve checkpoint data remotely when start stream tasks in vnodes.
|
2024-05-28 09:54:22 +08:00 |
Haojun Liao
|
be39044b66
|
fix(stream): add more info
|
2024-05-22 11:04:54 +08:00 |
Haojun Liao
|
abd90c733a
|
fix(stream): remove backend files only after the in-memory task is dropped.
|
2024-05-15 14:24:35 +08:00 |
Haojun Liao
|
7f93ec2c53
|
fix(stream): update the checkpoint info for followers, and some internal refactor.
|
2024-05-11 09:37:02 +08:00 |
Haojun Liao
|
db848f7e6b
|
refactor: do some internal refactor.
|
2024-05-09 10:15:34 +08:00 |
Haojun Liao
|
6693efaa85
|
refactor: do some internal refactor.
|
2024-05-09 10:11:37 +08:00 |
Haojun Liao
|
c43fbf6fee
|
refactor: do some internal refactor.
|
2024-05-08 11:21:24 +08:00 |
Haojun Liao
|
18c66a5491
|
refactor: do some internal refactor.
|
2024-05-06 18:17:38 +08:00 |
Haojun Liao
|
7ad7ef7cfc
|
refactor: do some internal refactor.
|
2024-05-06 17:03:41 +08:00 |
Haojun Liao
|
a0e68c2bfb
|
refactor: do some internal refactor.
|
2024-04-26 11:14:53 +08:00 |
Haojun Liao
|
ae4e2bf671
|
fix(stream): suppress some warnings by ide.
|
2024-04-26 10:00:54 +08:00 |
Haojun Liao
|
fae53efed9
|
fix(stream): add some logs for retry for notready/timeout downstream tasks. and do some internal refactor.
|
2024-04-26 09:58:20 +08:00 |
Haojun Liao
|
addd2d2a84
|
fix(stream): fix syntax error.
|
2024-04-25 17:06:15 +08:00 |
Haojun Liao
|
cd8baa7ba0
|
fix(stream): add log for update task epset, set correct update flag if epset updated.
|
2024-04-25 16:39:11 +08:00 |
Haojun Liao
|
b698b8be96
|
fix(stream): pass the address of tmr_h id
|
2024-04-25 09:57:08 +08:00 |
Haojun Liao
|
10c792efa2
|
fix(stream):add related fill-history task to be done, when check-rsp moniting quit.
|
2024-04-23 16:55:47 +08:00 |
Haojun Liao
|
1adf59e7d8
|
fix(stream): do check when task is paused, and do some internal refactor.
|
2024-04-23 13:53:23 +08:00 |
Haojun Liao
|
34048937a4
|
fix(stream): check req id to remove expired check rsp .
|
2024-04-23 10:03:01 +08:00 |
Haojun Liao
|
315b86cf66
|
fix(stream): save the epset if task epset updated.
|
2024-04-22 23:52:45 +08:00 |
Haojun Liao
|
cf7ffb82e0
|
fix(stream): init before send msg, to avoid race condition.
|
2024-04-22 17:18:01 +08:00 |
Haojun Liao
|
97c1f88b22
|
refactor: do some internal refactor.
|
2024-04-22 14:06:11 +08:00 |
Haojun Liao
|
6c76790e6c
|
fix(stream): fix a typo
|
2024-04-22 14:03:13 +08:00 |
Haojun Liao
|
a8fac441be
|
fix(stream):update the check-rsp prcedure, to avoid repeatly start check-rsp procedure.
|
2024-04-22 14:02:31 +08:00 |
Haojun Liao
|
b903872a4e
|
fix(stream): correct count down the ready tasks.
|
2024-04-19 19:02:34 +08:00 |
Haojun Liao
|
3baa47f266
|
fix(stream): record the task check downstream failed info.
|
2024-04-19 16:21:05 +08:00 |
Haojun Liao
|
3769da535e
|
fix(stream): re-send checkmsg to downstream for fixed dispatch type.
|
2024-04-19 10:00:47 +08:00 |
Haojun Liao
|
815d12fd77
|
fix(stream): set check downstream completed for sink task.
|
2024-04-18 18:36:02 +08:00 |
Haojun Liao
|
e7dee4ac63
|
refactor(stream): refactor check msg retry procedure and be tolerant to the dnode disconnection during check downstream tasks.
|
2024-04-18 15:55:21 +08:00 |
Haojun Liao
|
ac84a5f82b
|
refactor: do some internal refactor.
|
2024-04-17 21:57:09 +08:00 |
Haojun Liao
|
665107ad3a
|
enh(stream): add more info in meta table.
|
2024-04-15 14:23:37 +08:00 |
Haojun Liao
|
fabb986aa8
|
fix(stream): fix stack overflow, caused by print epset.
|
2024-04-10 19:54:33 +08:00 |
Haojun Liao
|
e261023ee6
|
fix(stream): add lock, and fix race condition.
|
2024-04-10 18:42:44 +08:00 |
Haojun Liao
|
fb58ca8592
|
fix(stream): not wait for the timer stopped.
|
2024-04-07 18:53:25 +08:00 |
Haojun Liao
|
f82505ba16
|
fix(stream): remove invalid assert
|
2024-04-07 14:06:25 +08:00 |
Haojun Liao
|
1b343e662c
|
fix(stream): retry stop timer for trigger tmr.
|
2024-04-07 10:18:01 +08:00 |
wangmm0220
|
8e45bebd66
|
fix:decode task error if task version is smaller than 2
|
2024-03-26 15:16:09 +08:00 |
wangmm0220
|
6aaac7c0dc
|
fix:decode task error if task version is smaller than 2
|
2024-03-25 17:57:13 +08:00 |
Haojun Liao
|
f28e994409
|
Merge pull request #25091 from taosdata/fix/3_liaohj
fix(stream): transfer state before do checkpoint
|
2024-03-14 17:59:13 +08:00 |
Haojun Liao
|
cc0b32b1f8
|
fix(stream): transfer state before do checkpoint, to avoid the retrieve and deadlock by using waiting .
|
2024-03-14 16:13:41 +08:00 |
Haojun Liao
|
15663ab450
|
Merge pull request #25084 from taosdata/fix/3_liaohj
fix(tsdb): set strict varchar length check.
|
2024-03-14 11:16:03 +08:00 |
Haojun Liao
|
190b02dd1a
|
fix(stream):set correct version for sink/agg tasks.
|
2024-03-14 10:04:43 +08:00 |
Haojun Liao
|
3aa2e24d78
|
Merge pull request #25006 from taosdata/fix/nullcheck
fix(stream): set the dest epset from mnode, and set the retry error
|
2024-03-05 19:46:41 +08:00 |
Haojun Liao
|
45e779d464
|
refactor: do some internal refactor.
|
2024-03-05 15:48:58 +08:00 |
Haojun Liao
|
cdfbbc2985
|
fix(stream): set the dest epset from mnode, and set the retry error code for trans.
|
2024-03-05 13:28:34 +08:00 |
Haojun Liao
|
4d10f28a00
|
Merge pull request #24999 from taosdata/fix/nullcheck
fix(stream): remove related fill-history if task in stop status.
|
2024-03-05 09:15:21 +08:00 |
Haojun Liao
|
ad1780dbdc
|
fix(stream): reset the pData after transferring state.
|
2024-03-04 19:32:22 +08:00 |
Haojun Liao
|
80fd3e0445
|
fix(stream): remove related fill-history if task in stop status.
|
2024-03-04 19:31:47 +08:00 |
Haojun Liao
|
8791a163f8
|
other: merge 3.0
|
2024-02-29 22:31:52 +08:00 |
Haojun Liao
|
db92bf84d8
|
other: merge 3.0
|
2024-02-29 22:21:50 +08:00 |
Haojun Liao
|
dafac591f7
|
enh(stream): add rsp for req-checkpoint
|
2024-02-27 10:53:25 +08:00 |
Haojun Liao
|
d8ffa65b62
|
fix(stream): fix the compatible issue when the fill-history exists.
|
2024-02-23 09:12:27 +08:00 |
Haojun Liao
|
af1f61cd39
|
fix(stream): fix the compatible issue when the fill-history exists.
|
2024-02-22 19:05:30 +08:00 |
Haojun Liao
|
d6f5ae226b
|
refactor: do some internal refactor.
|
2024-02-21 09:42:23 +08:00 |
Haojun Liao
|
8d848a5bf0
|
fix(stream): add null ptr check.
|
2024-02-21 09:40:22 +08:00 |
Haojun Liao
|
13c3654bf5
|
other: merge 3.0
|
2024-02-20 10:51:04 +08:00 |
54liuyao
|
af1893d109
|
merge 3.0
|
2024-02-19 18:30:12 +08:00 |
Haojun Liao
|
bf242a4f64
|
fix(stream): handle pause event in waiting list.
|
2024-02-19 15:57:21 +08:00 |
wangmm0220
|
ac9582b24a
|
fix:[TD-28567] do not add md5 to the end of subtable if create stream by sma
|
2024-02-19 13:58:58 +08:00 |
Haojun Liao
|
730edf24f9
|
fix(stream): fix syntax error.
|
2024-02-19 13:38:14 +08:00 |
Haojun Liao
|
d3e8adf2eb
|
enh(stream): async handle pause event
|
2024-02-19 13:36:57 +08:00 |
54liuyao
|
b53dc5602e
|
Merge branch '3.0' of https://github.com/taosdata/TDengine into 3.0
|
2024-02-19 10:58:20 +08:00 |
wangmm0220
|
a8e45440c0
|
fix:conflicts from 3.0
|
2024-02-18 18:02:14 +08:00 |
Haojun Liao
|
7a18e5910c
|
enh(stream): halt the initial stream tasks when fill-history is set for count window agg
|
2024-02-05 17:51:09 +08:00 |
Haojun Liao
|
cb2ea4a721
|
fix(stream): take ver snapshot for all vgroups before launching stream with fill-history option opened.
|
2024-02-01 11:37:57 +08:00 |
wangmm0220
|
a9fcc67321
|
fix:conflicts from 3.0
|
2024-02-01 11:13:03 +08:00 |
Haojun Liao
|
d4bab8c09b
|
refactor: do some internal refactor.
|
2024-01-25 16:53:30 +08:00 |
Haojun Liao
|
dc1ea9f9a1
|
fix(stream): clear htask info when unregistering the task.
|
2024-01-24 16:23:47 +08:00 |
Haojun Liao
|
b8856931d8
|
fix(stream): fix syntax error.
|
2024-01-24 13:11:36 +08:00 |
Haojun Liao
|
8a7e38ad15
|
fix(stream): fix checkpoint failure check.
|
2024-01-24 13:10:53 +08:00 |
Haojun Liao
|
d973f66cea
|
fix(stream): do checkpoint after fill-history task completed.
|
2024-01-19 16:18:02 +08:00 |
wangmm0220
|
7246fedfef
|
Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/ly_multi_marks
|
2024-01-18 19:08:35 +08:00 |
Haojun Liao
|
76e6c453e7
|
enh(stream): send msg to mnode when the transferring state completed.
|
2024-01-18 15:43:36 +08:00 |
Haojun Liao
|
fc16d26da2
|
Merge pull request #24488 from taosdata/fix/3_liaohj
fix(stream): fix some errors and do some internal refactor.
|
2024-01-17 14:25:32 +08:00 |
Haojun Liao
|
8ede6d87ce
|
refactor: do some internal refactor.
|
2024-01-16 15:40:40 +08:00 |
jiajingbin
|
d59ede5196
|
Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/TD-28032
|
2024-01-16 15:05:13 +08:00 |
Haojun Liao
|
63494de7f9
|
refactor: do some internal refactor.
|
2024-01-16 10:28:07 +08:00 |
wangmm0220
|
2ab54a1335
|
fix:conflicts from 3.0
|
2024-01-15 16:54:52 +08:00 |
Haojun Liao
|
143e6a13af
|
fix(stream): fix deadlock in pause.
|
2024-01-15 14:37:24 +08:00 |
Haojun Liao
|
e012bc4bde
|
refactor: do some internal refactor.
|
2024-01-15 11:28:36 +08:00 |
Haojun Liao
|
6d37e596ec
|
refactor: do some internal refactor.
|
2024-01-04 18:47:49 +08:00 |
Haojun Liao
|
185fa75376
|
enh(stream): add task into timer to be idle during exec when the corresponding output queue is full.
|
2024-01-03 17:59:42 +08:00 |
wangmm0220
|
8add4dc177
|
fix:[TD-28032]concat subtable and hash val as new subtable name to avoid data from multi time line write to one time line
|
2024-01-02 18:37:29 +08:00 |
Haojun Liao
|
84583580e2
|
fix(stream): transfer the checkpoint trans id.
|
2023-12-21 19:12:49 +08:00 |
wangmm0220
|
81b5f59fa5
|
Merge branch 'feat/ly_multi_marks' of https://github.com/taosdata/TDengine into feat/ly_multi_marks
|
2023-12-19 10:54:12 +08:00 |
wangmm0220
|
3a0af1ea49
|
fix:aggCnt must bigger than 1 & move msg code to the end to be compatible with old version
|
2023-12-19 10:53:46 +08:00 |
Haojun Liao
|
4f852704f5
|
fix(stream): send checkpoint complete msg to mnode when dropping it.
|
2023-12-17 02:06:01 +08:00 |
yihaoDeng
|
08eeee0794
|
Merge branch '3.0' into enh/refactorBackend
|
2023-11-28 11:52:49 +08:00 |
wangmm0220
|
06e2fbfb1c
|
fix:conflicts from 3.0
|
2023-11-27 17:53:53 +08:00 |
wangmm0220
|
70c5d36103
|
opti:extract common logic from snode & vnode to tqCommon
|
2023-11-27 17:49:09 +08:00 |