Haojun Liao
|
48bf5eb4d8
|
other: merge 3.0
|
2024-06-27 19:23:06 +08:00 |
|
Haojun Liao
|
a44e17d5ea
|
fix(stream): enable to re-send hbmsg if mnode failed to recv this hbmsg.
|
2024-06-26 15:21:14 +08:00 |
Hongze Cheng
|
b761bd2e38
|
enh: port main change to 3.0
|
2024-06-26 10:32:15 +08:00 |
|
Haojun Liao
|
1818edcb2b
|
fix(stream): consensus the start checkpoint id, and extract the streamhb related functions into a new file.
|
2024-06-26 10:18:32 +08:00 |
|
Haojun Liao
|
119001e30b
|
fix(stream): update the retrieve checkpoint-trigger msg.
|
2024-06-21 15:11:48 +08:00 |
|
Haojun Liao
|
2cb9644471
|
fix(stream): update the checkpoint info only when the status is normal.
|
2024-06-21 09:23:29 +08:00 |
|
Haojun Liao
|
42e0dff589
|
fix(stream): move the expansion of the stream task related fill-history task to the place where the fill-history task must have been deoployed already.
|
2024-06-14 17:03:04 +08:00 |
|
Haojun Liao
|
0f8c0fa8cb
|
fix(stream): add dispatch data monitor to handle the network broken problem that may cause the stream process frozen.
|
2024-06-13 14:56:20 +08:00 |
|
Haojun Liao
|
a41a04dc37
|
fix(stream): remove the related history task correctly.
|
2024-06-11 18:35:59 +08:00 |
|
Haojun Liao
|
cbf8b363fc
|
fix(stream): update checkpoint info by using trans.
|
2024-06-10 00:46:01 +08:00 |
|
Haojun Liao
|
4fc21cc8b0
|
refactor: do some internal refactor.
|
2024-06-04 10:08:18 +08:00 |
|
Haojun Liao
|
3b3ed1c30c
|
fix(stream): add monitor for checkpoint-ready msg recv status.
|
2024-06-03 16:45:37 +08:00 |
|
Haojun Liao
|
2a8270f9c8
|
fix(stream): track the checkpoint-ready msg on the upstream tasks.
|
2024-06-01 18:26:45 +08:00 |
|
Haojun Liao
|
76b43dc072
|
fix(stream): 1. check the checkpoint-trigger rsp, 2. set the error code in the message body, 3. follower nodes not handle the checkpoint-trigger retrieve request.
|
2024-05-31 14:32:55 +08:00 |
|
Haojun Liao
|
ee4e4c0e6d
|
refactor: do some internal refactor.
|
2024-05-31 09:17:20 +08:00 |
|
Haojun Liao
|
27ac6ca16e
|
fix(stream): desc the ref for checkpoint-trigger timer.
|
2024-05-29 14:12:14 +08:00 |
|
Haojun Liao
|
d1d868f239
|
refactor: do some internal refactor and set the pActiveInfo for rsma.
|
2024-05-29 00:08:29 +08:00 |
|
Haojun Liao
|
be107b204c
|
enh(stream): support retrieve checkpoint data remotely when start stream tasks in vnodes.
|
2024-05-28 09:54:22 +08:00 |
|
Haojun Liao
|
be39044b66
|
fix(stream): add more info
|
2024-05-22 11:04:54 +08:00 |
|
Haojun Liao
|
abd90c733a
|
fix(stream): remove backend files only after the in-memory task is dropped.
|
2024-05-15 14:24:35 +08:00 |
|
Haojun Liao
|
610aa80e65
|
fix(stream): init backend for fill-history task.
|
2024-05-15 00:08:38 +08:00 |
|
Haojun Liao
|
6898eba6ed
|
fix(stream): expand stream tasks are divided into two phase, the first is to build stream task and then expand stream task before start stream tasks.
|
2024-05-14 14:34:31 +08:00 |
|
Haojun Liao
|
b7e7de0354
|
fix(stream): set the stream task load flag.
|
2024-05-13 16:45:38 +08:00 |
|
Haojun Liao
|
3dfffe9113
|
fix(stream): async load and start stream tasks.
|
2024-05-13 15:31:26 +08:00 |
|
Haojun Liao
|
7f93ec2c53
|
fix(stream): update the checkpoint info for followers, and some internal refactor.
|
2024-05-11 09:37:02 +08:00 |
|
Haojun Liao
|
6721ec3cd8
|
refactor: do some internal refactor.
|
2024-05-09 14:06:25 +08:00 |
|
Haojun Liao
|
c43fbf6fee
|
refactor: do some internal refactor.
|
2024-05-08 11:21:24 +08:00 |
|
Haojun Liao
|
cdeb4462fb
|
refactor: do some internal refactor.
|
2024-05-07 23:43:21 +08:00 |
|
Haojun Liao
|
b6debd985b
|
fix(stream): always return success if repeatly recv checkpoint source msg.
|
2024-05-07 16:33:08 +08:00 |
|
Haojun Liao
|
0e0f98eb8d
|
refactor: do some internal refactor.
|
2024-05-07 10:50:44 +08:00 |
|
Haojun Liao
|
18c66a5491
|
refactor: do some internal refactor.
|
2024-05-06 18:17:38 +08:00 |
|
Haojun Liao
|
7ad7ef7cfc
|
refactor: do some internal refactor.
|
2024-05-06 17:03:41 +08:00 |
|
Haojun Liao
|
d879c7c967
|
fix(stream): set global close flag in the streamMeta.
|
2024-05-06 16:40:49 +08:00 |
|
Haojun Liao
|
732e52d64d
|
refactor: do some internal refactor, and add some logs.
|
2024-04-30 19:11:58 +08:00 |
|
Haojun Liao
|
bf5d523116
|
fix(stream): disable the exec of complete check status in timer thread.
|
2024-04-28 17:57:34 +08:00 |
|
Haojun Liao
|
3c5ca17737
|
Merge branch '3.0' into fix/3_liaohj
|
2024-04-28 13:57:16 +08:00 |
|
Haojun Liao
|
6ea4823f1e
|
fix(stream): update the timeout measurement.
|
2024-04-28 11:14:10 +08:00 |
|
Haojun Liao
|
b2d8260f14
|
refactor: do some internal refactor.
|
2024-04-28 10:05:22 +08:00 |
|
Haojun Liao
|
9df2bc2634
|
refactor: do some internal refactor.
|
2024-04-26 22:23:23 +08:00 |
|
Haojun Liao
|
2d1e9ba631
|
fix(stream):add ref for task in check rsp monitor timer.
|
2024-04-26 19:11:57 +08:00 |
Haojun Liao
|
5f5595a6ab
|
Merge pull request #25517 from taosdata/fix/3_liaohj
fix(stream): add task node into update list if it is timeout for more than 100sec.
|
2024-04-26 17:00:23 +08:00 |
|
Haojun Liao
|
3961903fea
|
refactor: do some internal refactor.
|
2024-04-26 14:00:03 +08:00 |
|
Haojun Liao
|
19b0de6582
|
fix(stream): add task node into update list if it is timeout for more than 100sec.
|
2024-04-26 13:49:40 +08:00 |
|
Haojun Liao
|
c565e31638
|
Merge pull request #25510 from taosdata/fix/3_liaohj
fix(stream): handle disorder node Update trans Id.
|
2024-04-26 12:44:00 +08:00 |
|
Haojun Liao
|
a0e68c2bfb
|
refactor: do some internal refactor.
|
2024-04-26 11:14:53 +08:00 |
|
Haojun Liao
|
fae53efed9
|
fix(stream): add some logs for retry for notready/timeout downstream tasks. and do some internal refactor.
|
2024-04-26 09:58:20 +08:00 |
chenhaoran
|
14ff120fdc
|
fix: fix tstream.h
|
2024-04-25 19:09:53 +08:00 |
|
Haojun Liao
|
1adf59e7d8
|
fix(stream): do check when task is paused, and do some internal refactor.
|
2024-04-23 13:53:23 +08:00 |
|
Haojun Liao
|
315b86cf66
|
fix(stream): save the epset if task epset updated.
|
2024-04-22 23:52:45 +08:00 |
|
Haojun Liao
|
a8fac441be
|
fix(stream):update the check-rsp prcedure, to avoid repeatly start check-rsp procedure.
|
2024-04-22 14:02:31 +08:00 |
|
Haojun Liao
|
815d12fd77
|
fix(stream): set check downstream completed for sink task.
|
2024-04-18 18:36:02 +08:00 |
|
Haojun Liao
|
e7dee4ac63
|
refactor(stream): refactor check msg retry procedure and be tolerant to the dnode disconnection during check downstream tasks.
|
2024-04-18 15:55:21 +08:00 |
|
Haojun Liao
|
ac84a5f82b
|
refactor: do some internal refactor.
|
2024-04-17 21:57:09 +08:00 |
|
Haojun Liao
|
8bdd43c305
|
fix(stream): wait for 50ms when no token in bucket for sink task.
|
2024-04-16 14:42:21 +08:00 |
|
Haojun Liao
|
1ac192c069
|
fix(stream): keep the original tsdb scan version range.
|
2024-04-15 18:41:38 +08:00 |
|
Haojun Liao
|
665107ad3a
|
enh(stream): add more info in meta table.
|
2024-04-15 14:23:37 +08:00 |
|
Haojun Liao
|
f23a8a37bc
|
refactor: do some internal refactor.
|
2024-04-10 16:43:02 +08:00 |
|
Haojun Liao
|
dcc97472d3
|
fix(stream): add strict check for checkpoint-trigger msg dispatach rsp confirmation flag.
|
2024-04-02 21:53:50 +08:00 |
wangmm0220
|
8e2a2414c0
|
fix:same subtable same partition by leads to same table name in stream
|
2024-03-28 13:48:46 +08:00 |
|
Haojun Liao
|
4d10f28a00
|
Merge pull request #24999 from taosdata/fix/nullcheck
fix(stream): remove related fill-history if task in stop status.
|
2024-03-05 09:15:21 +08:00 |
|
Haojun Liao
|
80fd3e0445
|
fix(stream): remove related fill-history if task in stop status.
|
2024-03-04 19:31:47 +08:00 |
|
Haojun Liao
|
5554362399
|
fix(stream):remove unused def.
|
2024-03-03 16:41:16 +08:00 |
|
Haojun Liao
|
db92bf84d8
|
other: merge 3.0
|
2024-02-29 22:21:50 +08:00 |
|
Haojun Liao
|
13c3654bf5
|
other: merge 3.0
|
2024-02-20 10:51:04 +08:00 |
54liuyao
|
0e8170de49
|
remove invalid code
|
2024-02-20 10:17:47 +08:00 |
|
Haojun Liao
|
46b1fe520f
|
Merge pull request #24538 from taosdata/feat/TD-22023
stream count window
|
2024-02-20 08:50:25 +08:00 |
|
54liuyao
|
af1893d109
|
merge 3.0
|
2024-02-19 18:30:12 +08:00 |
|
Haojun Liao
|
931b9f0b51
|
other: merge 3.0
|
2024-02-19 18:27:18 +08:00 |
|
Haojun Liao
|
bf242a4f64
|
fix(stream): handle pause event in waiting list.
|
2024-02-19 15:57:21 +08:00 |
|
wangmm0220
|
ac9582b24a
|
fix:[TD-28567] do not add md5 to the end of subtable if create stream by sma
|
2024-02-19 13:58:58 +08:00 |
|
54liuyao
|
b53dc5602e
|
Merge branch '3.0' of https://github.com/taosdata/TDengine into 3.0
|
2024-02-19 10:58:20 +08:00 |
|
Haojun Liao
|
e62dd2ff5c
|
refactor: do some internal refactor.
|
2024-02-19 10:31:25 +08:00 |
|
Haojun Liao
|
cf571e4f1f
|
refactor: do some internal refactor.
|
2024-02-19 09:52:22 +08:00 |
|
wangmm0220
|
a8e45440c0
|
fix:conflicts from 3.0
|
2024-02-18 18:02:14 +08:00 |
|
Haojun Liao
|
472020a2b9
|
enh(stream): handle event async function.
|
2024-02-18 14:07:15 +08:00 |
|
Haojun Liao
|
2bba011e4e
|
Merge remote-tracking branch 'origin/feat/TD-22023' into feat/TD-22023
|
2024-02-05 17:51:23 +08:00 |
|
Haojun Liao
|
7a18e5910c
|
enh(stream): halt the initial stream tasks when fill-history is set for count window agg
|
2024-02-05 17:51:09 +08:00 |
|
Haojun Liao
|
739485a419
|
test(stream): add unit test case for the mnode stream module.
|
2024-02-05 09:10:04 +08:00 |
|
Haojun Liao
|
3236ef7bae
|
feat(stream): return the stream source task exec delay, and do some internal refactor.
|
2024-02-02 11:26:47 +08:00 |
|
Haojun Liao
|
cb2ea4a721
|
fix(stream): take ver snapshot for all vgroups before launching stream with fill-history option opened.
|
2024-02-01 11:37:57 +08:00 |
|
wangmm0220
|
a9fcc67321
|
fix:conflicts from 3.0
|
2024-02-01 11:13:03 +08:00 |
|
Haojun Liao
|
4970040459
|
refactor: do some internal refactor.
|
2024-01-30 15:22:49 +08:00 |
|
Haojun Liao
|
ac08f659c3
|
refactor: remove invalid procedure in fill-history.
|
2024-01-26 16:20:43 +08:00 |
|
Haojun Liao
|
d4bab8c09b
|
refactor: do some internal refactor.
|
2024-01-25 16:53:30 +08:00 |
|
Haojun Liao
|
1a45d40607
|
fix(stream): fix deadlock.
|
2024-01-24 14:37:46 +08:00 |
|
Haojun Liao
|
8a7e38ad15
|
fix(stream): fix checkpoint failure check.
|
2024-01-24 13:10:53 +08:00 |
|
Haojun Liao
|
d973f66cea
|
fix(stream): do checkpoint after fill-history task completed.
|
2024-01-19 16:18:02 +08:00 |
|
wangmm0220
|
7246fedfef
|
Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/ly_multi_marks
|
2024-01-18 19:08:35 +08:00 |
|
Haojun Liao
|
76e6c453e7
|
enh(stream): send msg to mnode when the transferring state completed.
|
2024-01-18 15:43:36 +08:00 |
|
Haojun Liao
|
56eac88349
|
Merge branch '3.0' into fix/3_liaohj
|
2024-01-17 15:14:52 +08:00 |
|
Haojun Liao
|
1ea671e373
|
enh(stream): remove time controller.
|
2024-01-17 14:55:15 +08:00 |
|
Haojun Liao
|
fc16d26da2
|
Merge pull request #24488 from taosdata/fix/3_liaohj
fix(stream): fix some errors and do some internal refactor.
|
2024-01-17 14:25:32 +08:00 |
|
Haojun Liao
|
8ede6d87ce
|
refactor: do some internal refactor.
|
2024-01-16 15:40:40 +08:00 |
jiajingbin
|
d59ede5196
|
Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/TD-28032
|
2024-01-16 15:05:13 +08:00 |
|
Haojun Liao
|
80793c94c2
|
fix(stream): reset the tasks status before start all tasks, and do some other internal refactor.
|
2024-01-16 14:32:45 +08:00 |
|
Haojun Liao
|
63494de7f9
|
refactor: do some internal refactor.
|
2024-01-16 10:28:07 +08:00 |
|
wangmm0220
|
2ab54a1335
|
fix:conflicts from 3.0
|
2024-01-15 16:54:52 +08:00 |
|
Haojun Liao
|
43081b540b
|
fix(stream): reset restart counter to be 0 if all tasks are ready.
|
2024-01-15 16:16:28 +08:00 |
|
Haojun Liao
|
143e6a13af
|
fix(stream): fix deadlock in pause.
|
2024-01-15 14:37:24 +08:00 |
|
Haojun Liao
|
e012bc4bde
|
refactor: do some internal refactor.
|
2024-01-15 11:28:36 +08:00 |