Commit Graph

2723 Commits

Author SHA1 Message Date
Haojun Liao e74b8473f1 fix(stream): clear the active checkpoint info after report to mnode. 2024-06-28 23:40:05 +08:00
Haojun Liao 5585a141d5 fix(stream): set the failed id before clear the checkpoint info. 2024-06-28 23:16:03 +08:00
Haojun Liao 1ffec769b8 fix(stream): clear the msgId if send success, and handle the race condition problem. 2024-06-28 17:03:14 +08:00
Haojun Liao 79be59d20c fix(stream): reset the status before re-send data. 2024-06-28 16:27:31 +08:00
Haojun Liao 67f483430e fix(stream): reset the status before re-send data. 2024-06-28 16:25:59 +08:00
Yihao Deng bf656ec80f fix merge conflict 2024-06-28 08:23:09 +00:00
Yihao Deng 2e59284388 add self check 2024-06-28 08:14:34 +00:00
Yihao Deng 2ae54486b5 add self check 2024-06-28 07:01:45 +00:00
Yihao Deng 8fe57c1669 add self check 2024-06-28 03:08:02 +00:00
Yihao Deng 51e4abe256 add self check 2024-06-28 02:58:30 +00:00
Haojun Liao 025437df0c fix(stream): fix error in checkpoint consensus. 2024-06-27 19:25:18 +08:00
Haojun Liao 48bf5eb4d8 other: merge 3.0 2024-06-27 19:23:06 +08:00
Yihao Deng de77ce6480 add self check 2024-06-27 09:51:49 +00:00
Hongze Cheng 5e235b50fa
Merge pull request #26295 from taosdata/fix/TD-30720
fix(streamMeta): commit tdb after load tasks
2024-06-27 14:04:02 +08:00
Yihao Deng 1004ac6924 add self check 2024-06-27 05:28:17 +00:00
Yihao Deng 7c328f0cfa add self check 2024-06-27 05:28:06 +00:00
Yihao Deng f2fc09cd02 add self check 2024-06-27 01:48:59 +00:00
Yihao Deng 0a35d7ef6b add self check 2024-06-27 01:33:25 +00:00
Haojun Liao a44e17d5ea fix(stream): enable to re-send hbmsg if mnode failed to recv this hbmsg. 2024-06-26 15:21:14 +08:00
Minglei Jin 3014c66965 fix(streamMeta): commit tdb after load tasks 2024-06-26 11:21:31 +08:00
Hongze Cheng b761bd2e38 enh: port main change to 3.0 2024-06-26 10:32:15 +08:00
Haojun Liao b6948dcc4e refactor: do some internal refactor. 2024-06-26 10:19:45 +08:00
Haojun Liao 1818edcb2b fix(stream): consensus the start checkpoint id, and extract the streamhb related functions into a new file. 2024-06-26 10:18:32 +08:00
Yihao Deng ac351c5b58 add self check info 2024-06-26 01:26:39 +00:00
Yihao Deng 061648071e add self check info 2024-06-25 12:35:25 +00:00
Yihao Deng 49ba8132c0 add self check info 2024-06-25 12:04:10 +00:00
54liuyao 25b150af10 fix(stream):fill result immediately after delete data 2024-06-25 17:24:59 +08:00
Haojun Liao c2ad0a6ec5
Revert "fix(stream):fill result immediately after delete data" 2024-06-25 16:53:32 +08:00
Haojun Liao 156e3ce109
Merge pull request #26267 from taosdata/fix/TD-30585
fix(stream):fill result immediately after delete data
2024-06-25 16:46:52 +08:00
Yihao Deng 33aef6ddc5 add self check info 2024-06-25 07:12:09 +00:00
Haojun Liao 195469f1dd fix(stream): disable the checkpoint-info-update for tasks in non-checkpoint status 2024-06-25 12:57:50 +08:00
Yihao Deng 7cab27110a add self check info 2024-06-24 12:26:10 +00:00
54liuyao a4211efacf calc end key 2024-06-24 19:19:15 +08:00
Haojun Liao 6b0b65527f fix(stream): do update the checkpoint info if not in checkpoint status. 2024-06-24 19:18:31 +08:00
Haojun Liao bd8c7d8c93 fix(stream): pause not stop the start procedure of stream tasks. 2024-06-24 13:25:48 +08:00
54liuyao 2d7d144ca2 fix(stream):fill dresultimmediately after delete data 2024-06-24 10:56:26 +08:00
Haojun Liao 393369fcd8 fix(stream):clear checkpoint-ready msg. 2024-06-23 00:40:12 +08:00
Haojun Liao 21e1763ff4 fix(stream): set correct flag for checkpoint. 2024-06-22 11:16:20 +08:00
Haojun Liao 095510ba41 fix(stream): fix deadlock 2024-06-21 23:43:25 +08:00
Haojun Liao 94f3c6ec2d fix(stream): fix deadlock 2024-06-21 23:40:03 +08:00
Haojun Liao 82febd30a0 fix(stream): check the task status checkpoint-ready msg send timer. 2024-06-21 18:48:34 +08:00
Haojun Liao 5a9500055d fix(stream): check the task status checkpoint-ready msg send timer. 2024-06-21 18:44:54 +08:00
Haojun Liao 5966b4f83f fix(stream): fix error in assert. 2024-06-21 17:17:39 +08:00
Haojun Liao 4c4bb0a2e4 other: merge 3.0. 2024-06-21 16:11:50 +08:00
Haojun Liao 53f9af06ff fix(stream): fix invalid write. 2024-06-21 15:44:38 +08:00
Haojun Liao 119001e30b fix(stream): update the retrieve checkpoint-trigger msg. 2024-06-21 15:11:48 +08:00
Haojun Liao e7105edaa4 fix(stream): disable pause if task is un-init. 2024-06-21 14:14:44 +08:00
Haojun Liao aea4254d40 fix(stream): async start task. 2024-06-21 10:37:06 +08:00
Haojun Liao f8578b4a69 fix(stream): fix syntax error. 2024-06-21 09:34:18 +08:00
Haojun Liao ebf2df965c
Update streamBackendRocksdb.c 2024-06-21 09:28:42 +08:00
Haojun Liao 2cb9644471 fix(stream): update the checkpoint info only when the status is normal. 2024-06-21 09:23:29 +08:00
Haojun Liao 8fd9baf6f5 fix(stream):synchronized upload checkpoint data to snode. 2024-06-21 09:11:16 +08:00
Haojun Liao bf16c596a6 fix(stream): fix syntax error. 2024-06-21 08:46:09 +08:00
Haojun Liao 096ba251ec Merge branch '3.0' into fix/3_liaohj 2024-06-20 23:12:18 +08:00
Haojun Liao 2ecc725b1a fix(stream): not clear check downstream info. 2024-06-20 21:31:23 +08:00
Haojun Liao 151fc212b8
Merge pull request #26218 from taosdata/fix/3_liaohj
fix(stream): clear the local backend default directory
2024-06-20 18:26:28 +08:00
Haojun Liao e1cb4e021f fix(stream): clear the local backend default directory, when no checkpoint generated yet. 2024-06-20 16:24:02 +08:00
54liuyao 0471afb840 adj sream tbname cache 2024-06-20 13:25:36 +08:00
54liuyao 1b317ae578 adj sream tbname cache 2024-06-20 11:06:09 +08:00
54liuyao 6a3bbccda9 adj par tbname cache 2024-06-20 10:23:44 +08:00
54liuyao ecfb5e5f4c adj par name catch 2024-06-20 09:28:04 +08:00
Haojun Liao da63a40796
Merge pull request #26188 from taosdata/fix/3_liaohj
fix(stream): fix a typo.
2024-06-19 14:58:21 +08:00
Haojun Liao 2534ce5071 fix(stream): fix a typo. 2024-06-19 10:29:01 +08:00
54liuyao 3ba7bc8ec5 Merge branch '3.0' of https://github.com/taosdata/TDengine into 3.0 2024-06-18 08:41:10 +08:00
Haojun Liao c3ae66c95c
Merge pull request #26169 from taosdata/fix/3_liaohj
fix(stream): not revise the stream id for fill-history task.
2024-06-18 08:38:29 +08:00
Haojun Liao bca3cf4e9e fix(stream): fix error in unit test. 2024-06-17 23:51:25 +08:00
Haojun Liao c4a2756907 fix(stream): not revise the stream id for fill-history task. 2024-06-17 23:13:54 +08:00
Haojun Liao f57ff96408 fix(stream): do some refactor. 2024-06-17 19:56:18 +08:00
Haojun Liao 60fac80345 fix(stream): add some logs. 2024-06-17 19:34:09 +08:00
54liuyao 00c64ed0e3 adj create count window state 2024-06-17 19:33:01 +08:00
Haojun Liao 0f4ffdf49a fix(stream): add some info. 2024-06-17 18:57:31 +08:00
Haojun Liao bdbcdf3465 refactor: add two assert. 2024-06-17 16:58:58 +08:00
Haojun Liao 848b1e19b5 fix(stream): fix some typo. 2024-06-17 14:39:46 +08:00
Haojun Liao b89b2158f1
Merge pull request #26135 from taosdata/fix/TD-30578
check cursor for count window
2024-06-17 11:25:19 +08:00
54liuyao 4474788e36 adj log 2024-06-17 11:24:30 +08:00
54liuyao 2298b4eae8 adj log 2024-06-17 11:19:10 +08:00
Haojun Liao b44d87475d fix(test): fix syntax error. 2024-06-14 17:54:44 +08:00
Haojun Liao 42e0dff589 fix(stream): move the expansion of the stream task related fill-history task to the place where the fill-history task must have been deoployed already. 2024-06-14 17:03:04 +08:00
Haojun Liao 4490f40c96 fix(stream): do some internal refactor. 2024-06-14 14:43:57 +08:00
Haojun Liao 9af6076b4f fix(stream): add the dispatch entry. 2024-06-14 14:42:22 +08:00
Haojun Liao 325ad5beb8 fix(stream):set correct node id 2024-06-13 18:25:34 +08:00
54liuyao 367b3b153f check cursor for count window 2024-06-13 15:35:26 +08:00
Haojun Liao 0f8c0fa8cb fix(stream): add dispatch data monitor to handle the network broken problem that may cause the stream process frozen. 2024-06-13 14:56:20 +08:00
Haojun Liao 9c42c90209
Merge pull request #26118 from taosdata/fix/3_liaohj
fix(stream): add fill-history task id in msg.
2024-06-12 18:03:43 +08:00
Haojun Liao d06e1549f1 fix(stream): add fill-history task id in msg. 2024-06-12 15:27:19 +08:00
Haojun Liao 623a73f57b
Merge pull request #26089 from taosdata/fix/3_liaohj
fix(stream): init the node list and task list when starting mnode.
2024-06-12 11:34:10 +08:00
Haojun Liao a41a04dc37 fix(stream): remove the related history task correctly. 2024-06-11 18:35:59 +08:00
Haojun Liao 00eb621825 fix(stream): do scan checkpoint-report in write queue. 2024-06-11 14:09:50 +08:00
Haojun Liao 20bade24c3
Merge branch '3.0' into fix/3_liaohj 2024-06-10 01:34:55 +08:00
Haojun Liao cbf8b363fc fix(stream): update checkpoint info by using trans. 2024-06-10 00:46:01 +08:00
Haojun Liao 895ee30cf3
Merge branch '3.0' into enh/opt_prj 2024-06-09 23:51:38 +08:00
Haojun Liao cbd9f86a34
Merge pull request #26065 from taosdata/fix/3_liaohj
fix(stream): always load the data for fill-history scan.
2024-06-07 14:01:50 +08:00
Haojun Liao c4447d6873 fix(stream): flush executor state for those with only one task for a stream. 2024-06-07 12:44:38 +08:00
Haojun Liao 1e47cb7eba other: update the test case. 2024-06-07 11:15:23 +08:00
Haojun Liao 385e1a8b0d refactor: do some internal refactor. 2024-06-06 23:55:54 +08:00
Haojun Liao 88e77d6bc6 fix(stream): remove expired stream in buf. 2024-06-06 23:54:48 +08:00
Haojun Liao 420cbc36e5 other: fix syntax error. 2024-06-06 17:40:17 +08:00
Haojun Liao 52e090634e fix(stream): transfer state before send checkpoint-trigger msg to downstream tasks. 2024-06-06 17:21:23 +08:00
Haojun Liao 29d34200b5 other: fix coverity issues. 2024-06-05 13:39:46 +08:00
Haojun Liao c529ecc7d2
Merge pull request #25734 from taosdata/fix/3_liaohj
fix(stream): update the checkpoint info for followers, and some internal refactor.
2024-06-05 13:38:51 +08:00