Commit Graph

352 Commits

Author SHA1 Message Date
Haojun Liao d1d868f239 refactor: do some internal refactor and set the pActiveInfo for rsma. 2024-05-29 00:08:29 +08:00
Haojun Liao 8d54d45054 fix(stream): fix error found by CI. 2024-05-28 17:30:14 +08:00
Haojun Liao be107b204c enh(stream): support retrieve checkpoint data remotely when start stream tasks in vnodes. 2024-05-28 09:54:22 +08:00
Haojun Liao 89fb56e77d other: merge 3.0 2024-05-24 11:41:51 +08:00
Haojun Liao f146ae4198 fix(stream): 2024-05-22 19:46:24 +08:00
wangmm0220 f21eeae56c fix:[TD-30180]error in judging if groupId already added to the end of table name 2024-05-21 16:57:00 +08:00
Haojun Liao f74fad7e60 fix(query): fix error in refactor. 2024-05-19 17:17:40 +08:00
Haojun Liao 7a90e68667 fix(query): fix bugs caused by refactor. 2024-05-19 13:55:46 +08:00
Haojun Liao 82c10fd709 fix(query): fix bugs caused by refactor. 2024-05-19 13:40:09 +08:00
Haojun Liao 1e5098f676 fix(query): fix bugs caused by refactor. 2024-05-19 13:32:30 +08:00
Haojun Liao 7f93ec2c53 fix(stream): update the checkpoint info for followers, and some internal refactor. 2024-05-11 09:37:02 +08:00
Haojun Liao 6693efaa85 refactor: do some internal refactor. 2024-05-09 10:11:37 +08:00
Haojun Liao cdeb4462fb refactor: do some internal refactor. 2024-05-07 23:43:21 +08:00
Haojun Liao b6debd985b fix(stream): always return success if repeatly recv checkpoint source msg. 2024-05-07 16:33:08 +08:00
Haojun Liao 18c66a5491 refactor: do some internal refactor. 2024-05-06 18:17:38 +08:00
Haojun Liao 7ad7ef7cfc refactor: do some internal refactor. 2024-05-06 17:03:41 +08:00
Haojun Liao 3619518d54 fix(stream): add logs. 2024-04-02 21:57:21 +08:00
Haojun Liao dcc97472d3 fix(stream): add strict check for checkpoint-trigger msg dispatach rsp confirmation flag. 2024-04-02 21:53:50 +08:00
Haojun Liao 5184e444df Merge branch '3.0' into fix/3_liaohj 2024-04-02 18:45:49 +08:00
Haojun Liao 24559725da fix(stream): add lock for when set checkpoint dispatch msg. 2024-04-02 18:45:30 +08:00
wangmm0220 8e2a2414c0 fix:same subtable same partition by leads to same table name in stream 2024-03-28 13:48:46 +08:00
Haojun Liao 7bdabc309b Merge branch '3.0' into fix/3_liaohj 2024-03-18 14:16:15 +08:00
Haojun Liao f28e994409
Merge pull request #25091 from taosdata/fix/3_liaohj
fix(stream): transfer state before do checkpoint
2024-03-14 17:59:13 +08:00
Haojun Liao cc0b32b1f8 fix(stream): transfer state before do checkpoint, to avoid the retrieve and deadlock by using waiting . 2024-03-14 16:13:41 +08:00
Haojun Liao a38161299b fix(stream): add clear msgData buf impl. 2024-03-04 19:51:01 +08:00
Haojun Liao 550d0fe5ae fix(stream): add an assert. 2024-03-03 16:46:13 +08:00
Haojun Liao aee0460daf enh(stream):rsp the checkpoint ready msg. 2024-02-27 11:15:09 +08:00
Haojun Liao df2488431e fix(stream): add logs. 2024-02-24 00:40:26 +08:00
Haojun Liao 931b9f0b51 other: merge 3.0 2024-02-19 18:27:18 +08:00
wangmm0220 ac9582b24a fix:[TD-28567] do not add md5 to the end of subtable if create stream by sma 2024-02-19 13:58:58 +08:00
Haojun Liao cf571e4f1f refactor: do some internal refactor. 2024-02-19 09:52:22 +08:00
wangmm0220 a9fcc67321 fix:conflicts from 3.0 2024-02-01 11:13:03 +08:00
Haojun Liao ac08f659c3 refactor: remove invalid procedure in fill-history. 2024-01-26 16:20:43 +08:00
wangmm0220 7246fedfef Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/ly_multi_marks 2024-01-18 19:08:35 +08:00
jiajingbin d59ede5196 Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/TD-28032 2024-01-16 15:05:13 +08:00
wangmm0220 2ab54a1335 fix:conflicts from 3.0 2024-01-15 16:54:52 +08:00
wangmm0220 00e0da15a3 fix:[TD-28032]groupid = 0 & modify test case in sim 2024-01-12 17:37:22 +08:00
Haojun Liao b36cc97236 fix(stream): close the inputQ of the related stream task when the fill-history task recv the trans-state msg from upstream. 2024-01-12 10:44:49 +08:00
Haojun Liao 6d37e596ec refactor: do some internal refactor. 2024-01-04 18:47:49 +08:00
wangmm0220 b200e6807f fix:[TD-28032]concat subtable and hash val as new subtable name to avoid data from multi time line write to one time line 2024-01-03 19:44:30 +08:00
wangmm0220 317f0c6a39 fix:[TD-28032]concat subtable and hash val as new subtable name to avoid data from multi time line write to one time line 2024-01-03 18:48:54 +08:00
wangmm0220 9ba2f71487 fix:[TD-28032]concat subtable and hash val as new subtable name to avoid data from multi time line write to one time line 2024-01-03 10:16:43 +08:00
wangmm0220 8add4dc177 fix:[TD-28032]concat subtable and hash val as new subtable name to avoid data from multi time line write to one time line 2024-01-02 18:37:29 +08:00
Haojun Liao 7eb0e42bb9 fix(stream): handle error when checkpoint is interrupted by nodeUpdate. 2023-12-27 22:57:58 +08:00
Haojun Liao 5592e11235 fix(stream): handle error when checkpoint is interrupted by nodeUpdate. 2023-12-26 19:02:52 +08:00
Haojun Liao bf895fadcb fix(stream): fix invalid read. 2023-12-24 03:05:29 +08:00
Haojun Liao 43fb7cf14a other: add log info. 2023-12-20 16:04:20 +08:00
wangmm0220 de8ce3f7ec fix:send stream retrieve msg to source task 2023-12-20 16:01:17 +08:00
Haojun Liao 4f852704f5 fix(stream): send checkpoint complete msg to mnode when dropping it. 2023-12-17 02:06:01 +08:00
wangmm0220 f06117dbc9 fix:[TD-27644]heartbeat closed before snode close leading to snode is hanged 2023-12-01 17:32:29 +08:00
yihaoDeng e9bec34c44 Merge branch '3.0' into enh/refactorBackend 2023-11-27 10:01:12 +08:00
yihaoDeng 6129ebc294 Merge branch '3.0' into enh/refactorBackend 2023-11-23 17:41:37 +08:00
Haojun Liao de47ea6c81 other: merge 3.0. 2023-11-23 15:42:40 +08:00
yihaoDeng 6a0501967d Merge branch '3.0' into fix/fixChkpRespMemleak 2023-11-23 14:06:04 +08:00
Haojun Liao 7b1f586d4f
Merge pull request #23762 from taosdata/fix/3_liaohj
fix(stream): fix error in generating token in bucket.
2023-11-23 09:32:14 +08:00
Haojun Liao 4ea49fe285 fix(stream): fix the race condition in dispatching data. 2023-11-22 23:49:16 +08:00
Haojun Liao 91e7000433 Merge branch 'enh/refactorBackend' of github.com:taosdata/tdengine into enh/refactorBackend 2023-11-22 15:29:31 +08:00
Haojun Liao c96f7cf182 fix(stream): scheduler the checkpoint generating. 2023-11-22 15:17:21 +08:00
yihaoDeng 0c0d9cdd2c Merge branch '3.0' into fix/fixChkpRespMemleak 2023-11-22 10:42:30 +08:00
Haojun Liao 81d3e5737e fix(stream): fix send msg error. 2023-11-22 08:41:55 +08:00
Haojun Liao d355b78884 fix(stream): fix invalid read. 2023-11-22 08:40:28 +08:00
Haojun Liao 75420bfefb fix(stream): fix the checkpoint msg failure. 2023-11-22 08:40:01 +08:00
Haojun Liao 785d91c17b
Merge pull request #23661 from taosdata/feat/TD-26060
fix: errors in snode in conditions like fill history/checkpoint/restart
2023-11-21 19:02:38 +08:00
yihaoDeng a92602b667 fix mem leak 2023-11-21 15:23:28 +08:00
Haojun Liao 27f3723cd3
Merge pull request #23723 from taosdata/fix/3_liaohj
fix(stream): wait for task to be normal and then send data block.
2023-11-16 22:58:50 +08:00
Haojun Liao 811d661d83 fix(stream): fix bug in delay send. 2023-11-16 17:34:47 +08:00
Haojun Liao 37d181bb9c fix(stream): fix syntax error. 2023-11-16 17:00:50 +08:00
Haojun Liao c0d3c15528 fix(stream): wait for task to be normal and then send data block. 2023-11-16 16:34:47 +08:00
wangmm0220 a16189d2a9 fix:confilct from 3.0 2023-11-15 19:14:27 +08:00
wangmm0220 8a05bad899 fix:snode error 2023-11-10 14:14:22 +08:00
Haojun Liao 8c2f6bab0e fix(stream): exec scan-history in timer. 2023-11-07 16:40:03 +08:00
Haojun Liao 4d8548e938 refactor: do some internal refactor. 2023-11-06 23:42:16 +08:00
Haojun Liao d9474016fc fix(stream): exec scan-history in timer. 2023-11-06 18:55:53 +08:00
Haojun Liao dc8a90c864 fix(stream): fix memory leak. 2023-11-02 08:13:11 +08:00
Haojun Liao 79e971385f fix(stream): fix memory leak. 2023-11-02 08:11:51 +08:00
Haojun Liao df7633650e fix(stream): fix memory leak. 2023-11-01 20:35:45 +08:00
Haojun Liao e1b3e00b3d fix(stream): fix memory leak. 2023-11-01 20:10:20 +08:00
Haojun Liao 9a9c1d689d fix(stream): add lock log. 2023-11-01 19:38:12 +08:00
Haojun Liao 5ff89bc098 fix(stream): add lock log. 2023-11-01 13:19:53 +08:00
Haojun Liao c7285c0ede fix(stream): add expired epset node list for stream tasks in hb to mnode. 2023-10-27 23:41:57 +08:00
Haojun Liao 4c267b538f fix(stream): add expired epset node list for stream tasks in hb to mnode. 2023-10-27 23:05:41 +08:00
Haojun Liao 52d8e05c0c fix(stream): resolve the nodeUpdate msg compatible issue. 2023-10-27 09:59:52 +08:00
Haojun Liao 454624516c fix(stream): handle the repeatly issued nodeUpdate msg from dnode. 2023-10-27 09:59:51 +08:00
Haojun Liao 48ff521968 fix(stream): update the nodeEp even during checkpoint trans. 2023-10-27 09:55:02 +08:00
Haojun Liao 579dd8e6b2 refactor(stream): do some internal refactor. 2023-10-27 09:54:56 +08:00
Haojun Liao 6f3c0d17cc refactor(stream): add state machine to manage the state of stream tasks. 2023-10-27 09:54:49 +08:00
Haojun Liao 596eb073b7 refactor(stream): do some internal refactor. 2023-10-27 09:54:48 +08:00
Haojun Liao 985371e841 fix(stream): resolve the nodeUpdate msg compatible issue. 2023-10-25 10:01:20 +08:00
Haojun Liao 03165d5327 fix(stream): handle the repeatly issued nodeUpdate msg from dnode. 2023-10-25 09:55:02 +08:00
Haojun Liao 49014d4b68 fix(stream): update the nodeEp even during checkpoint trans. 2023-10-21 01:42:43 +08:00
Haojun Liao 402aefd95d refactor(stream): do some internal refactor. 2023-10-19 15:09:47 +08:00
Haojun Liao f4caeca24a refactor(stream): add state machine to manage the state of stream tasks. 2023-10-19 10:34:20 +08:00
Haojun Liao 54ec679b58 refactor(stream): do some internal refactor. 2023-10-18 15:34:53 +08:00
Haojun Liao af2c0c95e9 refactor: do some internal refactor. 2023-10-09 20:10:22 +08:00
Haojun Liao cf14772dd9 enh(stream): optimize the scan wal perf 2023-10-09 20:09:21 +08:00
Haojun Liao d5abb21335 fix(stream): fix invalid check. 2023-10-09 20:09:20 +08:00
Haojun Liao dfe8641c0c refactor: optimize the fill-history task launch policy, and do some other internal refactor. 2023-10-09 20:08:52 +08:00
Haojun Liao f2848de12a fix(stream): reduce the counter when remove stream tasks. 2023-10-09 20:08:52 +08:00
Haojun Liao 0db357401d fix(stream): add new status for meta. 2023-10-09 20:08:12 +08:00
Haojun Liao 3912d80c02 fix(stream): do some internal refactor. 2023-10-09 20:08:11 +08:00