xxq250
/
homework-jianmu
1
0
Fork 0
Code Issues Pull Requests 1 Actions Packages Projects Releases Wiki Activity
76,779 Commits 3 Branches 0 Tags 479 MiB
Commit Graph

184 Commits

Author SHA1 Message Date
Haojun Liao c4447d6873 fix(stream): flush executor state for those with only one task for a stream. 2024-06-07 12:44:38 +08:00
Haojun Liao 52e090634e fix(stream): transfer state before send checkpoint-trigger msg to downstream tasks. 2024-06-06 17:21:23 +08:00
Haojun Liao 3b3ed1c30c fix(stream): add monitor for checkpoint-ready msg recv status. 2024-06-03 16:45:37 +08:00
Haojun Liao 31317c4895 fix(stream): set the checkpoint ready info for only one task in stream. 2024-06-01 23:20:43 +08:00
Haojun Liao 2a8270f9c8 fix(stream): track the checkpoint-ready msg on the upstream tasks. 2024-06-01 18:26:45 +08:00
Haojun Liao 76b43dc072 fix(stream): 1. check the checkpoint-trigger rsp, 2. set the error code in the message body, 3. follower nodes not handle the checkpoint-trigger retrieve request. 2024-05-31 14:32:55 +08:00
Haojun Liao ee4e4c0e6d refactor: do some internal refactor. 2024-05-31 09:17:20 +08:00
Haojun Liao 225dfb1a93 enh(stream): check checkpoint-trigger msg every 100ms. 2024-05-29 00:30:42 +08:00
Haojun Liao be107b204c enh(stream): support retrieve checkpoint data remotely when start stream tasks in vnodes. 2024-05-28 09:54:22 +08:00
Haojun Liao 610aa80e65 fix(stream): init backend for fill-history task. 2024-05-15 00:08:38 +08:00
Haojun Liao 6898eba6ed fix(stream): expand stream tasks are divided into two phase, the first is to build stream task and then expand stream task before start stream tasks. 2024-05-14 14:34:31 +08:00
Haojun Liao 7f93ec2c53 fix(stream): update the checkpoint info for followers, and some internal refactor. 2024-05-11 09:37:02 +08:00
Haojun Liao c43fbf6fee refactor: do some internal refactor. 2024-05-08 11:21:24 +08:00
Haojun Liao cdeb4462fb refactor: do some internal refactor. 2024-05-07 23:43:21 +08:00
Haojun Liao bbd423f666 refactor: do some internal refactor. 2024-05-07 09:46:12 +08:00
Haojun Liao 629502e12e refactor: do some internal refactor. 2024-04-30 17:00:51 +08:00
Haojun Liao b2d8260f14 refactor: do some internal refactor. 2024-04-28 10:05:22 +08:00
Haojun Liao 8adaeb59a3 refactor: do some internal refactor. 2024-04-28 09:50:21 +08:00
Haojun Liao a33e7b2eb3 refactor: do some internal refactor. 2024-04-26 22:22:54 +08:00
Haojun Liao 8b53f76691 fix(stream): discard the repeatly recv checkpoint-source msg. 2024-04-26 15:56:34 +08:00
Haojun Liao 3769da535e fix(stream): re-send checkmsg to downstream for fixed dispatch type. 2024-04-19 10:00:47 +08:00
Haojun Liao e7dee4ac63 refactor(stream): refactor check msg retry procedure and be tolerant to the dnode disconnection during check downstream tasks. 2024-04-18 15:55:21 +08:00
Haojun Liao 8bdd43c305 fix(stream): wait for 50ms when no token in bucket for sink task. 2024-04-16 14:42:21 +08:00
Haojun Liao f28e994409
Merge pull request #25091 from taosdata/fix/3_liaohj 
fix(stream): transfer state before do checkpoint
 2024-03-14 17:59:13 +08:00
Haojun Liao cc0b32b1f8 fix(stream): transfer state before do checkpoint, to avoid the retrieve and deadlock by using waiting . 2024-03-14 16:13:41 +08:00
Haojun Liao ad1780dbdc fix(stream): reset the pData after transferring state. 2024-03-04 19:32:22 +08:00
Haojun Liao cf571e4f1f refactor: do some internal refactor. 2024-02-19 09:52:22 +08:00
wangmm0220 a8e45440c0 fix:conflicts from 3.0 2024-02-18 18:02:14 +08:00
Haojun Liao cb2ea4a721 fix(stream): take ver snapshot for all vgroups before launching stream with fill-history option opened. 2024-02-01 11:37:57 +08:00
wangmm0220 a9fcc67321 fix:conflicts from 3.0 2024-02-01 11:13:03 +08:00
Haojun Liao bfbd61a02f
Merge pull request #24634 from taosdata/fix/3_liaohj 
refactor: do some internal refactor.
 2024-01-26 18:08:54 +08:00
Haojun Liao ac08f659c3 refactor: remove invalid procedure in fill-history. 2024-01-26 16:20:43 +08:00
wangmm0220 7246fedfef Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/ly_multi_marks 2024-01-18 19:08:35 +08:00
Yihao Deng f27b69f0c2 fix debug log err 2024-01-17 04:46:54 +00:00
wangmm0220 2ab54a1335 fix:conflicts from 3.0 2024-01-15 16:54:52 +08:00
Haojun Liao e012bc4bde refactor: do some internal refactor. 2024-01-15 11:28:36 +08:00
Haojun Liao f9d5c0d403 fix(stream): fix error in tq timer. 2024-01-09 09:13:53 +08:00
Haojun Liao cd85dae3fd fix(stream): fix the dead lock. 2023-12-24 23:30:00 +08:00
Haojun Liao 8a8ddf5699 fix(stream): record the checkpoint failure when nodeEp changed. 2023-12-21 10:30:44 +08:00
wangmm0220 de8ce3f7ec fix:send stream retrieve msg to source task 2023-12-20 16:01:17 +08:00
yihaoDeng 547d797a26 fix stream backend crash when transfer 2023-12-16 15:05:27 +08:00
wangmm0220 f06117dbc9 fix:[TD-27644]heartbeat closed before snode close leading to snode is hanged 2023-12-01 17:32:29 +08:00
yihaoDeng e9bec34c44 Merge branch '3.0' into enh/refactorBackend 2023-11-27 10:01:12 +08:00
yihaoDeng 6129ebc294 Merge branch '3.0' into enh/refactorBackend 2023-11-23 17:41:37 +08:00
Haojun Liao de47ea6c81 other: merge 3.0. 2023-11-23 15:42:40 +08:00
Haojun Liao 1a1319908d refactor: do some internal refactor. 2023-11-23 14:25:52 +08:00
yihaoDeng 6a0501967d Merge branch '3.0' into fix/fixChkpRespMemleak 2023-11-23 14:06:04 +08:00
Haojun Liao c96f7cf182 fix(stream): scheduler the checkpoint generating. 2023-11-22 15:17:21 +08:00
yihaoDeng a92602b667 fix mem leak 2023-11-21 15:23:28 +08:00
Haojun Liao 9f8a63099c fix(stream): fix error in generating token in bucket. 2023-11-20 15:26:50 +08:00
yihaoDeng 4476e46a5f rm dup data 2023-11-14 17:43:13 +08:00
yihaoDeng 757425bff8 Merge branch '3.0' into enh/refactorBackend 2023-11-09 17:58:49 +08:00
dapan1121 8314cb6013
Merge pull request #23494 from taosdata/enh/TD-23769-3.0x 
enh: checkpoint for rsma
 2023-11-09 14:51:37 +08:00
yihaoDeng 3abf0ae4b2 Merge branch 'feat/TD-26060' into enh/refactorBackend 2023-11-08 17:31:16 +08:00
yihaoDeng 92fa1043b8 Merge branch 'enh/refactorBackend' of https://github.com/taosdata/TDengine into enh/refactorBackend 2023-11-08 17:12:32 +08:00
yihaoDeng 76fcc49c6d fix stream transfer error 2023-11-08 17:10:54 +08:00
Haojun Liao 99dbbe61d7 refactor(stream): do some internal refactor. 2023-11-08 15:20:47 +08:00
wangmm0220 c4c1423243 fix:error 2023-11-08 15:01:04 +08:00
Haojun Liao 17bd6badec refactor(stream): do checkpoint for each task. 2023-11-08 10:47:54 +08:00
yihaoDeng 7ada7f34ac fix:merge from 3.0 2023-11-08 10:45:15 +08:00
kailixu b9f389a49f Merge branch '3.0' into enh/TD-23769-3.0x 2023-11-08 08:36:35 +08:00
wangmm0220 f0b2ed567c fix:upload checkpoint to s3 2023-11-07 18:49:12 +08:00
Haojun Liao ed0c580d11 refactor: do some internal refactor. 2023-11-07 17:04:55 +08:00
Haojun Liao 8c2f6bab0e fix(stream): exec scan-history in timer. 2023-11-07 16:40:03 +08:00
Haojun Liao e38e526dda fix(stream):reset the starting flag for the followers. 2023-11-07 16:39:12 +08:00
yihaoDeng f038f88c07 Merge branch 'feat/TD-26060' into enh/refactorBackend 2023-11-03 18:29:18 +08:00
wangmm0220 0a1f1085fc Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26060 2023-11-03 11:33:50 +08:00
wangmm0220 3ac11eba0e fix:modify upload checkpoint interface 2023-11-03 11:33:18 +08:00
wangmm0220 159873692c feat:checkpoint bakeup using rsync 2023-11-02 20:13:29 +08:00
yihaoDeng 4c8edb5545 Merge branch 'enh/new3.0' into enh/refactorBackend 2023-11-01 16:07:49 +08:00
kailixu 1530fe0c49 Merge branch '3.0' into enh/TD-23769-3.0x 2023-11-01 09:52:16 +08:00
kailixu ad1e6accd4 chore: build checkpoint for rsma 2023-11-01 09:45:58 +08:00
Haojun Liao 1ccbb77981 fix(stream): fix dead lock when shutdown all tasks. 2023-10-27 09:59:37 +08:00
Haojun Liao 164159f293 enh(stream): add parameter to limit the stream sink task. 2023-10-27 09:54:07 +08:00
yihaoDeng 1a4cfd11a5 Merge branch 'enh/new3.0' into enh/refactorBackend 2023-10-20 15:28:10 +08:00
yihaoDeng 2004c1a346 fix transfer crash 2023-10-17 18:19:52 +08:00
yihaoDeng 4c94fbb44f refactor backend 2023-10-11 20:26:19 +08:00
yihaoDeng 28421cd35e refactor backend 2023-10-10 20:51:41 +08:00
Haojun Liao 59e284c332 fix(stream): quit from loop when input queue is full. 2023-10-09 20:10:21 +08:00
Haojun Liao 28008f8263 enh(stream): add more info for sink task. 2023-10-09 20:09:22 +08:00
Haojun Liao cf14772dd9 enh(stream): optimize the scan wal perf 2023-10-09 20:09:21 +08:00
Haojun Liao 583ac1fc45 refactor: do some internal refactor. 2023-10-09 20:09:20 +08:00
Haojun Liao d10b07d23d refactor: do some internal refactor. 2023-10-09 20:08:53 +08:00
Haojun Liao dfe8641c0c refactor: optimize the fill-history task launch policy, and do some other internal refactor. 2023-10-09 20:08:52 +08:00
Haojun Liao 7f8da725bc enh(stream): add quota limitation for sink task. 2023-10-09 20:08:13 +08:00
Haojun Liao 7167c3c5de fix(stream): add new timer for each task. 2023-10-09 20:08:08 +08:00
Haojun Liao 52763ca2a3 refactor: do some internal refactor. 2023-10-09 20:08:07 +08:00
Haojun Liao 2b16976902 refactor(stream): refactor send msg. 2023-10-09 20:08:03 +08:00
Haojun Liao ef9efc8a8e refactor: do refactor the sink task. 2023-10-09 20:07:53 +08:00
Haojun Liao 1f45bd82d2 other: merge stream fix in main. 2023-10-09 20:07:01 +08:00
Haojun Liao 7ccc273206 other: merge stream fix in main. 2023-10-09 20:05:29 +08:00
Haojun Liao e84eeee6b8 refactor: do some internal refactor. 2023-10-09 20:04:17 +08:00
Haojun Liao 7ce3d2c200 fix(stream): quit from loop when input queue is full. 2023-10-07 14:54:11 +08:00
yihaoDeng fa70221238 refact task backend 2023-10-07 12:17:55 +08:00
Haojun Liao c20dd002fb enh(stream): add more info for sink task. 2023-10-07 01:14:00 +08:00
Haojun Liao 41ef1a45c1 enh(stream): optimize the scan wal perf 2023-10-04 22:06:46 +08:00
Haojun Liao 5718158fc0 refactor: do some internal refactor. 2023-10-01 22:27:29 +08:00
Haojun Liao 11641e1115 refactor: do some internal refactor. 2023-09-27 14:18:01 +08:00
Haojun Liao e13efd5b04 refactor: optimize the fill-history task launch policy, and do some other internal refactor. 2023-09-27 14:00:48 +08:00
Haojun Liao aec15ae39f enh(stream): add quota limitation for sink task. 2023-09-26 23:29:54 +08:00