Commit Graph

153 Commits

Author SHA1 Message Date
Haojun Liao 87e543c824 fix(stream): pass down the transId of checkpoint, to make sure the downstream task can report the error transId successfully. 2024-02-01 17:14:36 +08:00
Haojun Liao 3751e11394 fix(stream): fix dead lock. 2024-01-25 17:11:16 +08:00
Haojun Liao 8a7e38ad15 fix(stream): fix checkpoint failure check. 2024-01-24 13:10:53 +08:00
Haojun Liao d973f66cea fix(stream): do checkpoint after fill-history task completed. 2024-01-19 16:18:02 +08:00
Haojun Liao 76e6c453e7 enh(stream): send msg to mnode when the transferring state completed. 2024-01-18 15:43:36 +08:00
Haojun Liao 8ede6d87ce refactor: do some internal refactor. 2024-01-16 15:40:40 +08:00
Haojun Liao 63494de7f9 refactor: do some internal refactor. 2024-01-16 10:28:07 +08:00
Haojun Liao cacbb4e369 fix(stream): save the checkpoint info for sink tasks. 2024-01-15 17:40:35 +08:00
Haojun Liao d46b5e6c9a fix(stream): enable sink tasks handle the checkpoint. 2024-01-15 09:53:15 +08:00
Haojun Liao ce855bc493 refactor: do some internal refactor. 2024-01-15 09:21:31 +08:00
Haojun Liao 9703018f56 fix(stream): add checkpoint status check. 2024-01-11 16:47:51 +08:00
Haojun Liao 6d37e596ec refactor: do some internal refactor. 2024-01-04 18:47:49 +08:00
Haojun Liao cd85dae3fd fix(stream): fix the dead lock. 2023-12-24 23:30:00 +08:00
Haojun Liao 84583580e2 fix(stream): transfer the checkpoint trans id. 2023-12-21 19:12:49 +08:00
Haojun Liao 8a8ddf5699 fix(stream): record the checkpoint failure when nodeEp changed. 2023-12-21 10:30:44 +08:00
yihaoDeng d8093d9f21 not do chkp when pbackend not inited 2023-12-15 11:47:44 +08:00
yihaoDeng 5189f3d15b not do chkp when pbackend not inited 2023-12-15 09:18:37 +08:00
Minglei Jin 49ecb1093f cos/put: new arg withcp to control resumable uploading 2023-11-30 17:20:21 +08:00
yihaoDeng a4d475b582 fix rsma 2023-11-27 20:27:53 +08:00
yihaoDeng 6129ebc294 Merge branch '3.0' into enh/refactorBackend 2023-11-23 17:41:37 +08:00
yihaoDeng 6a0501967d Merge branch '3.0' into fix/fixChkpRespMemleak 2023-11-23 14:06:04 +08:00
Haojun Liao 4ea49fe285 fix(stream): fix the race condition in dispatching data. 2023-11-22 23:49:16 +08:00
yihaoDeng 947775155b fix transfer crash 2023-11-21 20:51:11 +08:00
yihaoDeng a92602b667 fix mem leak 2023-11-21 15:23:28 +08:00
yihaoDeng 939aa7a3cc Merge branch '3.0' into enh/refactorBackend 2023-11-20 17:33:30 +08:00
yihaoDeng 0d724244dc Merge branch '3.0' into enh/refactorBackend 2023-11-20 16:55:14 +08:00
Haojun Liao 7cfa45e95e enh(stream): add sink_quota/scan-history-idle-duration column for stream tasks. 2023-11-20 11:59:49 +08:00
yihaoDeng aa2c09ef5b rm dup data 2023-11-14 18:09:00 +08:00
yihaoDeng 4476e46a5f rm dup data 2023-11-14 17:43:13 +08:00
yihaoDeng 4104840cea Merge branch '3.0' into enh/refactorBackend 2023-11-13 18:07:38 +08:00
yihaoDeng de7f2a2d1a Merge branch '3.0' into enh/refactorBackend 2023-11-13 11:11:28 +08:00
Haojun Liao 9ee9174608 other: merge 3.0 2023-11-11 15:48:31 +08:00
Haojun Liao 97772e9aab fix(stream): the checkpoint version can only be updated when generating checkpoint. 2023-11-11 15:40:05 +08:00
yihaoDeng 1e8d46c405 Merge branch '3.0' into enh/refactorBackend 2023-11-10 18:37:25 +08:00
yihaoDeng a3fdb6dd59 Merge branch '3.0' into enh/refactorBackend 2023-11-10 16:06:08 +08:00
yihaoDeng 5f9b922a04 support s3 2023-11-09 20:15:08 +08:00
yihaoDeng dd2252598e upload by rsync 2023-11-09 17:39:34 +08:00
yihaoDeng 3abf0ae4b2 Merge branch 'feat/TD-26060' into enh/refactorBackend 2023-11-08 17:31:16 +08:00
yihaoDeng 92fa1043b8 Merge branch 'enh/refactorBackend' of https://github.com/taosdata/TDengine into enh/refactorBackend 2023-11-08 17:12:32 +08:00
yihaoDeng 2de5c4a97d add bg thread 2023-11-08 17:11:11 +08:00
yihaoDeng 76fcc49c6d fix stream transfer error 2023-11-08 17:10:54 +08:00
Haojun Liao f949333e8b refactor:do some internal refactor. 2023-11-08 16:57:55 +08:00
Haojun Liao 99dbbe61d7 refactor(stream): do some internal refactor. 2023-11-08 15:20:47 +08:00
wangmm0220 c4c1423243 fix:error 2023-11-08 15:01:04 +08:00
wangmm0220 047eb14f67 fix:error 2023-11-08 11:57:49 +08:00
Haojun Liao 17bd6badec refactor(stream): do checkpoint for each task. 2023-11-08 10:47:54 +08:00
wangmm0220 07aa749fcd fix:adapt to windows 2023-11-08 10:28:45 +08:00
wangmm0220 f0b2ed567c fix:upload checkpoint to s3 2023-11-07 18:49:12 +08:00
yihaoDeng f038f88c07 Merge branch 'feat/TD-26060' into enh/refactorBackend 2023-11-03 18:29:18 +08:00
wangmm0220 5a6c3f2b04 fix:add windows support 2023-11-03 17:45:37 +08:00