Commit Graph

1866 Commits

Author SHA1 Message Date
yihaoDeng a215332e2f change chkpid gen way 2023-11-09 11:24:18 +08:00
yihaoDeng 50666987f0 change chkpid gen way 2023-11-09 11:23:17 +08:00
Haojun Liao ef646873ef
Merge pull request #23596 from taosdata/fix/streamTransferError
fix stream transfer err
2023-11-09 10:51:22 +08:00
kailixu edef4de7b2 chore: revert the code 2023-11-08 20:57:57 +08:00
kailixu 72ecb0431c enh: rsma checkpoint 2023-11-08 20:45:44 +08:00
kailixu e72582a1fa Merge branch 'fix/streamTransferError' into enh/TD-23769-3.0x 2023-11-08 20:45:21 +08:00
yihaoDeng 6a82cd7fbf Merge branch 'main' of https://github.com/taosdata/TDengine into fix/fixStreamTransferErrMain 2023-11-08 15:14:31 +08:00
yihaoDeng b3c056e6cb fix stream transfer err 2023-11-08 15:12:47 +08:00
wangmm0220 c4c1423243 fix:error 2023-11-08 15:01:04 +08:00
yihaoDeng 7e03fa6664 fix stream transfer err 2023-11-08 14:57:20 +08:00
yihaoDeng 2e7d041e0a fix stream transfer err 2023-11-08 14:48:28 +08:00
liuyao 340fb3e727 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898 2023-11-08 14:16:59 +08:00
wangmm0220 7d19fcf19f Merge branch 'feat/TD-26060' of https://github.com/taosdata/TDengine into feat/TD-26060 2023-11-08 11:59:03 +08:00
wangmm0220 047eb14f67 fix:error 2023-11-08 11:57:49 +08:00
yihaoDeng 7ada7f34ac fix:merge from 3.0 2023-11-08 10:45:15 +08:00
wangmm0220 07aa749fcd fix:adapt to windows 2023-11-08 10:28:45 +08:00
kailixu b9f389a49f Merge branch '3.0' into enh/TD-23769-3.0x 2023-11-08 08:36:35 +08:00
kailixu f2d24306b1 enh: rsma tasks share one checkpoint and fix memory leak 2023-11-08 08:35:52 +08:00
Haojun Liao e052d3cd62 fix(stream): check null. 2023-11-08 00:10:08 +08:00
kailixu 6b738884a4 chore: rsma checkpoint 2023-11-07 19:59:05 +08:00
wangmm0220 f0b2ed567c fix:upload checkpoint to s3 2023-11-07 18:49:12 +08:00
Haojun Liao 73d75aac25 fix(stream): add ref for task. 2023-11-07 18:43:35 +08:00
Haojun Liao 26b96b149d refactor: wait for a while when no quota available. 2023-11-07 18:43:35 +08:00
Haojun Liao 0979ff944b fix(stream): update the fill-time for quota limitation. 2023-11-07 18:43:34 +08:00
Haojun Liao 2bdde122fc refactor: wait a while when no token available. 2023-11-07 18:43:34 +08:00
Haojun Liao a0d81734f1 fix(stream): add ref for task. 2023-11-07 18:18:58 +08:00
Haojun Liao 43b14ba8b4 refactor: wait for a while when no quota available. 2023-11-07 17:49:49 +08:00
Haojun Liao 06d02b862e fix(stream): update the fill-time for quota limitation. 2023-11-07 17:33:30 +08:00
Haojun Liao 0b59681158 refactor: wait a while when no token available. 2023-11-07 17:18:58 +08:00
Haojun Liao 884770dab1 fix(stream): fix syntax error. 2023-11-07 17:12:06 +08:00
Haojun Liao 344c3c5b13 fix(stream): fix syntax error. 2023-11-07 17:11:36 +08:00
Haojun Liao 9c49de69f8 refactor: do some internal refactor. 2023-11-07 17:05:20 +08:00
Haojun Liao ed0c580d11 refactor: do some internal refactor. 2023-11-07 17:04:55 +08:00
Haojun Liao 1301b92844 fix(stream): fix errors in scan-history, introduced by refactor 2023-11-07 16:41:15 +08:00
Haojun Liao c9a1cc50fb refactor: do some internal refactor. 2023-11-07 16:40:04 +08:00
Haojun Liao 9125fe44c6 fix(stream): fix error. 2023-11-07 16:40:04 +08:00
Haojun Liao 8c2f6bab0e fix(stream): exec scan-history in timer. 2023-11-07 16:40:03 +08:00
Haojun Liao 7370daa6e0 fix(stream): record the start failure tasks. 2023-11-07 16:39:56 +08:00
Haojun Liao e38e526dda fix(stream):reset the starting flag for the followers. 2023-11-07 16:39:12 +08:00
Haojun Liao 207b53f3f6 fix(stream): fix errors in scan-history, introduced by refactor 2023-11-07 16:19:09 +08:00
liuyao 467c27c758 recover flush mark 2023-11-07 15:45:38 +08:00
liuyao e972ab16fe recover flush mark 2023-11-07 14:11:08 +08:00
Haojun Liao 96f9264906 fix(stream): add null ptr check. 2023-11-07 00:38:02 +08:00
Haojun Liao 1312b9ea36 fix(stream): fix error. 2023-11-06 23:44:01 +08:00
Haojun Liao 4d8548e938 refactor: do some internal refactor. 2023-11-06 23:42:16 +08:00
kailixu f5d796a081 chore: print stream state 2023-11-06 19:53:09 +08:00
Haojun Liao 312dbc1caa refactor: do some internal refactor. 2023-11-06 19:49:25 +08:00
Haojun Liao 1f09d3a46b fix(stream): fix error. 2023-11-06 19:46:47 +08:00
Haojun Liao d9474016fc fix(stream): exec scan-history in timer. 2023-11-06 18:55:53 +08:00
Haojun Liao 6b1889284b fix(stream): record the start failure tasks. 2023-11-06 15:45:44 +08:00
Haojun Liao 69863febe6 fix(stream):reset the starting flag for the followers. 2023-11-06 13:17:13 +08:00
Haojun Liao d41fd27189 fix(stream): restart tasks in stream threads, instead of write thread. 2023-11-06 11:57:21 +08:00
Haojun Liao 0e44950a37 enh(stream): execute scan history by using time slice 1s. 2023-11-06 09:21:33 +08:00
Haojun Liao 1f756f58f6 fix(stream): add need update node into update node list. 2023-11-06 09:21:33 +08:00
Haojun Liao 680eb5674e refactor: do some internal refactor. 2023-11-06 09:15:49 +08:00
Haojun Liao d440da0d8c enh(stream): execute scan history by using time slice 1s. 2023-11-05 01:26:53 +08:00
Haojun Liao c71f6713a7 fix(stream): add need update node into update node list. 2023-11-05 01:24:23 +08:00
Haojun Liao e13f003b90 refactor: do some internal refactor. 2023-11-05 01:23:23 +08:00
kailixu 411151d671 fix: buffer overflow/buffer use after free/memory leak 2023-11-04 08:44:26 +08:00
wangmm0220 5a6c3f2b04 fix:add windows support 2023-11-03 17:45:37 +08:00
kailixu 77eadc59dc Merge branch '3.0' into enh/TD-23769-3.0x 2023-11-03 16:26:07 +08:00
kailixu a48968e5e8 enh: rsma checkpoint 2023-11-03 14:33:45 +08:00
Haojun Liao 53b2158c54 refactor: do some internal refactor. 2023-11-03 13:51:17 +08:00
wangmm0220 0a1f1085fc Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26060 2023-11-03 11:33:50 +08:00
wangmm0220 3ac11eba0e fix:modify upload checkpoint interface 2023-11-03 11:33:18 +08:00
Haojun Liao 9d77351bb2 refactor: do some internal refactor. 2023-11-03 09:30:50 +08:00
liuyao 31ad73f6d1 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898 2023-11-03 09:12:17 +08:00
kailixu 6c944bb192 enh: skip rsma_task during load stream tasks 2023-11-02 20:32:54 +08:00
wangmm0220 159873692c feat:checkpoint bakeup using rsync 2023-11-02 20:13:29 +08:00
Haojun Liao b3d57e4a2d fix(stream): not transfer state if state is not appropriate. 2023-11-02 19:31:35 +08:00
Haojun Liao 7a32b3a209 fix(stream): not transfer state if state is not appropriate. 2023-11-02 19:12:36 +08:00
Haojun Liao 706f1e4744 fix(stream): fix deadlock in transfer state. 2023-11-02 18:18:04 +08:00
Haojun Liao 39175dc03b fix(stream): fix deadlock in transfer state. 2023-11-02 18:07:36 +08:00
Haojun Liao c48c801e19 fix(stream): return error code. 2023-11-02 11:02:40 +08:00
Haojun Liao 95efa07e92 fix(stream): add full unsupported event filtering. 2023-11-02 11:02:39 +08:00
Haojun Liao 05b3d51803 fix(stream): add qualified status in assert 2023-11-02 11:02:39 +08:00
Haojun Liao 420825c62f fix(stream): return error code. 2023-11-02 10:22:03 +08:00
Haojun Liao 351a31302f fix(stream): add full unsupported event filtering. 2023-11-02 09:43:48 +08:00
Haojun Liao e14d42c01e fix(stream): add qualified status in assert 2023-11-02 08:46:18 +08:00
Haojun Liao dc8a90c864 fix(stream): fix memory leak. 2023-11-02 08:13:11 +08:00
Haojun Liao 79e971385f fix(stream): fix memory leak. 2023-11-02 08:11:51 +08:00
Haojun Liao df7633650e fix(stream): fix memory leak. 2023-11-01 20:35:45 +08:00
Haojun Liao e1b3e00b3d fix(stream): fix memory leak. 2023-11-01 20:10:20 +08:00
Haojun Liao 6dc468c55f fix(stream): fix dead-lock 2023-11-01 19:38:13 +08:00
Haojun Liao fa7ebf63ea refactor: do some internal refactor. 2023-11-01 19:38:13 +08:00
Haojun Liao 9156e8449d fix(stream): fix deference null ptr. 2023-11-01 19:38:13 +08:00
Haojun Liao 7cf90dde5c refactor: do some internal refactor. 2023-11-01 19:38:13 +08:00
Haojun Liao 00f029e44f refactor: add some logs. 2023-11-01 19:38:12 +08:00
Haojun Liao 385e699cc2 fix(stream): do some internal refactor. 2023-11-01 19:38:12 +08:00
Haojun Liao bd12ae88e1 fix(stream):fix the bug when event in waiting list not fulfilled. 2023-11-01 19:38:12 +08:00
Haojun Liao 9a9c1d689d fix(stream): add lock log. 2023-11-01 19:38:12 +08:00
Haojun Liao e7609d8e56 fix(stream): fix dead-lock 2023-11-01 19:09:21 +08:00
Haojun Liao ae25f09c45 refactor: do some internal refactor. 2023-11-01 18:03:44 +08:00
Haojun Liao 899d13b4ae fix(stream): fix deference null ptr. 2023-11-01 17:25:59 +08:00
Haojun Liao 246ed4e022 refactor: do some internal refactor. 2023-11-01 17:19:21 +08:00
liuyao 505c44d9aa Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898 2023-11-01 16:50:46 +08:00
Haojun Liao 12bc4f32cf refactor: add some logs. 2023-11-01 16:12:15 +08:00
Haojun Liao 778c29b808 fix(stream): do some internal refactor. 2023-11-01 14:07:18 +08:00
Haojun Liao e4aeea176b fix(stream):fix the bug when event in waiting list not fulfilled. 2023-11-01 13:59:51 +08:00
Haojun Liao 5ff89bc098 fix(stream): add lock log. 2023-11-01 13:19:53 +08:00