Commit Graph

1720 Commits

Author SHA1 Message Date
Yihao Deng 0453991cdf
Merge branch '3.0' into fix/TD-27216-3 2023-11-09 17:12:56 +08:00
dapan1121 8314cb6013
Merge pull request #23494 from taosdata/enh/TD-23769-3.0x
enh: checkpoint for rsma
2023-11-09 14:51:37 +08:00
kailixu 1a950afdb8 enh: test case for rsma snapshot 2023-11-09 12:09:27 +08:00
Haojun Liao 257ab4f270
Merge pull request #23526 from taosdata/feat/TD-26060
feat:checkpoint backup function
2023-11-09 11:46:28 +08:00
yihaoDeng 50666987f0 change chkpid gen way 2023-11-09 11:23:17 +08:00
Haojun Liao ef646873ef
Merge pull request #23596 from taosdata/fix/streamTransferError
fix stream transfer err
2023-11-09 10:51:22 +08:00
kailixu edef4de7b2 chore: revert the code 2023-11-08 20:57:57 +08:00
kailixu 72ecb0431c enh: rsma checkpoint 2023-11-08 20:45:44 +08:00
kailixu e72582a1fa Merge branch 'fix/streamTransferError' into enh/TD-23769-3.0x 2023-11-08 20:45:21 +08:00
wangmm0220 c4c1423243 fix:error 2023-11-08 15:01:04 +08:00
yihaoDeng 7e03fa6664 fix stream transfer err 2023-11-08 14:57:20 +08:00
yihaoDeng 2e7d041e0a fix stream transfer err 2023-11-08 14:48:28 +08:00
wangmm0220 7d19fcf19f Merge branch 'feat/TD-26060' of https://github.com/taosdata/TDengine into feat/TD-26060 2023-11-08 11:59:03 +08:00
wangmm0220 047eb14f67 fix:error 2023-11-08 11:57:49 +08:00
yihaoDeng 7ada7f34ac fix:merge from 3.0 2023-11-08 10:45:15 +08:00
wangmm0220 07aa749fcd fix:adapt to windows 2023-11-08 10:28:45 +08:00
kailixu b9f389a49f Merge branch '3.0' into enh/TD-23769-3.0x 2023-11-08 08:36:35 +08:00
kailixu f2d24306b1 enh: rsma tasks share one checkpoint and fix memory leak 2023-11-08 08:35:52 +08:00
Haojun Liao e052d3cd62 fix(stream): check null. 2023-11-08 00:10:08 +08:00
kailixu 6b738884a4 chore: rsma checkpoint 2023-11-07 19:59:05 +08:00
wangmm0220 f0b2ed567c fix:upload checkpoint to s3 2023-11-07 18:49:12 +08:00
Haojun Liao 73d75aac25 fix(stream): add ref for task. 2023-11-07 18:43:35 +08:00
Haojun Liao 26b96b149d refactor: wait for a while when no quota available. 2023-11-07 18:43:35 +08:00
Haojun Liao 0979ff944b fix(stream): update the fill-time for quota limitation. 2023-11-07 18:43:34 +08:00
Haojun Liao 2bdde122fc refactor: wait a while when no token available. 2023-11-07 18:43:34 +08:00
Haojun Liao 884770dab1 fix(stream): fix syntax error. 2023-11-07 17:12:06 +08:00
Haojun Liao ed0c580d11 refactor: do some internal refactor. 2023-11-07 17:04:55 +08:00
Haojun Liao 1301b92844 fix(stream): fix errors in scan-history, introduced by refactor 2023-11-07 16:41:15 +08:00
Haojun Liao c9a1cc50fb refactor: do some internal refactor. 2023-11-07 16:40:04 +08:00
Haojun Liao 9125fe44c6 fix(stream): fix error. 2023-11-07 16:40:04 +08:00
Haojun Liao 8c2f6bab0e fix(stream): exec scan-history in timer. 2023-11-07 16:40:03 +08:00
Haojun Liao 7370daa6e0 fix(stream): record the start failure tasks. 2023-11-07 16:39:56 +08:00
Haojun Liao e38e526dda fix(stream):reset the starting flag for the followers. 2023-11-07 16:39:12 +08:00
liuyao 467c27c758 recover flush mark 2023-11-07 15:45:38 +08:00
liuyao e972ab16fe recover flush mark 2023-11-07 14:11:08 +08:00
kailixu f5d796a081 chore: print stream state 2023-11-06 19:53:09 +08:00
Haojun Liao d440da0d8c enh(stream): execute scan history by using time slice 1s. 2023-11-05 01:26:53 +08:00
Haojun Liao c71f6713a7 fix(stream): add need update node into update node list. 2023-11-05 01:24:23 +08:00
Haojun Liao e13f003b90 refactor: do some internal refactor. 2023-11-05 01:23:23 +08:00
kailixu 411151d671 fix: buffer overflow/buffer use after free/memory leak 2023-11-04 08:44:26 +08:00
wangmm0220 5a6c3f2b04 fix:add windows support 2023-11-03 17:45:37 +08:00
kailixu 77eadc59dc Merge branch '3.0' into enh/TD-23769-3.0x 2023-11-03 16:26:07 +08:00
kailixu a48968e5e8 enh: rsma checkpoint 2023-11-03 14:33:45 +08:00
Haojun Liao 53b2158c54 refactor: do some internal refactor. 2023-11-03 13:51:17 +08:00
wangmm0220 0a1f1085fc Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26060 2023-11-03 11:33:50 +08:00
wangmm0220 3ac11eba0e fix:modify upload checkpoint interface 2023-11-03 11:33:18 +08:00
kailixu 6c944bb192 enh: skip rsma_task during load stream tasks 2023-11-02 20:32:54 +08:00
wangmm0220 159873692c feat:checkpoint bakeup using rsync 2023-11-02 20:13:29 +08:00
Haojun Liao 7a32b3a209 fix(stream): not transfer state if state is not appropriate. 2023-11-02 19:12:36 +08:00
Haojun Liao 706f1e4744 fix(stream): fix deadlock in transfer state. 2023-11-02 18:18:04 +08:00