Commit Graph

2022 Commits

Author SHA1 Message Date
Haojun Liao 2ca663ce66
Merge pull request #23593 from taosdata/feat/TD-21898
stream event window
2023-11-15 14:18:07 +08:00
dapan1121 dfb3feb5dc Merge remote-tracking branch 'origin/main' into merge/m23 2023-11-15 11:39:18 +08:00
yihaoDeng b74105727d fix mem leak 2023-11-14 20:58:35 +08:00
yihaoDeng 20e1bd9cff fix invalid read/write 2023-11-14 20:46:56 +08:00
yihaoDeng f4d6cf7c74 Merge branch '3.0' into enh/refactorBackend 2023-11-14 18:12:48 +08:00
yihaoDeng aa2c09ef5b rm dup data 2023-11-14 18:09:00 +08:00
yihaoDeng 4476e46a5f rm dup data 2023-11-14 17:43:13 +08:00
dapan1121 478c8ef87f
Merge pull request #23665 from taosdata/fix/TD-27281-3.0
fix: extend buffer of trace
2023-11-14 13:50:50 +08:00
Haojun Liao 436c7871a3
Merge pull request #23673 from taosdata/fix/3_liaohj
fix(stream): fix deadlock and do some internal refactor.
2023-11-14 11:26:54 +08:00
Haojun Liao e46a13c788
Merge pull request #23669 from taosdata/enh/stream_delay
opt max delay
2023-11-14 09:31:17 +08:00
Haojun Liao f99e22b91f fix(stream): fix deadlock. 2023-11-13 23:56:42 +08:00
yihaoDeng 68b6cc1d9d Merge branch '3.0' into enh/refactorBackend 2023-11-13 19:07:58 +08:00
wangmm0220 56381dea90 fix:conflict from 3.0 2023-11-13 18:42:59 +08:00
wangmm0220 1cbe568be7 fix:add logic when snode restart 2023-11-13 18:39:42 +08:00
Haojun Liao aad8a2eb87 fix(stream): fix deadlock. 2023-11-13 18:20:30 +08:00
kailixu dd663a7650 fix: extend buffer of trace 2023-11-13 18:16:48 +08:00
yihaoDeng 4104840cea Merge branch '3.0' into enh/refactorBackend 2023-11-13 18:07:38 +08:00
liuyao 37c102a115 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898 2023-11-13 16:06:17 +08:00
yihaoDeng 1786f7077d Merge branch '3.0' into enh/refactorBackend 2023-11-13 14:35:23 +08:00
yihaoDeng de7f2a2d1a Merge branch '3.0' into enh/refactorBackend 2023-11-13 11:11:28 +08:00
yihaoDeng cf3e01e942 Merge branch '3.0' into enh/refactorBackend 2023-11-13 10:34:44 +08:00
Haojun Liao 4ff8907b58 fix: fix syntax error. 2023-11-11 23:05:20 +08:00
Haojun Liao 9ee9174608 other: merge 3.0 2023-11-11 15:48:31 +08:00
Haojun Liao 3bacd7516e fix(stream): extact stream nodes list if not initialized. 2023-11-11 15:40:35 +08:00
Haojun Liao 15430f4d50 refactor: 2023-11-11 15:40:33 +08:00
Haojun Liao 5fcef5bd89 refactor:add some logs. 2023-11-11 15:40:32 +08:00
Haojun Liao 7a23df4b1a fix(stream): set the correct updated nodeId. 2023-11-11 15:40:32 +08:00
Haojun Liao 8e5db21c3f fix(test): fix syntax error. 2023-11-11 15:40:13 +08:00
Haojun Liao af08a189c1 fix(stream): disable concurrently restart stream tasks. 2023-11-11 15:40:10 +08:00
Haojun Liao e1de1de421 fix(stream): fix the invalid free. 2023-11-11 15:40:07 +08:00
Haojun Liao 97772e9aab fix(stream): the checkpoint version can only be updated when generating checkpoint. 2023-11-11 15:40:05 +08:00
Haojun Liao 0463c0d755 refactor: wait for a while when no quota available. 2023-11-11 15:38:41 +08:00
Haojun Liao 22808ce1b7 fix(stream): update the fill-time for quota limitation. 2023-11-11 15:38:32 +08:00
yihaoDeng 1e8d46c405 Merge branch '3.0' into enh/refactorBackend 2023-11-10 18:37:25 +08:00
Haojun Liao 438c303b0d other: merge main. 2023-11-10 17:05:36 +08:00
Haojun Liao 08a9244230 fix(stream): extact stream nodes list if not initialized. 2023-11-10 16:24:20 +08:00
yihaoDeng a3fdb6dd59 Merge branch '3.0' into enh/refactorBackend 2023-11-10 16:06:08 +08:00
Haojun Liao d0307e5876 refactor: 2023-11-10 15:30:21 +08:00
Haojun Liao 0b36081158 refactor:add some logs. 2023-11-10 14:36:18 +08:00
wangmm0220 8a05bad899 fix:snode error 2023-11-10 14:14:22 +08:00
Haojun Liao 1f9a58361d fix(stream): set the correct updated nodeId. 2023-11-10 13:36:35 +08:00
Haojun Liao 5824caa8f5
Merge pull request #23631 from taosdata/fix/liaohj
multiple fix
2023-11-10 13:09:40 +08:00
yihaoDeng ad119ea4c0 Merge branch '3.0' into enh/refactorBackend 2023-11-10 12:07:33 +08:00
Haojun Liao ecf6c1c09d fix(test): fix syntax error. 2023-11-10 10:10:38 +08:00
yihaoDeng 54fe42d372 Merge branch '3.0' into enh/refactorBackend 2023-11-10 09:24:40 +08:00
Haojun Liao 9978667c48 fix(stream): disable concurrently restart stream tasks. 2023-11-10 09:24:08 +08:00
liuyao 6d2d5823dc Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898 2023-11-10 09:24:05 +08:00
yihaoDeng 0669037de0 fix mem leak 2023-11-09 20:37:08 +08:00
yihaoDeng 4a99bdc2b0 support s3 2023-11-09 20:27:30 +08:00
yihaoDeng 5f9b922a04 support s3 2023-11-09 20:15:08 +08:00
Haojun Liao da83f27124
Merge pull request #23610 from taosdata/fix/TD-27216
change chkp gen way
2023-11-09 18:55:31 +08:00
Haojun Liao 7f3a50dfde fix(stream): fix the invalid free. 2023-11-09 18:14:27 +08:00
yihaoDeng 757425bff8 Merge branch '3.0' into enh/refactorBackend 2023-11-09 17:58:49 +08:00
yihaoDeng dd2252598e upload by rsync 2023-11-09 17:39:34 +08:00
Yihao Deng 0453991cdf
Merge branch '3.0' into fix/TD-27216-3 2023-11-09 17:12:56 +08:00
Haojun Liao 13c6d1b23a fix(stream): the checkpoint version can only be updated when generating checkpoint. 2023-11-09 17:11:37 +08:00
dapan1121 8314cb6013
Merge pull request #23494 from taosdata/enh/TD-23769-3.0x
enh: checkpoint for rsma
2023-11-09 14:51:37 +08:00
yihaoDeng f74edc7618 Merge branch '3.0' into enh/refactorBackend 2023-11-09 06:14:08 +00:00
liuyao e56a3e8a1e Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898 2023-11-09 13:59:39 +08:00
kailixu 1a950afdb8 enh: test case for rsma snapshot 2023-11-09 12:09:27 +08:00
Haojun Liao 257ab4f270
Merge pull request #23526 from taosdata/feat/TD-26060
feat:checkpoint backup function
2023-11-09 11:46:28 +08:00
yihaoDeng 679155f771 change chkpid gen way 2023-11-09 11:25:52 +08:00
yihaoDeng a215332e2f change chkpid gen way 2023-11-09 11:24:18 +08:00
yihaoDeng 50666987f0 change chkpid gen way 2023-11-09 11:23:17 +08:00
Haojun Liao ef646873ef
Merge pull request #23596 from taosdata/fix/streamTransferError
fix stream transfer err
2023-11-09 10:51:22 +08:00
kailixu edef4de7b2 chore: revert the code 2023-11-08 20:57:57 +08:00
kailixu 72ecb0431c enh: rsma checkpoint 2023-11-08 20:45:44 +08:00
kailixu e72582a1fa Merge branch 'fix/streamTransferError' into enh/TD-23769-3.0x 2023-11-08 20:45:21 +08:00
yihaoDeng 3abf0ae4b2 Merge branch 'feat/TD-26060' into enh/refactorBackend 2023-11-08 17:31:16 +08:00
yihaoDeng 92fa1043b8 Merge branch 'enh/refactorBackend' of https://github.com/taosdata/TDengine into enh/refactorBackend 2023-11-08 17:12:32 +08:00
yihaoDeng 2de5c4a97d add bg thread 2023-11-08 17:11:11 +08:00
yihaoDeng 76fcc49c6d fix stream transfer error 2023-11-08 17:10:54 +08:00
Haojun Liao f949333e8b refactor:do some internal refactor. 2023-11-08 16:57:55 +08:00
Haojun Liao 470f244032 Merge remote-tracking branch 'origin/enh/refactorBackend' into enh/refactorBackend
# Conflicts:
#	include/libs/stream/tstream.h
2023-11-08 15:21:21 +08:00
Haojun Liao 99dbbe61d7 refactor(stream): do some internal refactor. 2023-11-08 15:20:47 +08:00
yihaoDeng 6a82cd7fbf Merge branch 'main' of https://github.com/taosdata/TDengine into fix/fixStreamTransferErrMain 2023-11-08 15:14:31 +08:00
yihaoDeng b3c056e6cb fix stream transfer err 2023-11-08 15:12:47 +08:00
wangmm0220 c4c1423243 fix:error 2023-11-08 15:01:04 +08:00
yihaoDeng 7e03fa6664 fix stream transfer err 2023-11-08 14:57:20 +08:00
yihaoDeng 2e7d041e0a fix stream transfer err 2023-11-08 14:48:28 +08:00
liuyao 340fb3e727 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898 2023-11-08 14:16:59 +08:00
yihaoDeng 7b0891981e merge 3.0 2023-11-08 14:14:01 +08:00
wangmm0220 7d19fcf19f Merge branch 'feat/TD-26060' of https://github.com/taosdata/TDengine into feat/TD-26060 2023-11-08 11:59:03 +08:00
wangmm0220 047eb14f67 fix:error 2023-11-08 11:57:49 +08:00
yihaoDeng fb77d811f9 Merge branch 'enh/refactorBackend' of https://github.com/taosdata/TDengine into enh/refactorBackend 2023-11-08 10:48:36 +08:00
Haojun Liao 17bd6badec refactor(stream): do checkpoint for each task. 2023-11-08 10:47:54 +08:00
yihaoDeng 7ada7f34ac fix:merge from 3.0 2023-11-08 10:45:15 +08:00
wangmm0220 07aa749fcd fix:adapt to windows 2023-11-08 10:28:45 +08:00
yihaoDeng 594da2d603 merge 3.0 2023-11-08 10:04:46 +08:00
kailixu b9f389a49f Merge branch '3.0' into enh/TD-23769-3.0x 2023-11-08 08:36:35 +08:00
kailixu f2d24306b1 enh: rsma tasks share one checkpoint and fix memory leak 2023-11-08 08:35:52 +08:00
Haojun Liao e052d3cd62 fix(stream): check null. 2023-11-08 00:10:08 +08:00
kailixu 6b738884a4 chore: rsma checkpoint 2023-11-07 19:59:05 +08:00
wangmm0220 f0b2ed567c fix:upload checkpoint to s3 2023-11-07 18:49:12 +08:00
Haojun Liao 73d75aac25 fix(stream): add ref for task. 2023-11-07 18:43:35 +08:00
Haojun Liao 26b96b149d refactor: wait for a while when no quota available. 2023-11-07 18:43:35 +08:00
Haojun Liao 0979ff944b fix(stream): update the fill-time for quota limitation. 2023-11-07 18:43:34 +08:00
Haojun Liao 2bdde122fc refactor: wait a while when no token available. 2023-11-07 18:43:34 +08:00
Haojun Liao a0d81734f1 fix(stream): add ref for task. 2023-11-07 18:18:58 +08:00
Haojun Liao 43b14ba8b4 refactor: wait for a while when no quota available. 2023-11-07 17:49:49 +08:00