Haojun Liao
|
4ff8907b58
|
fix: fix syntax error.
|
2023-11-11 23:05:20 +08:00 |
|
Haojun Liao
|
9ee9174608
|
other: merge 3.0
|
2023-11-11 15:48:31 +08:00 |
|
Haojun Liao
|
3bacd7516e
|
fix(stream): extact stream nodes list if not initialized.
|
2023-11-11 15:40:35 +08:00 |
|
Haojun Liao
|
15430f4d50
|
refactor:
|
2023-11-11 15:40:33 +08:00 |
|
Haojun Liao
|
5fcef5bd89
|
refactor:add some logs.
|
2023-11-11 15:40:32 +08:00 |
|
Haojun Liao
|
7a23df4b1a
|
fix(stream): set the correct updated nodeId.
|
2023-11-11 15:40:32 +08:00 |
|
Haojun Liao
|
af08a189c1
|
fix(stream): disable concurrently restart stream tasks.
|
2023-11-11 15:40:10 +08:00 |
|
Haojun Liao
|
e1de1de421
|
fix(stream): fix the invalid free.
|
2023-11-11 15:40:07 +08:00 |
|
Haojun Liao
|
97772e9aab
|
fix(stream): the checkpoint version can only be updated when generating checkpoint.
|
2023-11-11 15:40:05 +08:00 |
|
Haojun Liao
|
0463c0d755
|
refactor: wait for a while when no quota available.
|
2023-11-11 15:38:41 +08:00 |
|
Haojun Liao
|
22808ce1b7
|
fix(stream): update the fill-time for quota limitation.
|
2023-11-11 15:38:32 +08:00 |
yihaoDeng
|
1e8d46c405
|
Merge branch '3.0' into enh/refactorBackend
|
2023-11-10 18:37:25 +08:00 |
|
Haojun Liao
|
438c303b0d
|
other: merge main.
|
2023-11-10 17:05:36 +08:00 |
|
Haojun Liao
|
08a9244230
|
fix(stream): extact stream nodes list if not initialized.
|
2023-11-10 16:24:20 +08:00 |
|
yihaoDeng
|
a3fdb6dd59
|
Merge branch '3.0' into enh/refactorBackend
|
2023-11-10 16:06:08 +08:00 |
|
Haojun Liao
|
d0307e5876
|
refactor:
|
2023-11-10 15:30:21 +08:00 |
|
Haojun Liao
|
0b36081158
|
refactor:add some logs.
|
2023-11-10 14:36:18 +08:00 |
wangmm0220
|
8a05bad899
|
fix:snode error
|
2023-11-10 14:14:22 +08:00 |
|
Haojun Liao
|
1f9a58361d
|
fix(stream): set the correct updated nodeId.
|
2023-11-10 13:36:35 +08:00 |
Haojun Liao
|
5824caa8f5
|
Merge pull request #23631 from taosdata/fix/liaohj
multiple fix
|
2023-11-10 13:09:40 +08:00 |
|
yihaoDeng
|
ad119ea4c0
|
Merge branch '3.0' into enh/refactorBackend
|
2023-11-10 12:07:33 +08:00 |
|
yihaoDeng
|
54fe42d372
|
Merge branch '3.0' into enh/refactorBackend
|
2023-11-10 09:24:40 +08:00 |
|
Haojun Liao
|
9978667c48
|
fix(stream): disable concurrently restart stream tasks.
|
2023-11-10 09:24:08 +08:00 |
liuyao
|
6d2d5823dc
|
Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898
|
2023-11-10 09:24:05 +08:00 |
|
yihaoDeng
|
0669037de0
|
fix mem leak
|
2023-11-09 20:37:08 +08:00 |
|
yihaoDeng
|
4a99bdc2b0
|
support s3
|
2023-11-09 20:27:30 +08:00 |
|
yihaoDeng
|
5f9b922a04
|
support s3
|
2023-11-09 20:15:08 +08:00 |
|
Haojun Liao
|
da83f27124
|
Merge pull request #23610 from taosdata/fix/TD-27216
change chkp gen way
|
2023-11-09 18:55:31 +08:00 |
|
Haojun Liao
|
7f3a50dfde
|
fix(stream): fix the invalid free.
|
2023-11-09 18:14:27 +08:00 |
|
yihaoDeng
|
757425bff8
|
Merge branch '3.0' into enh/refactorBackend
|
2023-11-09 17:58:49 +08:00 |
|
yihaoDeng
|
dd2252598e
|
upload by rsync
|
2023-11-09 17:39:34 +08:00 |
Yihao Deng
|
0453991cdf
|
Merge branch '3.0' into fix/TD-27216-3
|
2023-11-09 17:12:56 +08:00 |
|
Haojun Liao
|
13c6d1b23a
|
fix(stream): the checkpoint version can only be updated when generating checkpoint.
|
2023-11-09 17:11:37 +08:00 |
dapan1121
|
8314cb6013
|
Merge pull request #23494 from taosdata/enh/TD-23769-3.0x
enh: checkpoint for rsma
|
2023-11-09 14:51:37 +08:00 |
|
yihaoDeng
|
f74edc7618
|
Merge branch '3.0' into enh/refactorBackend
|
2023-11-09 06:14:08 +00:00 |
|
liuyao
|
e56a3e8a1e
|
Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898
|
2023-11-09 13:59:39 +08:00 |
kailixu
|
1a950afdb8
|
enh: test case for rsma snapshot
|
2023-11-09 12:09:27 +08:00 |
|
Haojun Liao
|
257ab4f270
|
Merge pull request #23526 from taosdata/feat/TD-26060
feat:checkpoint backup function
|
2023-11-09 11:46:28 +08:00 |
|
yihaoDeng
|
679155f771
|
change chkpid gen way
|
2023-11-09 11:25:52 +08:00 |
|
yihaoDeng
|
a215332e2f
|
change chkpid gen way
|
2023-11-09 11:24:18 +08:00 |
|
yihaoDeng
|
50666987f0
|
change chkpid gen way
|
2023-11-09 11:23:17 +08:00 |
|
Haojun Liao
|
ef646873ef
|
Merge pull request #23596 from taosdata/fix/streamTransferError
fix stream transfer err
|
2023-11-09 10:51:22 +08:00 |
|
kailixu
|
edef4de7b2
|
chore: revert the code
|
2023-11-08 20:57:57 +08:00 |
|
kailixu
|
72ecb0431c
|
enh: rsma checkpoint
|
2023-11-08 20:45:44 +08:00 |
|
kailixu
|
e72582a1fa
|
Merge branch 'fix/streamTransferError' into enh/TD-23769-3.0x
|
2023-11-08 20:45:21 +08:00 |
|
yihaoDeng
|
3abf0ae4b2
|
Merge branch 'feat/TD-26060' into enh/refactorBackend
|
2023-11-08 17:31:16 +08:00 |
|
yihaoDeng
|
92fa1043b8
|
Merge branch 'enh/refactorBackend' of https://github.com/taosdata/TDengine into enh/refactorBackend
|
2023-11-08 17:12:32 +08:00 |
|
yihaoDeng
|
2de5c4a97d
|
add bg thread
|
2023-11-08 17:11:11 +08:00 |
|
yihaoDeng
|
76fcc49c6d
|
fix stream transfer error
|
2023-11-08 17:10:54 +08:00 |
|
Haojun Liao
|
f949333e8b
|
refactor:do some internal refactor.
|
2023-11-08 16:57:55 +08:00 |
|
Haojun Liao
|
470f244032
|
Merge remote-tracking branch 'origin/enh/refactorBackend' into enh/refactorBackend
# Conflicts:
# include/libs/stream/tstream.h
|
2023-11-08 15:21:21 +08:00 |
|
Haojun Liao
|
99dbbe61d7
|
refactor(stream): do some internal refactor.
|
2023-11-08 15:20:47 +08:00 |
|
yihaoDeng
|
6a82cd7fbf
|
Merge branch 'main' of https://github.com/taosdata/TDengine into fix/fixStreamTransferErrMain
|
2023-11-08 15:14:31 +08:00 |
|
yihaoDeng
|
b3c056e6cb
|
fix stream transfer err
|
2023-11-08 15:12:47 +08:00 |
|
wangmm0220
|
c4c1423243
|
fix:error
|
2023-11-08 15:01:04 +08:00 |
|
yihaoDeng
|
7e03fa6664
|
fix stream transfer err
|
2023-11-08 14:57:20 +08:00 |
|
yihaoDeng
|
2e7d041e0a
|
fix stream transfer err
|
2023-11-08 14:48:28 +08:00 |
|
liuyao
|
340fb3e727
|
Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898
|
2023-11-08 14:16:59 +08:00 |
|
yihaoDeng
|
7b0891981e
|
merge 3.0
|
2023-11-08 14:14:01 +08:00 |
|
wangmm0220
|
7d19fcf19f
|
Merge branch 'feat/TD-26060' of https://github.com/taosdata/TDengine into feat/TD-26060
|
2023-11-08 11:59:03 +08:00 |
|
wangmm0220
|
047eb14f67
|
fix:error
|
2023-11-08 11:57:49 +08:00 |
|
yihaoDeng
|
fb77d811f9
|
Merge branch 'enh/refactorBackend' of https://github.com/taosdata/TDengine into enh/refactorBackend
|
2023-11-08 10:48:36 +08:00 |
|
Haojun Liao
|
17bd6badec
|
refactor(stream): do checkpoint for each task.
|
2023-11-08 10:47:54 +08:00 |
|
yihaoDeng
|
7ada7f34ac
|
fix:merge from 3.0
|
2023-11-08 10:45:15 +08:00 |
|
wangmm0220
|
07aa749fcd
|
fix:adapt to windows
|
2023-11-08 10:28:45 +08:00 |
|
yihaoDeng
|
594da2d603
|
merge 3.0
|
2023-11-08 10:04:46 +08:00 |
|
kailixu
|
b9f389a49f
|
Merge branch '3.0' into enh/TD-23769-3.0x
|
2023-11-08 08:36:35 +08:00 |
|
kailixu
|
f2d24306b1
|
enh: rsma tasks share one checkpoint and fix memory leak
|
2023-11-08 08:35:52 +08:00 |
|
Haojun Liao
|
e052d3cd62
|
fix(stream): check null.
|
2023-11-08 00:10:08 +08:00 |
|
kailixu
|
6b738884a4
|
chore: rsma checkpoint
|
2023-11-07 19:59:05 +08:00 |
|
wangmm0220
|
f0b2ed567c
|
fix:upload checkpoint to s3
|
2023-11-07 18:49:12 +08:00 |
|
Haojun Liao
|
73d75aac25
|
fix(stream): add ref for task.
|
2023-11-07 18:43:35 +08:00 |
|
Haojun Liao
|
26b96b149d
|
refactor: wait for a while when no quota available.
|
2023-11-07 18:43:35 +08:00 |
|
Haojun Liao
|
0979ff944b
|
fix(stream): update the fill-time for quota limitation.
|
2023-11-07 18:43:34 +08:00 |
|
Haojun Liao
|
2bdde122fc
|
refactor: wait a while when no token available.
|
2023-11-07 18:43:34 +08:00 |
|
Haojun Liao
|
a0d81734f1
|
fix(stream): add ref for task.
|
2023-11-07 18:18:58 +08:00 |
|
Haojun Liao
|
43b14ba8b4
|
refactor: wait for a while when no quota available.
|
2023-11-07 17:49:49 +08:00 |
|
Haojun Liao
|
06d02b862e
|
fix(stream): update the fill-time for quota limitation.
|
2023-11-07 17:33:30 +08:00 |
|
Haojun Liao
|
0b59681158
|
refactor: wait a while when no token available.
|
2023-11-07 17:18:58 +08:00 |
|
Haojun Liao
|
884770dab1
|
fix(stream): fix syntax error.
|
2023-11-07 17:12:06 +08:00 |
|
Haojun Liao
|
344c3c5b13
|
fix(stream): fix syntax error.
|
2023-11-07 17:11:36 +08:00 |
|
Haojun Liao
|
9c49de69f8
|
refactor: do some internal refactor.
|
2023-11-07 17:05:20 +08:00 |
|
Haojun Liao
|
ed0c580d11
|
refactor: do some internal refactor.
|
2023-11-07 17:04:55 +08:00 |
|
Haojun Liao
|
1301b92844
|
fix(stream): fix errors in scan-history, introduced by refactor
|
2023-11-07 16:41:15 +08:00 |
|
Haojun Liao
|
c9a1cc50fb
|
refactor: do some internal refactor.
|
2023-11-07 16:40:04 +08:00 |
|
Haojun Liao
|
9125fe44c6
|
fix(stream): fix error.
|
2023-11-07 16:40:04 +08:00 |
|
Haojun Liao
|
8c2f6bab0e
|
fix(stream): exec scan-history in timer.
|
2023-11-07 16:40:03 +08:00 |
|
Haojun Liao
|
7370daa6e0
|
fix(stream): record the start failure tasks.
|
2023-11-07 16:39:56 +08:00 |
|
Haojun Liao
|
e38e526dda
|
fix(stream):reset the starting flag for the followers.
|
2023-11-07 16:39:12 +08:00 |
|
Haojun Liao
|
207b53f3f6
|
fix(stream): fix errors in scan-history, introduced by refactor
|
2023-11-07 16:19:09 +08:00 |
|
yihaoDeng
|
4f53ffd76f
|
refactor backend
|
2023-11-07 16:01:57 +08:00 |
|
yihaoDeng
|
1ee82f5e2c
|
refactor backend
|
2023-11-07 15:50:42 +08:00 |
|
liuyao
|
467c27c758
|
recover flush mark
|
2023-11-07 15:45:38 +08:00 |
|
yihaoDeng
|
8f7ad2bd90
|
refactor backend
|
2023-11-07 15:20:58 +08:00 |
|
yihaoDeng
|
042522ac7a
|
refactor backend
|
2023-11-07 15:18:24 +08:00 |
|
yihaoDeng
|
e015134d6d
|
refactor backend
|
2023-11-07 14:46:52 +08:00 |
|
liuyao
|
e972ab16fe
|
recover flush mark
|
2023-11-07 14:11:08 +08:00 |
|
yihaoDeng
|
e5449bf161
|
refactor backend
|
2023-11-07 11:49:56 +08:00 |
|
yihaoDeng
|
95cfc5eb46
|
refactor checkpoint
|
2023-11-07 09:55:55 +08:00 |
|
yihaoDeng
|
021859361f
|
refactor checkpoint
|
2023-11-07 09:22:57 +08:00 |
|
Haojun Liao
|
96f9264906
|
fix(stream): add null ptr check.
|
2023-11-07 00:38:02 +08:00 |
|
Haojun Liao
|
1312b9ea36
|
fix(stream): fix error.
|
2023-11-06 23:44:01 +08:00 |
|
Haojun Liao
|
4d8548e938
|
refactor: do some internal refactor.
|
2023-11-06 23:42:16 +08:00 |
|
yihaoDeng
|
c9bf4f6507
|
refactor checkpoint
|
2023-11-06 20:19:11 +08:00 |
|
yihaoDeng
|
819be65db0
|
refactor checkpoint
|
2023-11-06 19:59:11 +08:00 |
|
kailixu
|
f5d796a081
|
chore: print stream state
|
2023-11-06 19:53:09 +08:00 |
|
Haojun Liao
|
312dbc1caa
|
refactor: do some internal refactor.
|
2023-11-06 19:49:25 +08:00 |
|
yihaoDeng
|
9ca1151b67
|
refactor checkpoint
|
2023-11-06 19:47:47 +08:00 |
|
Haojun Liao
|
1f09d3a46b
|
fix(stream): fix error.
|
2023-11-06 19:46:47 +08:00 |
|
Haojun Liao
|
d9474016fc
|
fix(stream): exec scan-history in timer.
|
2023-11-06 18:55:53 +08:00 |
|
yihaoDeng
|
aee1b700a6
|
Merge branch 'enh/new3.0' into enh/refactorBackend
|
2023-11-06 18:08:03 +08:00 |
|
yihaoDeng
|
ba52769867
|
Merge branch 'enh/new3.0' into enh/refactorBackend
|
2023-11-06 17:56:09 +08:00 |
|
Haojun Liao
|
6b1889284b
|
fix(stream): record the start failure tasks.
|
2023-11-06 15:45:44 +08:00 |
|
yihaoDeng
|
feeead50c5
|
Merge branch 'enh/new3.0' into enh/refactorBackend
|
2023-11-06 13:26:38 +08:00 |
|
Haojun Liao
|
69863febe6
|
fix(stream):reset the starting flag for the followers.
|
2023-11-06 13:17:13 +08:00 |
|
Haojun Liao
|
d41fd27189
|
fix(stream): restart tasks in stream threads, instead of write thread.
|
2023-11-06 11:57:21 +08:00 |
|
Haojun Liao
|
0e44950a37
|
enh(stream): execute scan history by using time slice 1s.
|
2023-11-06 09:21:33 +08:00 |
|
Haojun Liao
|
1f756f58f6
|
fix(stream): add need update node into update node list.
|
2023-11-06 09:21:33 +08:00 |
|
Haojun Liao
|
680eb5674e
|
refactor: do some internal refactor.
|
2023-11-06 09:15:49 +08:00 |
|
Haojun Liao
|
d440da0d8c
|
enh(stream): execute scan history by using time slice 1s.
|
2023-11-05 01:26:53 +08:00 |
|
Haojun Liao
|
c71f6713a7
|
fix(stream): add need update node into update node list.
|
2023-11-05 01:24:23 +08:00 |
|
Haojun Liao
|
e13f003b90
|
refactor: do some internal refactor.
|
2023-11-05 01:23:23 +08:00 |
|
kailixu
|
411151d671
|
fix: buffer overflow/buffer use after free/memory leak
|
2023-11-04 08:44:26 +08:00 |
|
yihaoDeng
|
f038f88c07
|
Merge branch 'feat/TD-26060' into enh/refactorBackend
|
2023-11-03 18:29:18 +08:00 |
|
wangmm0220
|
5a6c3f2b04
|
fix:add windows support
|
2023-11-03 17:45:37 +08:00 |
|
Haojun Liao
|
53b2158c54
|
refactor: do some internal refactor.
|
2023-11-03 13:51:17 +08:00 |
|
wangmm0220
|
0a1f1085fc
|
Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26060
|
2023-11-03 11:33:50 +08:00 |
|
wangmm0220
|
3ac11eba0e
|
fix:modify upload checkpoint interface
|
2023-11-03 11:33:18 +08:00 |
|
yihaoDeng
|
d82d51cf8f
|
Merge branch 'enh/new3.0' into enh/refactorBackend
|
2023-11-03 10:40:00 +08:00 |
|
yihaoDeng
|
24e961976f
|
Merge branch 'enh/new3.0' into enh/refactorBackend
|
2023-11-03 09:31:57 +08:00 |
|
Haojun Liao
|
9d77351bb2
|
refactor: do some internal refactor.
|
2023-11-03 09:30:50 +08:00 |
|
yihaoDeng
|
069dd8de84
|
Merge branch 'enh/new3.0' into enh/refactorBackend
|
2023-11-03 09:28:30 +08:00 |
|
liuyao
|
31ad73f6d1
|
Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898
|
2023-11-03 09:12:17 +08:00 |
|
yihaoDeng
|
0a73832fd2
|
add checkpoint delta
|
2023-11-02 20:39:55 +08:00 |
|
wangmm0220
|
159873692c
|
feat:checkpoint bakeup using rsync
|
2023-11-02 20:13:29 +08:00 |
|
Haojun Liao
|
b3d57e4a2d
|
fix(stream): not transfer state if state is not appropriate.
|
2023-11-02 19:31:35 +08:00 |
|
Haojun Liao
|
7a32b3a209
|
fix(stream): not transfer state if state is not appropriate.
|
2023-11-02 19:12:36 +08:00 |
|
Haojun Liao
|
706f1e4744
|
fix(stream): fix deadlock in transfer state.
|
2023-11-02 18:18:04 +08:00 |
|
Haojun Liao
|
39175dc03b
|
fix(stream): fix deadlock in transfer state.
|
2023-11-02 18:07:36 +08:00 |
|
Haojun Liao
|
c48c801e19
|
fix(stream): return error code.
|
2023-11-02 11:02:40 +08:00 |
|
Haojun Liao
|
95efa07e92
|
fix(stream): add full unsupported event filtering.
|
2023-11-02 11:02:39 +08:00 |
|
Haojun Liao
|
05b3d51803
|
fix(stream): add qualified status in assert
|
2023-11-02 11:02:39 +08:00 |
|
Haojun Liao
|
420825c62f
|
fix(stream): return error code.
|
2023-11-02 10:22:03 +08:00 |
|
yihaoDeng
|
7e7a39f077
|
Merge branch 'enh/new3.0' into enh/refactorBackend
|
2023-11-02 10:15:34 +08:00 |
|
yihaoDeng
|
b911492270
|
Merge branch 'enh/new3.0' into enh/refactorBackend
|
2023-11-02 09:46:36 +08:00 |
|
Haojun Liao
|
351a31302f
|
fix(stream): add full unsupported event filtering.
|
2023-11-02 09:43:48 +08:00 |
|
Haojun Liao
|
e14d42c01e
|
fix(stream): add qualified status in assert
|
2023-11-02 08:46:18 +08:00 |
|
Haojun Liao
|
dc8a90c864
|
fix(stream): fix memory leak.
|
2023-11-02 08:13:11 +08:00 |
|
Haojun Liao
|
79e971385f
|
fix(stream): fix memory leak.
|
2023-11-02 08:11:51 +08:00 |
|
Haojun Liao
|
df7633650e
|
fix(stream): fix memory leak.
|
2023-11-01 20:35:45 +08:00 |