Haojun Liao
|
da83f27124
|
Merge pull request #23610 from taosdata/fix/TD-27216
change chkp gen way
|
2023-11-09 18:55:31 +08:00 |
Haojun Liao
|
7f3a50dfde
|
fix(stream): fix the invalid free.
|
2023-11-09 18:14:27 +08:00 |
yihaoDeng
|
757425bff8
|
Merge branch '3.0' into enh/refactorBackend
|
2023-11-09 17:58:49 +08:00 |
|
yihaoDeng
|
dd2252598e
|
upload by rsync
|
2023-11-09 17:39:34 +08:00 |
Yihao Deng
|
0453991cdf
|
Merge branch '3.0' into fix/TD-27216-3
|
2023-11-09 17:12:56 +08:00 |
|
Haojun Liao
|
13c6d1b23a
|
fix(stream): the checkpoint version can only be updated when generating checkpoint.
|
2023-11-09 17:11:37 +08:00 |
dapan1121
|
8314cb6013
|
Merge pull request #23494 from taosdata/enh/TD-23769-3.0x
enh: checkpoint for rsma
|
2023-11-09 14:51:37 +08:00 |
|
yihaoDeng
|
f74edc7618
|
Merge branch '3.0' into enh/refactorBackend
|
2023-11-09 06:14:08 +00:00 |
liuyao
|
e56a3e8a1e
|
Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898
|
2023-11-09 13:59:39 +08:00 |
kailixu
|
1a950afdb8
|
enh: test case for rsma snapshot
|
2023-11-09 12:09:27 +08:00 |
|
Haojun Liao
|
257ab4f270
|
Merge pull request #23526 from taosdata/feat/TD-26060
feat:checkpoint backup function
|
2023-11-09 11:46:28 +08:00 |
|
yihaoDeng
|
679155f771
|
change chkpid gen way
|
2023-11-09 11:25:52 +08:00 |
|
yihaoDeng
|
a215332e2f
|
change chkpid gen way
|
2023-11-09 11:24:18 +08:00 |
|
yihaoDeng
|
50666987f0
|
change chkpid gen way
|
2023-11-09 11:23:17 +08:00 |
|
Haojun Liao
|
ef646873ef
|
Merge pull request #23596 from taosdata/fix/streamTransferError
fix stream transfer err
|
2023-11-09 10:51:22 +08:00 |
|
kailixu
|
edef4de7b2
|
chore: revert the code
|
2023-11-08 20:57:57 +08:00 |
|
kailixu
|
72ecb0431c
|
enh: rsma checkpoint
|
2023-11-08 20:45:44 +08:00 |
|
kailixu
|
e72582a1fa
|
Merge branch 'fix/streamTransferError' into enh/TD-23769-3.0x
|
2023-11-08 20:45:21 +08:00 |
|
yihaoDeng
|
3abf0ae4b2
|
Merge branch 'feat/TD-26060' into enh/refactorBackend
|
2023-11-08 17:31:16 +08:00 |
|
yihaoDeng
|
92fa1043b8
|
Merge branch 'enh/refactorBackend' of https://github.com/taosdata/TDengine into enh/refactorBackend
|
2023-11-08 17:12:32 +08:00 |
|
yihaoDeng
|
2de5c4a97d
|
add bg thread
|
2023-11-08 17:11:11 +08:00 |
|
yihaoDeng
|
76fcc49c6d
|
fix stream transfer error
|
2023-11-08 17:10:54 +08:00 |
|
Haojun Liao
|
f949333e8b
|
refactor:do some internal refactor.
|
2023-11-08 16:57:55 +08:00 |
|
Haojun Liao
|
470f244032
|
Merge remote-tracking branch 'origin/enh/refactorBackend' into enh/refactorBackend
# Conflicts:
# include/libs/stream/tstream.h
|
2023-11-08 15:21:21 +08:00 |
|
Haojun Liao
|
99dbbe61d7
|
refactor(stream): do some internal refactor.
|
2023-11-08 15:20:47 +08:00 |
|
yihaoDeng
|
6a82cd7fbf
|
Merge branch 'main' of https://github.com/taosdata/TDengine into fix/fixStreamTransferErrMain
|
2023-11-08 15:14:31 +08:00 |
|
yihaoDeng
|
b3c056e6cb
|
fix stream transfer err
|
2023-11-08 15:12:47 +08:00 |
wangmm0220
|
c4c1423243
|
fix:error
|
2023-11-08 15:01:04 +08:00 |
|
yihaoDeng
|
7e03fa6664
|
fix stream transfer err
|
2023-11-08 14:57:20 +08:00 |
|
yihaoDeng
|
2e7d041e0a
|
fix stream transfer err
|
2023-11-08 14:48:28 +08:00 |
|
liuyao
|
340fb3e727
|
Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898
|
2023-11-08 14:16:59 +08:00 |
|
yihaoDeng
|
7b0891981e
|
merge 3.0
|
2023-11-08 14:14:01 +08:00 |
|
wangmm0220
|
7d19fcf19f
|
Merge branch 'feat/TD-26060' of https://github.com/taosdata/TDengine into feat/TD-26060
|
2023-11-08 11:59:03 +08:00 |
|
wangmm0220
|
047eb14f67
|
fix:error
|
2023-11-08 11:57:49 +08:00 |
|
yihaoDeng
|
fb77d811f9
|
Merge branch 'enh/refactorBackend' of https://github.com/taosdata/TDengine into enh/refactorBackend
|
2023-11-08 10:48:36 +08:00 |
|
Haojun Liao
|
17bd6badec
|
refactor(stream): do checkpoint for each task.
|
2023-11-08 10:47:54 +08:00 |
|
yihaoDeng
|
7ada7f34ac
|
fix:merge from 3.0
|
2023-11-08 10:45:15 +08:00 |
|
wangmm0220
|
07aa749fcd
|
fix:adapt to windows
|
2023-11-08 10:28:45 +08:00 |
|
yihaoDeng
|
594da2d603
|
merge 3.0
|
2023-11-08 10:04:46 +08:00 |
|
kailixu
|
b9f389a49f
|
Merge branch '3.0' into enh/TD-23769-3.0x
|
2023-11-08 08:36:35 +08:00 |
|
kailixu
|
f2d24306b1
|
enh: rsma tasks share one checkpoint and fix memory leak
|
2023-11-08 08:35:52 +08:00 |
|
Haojun Liao
|
e052d3cd62
|
fix(stream): check null.
|
2023-11-08 00:10:08 +08:00 |
|
kailixu
|
6b738884a4
|
chore: rsma checkpoint
|
2023-11-07 19:59:05 +08:00 |
|
wangmm0220
|
f0b2ed567c
|
fix:upload checkpoint to s3
|
2023-11-07 18:49:12 +08:00 |
|
Haojun Liao
|
73d75aac25
|
fix(stream): add ref for task.
|
2023-11-07 18:43:35 +08:00 |
|
Haojun Liao
|
26b96b149d
|
refactor: wait for a while when no quota available.
|
2023-11-07 18:43:35 +08:00 |
|
Haojun Liao
|
0979ff944b
|
fix(stream): update the fill-time for quota limitation.
|
2023-11-07 18:43:34 +08:00 |
|
Haojun Liao
|
2bdde122fc
|
refactor: wait a while when no token available.
|
2023-11-07 18:43:34 +08:00 |
|
Haojun Liao
|
a0d81734f1
|
fix(stream): add ref for task.
|
2023-11-07 18:18:58 +08:00 |
|
Haojun Liao
|
43b14ba8b4
|
refactor: wait for a while when no quota available.
|
2023-11-07 17:49:49 +08:00 |
|
Haojun Liao
|
06d02b862e
|
fix(stream): update the fill-time for quota limitation.
|
2023-11-07 17:33:30 +08:00 |
|
Haojun Liao
|
0b59681158
|
refactor: wait a while when no token available.
|
2023-11-07 17:18:58 +08:00 |
|
Haojun Liao
|
884770dab1
|
fix(stream): fix syntax error.
|
2023-11-07 17:12:06 +08:00 |
|
Haojun Liao
|
344c3c5b13
|
fix(stream): fix syntax error.
|
2023-11-07 17:11:36 +08:00 |
|
Haojun Liao
|
9c49de69f8
|
refactor: do some internal refactor.
|
2023-11-07 17:05:20 +08:00 |
|
Haojun Liao
|
ed0c580d11
|
refactor: do some internal refactor.
|
2023-11-07 17:04:55 +08:00 |
|
Haojun Liao
|
1301b92844
|
fix(stream): fix errors in scan-history, introduced by refactor
|
2023-11-07 16:41:15 +08:00 |
|
Haojun Liao
|
c9a1cc50fb
|
refactor: do some internal refactor.
|
2023-11-07 16:40:04 +08:00 |
|
Haojun Liao
|
9125fe44c6
|
fix(stream): fix error.
|
2023-11-07 16:40:04 +08:00 |
|
Haojun Liao
|
8c2f6bab0e
|
fix(stream): exec scan-history in timer.
|
2023-11-07 16:40:03 +08:00 |
|
Haojun Liao
|
7370daa6e0
|
fix(stream): record the start failure tasks.
|
2023-11-07 16:39:56 +08:00 |
|
Haojun Liao
|
e38e526dda
|
fix(stream):reset the starting flag for the followers.
|
2023-11-07 16:39:12 +08:00 |
|
Haojun Liao
|
207b53f3f6
|
fix(stream): fix errors in scan-history, introduced by refactor
|
2023-11-07 16:19:09 +08:00 |
|
yihaoDeng
|
4f53ffd76f
|
refactor backend
|
2023-11-07 16:01:57 +08:00 |
|
yihaoDeng
|
1ee82f5e2c
|
refactor backend
|
2023-11-07 15:50:42 +08:00 |
|
liuyao
|
467c27c758
|
recover flush mark
|
2023-11-07 15:45:38 +08:00 |
|
yihaoDeng
|
8f7ad2bd90
|
refactor backend
|
2023-11-07 15:20:58 +08:00 |
|
yihaoDeng
|
042522ac7a
|
refactor backend
|
2023-11-07 15:18:24 +08:00 |
|
yihaoDeng
|
e015134d6d
|
refactor backend
|
2023-11-07 14:46:52 +08:00 |
|
liuyao
|
e972ab16fe
|
recover flush mark
|
2023-11-07 14:11:08 +08:00 |
|
yihaoDeng
|
e5449bf161
|
refactor backend
|
2023-11-07 11:49:56 +08:00 |
|
yihaoDeng
|
95cfc5eb46
|
refactor checkpoint
|
2023-11-07 09:55:55 +08:00 |
|
yihaoDeng
|
021859361f
|
refactor checkpoint
|
2023-11-07 09:22:57 +08:00 |
|
Haojun Liao
|
96f9264906
|
fix(stream): add null ptr check.
|
2023-11-07 00:38:02 +08:00 |
|
Haojun Liao
|
1312b9ea36
|
fix(stream): fix error.
|
2023-11-06 23:44:01 +08:00 |
|
Haojun Liao
|
4d8548e938
|
refactor: do some internal refactor.
|
2023-11-06 23:42:16 +08:00 |
|
yihaoDeng
|
c9bf4f6507
|
refactor checkpoint
|
2023-11-06 20:19:11 +08:00 |
|
yihaoDeng
|
819be65db0
|
refactor checkpoint
|
2023-11-06 19:59:11 +08:00 |
|
kailixu
|
f5d796a081
|
chore: print stream state
|
2023-11-06 19:53:09 +08:00 |
|
Haojun Liao
|
312dbc1caa
|
refactor: do some internal refactor.
|
2023-11-06 19:49:25 +08:00 |
|
yihaoDeng
|
9ca1151b67
|
refactor checkpoint
|
2023-11-06 19:47:47 +08:00 |
|
Haojun Liao
|
1f09d3a46b
|
fix(stream): fix error.
|
2023-11-06 19:46:47 +08:00 |
|
Haojun Liao
|
d9474016fc
|
fix(stream): exec scan-history in timer.
|
2023-11-06 18:55:53 +08:00 |
|
yihaoDeng
|
aee1b700a6
|
Merge branch 'enh/new3.0' into enh/refactorBackend
|
2023-11-06 18:08:03 +08:00 |
|
yihaoDeng
|
ba52769867
|
Merge branch 'enh/new3.0' into enh/refactorBackend
|
2023-11-06 17:56:09 +08:00 |
|
Haojun Liao
|
6b1889284b
|
fix(stream): record the start failure tasks.
|
2023-11-06 15:45:44 +08:00 |
|
yihaoDeng
|
feeead50c5
|
Merge branch 'enh/new3.0' into enh/refactorBackend
|
2023-11-06 13:26:38 +08:00 |
|
Haojun Liao
|
69863febe6
|
fix(stream):reset the starting flag for the followers.
|
2023-11-06 13:17:13 +08:00 |
|
Haojun Liao
|
d41fd27189
|
fix(stream): restart tasks in stream threads, instead of write thread.
|
2023-11-06 11:57:21 +08:00 |
|
Haojun Liao
|
0e44950a37
|
enh(stream): execute scan history by using time slice 1s.
|
2023-11-06 09:21:33 +08:00 |
|
Haojun Liao
|
1f756f58f6
|
fix(stream): add need update node into update node list.
|
2023-11-06 09:21:33 +08:00 |
|
Haojun Liao
|
680eb5674e
|
refactor: do some internal refactor.
|
2023-11-06 09:15:49 +08:00 |
|
Haojun Liao
|
d440da0d8c
|
enh(stream): execute scan history by using time slice 1s.
|
2023-11-05 01:26:53 +08:00 |
|
Haojun Liao
|
c71f6713a7
|
fix(stream): add need update node into update node list.
|
2023-11-05 01:24:23 +08:00 |
|
Haojun Liao
|
e13f003b90
|
refactor: do some internal refactor.
|
2023-11-05 01:23:23 +08:00 |
|
kailixu
|
411151d671
|
fix: buffer overflow/buffer use after free/memory leak
|
2023-11-04 08:44:26 +08:00 |
|
yihaoDeng
|
f038f88c07
|
Merge branch 'feat/TD-26060' into enh/refactorBackend
|
2023-11-03 18:29:18 +08:00 |
|
wangmm0220
|
5a6c3f2b04
|
fix:add windows support
|
2023-11-03 17:45:37 +08:00 |
|
kailixu
|
77eadc59dc
|
Merge branch '3.0' into enh/TD-23769-3.0x
|
2023-11-03 16:26:07 +08:00 |
|
kailixu
|
a48968e5e8
|
enh: rsma checkpoint
|
2023-11-03 14:33:45 +08:00 |
|
Haojun Liao
|
53b2158c54
|
refactor: do some internal refactor.
|
2023-11-03 13:51:17 +08:00 |
|
wangmm0220
|
0a1f1085fc
|
Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26060
|
2023-11-03 11:33:50 +08:00 |
|
wangmm0220
|
3ac11eba0e
|
fix:modify upload checkpoint interface
|
2023-11-03 11:33:18 +08:00 |
|
yihaoDeng
|
d82d51cf8f
|
Merge branch 'enh/new3.0' into enh/refactorBackend
|
2023-11-03 10:40:00 +08:00 |
|
yihaoDeng
|
24e961976f
|
Merge branch 'enh/new3.0' into enh/refactorBackend
|
2023-11-03 09:31:57 +08:00 |
|
Haojun Liao
|
9d77351bb2
|
refactor: do some internal refactor.
|
2023-11-03 09:30:50 +08:00 |
|
yihaoDeng
|
069dd8de84
|
Merge branch 'enh/new3.0' into enh/refactorBackend
|
2023-11-03 09:28:30 +08:00 |
|
liuyao
|
31ad73f6d1
|
Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898
|
2023-11-03 09:12:17 +08:00 |
|
yihaoDeng
|
0a73832fd2
|
add checkpoint delta
|
2023-11-02 20:39:55 +08:00 |
|
kailixu
|
6c944bb192
|
enh: skip rsma_task during load stream tasks
|
2023-11-02 20:32:54 +08:00 |
|
wangmm0220
|
159873692c
|
feat:checkpoint bakeup using rsync
|
2023-11-02 20:13:29 +08:00 |
|
Haojun Liao
|
b3d57e4a2d
|
fix(stream): not transfer state if state is not appropriate.
|
2023-11-02 19:31:35 +08:00 |
|
Haojun Liao
|
7a32b3a209
|
fix(stream): not transfer state if state is not appropriate.
|
2023-11-02 19:12:36 +08:00 |
|
Haojun Liao
|
706f1e4744
|
fix(stream): fix deadlock in transfer state.
|
2023-11-02 18:18:04 +08:00 |
|
Haojun Liao
|
39175dc03b
|
fix(stream): fix deadlock in transfer state.
|
2023-11-02 18:07:36 +08:00 |
|
Haojun Liao
|
c48c801e19
|
fix(stream): return error code.
|
2023-11-02 11:02:40 +08:00 |
|
Haojun Liao
|
95efa07e92
|
fix(stream): add full unsupported event filtering.
|
2023-11-02 11:02:39 +08:00 |
|
Haojun Liao
|
05b3d51803
|
fix(stream): add qualified status in assert
|
2023-11-02 11:02:39 +08:00 |
|
Haojun Liao
|
420825c62f
|
fix(stream): return error code.
|
2023-11-02 10:22:03 +08:00 |
|
yihaoDeng
|
7e7a39f077
|
Merge branch 'enh/new3.0' into enh/refactorBackend
|
2023-11-02 10:15:34 +08:00 |
|
yihaoDeng
|
b911492270
|
Merge branch 'enh/new3.0' into enh/refactorBackend
|
2023-11-02 09:46:36 +08:00 |
|
Haojun Liao
|
351a31302f
|
fix(stream): add full unsupported event filtering.
|
2023-11-02 09:43:48 +08:00 |
|
Haojun Liao
|
e14d42c01e
|
fix(stream): add qualified status in assert
|
2023-11-02 08:46:18 +08:00 |
|
Haojun Liao
|
dc8a90c864
|
fix(stream): fix memory leak.
|
2023-11-02 08:13:11 +08:00 |
|
Haojun Liao
|
79e971385f
|
fix(stream): fix memory leak.
|
2023-11-02 08:11:51 +08:00 |
|
Haojun Liao
|
df7633650e
|
fix(stream): fix memory leak.
|
2023-11-01 20:35:45 +08:00 |
|
Haojun Liao
|
e1b3e00b3d
|
fix(stream): fix memory leak.
|
2023-11-01 20:10:20 +08:00 |
|
Haojun Liao
|
6dc468c55f
|
fix(stream): fix dead-lock
|
2023-11-01 19:38:13 +08:00 |
|
Haojun Liao
|
fa7ebf63ea
|
refactor: do some internal refactor.
|
2023-11-01 19:38:13 +08:00 |
|
Haojun Liao
|
9156e8449d
|
fix(stream): fix deference null ptr.
|
2023-11-01 19:38:13 +08:00 |
|
Haojun Liao
|
7cf90dde5c
|
refactor: do some internal refactor.
|
2023-11-01 19:38:13 +08:00 |
|
Haojun Liao
|
00f029e44f
|
refactor: add some logs.
|
2023-11-01 19:38:12 +08:00 |
|
Haojun Liao
|
385e699cc2
|
fix(stream): do some internal refactor.
|
2023-11-01 19:38:12 +08:00 |
|
Haojun Liao
|
bd12ae88e1
|
fix(stream):fix the bug when event in waiting list not fulfilled.
|
2023-11-01 19:38:12 +08:00 |
|
Haojun Liao
|
9a9c1d689d
|
fix(stream): add lock log.
|
2023-11-01 19:38:12 +08:00 |
|
Haojun Liao
|
e7609d8e56
|
fix(stream): fix dead-lock
|
2023-11-01 19:09:21 +08:00 |
|
Haojun Liao
|
ae25f09c45
|
refactor: do some internal refactor.
|
2023-11-01 18:03:44 +08:00 |
|
Haojun Liao
|
899d13b4ae
|
fix(stream): fix deference null ptr.
|
2023-11-01 17:25:59 +08:00 |
|
Haojun Liao
|
246ed4e022
|
refactor: do some internal refactor.
|
2023-11-01 17:19:21 +08:00 |
|
liuyao
|
505c44d9aa
|
Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898
|
2023-11-01 16:50:46 +08:00 |
|
Haojun Liao
|
12bc4f32cf
|
refactor: add some logs.
|
2023-11-01 16:12:15 +08:00 |
|
yihaoDeng
|
4c8edb5545
|
Merge branch 'enh/new3.0' into enh/refactorBackend
|
2023-11-01 16:07:49 +08:00 |
|
Haojun Liao
|
778c29b808
|
fix(stream): do some internal refactor.
|
2023-11-01 14:07:18 +08:00 |
|
Haojun Liao
|
e4aeea176b
|
fix(stream):fix the bug when event in waiting list not fulfilled.
|
2023-11-01 13:59:51 +08:00 |
|
Haojun Liao
|
5ff89bc098
|
fix(stream): add lock log.
|
2023-11-01 13:19:53 +08:00 |
|
Haojun Liao
|
3f561fb8e4
|
fix(stream): remove invalid assert.
|
2023-11-01 11:43:02 +08:00 |
|
Haojun Liao
|
3e6c89d8eb
|
fix(stream): add unsupport trans.
|
2023-11-01 11:43:02 +08:00 |
|
kailixu
|
1530fe0c49
|
Merge branch '3.0' into enh/TD-23769-3.0x
|
2023-11-01 09:52:16 +08:00 |
|
kailixu
|
ad1e6accd4
|
chore: build checkpoint for rsma
|
2023-11-01 09:45:58 +08:00 |
|
Haojun Liao
|
0fb4cfd94f
|
fix(stream): remove invalid assert.
|
2023-11-01 00:33:17 +08:00 |