yihaoDeng
|
f038f88c07
|
Merge branch 'feat/TD-26060' into enh/refactorBackend
|
2023-11-03 18:29:18 +08:00 |
Haojun Liao
|
3415ba5195
|
Merge pull request #23528 from taosdata/fix/liaohj
enh(tsdb): on-demand open stt file reader.
|
2023-11-03 17:29:55 +08:00 |
kailixu
|
77eadc59dc
|
Merge branch '3.0' into enh/TD-23769-3.0x
|
2023-11-03 16:26:07 +08:00 |
Haojun Liao
|
d3ddaaa9f3
|
other(tsdb): adjust some log info.
|
2023-11-03 15:08:25 +08:00 |
|
Haojun Liao
|
de5c4d8d5d
|
other(tsdb): adjust some log info.
|
2023-11-03 15:07:40 +08:00 |
|
kailixu
|
c95fc014a8
|
enh: rsma checkpoint
|
2023-11-03 14:57:36 +08:00 |
|
kailixu
|
a48968e5e8
|
enh: rsma checkpoint
|
2023-11-03 14:33:45 +08:00 |
|
Haojun Liao
|
34403534ed
|
Merge branch '3.0' into fix/3_liaohj
|
2023-11-03 14:06:58 +08:00 |
liuyao
|
b1d1e2c778
|
Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898
|
2023-11-03 14:02:59 +08:00 |
|
Haojun Liao
|
b4d14d3847
|
fix(tsdb): fix error during add on-demand opening stt file reader.
|
2023-11-03 13:51:18 +08:00 |
|
Haojun Liao
|
675c9ca613
|
enh(tsdb): on-demand open stt file reader.
|
2023-11-03 13:51:18 +08:00 |
wangmm0220
|
0a1f1085fc
|
Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26060
|
2023-11-03 11:33:50 +08:00 |
|
Haojun Liao
|
c980e2030c
|
fix(tsdb): fix error during add on-demand opening stt file reader.
|
2023-11-03 11:04:32 +08:00 |
|
Haojun Liao
|
0acf4f1795
|
enh(tsdb): on-demand open stt file reader.
|
2023-11-03 10:35:05 +08:00 |
Hongze Cheng
|
1ff3f96b08
|
Merge pull request #23465 from taosdata/fix/TD-26189-last-tier-write
enh(tsdb/retention): enable last tier write
|
2023-11-02 21:21:38 -05:00 |
|
yihaoDeng
|
24e961976f
|
Merge branch 'enh/new3.0' into enh/refactorBackend
|
2023-11-03 09:31:57 +08:00 |
|
liuyao
|
31ad73f6d1
|
Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898
|
2023-11-03 09:12:17 +08:00 |
|
Haojun Liao
|
ff5d69352f
|
Merge pull request #23493 from taosdata/fix/3_liaohj
fix(stream): add unsupport trans.
|
2023-11-03 09:07:33 +08:00 |
|
Haojun Liao
|
70388bafd2
|
Merge pull request #23523 from taosdata/fix/liaohj
fix(stream): fix deadlock in transfer state.
|
2023-11-03 09:07:23 +08:00 |
|
kailixu
|
d9ed63473c
|
Merge branch '3.0' into enh/TD-23769-3.0x
|
2023-11-03 08:37:41 +08:00 |
|
yihaoDeng
|
6ce878948f
|
Merge branch 'enh/new3.0' into enh/refactorBackend
|
2023-11-02 20:44:36 +08:00 |
|
kailixu
|
6c944bb192
|
enh: skip rsma_task during load stream tasks
|
2023-11-02 20:32:54 +08:00 |
|
wangmm0220
|
159873692c
|
feat:checkpoint bakeup using rsync
|
2023-11-02 20:13:29 +08:00 |
|
liuyao
|
389117b806
|
Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898
|
2023-11-02 20:07:12 +08:00 |
|
Haojun Liao
|
b3d57e4a2d
|
fix(stream): not transfer state if state is not appropriate.
|
2023-11-02 19:31:35 +08:00 |
|
Haojun Liao
|
7a32b3a209
|
fix(stream): not transfer state if state is not appropriate.
|
2023-11-02 19:12:36 +08:00 |
|
kailixu
|
fa5d896787
|
enh: rsma checkpoint
|
2023-11-02 18:56:36 +08:00 |
|
Haojun Liao
|
c4079332ff
|
fix(stream):update the log level.
|
2023-11-02 18:18:04 +08:00 |
|
Haojun Liao
|
0a227e807f
|
refactor: set different tq level.
|
2023-11-02 18:18:04 +08:00 |
|
Haojun Liao
|
48aff868b6
|
fix(stream):update the log level.
|
2023-11-02 18:16:47 +08:00 |
|
Haojun Liao
|
3aed8c29ae
|
refactor: set different tq level.
|
2023-11-02 17:12:20 +08:00 |
|
Hongze Cheng
|
faea18c38f
|
fix: invalid read when file is deleted
|
2023-11-02 16:59:11 +08:00 |
|
kailixu
|
2d597659bc
|
enh: rsma checkpoint
|
2023-11-02 15:20:54 +08:00 |
|
liuyao
|
330b04a8bc
|
Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898
|
2023-11-02 14:36:13 +08:00 |
|
Haojun Liao
|
f5fa3edeba
|
Merge pull request #23503 from taosdata/fix/liaohj
fix(stream): fix dead lock.
|
2023-11-02 13:52:50 +08:00 |
|
kailixu
|
722777f8c9
|
enh: rsma checkpoint
|
2023-11-02 13:15:31 +08:00 |
|
kailixu
|
96b5024347
|
enh: rsma checkpoint
|
2023-11-02 13:05:36 +08:00 |
|
kailixu
|
698fb804f9
|
enh: disable update tbUidList during reboot
|
2023-11-02 12:54:23 +08:00 |
|
kailixu
|
76536e1c82
|
enh: rsma logic
|
2023-11-02 11:03:18 +08:00 |
|
Haojun Liao
|
95efa07e92
|
fix(stream): add full unsupported event filtering.
|
2023-11-02 11:02:39 +08:00 |
Minglei Jin
|
46d3be1f08
|
config/page-cache-size: new parameter for pcache size
|
2023-11-02 10:10:03 +08:00 |
|
kailixu
|
9649e87cab
|
fix: rsma checkpoint
|
2023-11-02 09:44:43 +08:00 |
|
Haojun Liao
|
351a31302f
|
fix(stream): add full unsupported event filtering.
|
2023-11-02 09:43:48 +08:00 |
|
Minglei Jin
|
d0327e07b8
|
tsdb/pg-cache: use pgno for cache key instead of blkno
|
2023-11-02 09:42:19 +08:00 |
|
Hongze Cheng
|
a6ee7c4685
|
fix: possible coredump
|
2023-11-01 20:34:47 +08:00 |
|
kailixu
|
3803f952f9
|
chore: rsma checkpoint verify
|
2023-11-01 20:05:00 +08:00 |
|
Haojun Liao
|
7cf90dde5c
|
refactor: do some internal refactor.
|
2023-11-01 19:38:13 +08:00 |
|
Haojun Liao
|
00f029e44f
|
refactor: add some logs.
|
2023-11-01 19:38:12 +08:00 |
|
Haojun Liao
|
9a9c1d689d
|
fix(stream): add lock log.
|
2023-11-01 19:38:12 +08:00 |
|
Haojun Liao
|
246ed4e022
|
refactor: do some internal refactor.
|
2023-11-01 17:19:21 +08:00 |
|
liuyao
|
505c44d9aa
|
Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898
|
2023-11-01 16:50:46 +08:00 |
|
kailixu
|
c32e60d199
|
chore: more code for rsma checkpoint
|
2023-11-01 16:27:41 +08:00 |
|
Haojun Liao
|
12bc4f32cf
|
refactor: add some logs.
|
2023-11-01 16:12:15 +08:00 |
|
yihaoDeng
|
4c8edb5545
|
Merge branch 'enh/new3.0' into enh/refactorBackend
|
2023-11-01 16:07:49 +08:00 |
|
kailixu
|
59be62c96e
|
chore: set stream input checkpoint
|
2023-11-01 15:34:17 +08:00 |
|
Minglei Jin
|
6f0fa5d47e
|
tsdb/retention: remove incorrect right brace
|
2023-11-01 14:56:57 +08:00 |
|
Haojun Liao
|
5ff89bc098
|
fix(stream): add lock log.
|
2023-11-01 13:19:53 +08:00 |
|
kailixu
|
ab266c712f
|
chore: checkpoint for rsma stream state
|
2023-11-01 12:29:54 +08:00 |
|
Haojun Liao
|
0cf0ff3bbf
|
Merge pull request #23455 from taosdata/fix/liaohj
refactor: do some internal refactor.
|
2023-11-01 12:01:54 +08:00 |
|
Haojun Liao
|
3e6c89d8eb
|
fix(stream): add unsupport trans.
|
2023-11-01 11:43:02 +08:00 |
|
Minglei Jin
|
221afff9ee
|
vnode/write: remove keep modify code block
|
2023-11-01 11:00:47 +08:00 |
Minglei Jin
|
64644d673b
|
Merge branch '3.0' into fix/TD-26189-last-tier-write
|
2023-11-01 10:53:55 +08:00 |
|
Minglei Jin
|
a61502411d
|
tsdb/pg-cache: new page cache for tsdb s3 read file page
|
2023-11-01 10:49:05 +08:00 |
|
kailixu
|
1530fe0c49
|
Merge branch '3.0' into enh/TD-23769-3.0x
|
2023-11-01 09:52:16 +08:00 |
|
kailixu
|
ad1e6accd4
|
chore: build checkpoint for rsma
|
2023-11-01 09:45:58 +08:00 |
|
Haojun Liao
|
7359f98eca
|
Merge pull request #23428 from taosdata/fix/3_liaohj
other: merge refactor into 3.0
|
2023-11-01 09:44:31 +08:00 |
|
Haojun Liao
|
639d5cde47
|
fix(stream): add unsupport trans.
|
2023-10-31 23:14:02 +08:00 |
|
yihaoDeng
|
bb8252df16
|
fix mem leak
|
2023-10-31 20:59:24 +08:00 |
|
kailixu
|
e6684fa5de
|
enh: rsma retetion and stream state
|
2023-10-31 20:26:42 +08:00 |
dapan1121
|
d40cc27abc
|
Merge pull request #23464 from taosdata/enh/TD-26638-3.0
enh: use placeholder '-' for interval of 1st retention level
|
2023-10-31 18:36:43 +08:00 |
|
Haojun Liao
|
a1aa2380ae
|
other: merge 3.0
|
2023-10-31 16:42:51 +08:00 |
|
Haojun Liao
|
0b18192b23
|
fix(stream): fix error in finishing event handling.
|
2023-10-31 16:40:16 +08:00 |
|
Haojun Liao
|
4c0242a58d
|
fix(stream): fix error in finishing event handling.
|
2023-10-31 16:39:14 +08:00 |
|
liuyao
|
696294c208
|
Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898
|
2023-10-31 15:41:04 +08:00 |
wade zhang
|
76c9b9afc5
|
Merge pull request #23377 from taosdata/FIX/TD-26596-3.0
feat: support pipelining of snap replication
|
2023-10-31 15:19:07 +08:00 |
|
wade zhang
|
25b09b467f
|
Merge pull request #23439 from taosdata/feat/TD-26971-3.0
TD-26971
|
2023-10-31 13:53:49 +08:00 |
|
kailixu
|
28cd8f4915
|
enh: file duration for rsma
|
2023-10-31 11:38:33 +08:00 |
|
Hongze Cheng
|
ac3df85d8a
|
Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26684
|
2023-10-31 11:23:23 +08:00 |
|
Haojun Liao
|
fc70fa053c
|
fix(tsdb): fix syntax error.
|
2023-10-31 10:45:14 +08:00 |
|
Haojun Liao
|
6a7ba0f5f5
|
fix(tsdb): handle the case where stt not exists, possibly exists while the stt-trigger is 1.
|
2023-10-31 10:45:14 +08:00 |
|
Haojun Liao
|
00626de6e4
|
fix(tsdb): fix error in decide if data buffer overlaps with stt files/block-files.
|
2023-10-31 10:45:13 +08:00 |
|
Haojun Liao
|
cb43299faa
|
fix(tsdb): avoid to read duplicated rows in buf.
|
2023-10-31 10:45:13 +08:00 |
|
Haojun Liao
|
635243f01a
|
refactor: do some internal refactor.
|
2023-10-31 10:45:12 +08:00 |
|
Haojun Liao
|
6e2240a3d1
|
fix(stream): fix the deadlock.
|
2023-10-31 10:45:12 +08:00 |
|
Haojun Liao
|
0c982093cd
|
fix(stream): enable the set of fill-history task to be un-init.
|
2023-10-31 10:45:12 +08:00 |
|
Haojun Liao
|
8b9bc988f1
|
fix(tsdb): fix syntax error.
|
2023-10-31 10:42:34 +08:00 |
|
Haojun Liao
|
eaf76854f6
|
fix(tsdb): handle the case where stt not exists, possibly exists while the stt-trigger is 1.
|
2023-10-31 09:29:24 +08:00 |
|
kailixu
|
b03baaed2c
|
chore: revert the code change
|
2023-10-30 19:49:50 +08:00 |
|
kailixu
|
89651626e3
|
chore: reopen rsma stream commit
|
2023-10-30 19:45:18 +08:00 |
dmchen
|
fe044051c8
|
memory leak
|
2023-10-30 19:36:27 +08:00 |
|
dmchen
|
5120d25297
|
memory leak
|
2023-10-30 11:34:34 +00:00 |
|
Minglei Jin
|
867ce92dcc
|
tsdb/file-rw: fix log msg
|
2023-10-30 19:28:18 +08:00 |
|
Minglei Jin
|
800cbfbb05
|
tsdb/file: new s3flag in mem
|
2023-10-30 17:36:49 +08:00 |
|
Haojun Liao
|
6e118c7963
|
fix(stream): fix memory leak.
|
2023-10-30 17:28:57 +08:00 |
|
dmchen
|
0f40e1dbb9
|
memory leak
|
2023-10-30 16:59:12 +08:00 |
|
dmchen
|
40c9622df5
|
memory leak
|
2023-10-30 08:57:07 +00:00 |
|
Haojun Liao
|
ed07486405
|
fix(tsdb): fix error in decide if data buffer overlaps with stt files/block-files.
|
2023-10-30 16:40:09 +08:00 |
|
Haojun Liao
|
bc1c2a879a
|
fix(tsdb): avoid to read duplicated rows in buf.
|
2023-10-30 16:12:08 +08:00 |
|
dmchen
|
be0a85a0ff
|
memory leak
|
2023-10-30 15:22:54 +08:00 |
|
Minglei Jin
|
84d2f9c379
|
tsdb/upload: delay data file uploading
|
2023-10-30 15:22:34 +08:00 |
|
dmchen
|
6172b820ac
|
memory leak
|
2023-10-30 07:19:08 +00:00 |
|
Haojun Liao
|
fdf3f210ac
|
refactor: do some internal refactor.
|
2023-10-30 14:39:24 +08:00 |
|
Haojun Liao
|
3275452bce
|
fix(stream): fix the deadlock.
|
2023-10-30 14:38:51 +08:00 |
|
kailixu
|
c77153cb81
|
enh: use placeholder '-' for interval of 1st retention level
|
2023-10-30 14:02:31 +08:00 |
|
Haojun Liao
|
15d217fc3e
|
fix(stream): fix memory leak.
|
2023-10-30 13:29:35 +08:00 |
|
Haojun Liao
|
b0700d6095
|
Merge branch '3.0' into fix/3_liaohj
|
2023-10-30 11:57:54 +08:00 |
|
Haojun Liao
|
93232a0e14
|
fix(stream): enable the set of fill-history task to be un-init.
|
2023-10-30 11:48:51 +08:00 |
|
liuyao
|
1a37f19c82
|
Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898
|
2023-10-30 11:43:23 +08:00 |
|
dapan1121
|
1b7a6bccdf
|
Merge pull request #23430 from taosdata/enh/TD-26641-3.0
enh: only float/double allowed for sum/avg of rsma
|
2023-10-30 10:08:55 +08:00 |
|
Minglei Jin
|
4fede02da4
|
tsdb/retention: remove s3 evict cache hook
|
2023-10-30 10:06:42 +08:00 |
|
Haojun Liao
|
c7285c0ede
|
fix(stream): add expired epset node list for stream tasks in hb to mnode.
|
2023-10-27 23:41:57 +08:00 |
|
Haojun Liao
|
4c267b538f
|
fix(stream): add expired epset node list for stream tasks in hb to mnode.
|
2023-10-27 23:05:41 +08:00 |
|
Hongze Cheng
|
a7f3041ff3
|
more fix
|
2023-10-27 17:59:27 +08:00 |
Benguang Zhao
|
4163a3be7c
|
feat: resend snap replication of data on timeout
|
2023-10-27 17:58:26 +08:00 |
|
Hongze Cheng
|
cdb1d8296d
|
feat: concurrency on fileset
|
2023-10-27 17:48:19 +08:00 |
|
dmchen
|
43e6dec6c2
|
TD-26971
|
2023-10-27 17:39:50 +08:00 |
|
dmchen
|
34c4ffde26
|
TD-26971
|
2023-10-27 09:30:30 +00:00 |
|
Minglei Jin
|
8c6f452f09
|
tsdb/write: make last tier writable to mem
|
2023-10-27 15:51:52 +08:00 |
|
Haojun Liao
|
dcca6b0868
|
other: merge 3.0.
|
2023-10-27 11:41:28 +08:00 |
|
Haojun Liao
|
9c9d02b181
|
fix(stream): disable follower nodes exec reset.
|
2023-10-27 09:59:52 +08:00 |
|
Haojun Liao
|
454624516c
|
fix(stream): handle the repeatly issued nodeUpdate msg from dnode.
|
2023-10-27 09:59:51 +08:00 |
|
Haojun Liao
|
33dc51cc86
|
fix(stream): add some logs.
|
2023-10-27 09:59:44 +08:00 |
|
Haojun Liao
|
1ccbb77981
|
fix(stream): fix dead lock when shutdown all tasks.
|
2023-10-27 09:59:37 +08:00 |
|
Haojun Liao
|
2493c21ed3
|
fix(stream): fix the invalid write in sma
|
2023-10-27 09:58:52 +08:00 |
|
Haojun Liao
|
7cce53f7e5
|
fix(stream): ignore the check status when is ready.
|
2023-10-27 09:58:52 +08:00 |
|
Haojun Liao
|
c99f434706
|
fix(stream): set checkpoint failure when in pause status.
|
2023-10-27 09:58:52 +08:00 |
|
Haojun Liao
|
2c1af8dad8
|
refactor: do some internal refactor.
|
2023-10-27 09:58:52 +08:00 |
|
Haojun Liao
|
1ad2c3029a
|
refactor(stream): do some internal refactor.
|
2023-10-27 09:58:52 +08:00 |
|
Haojun Liao
|
7311f9d2fe
|
fix(sma): fix bugs in sma and do some internal refactor.
|
2023-10-27 09:58:51 +08:00 |
|
Haojun Liao
|
3bcffcf1da
|
other: merge stream refactor from main.
|
2023-10-27 09:56:02 +08:00 |
|
Haojun Liao
|
226b6596d6
|
fix(stream): fix bugs caused by refactor.
|
2023-10-27 09:54:58 +08:00 |
|
Haojun Liao
|
091238e7be
|
fix(stream): fix bugs caused by refactor sm.
|
2023-10-27 09:54:58 +08:00 |
|
Haojun Liao
|
e1f6043eed
|
fix(stream): fix bugs caused by refactor sm.
|
2023-10-27 09:54:57 +08:00 |
|
Haojun Liao
|
8729bdac1e
|
fix(stream): fix bugs caused by refactor.
|
2023-10-27 09:54:57 +08:00 |
|
Haojun Liao
|
1eac7f44c0
|
fix(stream): fix error in stream.
|
2023-10-27 09:54:56 +08:00 |
|
Haojun Liao
|
579dd8e6b2
|
refactor(stream): do some internal refactor.
|
2023-10-27 09:54:56 +08:00 |
|
Haojun Liao
|
6f3c0d17cc
|
refactor(stream): add state machine to manage the state of stream tasks.
|
2023-10-27 09:54:49 +08:00 |
|
Haojun Liao
|
596eb073b7
|
refactor(stream): do some internal refactor.
|
2023-10-27 09:54:48 +08:00 |
|
Haojun Liao
|
62c58ecd8b
|
fix(stream):add more check for test cases.
|
2023-10-27 09:54:06 +08:00 |
|
liuyao
|
cf3bfe9310
|
Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898
|
2023-10-27 09:39:00 +08:00 |
|
Hongze Cheng
|
b8c379a20d
|
Merge pull request #23413 from taosdata/fix/TD-26669
fix(tsdb/commmit): make ts big enough to skip row
|
2023-10-26 07:17:53 -05:00 |
|
wade zhang
|
d1e4e909c3
|
Merge pull request #23384 from taosdata/fix/TD-26884-3.0
Fix/td 26884 3.0
|
2023-10-26 17:00:00 +08:00 |
|
wade zhang
|
951442e3db
|
Merge pull request #23381 from taosdata/fix/TD-26884-main
TD-26884
|
2023-10-26 16:59:39 +08:00 |
|
Minglei Jin
|
b314758108
|
tsdb/commit: make ts big enough to skip row
|
2023-10-26 16:24:06 +08:00 |
|
yihaoDeng
|
4c03d372ef
|
fix stream case error
|
2023-10-26 14:19:34 +08:00 |
|
kailixu
|
bb77015998
|
Merge branch '3.0' into enh/TD-26641-3.0
|
2023-10-26 10:40:54 +08:00 |
|
Hongze Cheng
|
209ebbde84
|
Merge pull request #23402 from taosdata/fix/TD-26189-libs3
cmake/xml2: use sha256 to verify distribution release
|
2023-10-25 20:27:29 -05:00 |
|
kailixu
|
64765579e9
|
enh: check interval and keep for retentions
|
2023-10-25 22:42:01 +08:00 |
|
yihaoDeng
|
db0f6258fe
|
fix stream case error
|
2023-10-25 19:38:22 +08:00 |
|
liuyao
|
f51c985914
|
stream event window
|
2023-10-25 17:50:16 +08:00 |
|
Minglei Jin
|
d77ecbbb1b
|
cmake/xml2: use sha256 to verify distribution release
|
2023-10-25 17:41:55 +08:00 |
|
dmchen
|
14be9c81e2
|
create table user and clusterid
|
2023-10-25 14:53:06 +08:00 |
|
dmchen
|
7ef019d105
|
create table user and clusterid
|
2023-10-25 06:49:23 +00:00 |
|
Haojun Liao
|
f36b24ed24
|
fix(stream): disable follower nodes exec reset.
|
2023-10-25 14:16:36 +08:00 |
|
Hongze Cheng
|
3ff331b8b7
|
Merge pull request #23391 from taosdata/fix/TD-26189-libs3
cmake: new option: BUILD_S3
|
2023-10-24 22:37:20 -05:00 |
|
Haojun Liao
|
03165d5327
|
fix(stream): handle the repeatly issued nodeUpdate msg from dnode.
|
2023-10-25 09:55:02 +08:00 |
|
Haojun Liao
|
26aaa4a83c
|
other: merge main.
|
2023-10-25 00:39:14 +08:00 |
|
Haojun Liao
|
13d979a2ee
|
fix(stream): add some logs.
|
2023-10-25 00:03:46 +08:00 |
|
Haojun Liao
|
8cde39eebd
|
fix(stream): fix dead lock when shutdown all tasks.
|
2023-10-24 19:11:24 +08:00 |
|
Minglei Jin
|
f9ca8fe962
|
cmake: new option: BUILD_S3
|
2023-10-24 16:10:46 +08:00 |
|
Haojun Liao
|
f1498f8929
|
fix(stream): fix the invalid write in sma
|
2023-10-24 15:24:34 +08:00 |
|
dmchen
|
162066235b
|
create table
|
2023-10-24 14:31:27 +08:00 |
|
Hongze Cheng
|
e7e7748e6d
|
Merge pull request #23366 from taosdata/fix/TD-26669
tsdb/commit: skip last tier ts data committing
|
2023-10-24 01:29:01 -05:00 |
|
dmchen
|
ae728ab412
|
create table
|
2023-10-24 06:17:13 +00:00 |
|
yihaoDeng
|
95b0d4f083
|
Merge branch 'enh/new3.0' into enh/refactorBackend
|
2023-10-24 13:40:47 +08:00 |
|
Haojun Liao
|
a6e706ba2d
|
fix(stream): ignore the check status when is ready.
|
2023-10-24 11:38:14 +08:00 |
|
Haojun Liao
|
e92b276e3e
|
fix(stream): set checkpoint failure when in pause status.
|
2023-10-24 10:14:29 +08:00 |
|
Minglei Jin
|
e826532592
|
cmake/vnode: specify no default path for ssl & crypto
|
2023-10-24 10:10:43 +08:00 |
|
Haojun Liao
|
0dae8c3c76
|
refactor: do some internal refactor.
|
2023-10-24 09:49:14 +08:00 |
|
Haojun Liao
|
f446ff1c36
|
refactor(stream): do some internal refactor.
|
2023-10-24 09:48:10 +08:00 |
|
Haojun Liao
|
7a8b046a35
|
fix(sma): fix bugs in sma and do some internal refactor.
|
2023-10-24 09:40:38 +08:00 |
|
Minglei Jin
|
7fdf6cc696
|
cmake: use new dir for libs3
|
2023-10-24 09:04:24 +08:00 |
|
Minglei Jin
|
80fb38f172
|
Merge branch '3.0' into fix/TD-26189-libs3
|
2023-10-23 16:31:21 +08:00 |
|
Minglei Jin
|
f630fc38f8
|
tsdb/commit: skip last tier ts data committing
|
2023-10-23 15:46:32 +08:00 |
|
Haojun Liao
|
2ee3319611
|
Merge pull request #23360 from taosdata/fix/liaohj
fix(tsdb): apply the window range when building blocks from stt files.
|
2023-10-23 12:45:42 +08:00 |
|
Haojun Liao
|
6dc8fc50bc
|
Merge pull request #23359 from taosdata/fix/3_liaohj
fix(tsdb): apply the window range when building blocks from stt files.
|
2023-10-21 14:57:14 +08:00 |
|
Haojun Liao
|
f667bf3866
|
fix(tsdb): apply the window range when building blocks from stt files.
|
2023-10-20 18:19:45 +08:00 |
|
Haojun Liao
|
f1207d8d42
|
fix(tsdb): apply the window range when building blocks from stt files.
|
2023-10-20 18:18:58 +08:00 |
|
Haojun Liao
|
c4268ca395
|
fix(stream): fix bugs caused by refactor.
|
2023-10-20 15:54:30 +08:00 |
|
yihaoDeng
|
1a4cfd11a5
|
Merge branch 'enh/new3.0' into enh/refactorBackend
|
2023-10-20 15:28:10 +08:00 |
|
Minglei Jin
|
55647f9ce9
|
cos/put: make chunk small to not block other reqs
|
2023-10-20 15:15:03 +08:00 |
|
Haojun Liao
|
3b8c85f632
|
fix(stream): fix bugs caused by refactor sm.
|
2023-10-20 14:19:57 +08:00 |
|
Minglei Jin
|
74d05c2771
|
vnode/cos: fix multipart uploading
|
2023-10-20 13:47:25 +08:00 |
|
Haojun Liao
|
270a847809
|
fix(stream): fix bugs caused by refactor sm.
|
2023-10-20 10:23:48 +08:00 |
|
Benguang Zhao
|
959f8105ee
|
enh: require command to trigger repairing vnodes on replaced disks
|
2023-10-19 18:55:12 +08:00 |
|
Haojun Liao
|
d5059826a8
|
fix(stream): fix bugs caused by refactor.
|
2023-10-19 17:59:04 +08:00 |
|
Haojun Liao
|
c1cebae6ba
|
fix(stream): fix error in stream.
|
2023-10-19 16:20:27 +08:00 |
|
Haojun Liao
|
402aefd95d
|
refactor(stream): do some internal refactor.
|
2023-10-19 15:09:47 +08:00 |
|
Benguang Zhao
|
a2e0480839
|
refact: rename as SYNC_FSM_STATE_COMPLETE
|
2023-10-19 11:18:57 +08:00 |
|
Benguang Zhao
|
a515f8a94f
|
feat: use vnode config info if existing during vnodeCreate
|
2023-10-19 11:18:57 +08:00 |
|
Benguang Zhao
|
a95f6e6862
|
feat: support restore dnode with vnodes of replaced disks for primary dirs
|
2023-10-19 11:18:57 +08:00 |
|
Benguang Zhao
|
c4e9069a66
|
fix: set nextProcessedVer properly in tqProcessTaskScanHistory
|
2023-10-19 11:18:57 +08:00 |
|
Benguang Zhao
|
5c85525fd0
|
enh: add tsdbFSCreateRefSnapshotWithoutLock
|
2023-10-19 11:18:57 +08:00 |
|
Benguang Zhao
|
f2bd43c07e
|
fix: set field length properly in tsdbGetSnapDetails
|
2023-10-19 11:18:57 +08:00 |
|
Benguang Zhao
|
83013e0fe5
|
enh: return error in case of out of memory for tsdbGetSnapRangeHash
|
2023-10-19 11:18:57 +08:00 |
|
Benguang Zhao
|
59e8a2104c
|
refact: wrap funcs to handle snapshot info for vnodeSnapReaderOpen and vnodeSnapWriterOpen
|
2023-10-19 11:18:57 +08:00 |
|
Benguang Zhao
|
eb8c4d3e8c
|
enh: use hash table for filtering fset in tsdbSnapReaderOpen and tsdbSnapWriterOpen
|
2023-10-19 11:18:57 +08:00 |
|
Benguang Zhao
|
4e74533878
|
enh: avoid _Static_assert
|
2023-10-19 11:18:57 +08:00 |
|
Benguang Zhao
|
094cf408df
|
enh: prepare vnode dir again in vnodeOpen
|
2023-10-19 11:18:57 +08:00 |
|
Benguang Zhao
|
c1f1709d59
|
fix: add rsmaSnapWriterPrepareClose
|
2023-10-19 11:18:57 +08:00 |
|
Benguang Zhao
|
74185b8b9c
|
feat: exchange snapshot info for rsma tsdbs
|
2023-10-19 11:18:57 +08:00 |
|
Benguang Zhao
|
d5d713b1b4
|
enh: fill snapshot info for rsma tsdbs
|
2023-10-19 11:04:39 +08:00 |
|
Benguang Zhao
|
b80f8201ce
|
feat: detect fs incompleteness of RSMA tsdbs
|
2023-10-19 11:04:39 +08:00 |
|
Benguang Zhao
|
29bbebc323
|
enh: refactor a func name as tsdbSnapGetDetails
|
2023-10-19 11:04:39 +08:00 |
|
Benguang Zhao
|
00aeb031d4
|
enh: replicate a fset if it is corrupted without valid minVer
|
2023-10-19 11:04:39 +08:00 |
|
Benguang Zhao
|
a6d5deb5d1
|
fixup: fix tsdbFSDoSanAndFix
|
2023-10-19 11:04:39 +08:00 |
|
Benguang Zhao
|
eb4e2aa58f
|
feat: restore incomplete fsm state with maxVerValid via snapshot replication
|
2023-10-19 11:04:36 +08:00 |
|
Benguang Zhao
|
0c41fa56dc
|
feat: filter pExclude in tsdbFSCreateCopyRangedSnapshot
|
2023-10-19 11:00:44 +08:00 |
|
Benguang Zhao
|
e1c03118ab
|
enh: extract snapshot info for both of snap reader and writer
|
2023-10-19 10:51:13 +08:00 |
|
Benguang Zhao
|
410ced8320
|
feat: use TLV format to encode data of snapshot info
|
2023-10-19 10:51:13 +08:00 |
|
Benguang Zhao
|
f99795d027
|
enh: use tsdbSnapRangeArrayDestroy
|
2023-10-19 10:51:13 +08:00 |
|
Benguang Zhao
|
c1b2eedd3c
|
feat: impl tsdbSnapGetInfo
|
2023-10-19 10:51:08 +08:00 |
|
Benguang Zhao
|
4d55488495
|
feat: use SSnapshotParam as a parameter to vnodeSnapReaderOpen
|
2023-10-19 10:37:34 +08:00 |
|
Benguang Zhao
|
083dd148be
|
feat: exchange difference of snapshot info for replication
|
2023-10-19 10:37:34 +08:00 |
|
Benguang Zhao
|
b23bcee690
|
fixup: about to revert this commit
|
2023-10-19 10:37:34 +08:00 |
|
Benguang Zhao
|
0ddbcd50d0
|
enh: maintain independent version range of tombs for SDataFileWriter
|
2023-10-19 10:37:34 +08:00 |
|
Benguang Zhao
|
4540bcb170
|
fixup: work-around a compiler bug
|
2023-10-19 10:37:34 +08:00 |
|
Benguang Zhao
|
44a7f5df47
|
feat: add tsdbSnapDiff
|
2023-10-19 10:37:34 +08:00 |
|
Benguang Zhao
|
6ae9bd0e9a
|
feat: add tsdbFSToSnapRangeArray
|
2023-10-19 10:37:34 +08:00 |
|
Benguang Zhao
|
0a67cc8477
|
refact: use tsdbTFileUpdVerRange in tsdbSttFWriterCloseCommit
|
2023-10-19 10:37:34 +08:00 |
|
Benguang Zhao
|
54a10154a4
|
fixup: remove unused minVer and maxVer in ctx of SCommitter2
|
2023-10-19 10:37:34 +08:00 |
|
Benguang Zhao
|
6b753cc0cd
|
refact: remove unused code is_same_file
|
2023-10-19 10:37:34 +08:00 |
|
Benguang Zhao
|
dc402e21e3
|
fix: merge old version range of head and tomb files in tsdbDataFileWriterCloseCommit
|
2023-10-19 10:37:34 +08:00 |
|
Benguang Zhao
|
f8c6e8744a
|
refact: change field name of pExclude in SVSnapReader
|
2023-10-19 10:37:34 +08:00 |
|
Benguang Zhao
|
01d0c1247d
|
enh: record ver range in writer ctx
|
2023-10-19 10:37:34 +08:00 |
|
Benguang Zhao
|
f207b3ddd5
|
refact: rename func names of tsdbDataWriterUpdVerRange and tsdbSttWriterUpdVerRange
|
2023-10-19 10:37:34 +08:00 |
|
Benguang Zhao
|
399afe1094
|
refact: tidy up declarations of funcs in tsdbUpgrade.c
|
2023-10-19 10:37:25 +08:00 |
|
Haojun Liao
|
f4caeca24a
|
refactor(stream): add state machine to manage the state of stream tasks.
|
2023-10-19 10:34:20 +08:00 |
|
Benguang Zhao
|
ed6d7c4c4d
|
refact: relocate declarations and defs of tsdbFileWriteTombBlock and tsdbFileWriteTombBlk
|
2023-10-19 10:17:34 +08:00 |
|
Benguang Zhao
|
823aad4a5e
|
enh: record version range of STFile for data and stt files
|
2023-10-19 10:17:34 +08:00 |
|
Benguang Zhao
|
3cd458f5c9
|
enh: fill minVer and maxVer of nf in STFileObj during migration
|
2023-10-19 10:17:34 +08:00 |
|
Benguang Zhao
|
1446b44733
|
fixup: remove minVer and maxVer in FSetWriterConfig
|
2023-10-19 10:17:34 +08:00 |
|
Benguang Zhao
|
c8a46394f1
|
enh: set default values of minVer and maxVer while upgrading from CURRENT
|
2023-10-19 10:17:34 +08:00 |
|
Benguang Zhao
|
ab7a20c117
|
enh: write stt and data files with minVer and maxVer
|
2023-10-19 10:17:34 +08:00 |
|
Benguang Zhao
|
da28d490aa
|
enh: filterByVersion with snap ranges
|
2023-10-19 10:17:34 +08:00 |
|
Benguang Zhao
|
7a13e4b2cf
|
enh: add minVer and maxVer for entries in current.json
|
2023-10-19 10:17:34 +08:00 |
|
Benguang Zhao
|
1be2835fc1
|
enh: exclude a list of snap ranges in tsdbSnapReaderOpen
|
2023-10-19 10:17:34 +08:00 |
|
Benguang Zhao
|
573c28fd06
|
enh: iterate over a list of snap ranges for STsdbSnapReader
|
2023-10-19 10:17:28 +08:00 |
|
Minglei Jin
|
52c8bc91f9
|
cos/delete: fix delete object cond and double free
|
2023-10-18 18:21:45 +08:00 |
|
Haojun Liao
|
54ec679b58
|
refactor(stream): do some internal refactor.
|
2023-10-18 15:34:53 +08:00 |
|
Minglei Jin
|
f26ec41b8e
|
vnode/cos: fix get callback buffer
|
2023-10-18 15:30:02 +08:00 |
|
Haojun Liao
|
c6dd73b68b
|
Merge pull request #23187 from taosdata/feat/TD-26056
feat:add replay logic
|
2023-10-18 11:43:43 +08:00 |
|
yihaoDeng
|
e49b9b2276
|
fix transfer crash
|
2023-10-18 11:34:11 +08:00 |
|
Haojun Liao
|
df07443379
|
Merge pull request #23288 from taosdata/fix/liaohj
fix(stream):add more check for test cases.
|
2023-10-18 08:13:15 +08:00 |
|
yihaoDeng
|
d67fdb5e46
|
fix transfer crash
|
2023-10-17 21:08:31 +08:00 |
|
yihaoDeng
|
2004c1a346
|
fix transfer crash
|
2023-10-17 18:19:52 +08:00 |
|
Minglei Jin
|
11b65e2779
|
vnode/cos: make dependent lib public
|
2023-10-17 18:11:13 +08:00 |
|
Minglei Jin
|
dd21d8e3ad
|
cos/multipart: first round multipart uploading
|
2023-10-17 17:24:50 +08:00 |
|
Minglei Jin
|
8fa8c40391
|
cos/put: simple object putting(< 5 gigabytes)
|
2023-10-17 14:59:03 +08:00 |
|
yihaoDeng
|
b793c92fed
|
fix stream snap deadlock
|
2023-10-16 22:00:34 +08:00 |