Haojun Liao
|
b4d14d3847
|
fix(tsdb): fix error during add on-demand opening stt file reader.
|
2023-11-03 13:51:18 +08:00 |
|
Haojun Liao
|
675c9ca613
|
enh(tsdb): on-demand open stt file reader.
|
2023-11-03 13:51:18 +08:00 |
wangmm0220
|
0a1f1085fc
|
Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26060
|
2023-11-03 11:33:50 +08:00 |
Hongze Cheng
|
1ff3f96b08
|
Merge pull request #23465 from taosdata/fix/TD-26189-last-tier-write
enh(tsdb/retention): enable last tier write
|
2023-11-02 21:21:38 -05:00 |
Haojun Liao
|
ff5d69352f
|
Merge pull request #23493 from taosdata/fix/3_liaohj
fix(stream): add unsupport trans.
|
2023-11-03 09:07:33 +08:00 |
kailixu
|
d9ed63473c
|
Merge branch '3.0' into enh/TD-23769-3.0x
|
2023-11-03 08:37:41 +08:00 |
|
kailixu
|
6c944bb192
|
enh: skip rsma_task during load stream tasks
|
2023-11-02 20:32:54 +08:00 |
|
wangmm0220
|
159873692c
|
feat:checkpoint bakeup using rsync
|
2023-11-02 20:13:29 +08:00 |
|
Haojun Liao
|
7a32b3a209
|
fix(stream): not transfer state if state is not appropriate.
|
2023-11-02 19:12:36 +08:00 |
|
kailixu
|
fa5d896787
|
enh: rsma checkpoint
|
2023-11-02 18:56:36 +08:00 |
|
Haojun Liao
|
c4079332ff
|
fix(stream):update the log level.
|
2023-11-02 18:18:04 +08:00 |
|
Haojun Liao
|
0a227e807f
|
refactor: set different tq level.
|
2023-11-02 18:18:04 +08:00 |
|
Hongze Cheng
|
faea18c38f
|
fix: invalid read when file is deleted
|
2023-11-02 16:59:11 +08:00 |
|
kailixu
|
2d597659bc
|
enh: rsma checkpoint
|
2023-11-02 15:20:54 +08:00 |
|
kailixu
|
722777f8c9
|
enh: rsma checkpoint
|
2023-11-02 13:15:31 +08:00 |
|
kailixu
|
96b5024347
|
enh: rsma checkpoint
|
2023-11-02 13:05:36 +08:00 |
|
kailixu
|
698fb804f9
|
enh: disable update tbUidList during reboot
|
2023-11-02 12:54:23 +08:00 |
|
kailixu
|
76536e1c82
|
enh: rsma logic
|
2023-11-02 11:03:18 +08:00 |
|
Haojun Liao
|
95efa07e92
|
fix(stream): add full unsupported event filtering.
|
2023-11-02 11:02:39 +08:00 |
Minglei Jin
|
46d3be1f08
|
config/page-cache-size: new parameter for pcache size
|
2023-11-02 10:10:03 +08:00 |
|
kailixu
|
9649e87cab
|
fix: rsma checkpoint
|
2023-11-02 09:44:43 +08:00 |
|
Minglei Jin
|
d0327e07b8
|
tsdb/pg-cache: use pgno for cache key instead of blkno
|
2023-11-02 09:42:19 +08:00 |
|
Hongze Cheng
|
a6ee7c4685
|
fix: possible coredump
|
2023-11-01 20:34:47 +08:00 |
|
kailixu
|
3803f952f9
|
chore: rsma checkpoint verify
|
2023-11-01 20:05:00 +08:00 |
|
Haojun Liao
|
7cf90dde5c
|
refactor: do some internal refactor.
|
2023-11-01 19:38:13 +08:00 |
|
Haojun Liao
|
00f029e44f
|
refactor: add some logs.
|
2023-11-01 19:38:12 +08:00 |
|
Haojun Liao
|
9a9c1d689d
|
fix(stream): add lock log.
|
2023-11-01 19:38:12 +08:00 |
|
kailixu
|
c32e60d199
|
chore: more code for rsma checkpoint
|
2023-11-01 16:27:41 +08:00 |
|
kailixu
|
59be62c96e
|
chore: set stream input checkpoint
|
2023-11-01 15:34:17 +08:00 |
|
Minglei Jin
|
6f0fa5d47e
|
tsdb/retention: remove incorrect right brace
|
2023-11-01 14:56:57 +08:00 |
|
kailixu
|
ab266c712f
|
chore: checkpoint for rsma stream state
|
2023-11-01 12:29:54 +08:00 |
|
Haojun Liao
|
3e6c89d8eb
|
fix(stream): add unsupport trans.
|
2023-11-01 11:43:02 +08:00 |
|
Minglei Jin
|
221afff9ee
|
vnode/write: remove keep modify code block
|
2023-11-01 11:00:47 +08:00 |
Minglei Jin
|
64644d673b
|
Merge branch '3.0' into fix/TD-26189-last-tier-write
|
2023-11-01 10:53:55 +08:00 |
|
Minglei Jin
|
a61502411d
|
tsdb/pg-cache: new page cache for tsdb s3 read file page
|
2023-11-01 10:49:05 +08:00 |
|
kailixu
|
1530fe0c49
|
Merge branch '3.0' into enh/TD-23769-3.0x
|
2023-11-01 09:52:16 +08:00 |
|
kailixu
|
ad1e6accd4
|
chore: build checkpoint for rsma
|
2023-11-01 09:45:58 +08:00 |
|
Haojun Liao
|
7359f98eca
|
Merge pull request #23428 from taosdata/fix/3_liaohj
other: merge refactor into 3.0
|
2023-11-01 09:44:31 +08:00 |
|
kailixu
|
e6684fa5de
|
enh: rsma retetion and stream state
|
2023-10-31 20:26:42 +08:00 |
dapan1121
|
d40cc27abc
|
Merge pull request #23464 from taosdata/enh/TD-26638-3.0
enh: use placeholder '-' for interval of 1st retention level
|
2023-10-31 18:36:43 +08:00 |
|
Haojun Liao
|
a1aa2380ae
|
other: merge 3.0
|
2023-10-31 16:42:51 +08:00 |
|
Haojun Liao
|
0b18192b23
|
fix(stream): fix error in finishing event handling.
|
2023-10-31 16:40:16 +08:00 |
wade zhang
|
76c9b9afc5
|
Merge pull request #23377 from taosdata/FIX/TD-26596-3.0
feat: support pipelining of snap replication
|
2023-10-31 15:19:07 +08:00 |
|
wade zhang
|
25b09b467f
|
Merge pull request #23439 from taosdata/feat/TD-26971-3.0
TD-26971
|
2023-10-31 13:53:49 +08:00 |
|
kailixu
|
28cd8f4915
|
enh: file duration for rsma
|
2023-10-31 11:38:33 +08:00 |
|
Hongze Cheng
|
ac3df85d8a
|
Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26684
|
2023-10-31 11:23:23 +08:00 |
|
Haojun Liao
|
fc70fa053c
|
fix(tsdb): fix syntax error.
|
2023-10-31 10:45:14 +08:00 |
|
Haojun Liao
|
6a7ba0f5f5
|
fix(tsdb): handle the case where stt not exists, possibly exists while the stt-trigger is 1.
|
2023-10-31 10:45:14 +08:00 |
|
Haojun Liao
|
00626de6e4
|
fix(tsdb): fix error in decide if data buffer overlaps with stt files/block-files.
|
2023-10-31 10:45:13 +08:00 |
|
Haojun Liao
|
cb43299faa
|
fix(tsdb): avoid to read duplicated rows in buf.
|
2023-10-31 10:45:13 +08:00 |
|
Haojun Liao
|
635243f01a
|
refactor: do some internal refactor.
|
2023-10-31 10:45:12 +08:00 |
|
Haojun Liao
|
6e2240a3d1
|
fix(stream): fix the deadlock.
|
2023-10-31 10:45:12 +08:00 |
|
Haojun Liao
|
0c982093cd
|
fix(stream): enable the set of fill-history task to be un-init.
|
2023-10-31 10:45:12 +08:00 |
|
kailixu
|
b03baaed2c
|
chore: revert the code change
|
2023-10-30 19:49:50 +08:00 |
|
kailixu
|
89651626e3
|
chore: reopen rsma stream commit
|
2023-10-30 19:45:18 +08:00 |
dmchen
|
fe044051c8
|
memory leak
|
2023-10-30 19:36:27 +08:00 |
|
Minglei Jin
|
867ce92dcc
|
tsdb/file-rw: fix log msg
|
2023-10-30 19:28:18 +08:00 |
|
Minglei Jin
|
800cbfbb05
|
tsdb/file: new s3flag in mem
|
2023-10-30 17:36:49 +08:00 |
|
Haojun Liao
|
6e118c7963
|
fix(stream): fix memory leak.
|
2023-10-30 17:28:57 +08:00 |
|
dmchen
|
0f40e1dbb9
|
memory leak
|
2023-10-30 16:59:12 +08:00 |
|
dmchen
|
be0a85a0ff
|
memory leak
|
2023-10-30 15:22:54 +08:00 |
|
Minglei Jin
|
84d2f9c379
|
tsdb/upload: delay data file uploading
|
2023-10-30 15:22:34 +08:00 |
|
kailixu
|
c77153cb81
|
enh: use placeholder '-' for interval of 1st retention level
|
2023-10-30 14:02:31 +08:00 |
|
Haojun Liao
|
15d217fc3e
|
fix(stream): fix memory leak.
|
2023-10-30 13:29:35 +08:00 |
|
Haojun Liao
|
b0700d6095
|
Merge branch '3.0' into fix/3_liaohj
|
2023-10-30 11:57:54 +08:00 |
|
dapan1121
|
1b7a6bccdf
|
Merge pull request #23430 from taosdata/enh/TD-26641-3.0
enh: only float/double allowed for sum/avg of rsma
|
2023-10-30 10:08:55 +08:00 |
|
Minglei Jin
|
4fede02da4
|
tsdb/retention: remove s3 evict cache hook
|
2023-10-30 10:06:42 +08:00 |
|
Haojun Liao
|
c7285c0ede
|
fix(stream): add expired epset node list for stream tasks in hb to mnode.
|
2023-10-27 23:41:57 +08:00 |
|
Hongze Cheng
|
a7f3041ff3
|
more fix
|
2023-10-27 17:59:27 +08:00 |
Benguang Zhao
|
4163a3be7c
|
feat: resend snap replication of data on timeout
|
2023-10-27 17:58:26 +08:00 |
|
Hongze Cheng
|
cdb1d8296d
|
feat: concurrency on fileset
|
2023-10-27 17:48:19 +08:00 |
|
dmchen
|
43e6dec6c2
|
TD-26971
|
2023-10-27 17:39:50 +08:00 |
|
Minglei Jin
|
8c6f452f09
|
tsdb/write: make last tier writable to mem
|
2023-10-27 15:51:52 +08:00 |
|
Haojun Liao
|
dcca6b0868
|
other: merge 3.0.
|
2023-10-27 11:41:28 +08:00 |
|
Haojun Liao
|
9c9d02b181
|
fix(stream): disable follower nodes exec reset.
|
2023-10-27 09:59:52 +08:00 |
|
Haojun Liao
|
454624516c
|
fix(stream): handle the repeatly issued nodeUpdate msg from dnode.
|
2023-10-27 09:59:51 +08:00 |
|
Haojun Liao
|
33dc51cc86
|
fix(stream): add some logs.
|
2023-10-27 09:59:44 +08:00 |
|
Haojun Liao
|
1ccbb77981
|
fix(stream): fix dead lock when shutdown all tasks.
|
2023-10-27 09:59:37 +08:00 |
|
Haojun Liao
|
2493c21ed3
|
fix(stream): fix the invalid write in sma
|
2023-10-27 09:58:52 +08:00 |
|
Haojun Liao
|
7cce53f7e5
|
fix(stream): ignore the check status when is ready.
|
2023-10-27 09:58:52 +08:00 |
|
Haojun Liao
|
c99f434706
|
fix(stream): set checkpoint failure when in pause status.
|
2023-10-27 09:58:52 +08:00 |
|
Haojun Liao
|
2c1af8dad8
|
refactor: do some internal refactor.
|
2023-10-27 09:58:52 +08:00 |
|
Haojun Liao
|
1ad2c3029a
|
refactor(stream): do some internal refactor.
|
2023-10-27 09:58:52 +08:00 |
|
Haojun Liao
|
7311f9d2fe
|
fix(sma): fix bugs in sma and do some internal refactor.
|
2023-10-27 09:58:51 +08:00 |
|
Haojun Liao
|
3bcffcf1da
|
other: merge stream refactor from main.
|
2023-10-27 09:56:02 +08:00 |
|
Haojun Liao
|
226b6596d6
|
fix(stream): fix bugs caused by refactor.
|
2023-10-27 09:54:58 +08:00 |
|
Haojun Liao
|
091238e7be
|
fix(stream): fix bugs caused by refactor sm.
|
2023-10-27 09:54:58 +08:00 |
|
Haojun Liao
|
e1f6043eed
|
fix(stream): fix bugs caused by refactor sm.
|
2023-10-27 09:54:57 +08:00 |
|
Haojun Liao
|
8729bdac1e
|
fix(stream): fix bugs caused by refactor.
|
2023-10-27 09:54:57 +08:00 |
|
Haojun Liao
|
1eac7f44c0
|
fix(stream): fix error in stream.
|
2023-10-27 09:54:56 +08:00 |
|
Haojun Liao
|
579dd8e6b2
|
refactor(stream): do some internal refactor.
|
2023-10-27 09:54:56 +08:00 |
|
Haojun Liao
|
6f3c0d17cc
|
refactor(stream): add state machine to manage the state of stream tasks.
|
2023-10-27 09:54:49 +08:00 |
|
Haojun Liao
|
596eb073b7
|
refactor(stream): do some internal refactor.
|
2023-10-27 09:54:48 +08:00 |
|
Haojun Liao
|
62c58ecd8b
|
fix(stream):add more check for test cases.
|
2023-10-27 09:54:06 +08:00 |
|
Hongze Cheng
|
b8c379a20d
|
Merge pull request #23413 from taosdata/fix/TD-26669
fix(tsdb/commmit): make ts big enough to skip row
|
2023-10-26 07:17:53 -05:00 |
|
wade zhang
|
d1e4e909c3
|
Merge pull request #23384 from taosdata/fix/TD-26884-3.0
Fix/td 26884 3.0
|
2023-10-26 17:00:00 +08:00 |
|
Minglei Jin
|
b314758108
|
tsdb/commit: make ts big enough to skip row
|
2023-10-26 16:24:06 +08:00 |
|
kailixu
|
bb77015998
|
Merge branch '3.0' into enh/TD-26641-3.0
|
2023-10-26 10:40:54 +08:00 |
|
Hongze Cheng
|
209ebbde84
|
Merge pull request #23402 from taosdata/fix/TD-26189-libs3
cmake/xml2: use sha256 to verify distribution release
|
2023-10-25 20:27:29 -05:00 |
|
kailixu
|
64765579e9
|
enh: check interval and keep for retentions
|
2023-10-25 22:42:01 +08:00 |
|
Minglei Jin
|
d77ecbbb1b
|
cmake/xml2: use sha256 to verify distribution release
|
2023-10-25 17:41:55 +08:00 |
|
dmchen
|
14be9c81e2
|
create table user and clusterid
|
2023-10-25 14:53:06 +08:00 |
|
Hongze Cheng
|
3ff331b8b7
|
Merge pull request #23391 from taosdata/fix/TD-26189-libs3
cmake: new option: BUILD_S3
|
2023-10-24 22:37:20 -05:00 |
|
Minglei Jin
|
f9ca8fe962
|
cmake: new option: BUILD_S3
|
2023-10-24 16:10:46 +08:00 |
|
dmchen
|
162066235b
|
create table
|
2023-10-24 14:31:27 +08:00 |
|
Hongze Cheng
|
e7e7748e6d
|
Merge pull request #23366 from taosdata/fix/TD-26669
tsdb/commit: skip last tier ts data committing
|
2023-10-24 01:29:01 -05:00 |
|
Minglei Jin
|
e826532592
|
cmake/vnode: specify no default path for ssl & crypto
|
2023-10-24 10:10:43 +08:00 |
|
Minglei Jin
|
7fdf6cc696
|
cmake: use new dir for libs3
|
2023-10-24 09:04:24 +08:00 |
|
Minglei Jin
|
80fb38f172
|
Merge branch '3.0' into fix/TD-26189-libs3
|
2023-10-23 16:31:21 +08:00 |
|
Minglei Jin
|
f630fc38f8
|
tsdb/commit: skip last tier ts data committing
|
2023-10-23 15:46:32 +08:00 |
|
Haojun Liao
|
6dc8fc50bc
|
Merge pull request #23359 from taosdata/fix/3_liaohj
fix(tsdb): apply the window range when building blocks from stt files.
|
2023-10-21 14:57:14 +08:00 |
|
Haojun Liao
|
f667bf3866
|
fix(tsdb): apply the window range when building blocks from stt files.
|
2023-10-20 18:19:45 +08:00 |
|
Minglei Jin
|
55647f9ce9
|
cos/put: make chunk small to not block other reqs
|
2023-10-20 15:15:03 +08:00 |
|
Minglei Jin
|
74d05c2771
|
vnode/cos: fix multipart uploading
|
2023-10-20 13:47:25 +08:00 |
|
Benguang Zhao
|
959f8105ee
|
enh: require command to trigger repairing vnodes on replaced disks
|
2023-10-19 18:55:12 +08:00 |
|
Benguang Zhao
|
a2e0480839
|
refact: rename as SYNC_FSM_STATE_COMPLETE
|
2023-10-19 11:18:57 +08:00 |
|
Benguang Zhao
|
a515f8a94f
|
feat: use vnode config info if existing during vnodeCreate
|
2023-10-19 11:18:57 +08:00 |
|
Benguang Zhao
|
a95f6e6862
|
feat: support restore dnode with vnodes of replaced disks for primary dirs
|
2023-10-19 11:18:57 +08:00 |
|
Benguang Zhao
|
c4e9069a66
|
fix: set nextProcessedVer properly in tqProcessTaskScanHistory
|
2023-10-19 11:18:57 +08:00 |
|
Benguang Zhao
|
5c85525fd0
|
enh: add tsdbFSCreateRefSnapshotWithoutLock
|
2023-10-19 11:18:57 +08:00 |
|
Benguang Zhao
|
f2bd43c07e
|
fix: set field length properly in tsdbGetSnapDetails
|
2023-10-19 11:18:57 +08:00 |
|
Benguang Zhao
|
83013e0fe5
|
enh: return error in case of out of memory for tsdbGetSnapRangeHash
|
2023-10-19 11:18:57 +08:00 |
|
Benguang Zhao
|
59e8a2104c
|
refact: wrap funcs to handle snapshot info for vnodeSnapReaderOpen and vnodeSnapWriterOpen
|
2023-10-19 11:18:57 +08:00 |
|
Benguang Zhao
|
eb8c4d3e8c
|
enh: use hash table for filtering fset in tsdbSnapReaderOpen and tsdbSnapWriterOpen
|
2023-10-19 11:18:57 +08:00 |
|
Benguang Zhao
|
4e74533878
|
enh: avoid _Static_assert
|
2023-10-19 11:18:57 +08:00 |
|
Benguang Zhao
|
094cf408df
|
enh: prepare vnode dir again in vnodeOpen
|
2023-10-19 11:18:57 +08:00 |
|
Benguang Zhao
|
c1f1709d59
|
fix: add rsmaSnapWriterPrepareClose
|
2023-10-19 11:18:57 +08:00 |
|
Benguang Zhao
|
74185b8b9c
|
feat: exchange snapshot info for rsma tsdbs
|
2023-10-19 11:18:57 +08:00 |
|
Benguang Zhao
|
d5d713b1b4
|
enh: fill snapshot info for rsma tsdbs
|
2023-10-19 11:04:39 +08:00 |
|
Benguang Zhao
|
b80f8201ce
|
feat: detect fs incompleteness of RSMA tsdbs
|
2023-10-19 11:04:39 +08:00 |
|
Benguang Zhao
|
29bbebc323
|
enh: refactor a func name as tsdbSnapGetDetails
|
2023-10-19 11:04:39 +08:00 |
|
Benguang Zhao
|
00aeb031d4
|
enh: replicate a fset if it is corrupted without valid minVer
|
2023-10-19 11:04:39 +08:00 |
|
Benguang Zhao
|
a6d5deb5d1
|
fixup: fix tsdbFSDoSanAndFix
|
2023-10-19 11:04:39 +08:00 |
|
Benguang Zhao
|
eb4e2aa58f
|
feat: restore incomplete fsm state with maxVerValid via snapshot replication
|
2023-10-19 11:04:36 +08:00 |
|
Benguang Zhao
|
0c41fa56dc
|
feat: filter pExclude in tsdbFSCreateCopyRangedSnapshot
|
2023-10-19 11:00:44 +08:00 |
|
Benguang Zhao
|
e1c03118ab
|
enh: extract snapshot info for both of snap reader and writer
|
2023-10-19 10:51:13 +08:00 |
|
Benguang Zhao
|
410ced8320
|
feat: use TLV format to encode data of snapshot info
|
2023-10-19 10:51:13 +08:00 |
|
Benguang Zhao
|
f99795d027
|
enh: use tsdbSnapRangeArrayDestroy
|
2023-10-19 10:51:13 +08:00 |
|
Benguang Zhao
|
c1b2eedd3c
|
feat: impl tsdbSnapGetInfo
|
2023-10-19 10:51:08 +08:00 |
|
Benguang Zhao
|
4d55488495
|
feat: use SSnapshotParam as a parameter to vnodeSnapReaderOpen
|
2023-10-19 10:37:34 +08:00 |
|
Benguang Zhao
|
083dd148be
|
feat: exchange difference of snapshot info for replication
|
2023-10-19 10:37:34 +08:00 |
|
Benguang Zhao
|
b23bcee690
|
fixup: about to revert this commit
|
2023-10-19 10:37:34 +08:00 |
|
Benguang Zhao
|
0ddbcd50d0
|
enh: maintain independent version range of tombs for SDataFileWriter
|
2023-10-19 10:37:34 +08:00 |
|
Benguang Zhao
|
4540bcb170
|
fixup: work-around a compiler bug
|
2023-10-19 10:37:34 +08:00 |
|
Benguang Zhao
|
44a7f5df47
|
feat: add tsdbSnapDiff
|
2023-10-19 10:37:34 +08:00 |
|
Benguang Zhao
|
6ae9bd0e9a
|
feat: add tsdbFSToSnapRangeArray
|
2023-10-19 10:37:34 +08:00 |
|
Benguang Zhao
|
0a67cc8477
|
refact: use tsdbTFileUpdVerRange in tsdbSttFWriterCloseCommit
|
2023-10-19 10:37:34 +08:00 |
|
Benguang Zhao
|
54a10154a4
|
fixup: remove unused minVer and maxVer in ctx of SCommitter2
|
2023-10-19 10:37:34 +08:00 |
|
Benguang Zhao
|
6b753cc0cd
|
refact: remove unused code is_same_file
|
2023-10-19 10:37:34 +08:00 |
|
Benguang Zhao
|
dc402e21e3
|
fix: merge old version range of head and tomb files in tsdbDataFileWriterCloseCommit
|
2023-10-19 10:37:34 +08:00 |