Commit Graph

3257 Commits

Author SHA1 Message Date
Haojun Liao 7b1f586d4f
Merge pull request #23762 from taosdata/fix/3_liaohj
fix(stream): fix error in generating token in bucket.
2023-11-23 09:32:14 +08:00
Hongze Cheng 44866b7b12 fix: possible race condition coredump 2023-11-22 20:35:18 +08:00
dapan1121 1b6a3c2069
Merge pull request #23771 from taosdata/enh/xsren/TD-27022/windows
Enh/xsren/td 27022/windows
2023-11-22 10:58:39 +08:00
Haojun Liao 7a0dfdb0cc fix(tsdb): fix invalid read. 2023-11-22 08:40:10 +08:00
facetosea 845493294d osfile 2023-11-21 16:31:31 +08:00
Minglei Jin d12bc41236 tsdb/merge: clear file set before return 0 2023-11-20 14:30:25 +08:00
Minglei Jin 65a27dd9c8 fix(tsdb/cos-merge): skip stt merging & not block commit 2023-11-16 18:58:58 +08:00
dapan1121 9457cf0b46
Merge pull request #23702 from taosdata/merge/m23
merge: from main to 3.0
2023-11-15 13:54:21 +08:00
dapan1121 dfb3feb5dc Merge remote-tracking branch 'origin/main' into merge/m23 2023-11-15 11:39:18 +08:00
Minglei Jin 7f65e92b81 tsdb/retention: not allow migrate backward 2023-11-14 19:27:18 +08:00
Minglei Jin cb3fe4d6de fix(tsdb/merge): skip merge if data file cannot be written 2023-11-14 14:15:02 +08:00
Minglei Jin acd816a364 fix(tsdb/retention): move fset destruction out of for loop 2023-11-13 16:59:26 +08:00
Minglei Jin 32528ab9cd fix(tsdb/reader-writer): fix pgnoEnd calc 2023-11-10 12:44:09 +08:00
Hongze Cheng ec3685db94
Merge pull request #23600 from taosdata/fix/TD-27206
fix(vnode/cos): fix error printing to avoid buffer overflow
2023-11-09 06:06:54 -06:00
dapan1121 4f67629ea1
Merge pull request #23621 from taosdata/fix/TS-4122
correct colid in blockinfo
2023-11-09 18:09:09 +08:00
Minglei Jin d3cf6a4340 tsdb/file: new nlevel field for remove 2023-11-09 17:44:24 +08:00
Hongze Cheng b1fbdfcdc9
Merge pull request #23617 from taosdata/fix/little_typo
fix: code typo
2023-11-09 03:35:31 -06:00
wade zhang c0c665d785
Merge pull request #23614 from taosdata/FIX/TD-27230-3.0
fix: close vnode in the failed mode properly in vmCloseVnode
2023-11-09 16:32:20 +08:00
wangjiaming0909 a6600ab23a correct colid in blockinfo 2023-11-09 15:41:01 +08:00
Minglei Jin 386c25a99a tsdb/retention: remove file when ref's clear 2023-11-09 15:24:19 +08:00
dapan1121 8314cb6013
Merge pull request #23494 from taosdata/enh/TD-23769-3.0x
enh: checkpoint for rsma
2023-11-09 14:51:37 +08:00
Hongze Cheng e60f69a7ed fix: code typo 2023-11-09 14:20:27 +08:00
Minglei Jin 398771da5b Merge branch '3.0' into fix/TD-27206 2023-11-09 14:06:15 +08:00
Benguang Zhao b80770dea8 fix: close vnode in the failed mode properly in vmCloseVnode 2023-11-09 13:05:52 +08:00
Haojun Liao 257ab4f270
Merge pull request #23526 from taosdata/feat/TD-26060
feat:checkpoint backup function
2023-11-09 11:46:28 +08:00
kailixu 3495efaac7 enh: rsma exception process 2023-11-09 10:49:40 +08:00
Minglei Jin 1bb10bb862 vnode/cos: check get object block size optionally 2023-11-09 09:32:13 +08:00
kailixu 501d5a7acc Merge branch '3.0' into enh/TD-23769-3.0x 2023-11-08 20:47:15 +08:00
kailixu 72ecb0431c enh: rsma checkpoint 2023-11-08 20:45:44 +08:00
wangjiaming0909 3e850df3c2 fix: last(ts2), ts2, ts caused data err 2023-11-08 14:43:11 +08:00
wangjiaming0909 fc6c4fba90 feat: cache scan for select last(c), ts/c 2023-11-08 13:39:28 +08:00
yihaoDeng 7ada7f34ac fix:merge from 3.0 2023-11-08 10:45:15 +08:00
kailixu b9f389a49f Merge branch '3.0' into enh/TD-23769-3.0x 2023-11-08 08:36:35 +08:00
Haojun Liao 9ba854d49d Merge branch '3.0' into fix/3_liaohj 2023-11-07 23:51:07 +08:00
kailixu 6b738884a4 chore: rsma checkpoint 2023-11-07 19:59:05 +08:00
wangmm0220 c0068abc9a fix:merge from 3.0 2023-11-07 18:55:46 +08:00
kailixu dc5284a19c chore: add debug info 2023-11-06 17:27:36 +08:00
Minglei Jin ec908fa4d0 fix(cache/reader): use int64 max instead of uint 2023-11-06 15:34:28 +08:00
kailixu 411151d671 fix: buffer overflow/buffer use after free/memory leak 2023-11-04 08:44:26 +08:00
Haojun Liao d3ddaaa9f3 other(tsdb): adjust some log info. 2023-11-03 15:08:25 +08:00
Haojun Liao de5c4d8d5d other(tsdb): adjust some log info. 2023-11-03 15:07:40 +08:00
Haojun Liao 34403534ed Merge branch '3.0' into fix/3_liaohj 2023-11-03 14:06:58 +08:00
Haojun Liao b4d14d3847 fix(tsdb): fix error during add on-demand opening stt file reader. 2023-11-03 13:51:18 +08:00
Haojun Liao 675c9ca613 enh(tsdb): on-demand open stt file reader. 2023-11-03 13:51:18 +08:00
wangmm0220 0a1f1085fc Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26060 2023-11-03 11:33:50 +08:00
Haojun Liao c980e2030c fix(tsdb): fix error during add on-demand opening stt file reader. 2023-11-03 11:04:32 +08:00
Haojun Liao 0acf4f1795 enh(tsdb): on-demand open stt file reader. 2023-11-03 10:35:05 +08:00
Hongze Cheng 1ff3f96b08
Merge pull request #23465 from taosdata/fix/TD-26189-last-tier-write
enh(tsdb/retention): enable last tier write
2023-11-02 21:21:38 -05:00
wangmm0220 159873692c feat:checkpoint bakeup using rsync 2023-11-02 20:13:29 +08:00
Hongze Cheng faea18c38f fix: invalid read when file is deleted 2023-11-02 16:59:11 +08:00
Minglei Jin 46d3be1f08 config/page-cache-size: new parameter for pcache size 2023-11-02 10:10:03 +08:00
Minglei Jin d0327e07b8 tsdb/pg-cache: use pgno for cache key instead of blkno 2023-11-02 09:42:19 +08:00
Hongze Cheng a6ee7c4685 fix: possible coredump 2023-11-01 20:34:47 +08:00
Minglei Jin 6f0fa5d47e tsdb/retention: remove incorrect right brace 2023-11-01 14:56:57 +08:00
Minglei Jin 64644d673b
Merge branch '3.0' into fix/TD-26189-last-tier-write 2023-11-01 10:53:55 +08:00
Minglei Jin a61502411d tsdb/pg-cache: new page cache for tsdb s3 read file page 2023-11-01 10:49:05 +08:00
Haojun Liao a1aa2380ae other: merge 3.0 2023-10-31 16:42:51 +08:00
Hongze Cheng ac3df85d8a Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26684 2023-10-31 11:23:23 +08:00
Haojun Liao fc70fa053c fix(tsdb): fix syntax error. 2023-10-31 10:45:14 +08:00
Haojun Liao 6a7ba0f5f5 fix(tsdb): handle the case where stt not exists, possibly exists while the stt-trigger is 1. 2023-10-31 10:45:14 +08:00
Haojun Liao 00626de6e4 fix(tsdb): fix error in decide if data buffer overlaps with stt files/block-files. 2023-10-31 10:45:13 +08:00
Haojun Liao cb43299faa fix(tsdb): avoid to read duplicated rows in buf. 2023-10-31 10:45:13 +08:00
Haojun Liao 8b9bc988f1 fix(tsdb): fix syntax error. 2023-10-31 10:42:34 +08:00
Haojun Liao eaf76854f6 fix(tsdb): handle the case where stt not exists, possibly exists while the stt-trigger is 1. 2023-10-31 09:29:24 +08:00
Minglei Jin 867ce92dcc tsdb/file-rw: fix log msg 2023-10-30 19:28:18 +08:00
Minglei Jin 800cbfbb05 tsdb/file: new s3flag in mem 2023-10-30 17:36:49 +08:00
Haojun Liao ed07486405 fix(tsdb): fix error in decide if data buffer overlaps with stt files/block-files. 2023-10-30 16:40:09 +08:00
Haojun Liao bc1c2a879a fix(tsdb): avoid to read duplicated rows in buf. 2023-10-30 16:12:08 +08:00
Minglei Jin 84d2f9c379 tsdb/upload: delay data file uploading 2023-10-30 15:22:34 +08:00
dapan1121 1b7a6bccdf
Merge pull request #23430 from taosdata/enh/TD-26641-3.0
enh: only float/double allowed for sum/avg of rsma
2023-10-30 10:08:55 +08:00
Minglei Jin 4fede02da4 tsdb/retention: remove s3 evict cache hook 2023-10-30 10:06:42 +08:00
Hongze Cheng a7f3041ff3 more fix 2023-10-27 17:59:27 +08:00
Hongze Cheng cdb1d8296d feat: concurrency on fileset 2023-10-27 17:48:19 +08:00
Minglei Jin 8c6f452f09 tsdb/write: make last tier writable to mem 2023-10-27 15:51:52 +08:00
Minglei Jin b314758108 tsdb/commit: make ts big enough to skip row 2023-10-26 16:24:06 +08:00
kailixu 64765579e9 enh: check interval and keep for retentions 2023-10-25 22:42:01 +08:00
Hongze Cheng e7e7748e6d
Merge pull request #23366 from taosdata/fix/TD-26669
tsdb/commit: skip last tier ts data committing
2023-10-24 01:29:01 -05:00
Minglei Jin 12aa399ae7 Merge branch '3.0' into fix/TD-26669 2023-10-23 18:19:39 +08:00
Minglei Jin f630fc38f8 tsdb/commit: skip last tier ts data committing 2023-10-23 15:46:32 +08:00
Haojun Liao 6dc8fc50bc
Merge pull request #23359 from taosdata/fix/3_liaohj
fix(tsdb): apply the window range when building blocks from stt files.
2023-10-21 14:57:14 +08:00
Haojun Liao f667bf3866 fix(tsdb): apply the window range when building blocks from stt files. 2023-10-20 18:19:45 +08:00
Haojun Liao f1207d8d42 fix(tsdb): apply the window range when building blocks from stt files. 2023-10-20 18:18:58 +08:00
Benguang Zhao 959f8105ee enh: require command to trigger repairing vnodes on replaced disks 2023-10-19 18:55:12 +08:00
Benguang Zhao 5c85525fd0 enh: add tsdbFSCreateRefSnapshotWithoutLock 2023-10-19 11:18:57 +08:00
Benguang Zhao f2bd43c07e fix: set field length properly in tsdbGetSnapDetails 2023-10-19 11:18:57 +08:00
Benguang Zhao 83013e0fe5 enh: return error in case of out of memory for tsdbGetSnapRangeHash 2023-10-19 11:18:57 +08:00
Benguang Zhao eb8c4d3e8c enh: use hash table for filtering fset in tsdbSnapReaderOpen and tsdbSnapWriterOpen 2023-10-19 11:18:57 +08:00
Benguang Zhao d5d713b1b4 enh: fill snapshot info for rsma tsdbs 2023-10-19 11:04:39 +08:00
Benguang Zhao b80f8201ce feat: detect fs incompleteness of RSMA tsdbs 2023-10-19 11:04:39 +08:00
Benguang Zhao 29bbebc323 enh: refactor a func name as tsdbSnapGetDetails 2023-10-19 11:04:39 +08:00
Benguang Zhao 00aeb031d4 enh: replicate a fset if it is corrupted without valid minVer 2023-10-19 11:04:39 +08:00
Benguang Zhao a6d5deb5d1 fixup: fix tsdbFSDoSanAndFix 2023-10-19 11:04:39 +08:00
Benguang Zhao eb4e2aa58f feat: restore incomplete fsm state with maxVerValid via snapshot replication 2023-10-19 11:04:36 +08:00
Benguang Zhao 0c41fa56dc feat: filter pExclude in tsdbFSCreateCopyRangedSnapshot 2023-10-19 11:00:44 +08:00
Benguang Zhao 410ced8320 feat: use TLV format to encode data of snapshot info 2023-10-19 10:51:13 +08:00
Benguang Zhao f99795d027 enh: use tsdbSnapRangeArrayDestroy 2023-10-19 10:51:13 +08:00
Benguang Zhao c1b2eedd3c feat: impl tsdbSnapGetInfo 2023-10-19 10:51:08 +08:00
Benguang Zhao 4d55488495 feat: use SSnapshotParam as a parameter to vnodeSnapReaderOpen 2023-10-19 10:37:34 +08:00
Benguang Zhao b23bcee690 fixup: about to revert this commit 2023-10-19 10:37:34 +08:00
Benguang Zhao 0ddbcd50d0 enh: maintain independent version range of tombs for SDataFileWriter 2023-10-19 10:37:34 +08:00