Commit Graph

12161 Commits

Author SHA1 Message Date
Benguang Zhao a95f6e6862 feat: support restore dnode with vnodes of replaced disks for primary dirs 2023-10-19 11:18:57 +08:00
Benguang Zhao c4e9069a66 fix: set nextProcessedVer properly in tqProcessTaskScanHistory 2023-10-19 11:18:57 +08:00
Benguang Zhao 5c85525fd0 enh: add tsdbFSCreateRefSnapshotWithoutLock 2023-10-19 11:18:57 +08:00
Benguang Zhao f2bd43c07e fix: set field length properly in tsdbGetSnapDetails 2023-10-19 11:18:57 +08:00
Benguang Zhao 83013e0fe5 enh: return error in case of out of memory for tsdbGetSnapRangeHash 2023-10-19 11:18:57 +08:00
Benguang Zhao 59e8a2104c refact: wrap funcs to handle snapshot info for vnodeSnapReaderOpen and vnodeSnapWriterOpen 2023-10-19 11:18:57 +08:00
Benguang Zhao eb8c4d3e8c enh: use hash table for filtering fset in tsdbSnapReaderOpen and tsdbSnapWriterOpen 2023-10-19 11:18:57 +08:00
Benguang Zhao 4e74533878 enh: avoid _Static_assert 2023-10-19 11:18:57 +08:00
Benguang Zhao 094cf408df enh: prepare vnode dir again in vnodeOpen 2023-10-19 11:18:57 +08:00
Benguang Zhao c1f1709d59 fix: add rsmaSnapWriterPrepareClose 2023-10-19 11:18:57 +08:00
Benguang Zhao 74185b8b9c feat: exchange snapshot info for rsma tsdbs 2023-10-19 11:18:57 +08:00
Benguang Zhao d5d713b1b4 enh: fill snapshot info for rsma tsdbs 2023-10-19 11:04:39 +08:00
Benguang Zhao b80f8201ce feat: detect fs incompleteness of RSMA tsdbs 2023-10-19 11:04:39 +08:00
Benguang Zhao 29bbebc323 enh: refactor a func name as tsdbSnapGetDetails 2023-10-19 11:04:39 +08:00
Benguang Zhao 00aeb031d4 enh: replicate a fset if it is corrupted without valid minVer 2023-10-19 11:04:39 +08:00
Benguang Zhao a6d5deb5d1 fixup: fix tsdbFSDoSanAndFix 2023-10-19 11:04:39 +08:00
Benguang Zhao eb4e2aa58f feat: restore incomplete fsm state with maxVerValid via snapshot replication 2023-10-19 11:04:36 +08:00
Benguang Zhao 0c41fa56dc feat: filter pExclude in tsdbFSCreateCopyRangedSnapshot 2023-10-19 11:00:44 +08:00
Benguang Zhao e1c03118ab enh: extract snapshot info for both of snap reader and writer 2023-10-19 10:51:13 +08:00
Benguang Zhao 410ced8320 feat: use TLV format to encode data of snapshot info 2023-10-19 10:51:13 +08:00
Benguang Zhao f99795d027 enh: use tsdbSnapRangeArrayDestroy 2023-10-19 10:51:13 +08:00
Benguang Zhao c1b2eedd3c feat: impl tsdbSnapGetInfo 2023-10-19 10:51:08 +08:00
yihaoDeng b9b62a9a00 add rpc sync read timeout 2023-10-19 10:38:45 +08:00
Benguang Zhao 4d55488495 feat: use SSnapshotParam as a parameter to vnodeSnapReaderOpen 2023-10-19 10:37:34 +08:00
Benguang Zhao 083dd148be feat: exchange difference of snapshot info for replication 2023-10-19 10:37:34 +08:00
Benguang Zhao b23bcee690 fixup: about to revert this commit 2023-10-19 10:37:34 +08:00
Benguang Zhao 0ddbcd50d0 enh: maintain independent version range of tombs for SDataFileWriter 2023-10-19 10:37:34 +08:00
Benguang Zhao 4540bcb170 fixup: work-around a compiler bug 2023-10-19 10:37:34 +08:00
Benguang Zhao 44a7f5df47 feat: add tsdbSnapDiff 2023-10-19 10:37:34 +08:00
Benguang Zhao 6ae9bd0e9a feat: add tsdbFSToSnapRangeArray 2023-10-19 10:37:34 +08:00
Benguang Zhao 0a67cc8477 refact: use tsdbTFileUpdVerRange in tsdbSttFWriterCloseCommit 2023-10-19 10:37:34 +08:00
Benguang Zhao 54a10154a4 fixup: remove unused minVer and maxVer in ctx of SCommitter2 2023-10-19 10:37:34 +08:00
Benguang Zhao 6b753cc0cd refact: remove unused code is_same_file 2023-10-19 10:37:34 +08:00
Benguang Zhao dc402e21e3 fix: merge old version range of head and tomb files in tsdbDataFileWriterCloseCommit 2023-10-19 10:37:34 +08:00
Benguang Zhao f8c6e8744a refact: change field name of pExclude in SVSnapReader 2023-10-19 10:37:34 +08:00
Benguang Zhao 01d0c1247d enh: record ver range in writer ctx 2023-10-19 10:37:34 +08:00
Benguang Zhao f207b3ddd5 refact: rename func names of tsdbDataWriterUpdVerRange and tsdbSttWriterUpdVerRange 2023-10-19 10:37:34 +08:00
Benguang Zhao 399afe1094 refact: tidy up declarations of funcs in tsdbUpgrade.c 2023-10-19 10:37:25 +08:00
Benguang Zhao ed6d7c4c4d refact: relocate declarations and defs of tsdbFileWriteTombBlock and tsdbFileWriteTombBlk 2023-10-19 10:17:34 +08:00
Benguang Zhao 823aad4a5e enh: record version range of STFile for data and stt files 2023-10-19 10:17:34 +08:00
Benguang Zhao 3cd458f5c9 enh: fill minVer and maxVer of nf in STFileObj during migration 2023-10-19 10:17:34 +08:00
Benguang Zhao 1446b44733 fixup: remove minVer and maxVer in FSetWriterConfig 2023-10-19 10:17:34 +08:00
Benguang Zhao c8a46394f1 enh: set default values of minVer and maxVer while upgrading from CURRENT 2023-10-19 10:17:34 +08:00
Benguang Zhao ab7a20c117 enh: write stt and data files with minVer and maxVer 2023-10-19 10:17:34 +08:00
Benguang Zhao da28d490aa enh: filterByVersion with snap ranges 2023-10-19 10:17:34 +08:00
Benguang Zhao 7a13e4b2cf enh: add minVer and maxVer for entries in current.json 2023-10-19 10:17:34 +08:00
Benguang Zhao 1be2835fc1 enh: exclude a list of snap ranges in tsdbSnapReaderOpen 2023-10-19 10:17:34 +08:00
Benguang Zhao 573c28fd06 enh: iterate over a list of snap ranges for STsdbSnapReader 2023-10-19 10:17:28 +08:00
dapan1121 afe963a9d1 enh: support view privilege 2023-10-19 08:31:31 +08:00
Minglei Jin 52c8bc91f9 cos/delete: fix delete object cond and double free 2023-10-18 18:21:45 +08:00
Shungang Li 5b69b584c3 enh: add log for deploy mnode 2023-10-18 16:58:58 +08:00
yihaoDeng ef27c87756 opt status send 2023-10-18 16:37:34 +08:00
yihaoDeng e62f3fa86a opt status send 2023-10-18 16:03:55 +08:00
Minglei Jin f26ec41b8e vnode/cos: fix get callback buffer 2023-10-18 15:30:02 +08:00
Haojun Liao c6dd73b68b
Merge pull request #23187 from taosdata/feat/TD-26056
feat:add replay logic
2023-10-18 11:43:43 +08:00
Minglei Jin 11b65e2779 vnode/cos: make dependent lib public 2023-10-17 18:11:13 +08:00
Minglei Jin dd21d8e3ad cos/multipart: first round multipart uploading 2023-10-17 17:24:50 +08:00
Minglei Jin 8fa8c40391 cos/put: simple object putting(< 5 gigabytes) 2023-10-17 14:59:03 +08:00
kailixu 29c6daaff5 fix: trans mutex init 2023-10-17 11:12:52 +08:00
kailixu a30eedafec fix: trans mutex init 2023-10-17 11:06:06 +08:00
kailixu 38c1f7d48d fix: add lock for trans 2023-10-16 20:20:04 +08:00
yihaoDeng b133418d88 fix stream snap deadlock 2023-10-16 20:03:44 +08:00
dapan1121 cdda43cd67 Merge remote-tracking branch 'origin/3.0' into feat/TD-25204 2023-10-16 19:54:21 +08:00
yihaoDeng f5ea3649c5 fix stream snap deadlock 2023-10-16 19:26:08 +08:00
yihaoDeng 0a84d7a8b3 fix stream snap deadlock 2023-10-16 19:20:48 +08:00
Minglei Jin 2479bb343e prefix/delete: delete with prefix 2023-10-16 15:54:51 +08:00
Minglei Jin 4a77a49a3e prefix/list: list bucket with prefix 2023-10-16 15:25:48 +08:00
Haojun Liao f98e454c5d
Merge pull request #23193 from taosdata/fix/3_liaohj
other: merge stream fix in main branch.
2023-10-16 15:17:04 +08:00
Haojun Liao 33018a0bdb fix(tsdb): fix syntax error. 2023-10-16 14:07:09 +08:00
Haojun Liao fa6ba6faf8 fix(tdsb): adjust the log level. 2023-10-16 13:26:13 +08:00
Haojun Liao 6b86d050f2 fix(tsdb): record the pinned block iter. 2023-10-16 13:26:13 +08:00
Haojun Liao 5fe7c8de24 fix(stream): fix syntax error. 2023-10-16 13:26:12 +08:00
Haojun Liao fb2172933a fix(tsdb): enable pin stt datablock. 2023-10-16 13:26:06 +08:00
wangmm0220 473142fab7 fix:conflicts from 3.0 2023-10-16 11:35:56 +08:00
Minglei Jin 0a1ff3283e vnode/cos: first round size delte and get 2023-10-13 16:59:05 +08:00
dapan1121 a0699d758c Merge remote-tracking branch 'origin/3.0' into feat/TD-25204 2023-10-13 16:51:38 +08:00
dapan1121 c0a4328803 feat: support view meta updating 2023-10-13 16:29:34 +08:00
dapan1121 a418307570
Merge pull request #23236 from taosdata/fix/TD-26658-3.0
enh: close stt before untake read snap
2023-10-13 14:16:47 +08:00
Haojun Liao 33d9f772be other: merge 3.0 2023-10-13 09:06:13 +08:00
Haojun Liao 84c5359d5b other: merge 3.0 2023-10-13 08:58:26 +08:00
Alex Duan 35fced8796
Merge pull request #23234 from taosdata/main_3_merge
other: merge main into 3.0
2023-10-12 07:48:20 -05:00
dapan1121 7c67f23469 feat: update view meta 2023-10-12 19:56:17 +08:00
Haojun Liao 506c55001d fix(tsdb): fix race condition. 2023-10-12 17:57:03 +08:00
Haojun Liao b782af2534 fix(stream): avoid double free. 2023-10-12 17:56:42 +08:00
Haojun Liao 90f866352b
Merge pull request #23221 from taosdata/feat/TD-26052
fix:[TD-26671] judge if pointer is null to avoid core dump
2023-10-12 17:23:41 +08:00
kailixu 3d32d55ea5 enh: close stt before untake read snap 2023-10-12 16:44:55 +08:00
Haojun Liao eb4449999f other: merge 3.0 2023-10-12 10:33:48 +08:00
dmchen c1e22eff1a fix/pr-23223-ci-core 2023-10-11 10:25:28 +00:00
Minglei Jin 8253874398 enh(tsdb/cos): new sdk for s3 2023-10-11 14:47:26 +08:00
wangmm0220 f7d1e0ea82 fix:[TD-26671] judge if pointer is null to avoid core dump 2023-10-11 11:08:14 +08:00
Shungang Li 2c66f44b31 fix(tsdb): ensure sst trigger array size for upgrade 2023-10-10 21:07:08 +08:00
Haojun Liao b4d7e66f19 other: add some logs. 2023-10-10 19:57:17 +08:00
Haojun Liao 56147120b9 fix(tsdb): remove invalid assert, and do some internal refactor. 2023-10-10 17:04:12 +08:00
wangmm0220 440fa77282 fix:merge datablock if data in same wal version 2023-10-10 16:55:36 +08:00
Haojun Liao 05dfadd8f8 fix(stream): set initial version for fill-history task. disable reentry of scan-history task function. 2023-10-10 15:52:48 +08:00
Haojun Liao 5f9b858fc1 other: merge main. 2023-10-10 15:38:46 +08:00
Haojun Liao adf6f65d09 fix(stream): set initial version for fill-history task. disable reentry of scan-history task function. 2023-10-10 14:00:30 +08:00
Alex Duan 9da96ebf63
Merge pull request #23017 from taosdata/case/TD-26408-MAIN
fix: add case for lost data after  split vgroup (main)
2023-10-10 00:54:34 -05:00
wangmm0220 9113c3c3b6 fix:rollback removed code 2023-10-10 11:53:54 +08:00
Hongze Cheng 1b559a0254
Merge pull request #23180 from taosdata/fix/TS-4121-main
fix(tsdb/cache reader): reset current fileset in cache reader
2023-10-09 20:46:33 -05:00