fac7e521e9
s3/evict: fetch atime from stat file
2023-08-07 15:59:37 +08:00
3ffdbe923d
other: merge 3.0
2023-07-11 09:12:57 +08:00
9b477eed81
enh: terminate on failure to recover WAL from writing errors, or to commit vnode
2023-07-05 17:54:56 +08:00
60dc26156b
enh: tolerate WAL_MAGIC mismatch as long as checksums being valid
2023-06-29 18:34:17 +08:00
b434ac2fc9
enh: improve walScanLogGetLastVer
2023-06-29 16:36:28 +08:00
b8933389bb
enh: keep the trailing empty wal file in walCheckAdnRepairMeta
2023-05-11 09:42:46 +08:00
2a558323be
fix: set absent closeTs with mtime of log files during walCheckAndRepairMeta
2023-05-10 20:35:08 +08:00
e45367f924
fix: resolve coverity scan issues in sync and wal
2023-02-23 14:16:21 +08:00
c597de099f
merge main
2023-02-20 13:41:27 +08:00
c597a1e4ce
refactor: do some internal refactor.
2023-02-13 15:46:47 +08:00
0f00862d8b
Merge branch 'fix/TD-22070' of https://github.com/taosdata/TDengine into fix/3.0_merge_main
2023-01-30 10:17:59 +08:00
95493432ed
enh: trim the last WAL idx file which is not fsynced
2023-01-16 14:12:26 +08:00
398161eb5f
Merge branch 'main' into merge/mainto3.0_0108
2023-01-09 10:00:53 +08:00
0c4ade9373
fix: update sync node commitIndex only if matchTerm equals currentTerm upon heartbeat
2022-12-28 20:25:52 +08:00
c4fad84c7c
enh: reset commitVer in WAL on restore
2022-12-28 20:25:52 +08:00
6cbcbd1402
remove assert
2022-12-21 15:37:50 +08:00
50729f0cc4
refactor: remove assert
2022-12-21 14:16:28 +08:00
6d94afe48f
Revert "refact: adjust some assert cases"
2022-12-07 21:51:17 +08:00
d5126d469a
refact: replcase ASSERT with tAssert
2022-12-07 18:42:48 +08:00
3f1a0cefbb
fix: walSaveMeta ahead of deleting WAL files as gc in walEndSnapshot
...
delete WAL files in descending order during walRollback
2022-12-06 00:51:45 +08:00
d9c261cd13
refact: remove some error codes
2022-12-03 10:17:02 +08:00
95f8e96eb5
fix: align firstVer with lastVer too if no WAL logs exist
2022-11-22 23:42:08 +08:00
7c8b2867ce
enh(stream): add stream task info into information schema
2022-11-14 19:23:42 +08:00
77a6cf503e
Merge pull request #17824 from taosdata/FIX/TS-1984-3.0
...
fix: set firstTrial as false if error encountered in loop of walScanLogGetLastVer
2022-11-02 15:49:48 +08:00
8a5130a88d
fix: set firstTrial as false if error encountered in loop of walScanLogGetLastVer
2022-11-02 10:21:40 +08:00
871757240a
Merge pull request #17777 from taosdata/FIX/TS-1984-3.0
...
fix: fsync wal files and meta if data size not synced yet beyond a threshold
2022-11-01 18:53:10 +08:00
4e46b78aa0
fix: update info of WAL entry found within loop in walScanLogGetLastVer
2022-11-01 17:56:24 +08:00
3c1c95c5e6
enh: turn error on WAL data size to recover exceeding a limit as warn
2022-11-01 17:26:31 +08:00
4237cafb21
enh: rename walRecoverSizeLimit to walFsyncDataSizeLimit
2022-11-01 17:19:33 +08:00
ffa6906a9f
Merge branch 'FIX/TS-1984-3.0' of github.com:taosdata/TDengine into FIX/TS-1984-3.0
2022-11-01 15:52:25 +08:00
6907e3dfe3
enh: scan forward step by step in walScanLogGetLastVer
2022-11-01 15:25:18 +08:00
a031010a9e
Merge pull request #17721 from taosdata/FIX/TD-19673-3.0
...
enh: check completeness of WAL log entries after repairing
2022-11-01 13:59:34 +08:00
26778f29da
enh: add config for persist wal at the beginning of vnodeCommit
2022-11-01 10:42:13 +08:00
cccfa17027
fix: fsync wal files and their meta if data size unsynced exceeds a limit
2022-10-31 23:58:49 +08:00
fd3a1de904
fix: use the relative pos during searching in walScanLogGetLastVer
2022-10-28 11:47:44 +08:00
31a0421878
enh: check completeness of WAL log entries after repairing
2022-10-27 15:55:22 +08:00
2a3448552e
test(wal): rollback multiple file
2022-10-26 18:03:25 +08:00
6c3cd3e19e
test: adjust log
2022-10-21 10:39:29 +08:00
3b0968d7f9
enh: enable the -Wformat=2 compiler option
2022-10-19 09:24:15 +08:00
3190ef65a3
fix: deal with misaligned idx entries in walCheckAndRepairIdxFile
2022-10-18 11:21:48 +08:00
a4fd2def98
fix: resolve a typo in errormsg printing in walScanLogGetLastVer
2022-10-17 14:22:20 +08:00
e3f50c0d48
fix: align vers.firstVer with vers.snapshotVer+1 in WAL meta info
2022-10-16 13:10:57 +08:00
616eb5f903
Merge branch '3.0' into FIX/TD-19239-3.0
2022-10-16 00:29:01 +08:00
7fb827debd
fix: refactor walScanLogGetLastVer, walCheckAndRepairMeta, and walCheckAndRepairIdx.
...
* search for the last entry in the contiguous range of valid WAL from the last pos fsynced as firstTrial
* find the last entry before the last pos fsynced backwards as second trial
* reserve sufficient space for computing CRC32 checksum, esp. of WAL record body
* rebuild meta info to resolve potential misalignment between lists of meta and actual log files
* retract commitIndex and appliedIndex to lastLogIndex if needed
* put an upper size limit on possibly corrupted WAL range to be recovered
2022-10-15 23:56:31 +08:00
948fa60ef0
fix: check the length of remaining content for computing CRC32 chksum of WAL record body
2022-10-14 22:57:28 +08:00
63b13db10f
fix: eliminate asserts on getting and committing log entries
2022-10-14 22:57:27 +08:00
df18ddbbb5
enh: remove WAL log file corrupted completely
2022-10-14 22:57:27 +08:00
9055f63742
fix: ftruncate WAL log after the last valid WAL record properly in walScanLogGetLastVer
2022-10-14 22:43:41 +08:00
76865258cf
enh: protect WAL meta by flushing to a tmpfile at first and then renaming
2022-10-14 22:32:15 +08:00
36bf800e15
fix: improve fault tolerance on disk space full with error handling enhanced
2022-10-14 22:02:27 +08:00
Minglei Jin
Haojun Liao
Benguang Zhao
Xiaoyu Wang
Hongze Cheng
Shengliang Guan
Liu Jicong
Shengliang Guan
benguang.zhao