25bb914ac1
merge 3.0
2022-10-21 16:30:43 +08:00
1c26f1b53e
fix(wal): reference
2022-10-21 16:13:55 +08:00
05d04dcd2d
Merge remote-tracking branch 'origin/3.0' into enh/TD-19461
2022-10-21 11:07:48 +08:00
6c3cd3e19e
test: adjust log
2022-10-21 10:39:29 +08:00
c4e568d41e
Merge pull request #17523 from taosdata/FIX/TD-19673-3.0
...
enh: provide more info on misalignment detection of idx entries after…
2022-10-21 09:06:57 +08:00
ce1b6147a0
enh(client): add debug log
2022-10-20 15:34:27 +08:00
06f5d91d21
enh: provide more info on misalignment detection of idx entries after appending
2022-10-20 15:17:52 +08:00
3b0968d7f9
enh: enable the -Wformat=2 compiler option
2022-10-19 09:24:15 +08:00
3cbfd2d160
Merge pull request #17392 from taosdata/FIX/TD-19183-3.0
...
enh: not allowed to start on disk space unavailable
2022-10-18 17:46:14 +08:00
cf2b6ccbfb
enh: write idx ahead of writing its log entry in WAL
2022-10-18 11:23:24 +08:00
af9aa9d783
enh: assert on alignment of idx entries in walWriteIndex
2022-10-18 11:23:13 +08:00
f0427c9322
fix: ftrunc on appending WAL log failure for recovery in walWriteImpl
2022-10-18 11:22:21 +08:00
3190ef65a3
fix: deal with misaligned idx entries in walCheckAndRepairIdxFile
2022-10-18 11:21:48 +08:00
a4fd2def98
fix: resolve a typo in errormsg printing in walScanLogGetLastVer
2022-10-17 14:22:20 +08:00
9a3ac0ca57
Merge branch '3.0' into feature/stream
2022-10-17 10:17:45 +08:00
6f9153c6e3
fix: error handling
2022-10-17 10:13:10 +08:00
e3f50c0d48
fix: align vers.firstVer with vers.snapshotVer+1 in WAL meta info
2022-10-16 13:10:57 +08:00
616eb5f903
Merge branch '3.0' into FIX/TD-19239-3.0
2022-10-16 00:29:01 +08:00
b6c31ee67d
fix: fsync the current wal log and idx files at first to ensure validity of meta in walSaveMeta
2022-10-15 23:57:37 +08:00
7fb827debd
fix: refactor walScanLogGetLastVer, walCheckAndRepairMeta, and walCheckAndRepairIdx.
...
* search for the last entry in the contiguous range of valid WAL from the last pos fsynced as firstTrial
* find the last entry before the last pos fsynced backwards as second trial
* reserve sufficient space for computing CRC32 checksum, esp. of WAL record body
* rebuild meta info to resolve potential misalignment between lists of meta and actual log files
* retract commitIndex and appliedIndex to lastLogIndex if needed
* put an upper size limit on possibly corrupted WAL range to be recovered
2022-10-15 23:56:31 +08:00
c693384ec4
enh: replace asserts with error logs in walReadVer
2022-10-14 22:57:28 +08:00
948fa60ef0
fix: check the length of remaining content for computing CRC32 chksum of WAL record body
2022-10-14 22:57:28 +08:00
63b13db10f
fix: eliminate asserts on getting and committing log entries
2022-10-14 22:57:27 +08:00
df18ddbbb5
enh: remove WAL log file corrupted completely
2022-10-14 22:57:27 +08:00
9055f63742
fix: ftruncate WAL log after the last valid WAL record properly in walScanLogGetLastVer
2022-10-14 22:43:41 +08:00
76865258cf
enh: protect WAL meta by flushing to a tmpfile at first and then renaming
2022-10-14 22:32:15 +08:00
36bf800e15
fix: improve fault tolerance on disk space full with error handling enhanced
2022-10-14 22:02:27 +08:00
6f8d4d6955
fix(tmq): push msg
2022-10-14 13:31:05 +08:00
db6b0503a1
refactor(stream): change state table name
2022-10-12 14:34:04 +08:00
69352e6e89
fix tbanme length check
2022-10-12 10:50:54 +08:00
41474e40bf
enh(wal): auto fix
2022-10-12 02:08:58 +08:00
26fae13c61
refactor(stream): state/session map id to tbname
2022-10-11 15:27:56 +08:00
fbfae317b3
refactor
2022-10-11 02:09:15 +08:00
b1594a6857
fix coverity scan
2022-10-10 11:44:17 +08:00
78b4d10249
optimize fix condition
2022-09-22 00:54:23 +08:00
a6733dbbd1
feat(wal): auto fix corrupt file
2022-09-21 23:51:24 +08:00
756a2d3d5d
merge 3.0
2022-09-19 19:29:20 +08:00
1604d72967
add log for wal
2022-09-19 17:40:38 +08:00
86c0fb56e0
enhance stream backend for sma
2022-09-19 17:27:25 +08:00
b6ddf5bfd7
fix: update wal reader's curFileFirstVer
2022-09-08 18:30:15 +08:00
c5874ca892
fix: add filter logic for tmq in stable wal
2022-08-31 18:32:28 +08:00
d7b804e02e
fix stream load task
2022-08-24 10:42:34 +08:00
2d628491b2
feat(stream): support tdb state backend
2022-08-23 19:30:04 +08:00
18f6fb6123
enh(tmq): speed up consumer recover
2022-08-10 16:04:03 +08:00
f0f4748320
fix(util): concurrently hash iterate
2022-08-05 16:14:19 +08:00
56f2e49764
refactor: adjust logs
2022-08-02 17:12:07 +08:00
bd31c9da5a
Merge pull request #15657 from taosdata/fix/dnode
...
fix: write snapshot after apply queue is empty
2022-08-01 20:13:08 +08:00
b084dd8ee6
feat(tq): transport snapshot
2022-08-01 19:12:37 +08:00
99f29f6455
refactor: adjust log
2022-08-01 17:23:52 +08:00
bb6fabcc11
refactor(stream): use vnode meta
2022-07-30 20:20:12 +08:00
Liu Jicong
Shengliang Guan
Benguang Zhao
Minglei Jin
wangmm0220