555bf7d4cb
Merge pull request #18181 from taosdata/feature/stream
...
fix(stream): check task
2022-11-16 08:11:30 +08:00
6478fcb2c1
fix(stream): check task
2022-11-15 22:32:52 +08:00
ede50530f3
Merge pull request #18178 from taosdata/feature/wal
...
fix(wal): set commit ver and snapshot ver after restore
2022-11-15 21:26:03 +08:00
20e31aacca
fix(wal): set commit ver and snapshot ver after restore
2022-11-15 19:48:16 +08:00
a9bf05bc01
refactor: stream meta ref count
2022-11-15 19:11:42 +08:00
efde22f081
fix: memory leak
2022-11-15 11:59:29 +08:00
7c8b2867ce
enh(stream): add stream task info into information schema
2022-11-14 19:23:42 +08:00
aa9e935854
enh(stream): set path max length to 1024
2022-11-14 14:46:50 +08:00
bc469f7f7b
fix(stream): delete tb should be checked in write thread
2022-11-08 11:30:29 +08:00
77a6cf503e
Merge pull request #17824 from taosdata/FIX/TS-1984-3.0
...
fix: set firstTrial as false if error encountered in loop of walScanLogGetLastVer
2022-11-02 15:49:48 +08:00
8a5130a88d
fix: set firstTrial as false if error encountered in loop of walScanLogGetLastVer
2022-11-02 10:21:40 +08:00
cec6642700
Merge pull request #17811 from taosdata/feature/stream
...
fix(tmq): handle adding subtable for subscribing stb
2022-11-01 21:09:43 +08:00
f0a66602da
fix(taosx): set version
2022-11-01 19:28:42 +08:00
871757240a
Merge pull request #17777 from taosdata/FIX/TS-1984-3.0
...
fix: fsync wal files and meta if data size not synced yet beyond a threshold
2022-11-01 18:53:10 +08:00
94e7c79ca0
fix(tmq): handle adding subtable for subscribing stb
2022-11-01 18:18:26 +08:00
4e46b78aa0
fix: update info of WAL entry found within loop in walScanLogGetLastVer
2022-11-01 17:56:24 +08:00
3c1c95c5e6
enh: turn error on WAL data size to recover exceeding a limit as warn
2022-11-01 17:26:31 +08:00
4237cafb21
enh: rename walRecoverSizeLimit to walFsyncDataSizeLimit
2022-11-01 17:19:33 +08:00
ffa6906a9f
Merge branch 'FIX/TS-1984-3.0' of github.com:taosdata/TDengine into FIX/TS-1984-3.0
2022-11-01 15:52:25 +08:00
6907e3dfe3
enh: scan forward step by step in walScanLogGetLastVer
2022-11-01 15:25:18 +08:00
a031010a9e
Merge pull request #17721 from taosdata/FIX/TD-19673-3.0
...
enh: check completeness of WAL log entries after repairing
2022-11-01 13:59:34 +08:00
26778f29da
enh: add config for persist wal at the beginning of vnodeCommit
2022-11-01 10:42:13 +08:00
07db554fab
enh: persist wal at the beginning of vnodeCommit
2022-11-01 00:00:18 +08:00
cccfa17027
fix: fsync wal files and their meta if data size unsynced exceeds a limit
2022-10-31 23:58:49 +08:00
1d0eae197d
fix: not allow to rollback WAL across snapshot point
2022-10-31 21:06:23 +08:00
fd3a1de904
fix: use the relative pos during searching in walScanLogGetLastVer
2022-10-28 11:47:44 +08:00
31a0421878
enh: check completeness of WAL log entries after repairing
2022-10-27 15:55:22 +08:00
2a3448552e
test(wal): rollback multiple file
2022-10-26 18:03:25 +08:00
a16b010e9f
fix: memory leak
2022-10-26 11:35:15 +08:00
75e5e490fd
refactor(stream): recover and fill history
2022-10-26 00:31:00 +08:00
25bb914ac1
merge 3.0
2022-10-21 16:30:43 +08:00
1c26f1b53e
fix(wal): reference
2022-10-21 16:13:55 +08:00
05d04dcd2d
Merge remote-tracking branch 'origin/3.0' into enh/TD-19461
2022-10-21 11:07:48 +08:00
6c3cd3e19e
test: adjust log
2022-10-21 10:39:29 +08:00
c4e568d41e
Merge pull request #17523 from taosdata/FIX/TD-19673-3.0
...
enh: provide more info on misalignment detection of idx entries after…
2022-10-21 09:06:57 +08:00
ce1b6147a0
enh(client): add debug log
2022-10-20 15:34:27 +08:00
06f5d91d21
enh: provide more info on misalignment detection of idx entries after appending
2022-10-20 15:17:52 +08:00
3b0968d7f9
enh: enable the -Wformat=2 compiler option
2022-10-19 09:24:15 +08:00
3cbfd2d160
Merge pull request #17392 from taosdata/FIX/TD-19183-3.0
...
enh: not allowed to start on disk space unavailable
2022-10-18 17:46:14 +08:00
cf2b6ccbfb
enh: write idx ahead of writing its log entry in WAL
2022-10-18 11:23:24 +08:00
af9aa9d783
enh: assert on alignment of idx entries in walWriteIndex
2022-10-18 11:23:13 +08:00
f0427c9322
fix: ftrunc on appending WAL log failure for recovery in walWriteImpl
2022-10-18 11:22:21 +08:00
3190ef65a3
fix: deal with misaligned idx entries in walCheckAndRepairIdxFile
2022-10-18 11:21:48 +08:00
a4fd2def98
fix: resolve a typo in errormsg printing in walScanLogGetLastVer
2022-10-17 14:22:20 +08:00
9a3ac0ca57
Merge branch '3.0' into feature/stream
2022-10-17 10:17:45 +08:00
6f9153c6e3
fix: error handling
2022-10-17 10:13:10 +08:00
e3f50c0d48
fix: align vers.firstVer with vers.snapshotVer+1 in WAL meta info
2022-10-16 13:10:57 +08:00
616eb5f903
Merge branch '3.0' into FIX/TD-19239-3.0
2022-10-16 00:29:01 +08:00
b6c31ee67d
fix: fsync the current wal log and idx files at first to ensure validity of meta in walSaveMeta
2022-10-15 23:57:37 +08:00
7fb827debd
fix: refactor walScanLogGetLastVer, walCheckAndRepairMeta, and walCheckAndRepairIdx.
...
* search for the last entry in the contiguous range of valid WAL from the last pos fsynced as firstTrial
* find the last entry before the last pos fsynced backwards as second trial
* reserve sufficient space for computing CRC32 checksum, esp. of WAL record body
* rebuild meta info to resolve potential misalignment between lists of meta and actual log files
* retract commitIndex and appliedIndex to lastLogIndex if needed
* put an upper size limit on possibly corrupted WAL range to be recovered
2022-10-15 23:56:31 +08:00
Shengliang Guan
Liu Jicong
benguang.zhao
Benguang Zhao