70b45a4cf0
fix(stream): all data should be extracted from wal.
2023-04-13 23:22:09 +08:00
7419c0bfe9
enh(stream): the stream will start after vnode restore being completed.
2023-04-10 16:56:14 +08:00
f5b52749c2
refactor: do some internal refactor.
2023-04-09 01:39:09 +08:00
7616a283e3
fix:error in TD-23218 & remove useless logic
2023-03-18 18:23:38 +08:00
d04d610a85
Merge pull request #20061 from taosdata/FIX/TD-22611-main
...
enh: refactor syncBeginSnapshot and walBeginSnapshot for logRetention
2023-02-24 13:12:06 +08:00
b28c0ad952
fix:remove useless logic in tmq
2023-02-21 18:49:39 +08:00
0c7a4bfad9
enh: refactor syncBeginSnapshot and walBeginSnapshot for logRetention
2023-02-20 19:19:49 +08:00
5ce5dded75
enh: reset wal reader after walReadVer
2023-02-08 14:41:15 +08:00
f5c4ca3380
fix: wal ref
2023-01-28 17:17:55 +08:00
2a71d47668
fix: wal ref
2023-01-28 16:11:17 +08:00
a6fff95795
fix: close wal ref
2022-12-09 17:18:21 +08:00
3f1a0cefbb
fix: walSaveMeta ahead of deleting WAL files as gc in walEndSnapshot
...
delete WAL files in descending order during walRollback
2022-12-06 00:51:45 +08:00
051b73c1ed
Merge branch 3.0 to FIX/TD-19334-3.0
2022-11-17 17:28:11 +08:00
5878c9a31a
fix: impl ring log buffer
2022-11-07 14:27:22 +08:00
26778f29da
enh: add config for persist wal at the beginning of vnodeCommit
2022-11-01 10:42:13 +08:00
07db554fab
enh: persist wal at the beginning of vnodeCommit
2022-11-01 00:00:18 +08:00
75e5e490fd
refactor(stream): recover and fill history
2022-10-26 00:31:00 +08:00
7fb827debd
fix: refactor walScanLogGetLastVer, walCheckAndRepairMeta, and walCheckAndRepairIdx.
...
* search for the last entry in the contiguous range of valid WAL from the last pos fsynced as firstTrial
* find the last entry before the last pos fsynced backwards as second trial
* reserve sufficient space for computing CRC32 checksum, esp. of WAL record body
* rebuild meta info to resolve potential misalignment between lists of meta and actual log files
* retract commitIndex and appliedIndex to lastLogIndex if needed
* put an upper size limit on possibly corrupted WAL range to be recovered
2022-10-15 23:56:31 +08:00
b084dd8ee6
feat(tq): transport snapshot
2022-08-01 19:12:37 +08:00
bb6fabcc11
refactor(stream): use vnode meta
2022-07-30 20:20:12 +08:00
0c942e622a
enh(wal): remove file failure handling
2022-07-28 13:37:57 +08:00
0b8e9af8ec
refactor(wal)
2022-07-26 13:33:26 +08:00
5b654779ba
Merge pull request #15372 from taosdata/fix/tsim
...
test: regression case
2022-07-25 15:23:41 +08:00
095f6aa4e0
fix(tmq): correctly set reader status
2022-07-23 20:07:16 +08:00
bf37f3fa68
feat(wal): remove wal log size limitation
2022-07-20 16:15:53 +08:00
a3133b9f6d
feat(wal): log applied ver
2022-07-20 10:55:28 +08:00
c6052fadba
feat(wal): add append interface
2022-07-11 16:22:51 +08:00
219d966b25
fix(wal): read after rolling
2022-07-10 21:02:25 +08:00
e9077c036f
merge from 3.0
2022-07-10 11:24:37 +08:00
a2107992e2
refactor(stream)
2022-07-10 11:18:15 +08:00
c53a84b733
Merge remote-tracking branch 'origin/3.0' into fix/valgrind
2022-07-09 20:13:26 +08:00
3cd5a35054
refactor(stream): internal refactor
2022-07-08 17:48:34 +08:00
361c21a35c
refactor: adjust logs
2022-07-08 17:27:06 +08:00
4a648d711f
feat(wal): support filter
2022-07-07 13:56:47 +08:00
1ec57798d2
ci: remove unstable case
2022-07-07 11:45:28 +08:00
8c5dbde918
refactor(stream): stream reader created in scanner
2022-07-06 14:20:07 +08:00
52d09b4173
refactor(wal)
2022-07-01 14:39:21 +08:00
7a65589525
feat(wal): add api to check log existance
2022-07-01 10:15:05 +08:00
04f11e2646
feat(wal): provide is empty api
2022-06-22 19:40:37 +08:00
7ab3a1e42c
feat(wal): support restore from snapshot
2022-06-09 23:08:06 +08:00
361332505c
feat(wal): support restore from snapshot
2022-06-02 11:38:04 +08:00
714dd4f497
enh(tmq): only read committed log
2022-05-11 14:42:20 +08:00
9723145c1d
enh(tmq): use sem_timewait to reduce busy loop
2022-04-26 19:21:31 +08:00
575f64197d
enh(wal): skip read for specific msg
2022-04-24 16:51:32 +08:00
3d972f81a2
refacor(wal): rename len to bodyLen
2022-04-24 13:42:54 +08:00
a6d12f069e
insert return result
2022-04-16 06:32:34 +00:00
3e5da8bedb
fix
2022-03-31 15:52:54 +08:00
96eb6a9bcf
wal add sync info
2022-03-26 15:47:58 +08:00
7bd71bcb81
wal add sync info
2022-03-26 15:36:49 +08:00
79057240bd
[TD-13759]<fix>: redefine thread api.
2022-03-20 00:47:45 +08:00
Haojun Liao
wangmm0220
Xiaoyu Wang
Benguang Zhao
Liu Jicong
Shengliang Guan
benguang.zhao
Hongze Cheng
afwerar