2a71d47668
fix: wal ref
2023-01-28 16:11:17 +08:00
a6fff95795
fix: close wal ref
2022-12-09 17:18:21 +08:00
3f1a0cefbb
fix: walSaveMeta ahead of deleting WAL files as gc in walEndSnapshot
...
delete WAL files in descending order during walRollback
2022-12-06 00:51:45 +08:00
051b73c1ed
Merge branch 3.0 to FIX/TD-19334-3.0
2022-11-17 17:28:11 +08:00
5878c9a31a
fix: impl ring log buffer
2022-11-07 14:27:22 +08:00
26778f29da
enh: add config for persist wal at the beginning of vnodeCommit
2022-11-01 10:42:13 +08:00
07db554fab
enh: persist wal at the beginning of vnodeCommit
2022-11-01 00:00:18 +08:00
75e5e490fd
refactor(stream): recover and fill history
2022-10-26 00:31:00 +08:00
7fb827debd
fix: refactor walScanLogGetLastVer, walCheckAndRepairMeta, and walCheckAndRepairIdx.
...
* search for the last entry in the contiguous range of valid WAL from the last pos fsynced as firstTrial
* find the last entry before the last pos fsynced backwards as second trial
* reserve sufficient space for computing CRC32 checksum, esp. of WAL record body
* rebuild meta info to resolve potential misalignment between lists of meta and actual log files
* retract commitIndex and appliedIndex to lastLogIndex if needed
* put an upper size limit on possibly corrupted WAL range to be recovered
2022-10-15 23:56:31 +08:00
b084dd8ee6
feat(tq): transport snapshot
2022-08-01 19:12:37 +08:00
bb6fabcc11
refactor(stream): use vnode meta
2022-07-30 20:20:12 +08:00
0c942e622a
enh(wal): remove file failure handling
2022-07-28 13:37:57 +08:00
0b8e9af8ec
refactor(wal)
2022-07-26 13:33:26 +08:00
5b654779ba
Merge pull request #15372 from taosdata/fix/tsim
...
test: regression case
2022-07-25 15:23:41 +08:00
095f6aa4e0
fix(tmq): correctly set reader status
2022-07-23 20:07:16 +08:00
bf37f3fa68
feat(wal): remove wal log size limitation
2022-07-20 16:15:53 +08:00
a3133b9f6d
feat(wal): log applied ver
2022-07-20 10:55:28 +08:00
c6052fadba
feat(wal): add append interface
2022-07-11 16:22:51 +08:00
219d966b25
fix(wal): read after rolling
2022-07-10 21:02:25 +08:00
e9077c036f
merge from 3.0
2022-07-10 11:24:37 +08:00
a2107992e2
refactor(stream)
2022-07-10 11:18:15 +08:00
c53a84b733
Merge remote-tracking branch 'origin/3.0' into fix/valgrind
2022-07-09 20:13:26 +08:00
3cd5a35054
refactor(stream): internal refactor
2022-07-08 17:48:34 +08:00
361c21a35c
refactor: adjust logs
2022-07-08 17:27:06 +08:00
4a648d711f
feat(wal): support filter
2022-07-07 13:56:47 +08:00
1ec57798d2
ci: remove unstable case
2022-07-07 11:45:28 +08:00
8c5dbde918
refactor(stream): stream reader created in scanner
2022-07-06 14:20:07 +08:00
52d09b4173
refactor(wal)
2022-07-01 14:39:21 +08:00
7a65589525
feat(wal): add api to check log existance
2022-07-01 10:15:05 +08:00
04f11e2646
feat(wal): provide is empty api
2022-06-22 19:40:37 +08:00
7ab3a1e42c
feat(wal): support restore from snapshot
2022-06-09 23:08:06 +08:00
361332505c
feat(wal): support restore from snapshot
2022-06-02 11:38:04 +08:00
714dd4f497
enh(tmq): only read committed log
2022-05-11 14:42:20 +08:00
9723145c1d
enh(tmq): use sem_timewait to reduce busy loop
2022-04-26 19:21:31 +08:00
575f64197d
enh(wal): skip read for specific msg
2022-04-24 16:51:32 +08:00
3d972f81a2
refacor(wal): rename len to bodyLen
2022-04-24 13:42:54 +08:00
a6d12f069e
insert return result
2022-04-16 06:32:34 +00:00
3e5da8bedb
fix
2022-03-31 15:52:54 +08:00
96eb6a9bcf
wal add sync info
2022-03-26 15:47:58 +08:00
7bd71bcb81
wal add sync info
2022-03-26 15:36:49 +08:00
79057240bd
[TD-13759]<fix>: redefine thread api.
2022-03-20 00:47:45 +08:00
1d9119df87
record num of logs for monitoring
2022-03-04 14:34:35 +08:00
5a37fdf28f
[TD-13062]<fix>: cross platform file system.
2022-02-25 01:47:20 +08:00
c62304531a
fix query error
2022-01-26 09:56:32 +08:00
f7726ce8a4
add tq process consumer msg
2022-01-20 14:38:55 +08:00
47f1558e7c
add wal handle meta corrupt
2022-01-11 15:40:10 +08:00
6beee204d8
add tq query
2021-12-21 20:07:32 +08:00
dfc8c4e0b7
format code
2021-12-16 15:04:13 +08:00
3d141cf109
refactor wal and tq
2021-12-15 17:17:50 +08:00
5874463cb1
refactor wal
2021-12-14 18:14:45 +08:00
43a2bcdce3
fix wal read handle
2021-12-14 14:38:52 +08:00
dc24592929
add wal read handle
2021-12-13 18:33:30 +08:00
b2083ea62f
fix memory leak
2021-12-13 13:58:54 +08:00
9e4b890727
add test for wal snapshot
2021-12-11 17:18:18 +08:00
03a54b5a35
make tfinit called once
2021-12-10 10:30:57 +08:00
cf93f4c239
add unit test for wal
2021-12-09 18:32:38 +08:00
6de9692b7d
refactor wal
2021-12-03 14:28:54 +08:00
2e859aa138
refactor wal
2021-11-30 16:44:11 +08:00
9f75ad0652
refactor wal
2021-11-26 14:22:16 +08:00
044b02bb60
add wal implementation
2021-11-23 15:46:23 +08:00
759b077ecf
add walhandle for integration
2021-11-22 14:56:11 +08:00
fed05bb64b
add memallocator dependency
2021-11-16 16:03:39 +08:00
d95e8e1f6c
Call wal and sync code in vnode
2021-10-28 16:57:02 +08:00
05c07ba6f9
tq ( #8416 )
...
add tq header
2021-10-25 15:16:39 +08:00
dd9ac9bbb9
refine wal interface
2021-10-13 14:25:11 +08:00
4a883c23c5
refactor tq
2021-10-09 17:14:37 +08:00
066d11cea0
add tq header
2021-10-08 13:43:12 +08:00
3f593dc88b
add header for wal and consumer ( #8121 )
2021-09-30 13:18:15 +08:00
5b04e39691
refact
2021-09-22 16:25:22 +08:00
Liu Jicong
Benguang Zhao
Shengliang Guan
benguang.zhao
Hongze Cheng
afwerar