5f31575624
refactor
2024-04-09 06:55:01 +00:00
b9deb71fc5
basic function
2024-03-29 02:48:49 +00:00
c74c4fe208
enh: clean WAL logs based on size if one follower is offline.
2023-12-13 10:10:02 +08:00
aa8909b267
other: add some logs.
2023-09-09 15:18:54 +08:00
f1baed79b4
opti:rm useless code
2023-08-11 20:22:51 +08:00
7b22d37f12
fix:lost data when consumer db
2023-08-11 17:25:43 +08:00
4dae9f4eff
merge main to 3.0
2023-06-26 18:43:00 +08:00
c5dfe169a6
fix:error
2023-06-16 19:33:03 +08:00
8a81278024
fix:load pHandle if necessary wher tq restore
2023-06-13 15:14:11 +08:00
5301c5756a
other: merge main into 3.0.
2023-06-01 09:29:18 +08:00
b38e253019
fix(stream): set the skip offset when resume stream task.
2023-05-26 22:51:58 +08:00
a3e214b9e8
fix:put poll to push manager if wal not exist when offset is latest
2023-05-26 19:17:04 +08:00
5d5b2bb16a
refactor: do some internal refactor.
2023-05-18 12:59:19 +08:00
041ffa91bd
other: merge main.
2023-05-17 15:42:15 +08:00
366cd1871a
Merge pull request #21314 from taosdata/fix/liaohj_main
...
fix(stream):extract delete msg from wal.
2023-05-17 14:52:49 +08:00
30e7cb5860
fix(tmq): avoid return delete msg for table subscription.
2023-05-16 10:42:02 +08:00
d585f34ea9
fix(tmq): avoid seek to previous position.
2023-05-15 18:48:50 +08:00
36454c73ed
fix:add lock to pHandle for safety
2023-05-15 18:38:14 +08:00
170c603995
other: merge 3.0
2023-05-13 20:16:55 +08:00
7ef16e1922
other: merge main.
2023-05-12 11:49:53 +08:00
5708fcb5cb
Merge branch 'enh/3.0' into enh/rocksdbSstateMerge
2023-05-10 08:02:16 +00:00
8356533eb1
Merge branch 'enh/standVer' into enh/rocksdbSstateMerge
2023-05-09 12:13:16 +00:00
f9142c0ddb
fix:[TD24010] lost data if apply ver is small than commit ver
2023-05-08 16:49:56 +08:00
6b305bf745
refactor: do some internal refactor.
2023-05-06 13:35:18 +08:00
da6212bab0
other: merge main.
2023-05-06 12:51:38 +08:00
09a04052ec
refactor: do some internal refactor.
2023-05-04 16:15:14 +08:00
ace193ca9b
fix(stream): set the seek version if the reader's version is earlier than the first version in wal.
2023-04-29 23:34:49 +08:00
c654f1145d
enh(stream): add new msg for seek, and do some internal refactor.
2023-04-20 10:59:16 +08:00
70b45a4cf0
fix(stream): all data should be extracted from wal.
2023-04-13 23:22:09 +08:00
7419c0bfe9
enh(stream): the stream will start after vnode restore being completed.
2023-04-10 16:56:14 +08:00
f5b52749c2
refactor: do some internal refactor.
2023-04-09 01:39:09 +08:00
7616a283e3
fix:error in TD-23218 & remove useless logic
2023-03-18 18:23:38 +08:00
d04d610a85
Merge pull request #20061 from taosdata/FIX/TD-22611-main
...
enh: refactor syncBeginSnapshot and walBeginSnapshot for logRetention
2023-02-24 13:12:06 +08:00
b28c0ad952
fix:remove useless logic in tmq
2023-02-21 18:49:39 +08:00
0c7a4bfad9
enh: refactor syncBeginSnapshot and walBeginSnapshot for logRetention
2023-02-20 19:19:49 +08:00
5ce5dded75
enh: reset wal reader after walReadVer
2023-02-08 14:41:15 +08:00
f5c4ca3380
fix: wal ref
2023-01-28 17:17:55 +08:00
2a71d47668
fix: wal ref
2023-01-28 16:11:17 +08:00
a6fff95795
fix: close wal ref
2022-12-09 17:18:21 +08:00
3f1a0cefbb
fix: walSaveMeta ahead of deleting WAL files as gc in walEndSnapshot
...
delete WAL files in descending order during walRollback
2022-12-06 00:51:45 +08:00
051b73c1ed
Merge branch 3.0 to FIX/TD-19334-3.0
2022-11-17 17:28:11 +08:00
5878c9a31a
fix: impl ring log buffer
2022-11-07 14:27:22 +08:00
26778f29da
enh: add config for persist wal at the beginning of vnodeCommit
2022-11-01 10:42:13 +08:00
07db554fab
enh: persist wal at the beginning of vnodeCommit
2022-11-01 00:00:18 +08:00
75e5e490fd
refactor(stream): recover and fill history
2022-10-26 00:31:00 +08:00
7fb827debd
fix: refactor walScanLogGetLastVer, walCheckAndRepairMeta, and walCheckAndRepairIdx.
...
* search for the last entry in the contiguous range of valid WAL from the last pos fsynced as firstTrial
* find the last entry before the last pos fsynced backwards as second trial
* reserve sufficient space for computing CRC32 checksum, esp. of WAL record body
* rebuild meta info to resolve potential misalignment between lists of meta and actual log files
* retract commitIndex and appliedIndex to lastLogIndex if needed
* put an upper size limit on possibly corrupted WAL range to be recovered
2022-10-15 23:56:31 +08:00
b084dd8ee6
feat(tq): transport snapshot
2022-08-01 19:12:37 +08:00
bb6fabcc11
refactor(stream): use vnode meta
2022-07-30 20:20:12 +08:00
0c942e622a
enh(wal): remove file failure handling
2022-07-28 13:37:57 +08:00
0b8e9af8ec
refactor(wal)
2022-07-26 13:33:26 +08:00
dmchen
Benguang Zhao
Haojun Liao
wangmm0220
dapan1121
Haojun Liao
yihaoDeng
Xiaoyu Wang
Liu Jicong
Shengliang Guan
benguang.zhao