22776e60d5
fix:control memory size if consumer group is too much
2023-06-15 14:51:04 +08:00
5301c5756a
other: merge main into 3.0.
2023-06-01 09:29:18 +08:00
b38e253019
fix(stream): set the skip offset when resume stream task.
2023-05-26 22:51:58 +08:00
a3e214b9e8
fix:put poll to push manager if wal not exist when offset is latest
2023-05-26 19:17:04 +08:00
5d5b2bb16a
refactor: do some internal refactor.
2023-05-18 12:59:19 +08:00
041ffa91bd
other: merge main.
2023-05-17 15:42:15 +08:00
366cd1871a
Merge pull request #21314 from taosdata/fix/liaohj_main
...
fix(stream):extract delete msg from wal.
2023-05-17 14:52:49 +08:00
30e7cb5860
fix(tmq): avoid return delete msg for table subscription.
2023-05-16 10:42:02 +08:00
d585f34ea9
fix(tmq): avoid seek to previous position.
2023-05-15 18:48:50 +08:00
36454c73ed
fix:add lock to pHandle for safety
2023-05-15 18:38:14 +08:00
170c603995
other: merge 3.0
2023-05-13 20:16:55 +08:00
7ef16e1922
other: merge main.
2023-05-12 11:49:53 +08:00
5708fcb5cb
Merge branch 'enh/3.0' into enh/rocksdbSstateMerge
2023-05-10 08:02:16 +00:00
8356533eb1
Merge branch 'enh/standVer' into enh/rocksdbSstateMerge
2023-05-09 12:13:16 +00:00
f9142c0ddb
fix:[TD24010] lost data if apply ver is small than commit ver
2023-05-08 16:49:56 +08:00
6b305bf745
refactor: do some internal refactor.
2023-05-06 13:35:18 +08:00
da6212bab0
other: merge main.
2023-05-06 12:51:38 +08:00
09a04052ec
refactor: do some internal refactor.
2023-05-04 16:15:14 +08:00
ace193ca9b
fix(stream): set the seek version if the reader's version is earlier than the first version in wal.
2023-04-29 23:34:49 +08:00
c654f1145d
enh(stream): add new msg for seek, and do some internal refactor.
2023-04-20 10:59:16 +08:00
70b45a4cf0
fix(stream): all data should be extracted from wal.
2023-04-13 23:22:09 +08:00
7419c0bfe9
enh(stream): the stream will start after vnode restore being completed.
2023-04-10 16:56:14 +08:00
f5b52749c2
refactor: do some internal refactor.
2023-04-09 01:39:09 +08:00
7616a283e3
fix:error in TD-23218 & remove useless logic
2023-03-18 18:23:38 +08:00
d04d610a85
Merge pull request #20061 from taosdata/FIX/TD-22611-main
...
enh: refactor syncBeginSnapshot and walBeginSnapshot for logRetention
2023-02-24 13:12:06 +08:00
b28c0ad952
fix:remove useless logic in tmq
2023-02-21 18:49:39 +08:00
0c7a4bfad9
enh: refactor syncBeginSnapshot and walBeginSnapshot for logRetention
2023-02-20 19:19:49 +08:00
5ce5dded75
enh: reset wal reader after walReadVer
2023-02-08 14:41:15 +08:00
f5c4ca3380
fix: wal ref
2023-01-28 17:17:55 +08:00
2a71d47668
fix: wal ref
2023-01-28 16:11:17 +08:00
a6fff95795
fix: close wal ref
2022-12-09 17:18:21 +08:00
3f1a0cefbb
fix: walSaveMeta ahead of deleting WAL files as gc in walEndSnapshot
...
delete WAL files in descending order during walRollback
2022-12-06 00:51:45 +08:00
051b73c1ed
Merge branch 3.0 to FIX/TD-19334-3.0
2022-11-17 17:28:11 +08:00
5878c9a31a
fix: impl ring log buffer
2022-11-07 14:27:22 +08:00
26778f29da
enh: add config for persist wal at the beginning of vnodeCommit
2022-11-01 10:42:13 +08:00
07db554fab
enh: persist wal at the beginning of vnodeCommit
2022-11-01 00:00:18 +08:00
75e5e490fd
refactor(stream): recover and fill history
2022-10-26 00:31:00 +08:00
7fb827debd
fix: refactor walScanLogGetLastVer, walCheckAndRepairMeta, and walCheckAndRepairIdx.
...
* search for the last entry in the contiguous range of valid WAL from the last pos fsynced as firstTrial
* find the last entry before the last pos fsynced backwards as second trial
* reserve sufficient space for computing CRC32 checksum, esp. of WAL record body
* rebuild meta info to resolve potential misalignment between lists of meta and actual log files
* retract commitIndex and appliedIndex to lastLogIndex if needed
* put an upper size limit on possibly corrupted WAL range to be recovered
2022-10-15 23:56:31 +08:00
b084dd8ee6
feat(tq): transport snapshot
2022-08-01 19:12:37 +08:00
bb6fabcc11
refactor(stream): use vnode meta
2022-07-30 20:20:12 +08:00
0c942e622a
enh(wal): remove file failure handling
2022-07-28 13:37:57 +08:00
0b8e9af8ec
refactor(wal)
2022-07-26 13:33:26 +08:00
5b654779ba
Merge pull request #15372 from taosdata/fix/tsim
...
test: regression case
2022-07-25 15:23:41 +08:00
095f6aa4e0
fix(tmq): correctly set reader status
2022-07-23 20:07:16 +08:00
bf37f3fa68
feat(wal): remove wal log size limitation
2022-07-20 16:15:53 +08:00
a3133b9f6d
feat(wal): log applied ver
2022-07-20 10:55:28 +08:00
c6052fadba
feat(wal): add append interface
2022-07-11 16:22:51 +08:00
219d966b25
fix(wal): read after rolling
2022-07-10 21:02:25 +08:00
e9077c036f
merge from 3.0
2022-07-10 11:24:37 +08:00
a2107992e2
refactor(stream)
2022-07-10 11:18:15 +08:00
wangmm0220
Haojun Liao
Haojun Liao
yihaoDeng
Xiaoyu Wang
Benguang Zhao
Liu Jicong
Shengliang Guan
benguang.zhao