bc469f7f7b
fix(stream): delete tb should be checked in write thread
2022-11-08 11:30:29 +08:00
5878c9a31a
fix: impl ring log buffer
2022-11-07 14:27:22 +08:00
871757240a
Merge pull request #17777 from taosdata/FIX/TS-1984-3.0
...
fix: fsync wal files and meta if data size not synced yet beyond a threshold
2022-11-01 18:53:10 +08:00
4237cafb21
enh: rename walRecoverSizeLimit to walFsyncDataSizeLimit
2022-11-01 17:19:33 +08:00
26778f29da
enh: add config for persist wal at the beginning of vnodeCommit
2022-11-01 10:42:13 +08:00
cccfa17027
fix: fsync wal files and their meta if data size unsynced exceeds a limit
2022-10-31 23:58:49 +08:00
1d0eae197d
fix: not allow to rollback WAL across snapshot point
2022-10-31 21:06:23 +08:00
25bb914ac1
merge 3.0
2022-10-21 16:30:43 +08:00
1c26f1b53e
fix(wal): reference
2022-10-21 16:13:55 +08:00
05d04dcd2d
Merge remote-tracking branch 'origin/3.0' into enh/TD-19461
2022-10-21 11:07:48 +08:00
6c3cd3e19e
test: adjust log
2022-10-21 10:39:29 +08:00
06f5d91d21
enh: provide more info on misalignment detection of idx entries after appending
2022-10-20 15:17:52 +08:00
3b0968d7f9
enh: enable the -Wformat=2 compiler option
2022-10-19 09:24:15 +08:00
3cbfd2d160
Merge pull request #17392 from taosdata/FIX/TD-19183-3.0
...
enh: not allowed to start on disk space unavailable
2022-10-18 17:46:14 +08:00
cf2b6ccbfb
enh: write idx ahead of writing its log entry in WAL
2022-10-18 11:23:24 +08:00
af9aa9d783
enh: assert on alignment of idx entries in walWriteIndex
2022-10-18 11:23:13 +08:00
f0427c9322
fix: ftrunc on appending WAL log failure for recovery in walWriteImpl
2022-10-18 11:22:21 +08:00
9a3ac0ca57
Merge branch '3.0' into feature/stream
2022-10-17 10:17:45 +08:00
6f9153c6e3
fix: error handling
2022-10-17 10:13:10 +08:00
616eb5f903
Merge branch '3.0' into FIX/TD-19239-3.0
2022-10-16 00:29:01 +08:00
b6c31ee67d
fix: fsync the current wal log and idx files at first to ensure validity of meta in walSaveMeta
2022-10-15 23:57:37 +08:00
7fb827debd
fix: refactor walScanLogGetLastVer, walCheckAndRepairMeta, and walCheckAndRepairIdx.
...
* search for the last entry in the contiguous range of valid WAL from the last pos fsynced as firstTrial
* find the last entry before the last pos fsynced backwards as second trial
* reserve sufficient space for computing CRC32 checksum, esp. of WAL record body
* rebuild meta info to resolve potential misalignment between lists of meta and actual log files
* retract commitIndex and appliedIndex to lastLogIndex if needed
* put an upper size limit on possibly corrupted WAL range to be recovered
2022-10-15 23:56:31 +08:00
6f8d4d6955
fix(tmq): push msg
2022-10-14 13:31:05 +08:00
b1594a6857
fix coverity scan
2022-10-10 11:44:17 +08:00
18f6fb6123
enh(tmq): speed up consumer recover
2022-08-10 16:04:03 +08:00
f0f4748320
fix(util): concurrently hash iterate
2022-08-05 16:14:19 +08:00
b084dd8ee6
feat(tq): transport snapshot
2022-08-01 19:12:37 +08:00
bb6fabcc11
refactor(stream): use vnode meta
2022-07-30 20:20:12 +08:00
6d67b17113
enh(wal): add lock to guarantee read behaviour
2022-07-30 16:35:49 +08:00
0c942e622a
enh(wal): remove file failure handling
2022-07-28 13:37:57 +08:00
3fa5791889
fix(stream): dispatch
2022-07-27 10:52:25 +08:00
ecb7a9c133
fix(wal): snapshot end with no deleting
2022-07-26 14:53:39 +08:00
c2164dd8aa
fix(wal): snapshot end with no deleting
2022-07-26 14:13:03 +08:00
0b8e9af8ec
refactor(wal)
2022-07-26 13:33:26 +08:00
5b654779ba
Merge pull request #15372 from taosdata/fix/tsim
...
test: regression case
2022-07-25 15:23:41 +08:00
bf37f3fa68
feat(wal): remove wal log size limitation
2022-07-20 16:15:53 +08:00
a3133b9f6d
feat(wal): log applied ver
2022-07-20 10:55:28 +08:00
c6052fadba
feat(wal): add append interface
2022-07-11 16:22:51 +08:00
9fd5ec9020
fix(wal): rollback
2022-07-11 13:38:50 +08:00
de644c7d43
refactor: adjust logs
2022-07-08 18:33:52 +08:00
361c21a35c
refactor: adjust logs
2022-07-08 17:27:06 +08:00
dca93b18cc
refactor: adjust logs
2022-07-08 16:57:54 +08:00
ca3d918004
fix(wal): mutex
2022-07-07 09:58:23 +08:00
8c5dbde918
refactor(stream): stream reader created in scanner
2022-07-06 14:20:07 +08:00
3cc215bdcc
fix: crash while write wal in multi-threaded way
2022-07-04 17:54:00 +08:00
52d09b4173
refactor(wal)
2022-07-01 14:39:21 +08:00
81ed902d7f
fix(stream): stream rsp to retrieve msg if data is empty
2022-06-25 14:03:06 +08:00
f53521cb8c
test(stream): partition by tbname
2022-06-24 16:50:11 +08:00
ef554e9884
Merge pull request #14191 from taosdata/feature/stream
...
fix(wal): set first version to -1 if all log rollbacked
2022-06-24 11:45:24 +08:00
a1cc2571ee
fix(wal): set first version to -1 if all log rollbacked
2022-06-24 11:13:40 +08:00
983bf5b865
fix(wal): read handle version
2022-06-23 15:26:42 +08:00
04f11e2646
feat(wal): provide is empty api
2022-06-22 19:40:37 +08:00
5572abe1b4
feat(stream): drop task
2022-06-15 21:41:59 +08:00
7ab3a1e42c
feat(wal): support restore from snapshot
2022-06-09 23:08:06 +08:00
b23fa19bc4
feat(stream): sink table can be other db
2022-06-09 16:50:11 +08:00
0ead238adb
feat(tmq): support check col and tag modifiable
2022-06-02 15:53:30 +08:00
361332505c
feat(wal): support restore from snapshot
2022-06-02 11:38:04 +08:00
5acf419019
fix(os): win not close file ctest error
2022-05-21 23:47:39 +08:00
af2d2db5d3
fix(wal): int overflow
2022-05-12 20:56:29 +08:00
1dbe0650e0
enh(wal): set errno code
2022-05-12 14:20:50 +08:00
6b18948884
enh(wal): set error code
2022-05-07 00:14:52 +08:00
fa03303bad
reject wal write if exceeds limit
2022-04-26 17:19:09 +08:00
28325c9080
reject wal write if exceeds limit
2022-04-26 17:18:10 +08:00
a14b8dcc99
enh(tmq): delayed task
2022-04-26 14:32:37 +08:00
575f64197d
enh(wal): skip read for specific msg
2022-04-24 16:51:32 +08:00
3d972f81a2
refacor(wal): rename len to bodyLen
2022-04-24 13:42:54 +08:00
c11946fd75
[TD-13756]<fix>: Fix macro name error.
2022-04-11 18:55:43 +08:00
96eb6a9bcf
wal add sync info
2022-03-26 15:47:58 +08:00
7bd71bcb81
wal add sync info
2022-03-26 15:36:49 +08:00
79057240bd
[TD-13759]<fix>: redefine thread api.
2022-03-20 00:47:45 +08:00
913e8d70d8
define stream token
2022-03-09 19:51:08 +08:00
01cac6b06e
fix multiple polling
2022-03-04 17:14:26 +08:00
71e4c41941
[TD-13756]<fix>: file system remove func.
2022-03-04 16:45:20 +08:00
b7788aca04
fix
2022-03-02 16:22:43 +08:00
68f3de6111
remove tfile
2022-02-28 13:49:38 +08:00
dbb8cfceaf
[TD-13062]<fix>: file system judge pointer error.
2022-02-25 18:07:30 +08:00
5a37fdf28f
[TD-13062]<fix>: cross platform file system.
2022-02-25 01:47:20 +08:00
c62304531a
fix query error
2022-01-26 09:56:32 +08:00
47f1558e7c
add wal handle meta corrupt
2022-01-11 15:40:10 +08:00
1e17d776f9
fix crash
2022-01-10 16:13:05 +08:00
4d635478fe
fix
2022-01-07 18:59:17 +08:00
df554c03fc
handle merge conflict
2022-01-06 10:44:34 +08:00
0ba5427a9b
handle subscribe
2022-01-06 10:28:34 +08:00
81e7ff450e
minor changes
2022-01-04 13:40:47 +08:00
d037b24e05
refactor wal
2021-12-17 13:40:27 +08:00
dfc8c4e0b7
format code
2021-12-16 15:04:13 +08:00
3d141cf109
refactor wal and tq
2021-12-15 17:17:50 +08:00
5874463cb1
refactor wal
2021-12-14 18:14:45 +08:00
43a2bcdce3
fix wal read handle
2021-12-14 14:38:52 +08:00
dc24592929
add wal read handle
2021-12-13 18:33:30 +08:00
b2083ea62f
fix memory leak
2021-12-13 13:58:54 +08:00
9e4b890727
add test for wal snapshot
2021-12-11 17:18:18 +08:00
03a54b5a35
make tfinit called once
2021-12-10 10:30:57 +08:00
cf93f4c239
add unit test for wal
2021-12-09 18:32:38 +08:00
6de9692b7d
refactor wal
2021-12-03 14:28:54 +08:00
2e859aa138
refactor wal
2021-11-30 16:44:11 +08:00
9f75ad0652
refactor wal
2021-11-26 14:22:16 +08:00
044b02bb60
add wal implementation
2021-11-23 15:46:23 +08:00
Liu Jicong
Benguang Zhao
Shengliang Guan
benguang.zhao
Minghao Li
afwerar