Benguang Zhao
|
c693384ec4
|
enh: replace asserts with error logs in walReadVer
|
2022-10-14 22:57:28 +08:00 |
|
Benguang Zhao
|
948fa60ef0
|
fix: check the length of remaining content for computing CRC32 chksum of WAL record body
|
2022-10-14 22:57:28 +08:00 |
|
Benguang Zhao
|
63b13db10f
|
fix: eliminate asserts on getting and committing log entries
|
2022-10-14 22:57:27 +08:00 |
|
Benguang Zhao
|
df18ddbbb5
|
enh: remove WAL log file corrupted completely
|
2022-10-14 22:57:27 +08:00 |
|
Benguang Zhao
|
9055f63742
|
fix: ftruncate WAL log after the last valid WAL record properly in walScanLogGetLastVer
|
2022-10-14 22:43:41 +08:00 |
|
Benguang Zhao
|
76865258cf
|
enh: protect WAL meta by flushing to a tmpfile at first and then renaming
|
2022-10-14 22:32:15 +08:00 |
|
Benguang Zhao
|
36bf800e15
|
fix: improve fault tolerance on disk space full with error handling enhanced
|
2022-10-14 22:02:27 +08:00 |
Liu Jicong
|
6f8d4d6955
|
fix(tmq): push msg
|
2022-10-14 13:31:05 +08:00 |
|
Liu Jicong
|
db6b0503a1
|
refactor(stream): change state table name
|
2022-10-12 14:34:04 +08:00 |
|
Liu Jicong
|
69352e6e89
|
fix tbanme length check
|
2022-10-12 10:50:54 +08:00 |
|
Liu Jicong
|
41474e40bf
|
enh(wal): auto fix
|
2022-10-12 02:08:58 +08:00 |
|
Liu Jicong
|
26fae13c61
|
refactor(stream): state/session map id to tbname
|
2022-10-11 15:27:56 +08:00 |
|
Liu Jicong
|
fbfae317b3
|
refactor
|
2022-10-11 02:09:15 +08:00 |
|
Liu Jicong
|
b1594a6857
|
fix coverity scan
|
2022-10-10 11:44:17 +08:00 |
|
Liu Jicong
|
78b4d10249
|
optimize fix condition
|
2022-09-22 00:54:23 +08:00 |
|
Liu Jicong
|
a6733dbbd1
|
feat(wal): auto fix corrupt file
|
2022-09-21 23:51:24 +08:00 |
|
Liu Jicong
|
756a2d3d5d
|
merge 3.0
|
2022-09-19 19:29:20 +08:00 |
|
Liu Jicong
|
1604d72967
|
add log for wal
|
2022-09-19 17:40:38 +08:00 |
|
Liu Jicong
|
86c0fb56e0
|
enhance stream backend for sma
|
2022-09-19 17:27:25 +08:00 |
Minglei Jin
|
b6ddf5bfd7
|
fix: update wal reader's curFileFirstVer
|
2022-09-08 18:30:15 +08:00 |
wangmm0220
|
c5874ca892
|
fix: add filter logic for tmq in stable wal
|
2022-08-31 18:32:28 +08:00 |
|
Liu Jicong
|
d7b804e02e
|
fix stream load task
|
2022-08-24 10:42:34 +08:00 |
|
Liu Jicong
|
2d628491b2
|
feat(stream): support tdb state backend
|
2022-08-23 19:30:04 +08:00 |
|
Liu Jicong
|
18f6fb6123
|
enh(tmq): speed up consumer recover
|
2022-08-10 16:04:03 +08:00 |
|
Liu Jicong
|
f0f4748320
|
fix(util): concurrently hash iterate
|
2022-08-05 16:14:19 +08:00 |
Shengliang Guan
|
56f2e49764
|
refactor: adjust logs
|
2022-08-02 17:12:07 +08:00 |
|
Shengliang Guan
|
bd31c9da5a
|
Merge pull request #15657 from taosdata/fix/dnode
fix: write snapshot after apply queue is empty
|
2022-08-01 20:13:08 +08:00 |
|
Liu Jicong
|
b084dd8ee6
|
feat(tq): transport snapshot
|
2022-08-01 19:12:37 +08:00 |
|
Shengliang Guan
|
99f29f6455
|
refactor: adjust log
|
2022-08-01 17:23:52 +08:00 |
|
Liu Jicong
|
bb6fabcc11
|
refactor(stream): use vnode meta
|
2022-07-30 20:20:12 +08:00 |
|
Liu Jicong
|
6d67b17113
|
enh(wal): add lock to guarantee read behaviour
|
2022-07-30 16:35:49 +08:00 |
|
Liu Jicong
|
0c942e622a
|
enh(wal): remove file failure handling
|
2022-07-28 13:37:57 +08:00 |
|
Liu Jicong
|
3fa5791889
|
fix(stream): dispatch
|
2022-07-27 10:52:25 +08:00 |
|
Liu Jicong
|
ecb7a9c133
|
fix(wal): snapshot end with no deleting
|
2022-07-26 14:53:39 +08:00 |
|
Liu Jicong
|
c2164dd8aa
|
fix(wal): snapshot end with no deleting
|
2022-07-26 14:13:03 +08:00 |
|
Liu Jicong
|
0b8e9af8ec
|
refactor(wal)
|
2022-07-26 13:33:26 +08:00 |
|
Liu Jicong
|
222e925644
|
feat(wal): ref
|
2022-07-25 16:40:19 +08:00 |
|
Shengliang Guan
|
5b654779ba
|
Merge pull request #15372 from taosdata/fix/tsim
test: regression case
|
2022-07-25 15:23:41 +08:00 |
|
Liu Jicong
|
095f6aa4e0
|
fix(tmq): correctly set reader status
|
2022-07-23 20:07:16 +08:00 |
|
Liu Jicong
|
5d20804e76
|
fix(wal): use after free
|
2022-07-20 17:10:41 +08:00 |
|
Liu Jicong
|
b74560537c
|
fix(stream): check task exist
|
2022-07-20 16:25:20 +08:00 |
|
Liu Jicong
|
bf37f3fa68
|
feat(wal): remove wal log size limitation
|
2022-07-20 16:15:53 +08:00 |
|
Liu Jicong
|
a3133b9f6d
|
feat(wal): log applied ver
|
2022-07-20 10:55:28 +08:00 |
|
Liu Jicong
|
bc1af6deaf
|
refactor(stream): batch optimization for submit msg
|
2022-07-19 15:52:08 +08:00 |
|
Liu Jicong
|
053786e6b4
|
fix(stream): data exec
|
2022-07-18 15:50:36 +08:00 |
|
Liu Jicong
|
d637ffe22c
|
refactor(tmq): prepare only needed
|
2022-07-12 14:10:22 +08:00 |
|
Liu Jicong
|
c6052fadba
|
feat(wal): add append interface
|
2022-07-11 16:22:51 +08:00 |
|
Liu Jicong
|
9fd5ec9020
|
fix(wal): rollback
|
2022-07-11 13:38:50 +08:00 |
|
Liu Jicong
|
219d966b25
|
fix(wal): read after rolling
|
2022-07-10 21:02:25 +08:00 |
|
Liu Jicong
|
8afb54548f
|
refactor(stream)
|
2022-07-10 13:21:37 +08:00 |
|
Liu Jicong
|
e9077c036f
|
merge from 3.0
|
2022-07-10 11:24:37 +08:00 |
|
Liu Jicong
|
a2107992e2
|
refactor(stream)
|
2022-07-10 11:18:15 +08:00 |
|
Shengliang Guan
|
c53a84b733
|
Merge remote-tracking branch 'origin/3.0' into fix/valgrind
|
2022-07-09 20:13:26 +08:00 |
|
Liu Jicong
|
8d01ae00cb
|
fix(tmq): offset
|
2022-07-08 21:37:15 +08:00 |
|
Liu Jicong
|
a9e75c87aa
|
refactor(stream): internal refactor
|
2022-07-08 19:30:40 +08:00 |
|
Shengliang Guan
|
de644c7d43
|
refactor: adjust logs
|
2022-07-08 18:33:52 +08:00 |
|
Shengliang Guan
|
a5e8ddbc56
|
refactor: adjust logs
|
2022-07-08 18:00:19 +08:00 |
|
Liu Jicong
|
3cd5a35054
|
refactor(stream): internal refactor
|
2022-07-08 17:48:34 +08:00 |
|
Shengliang Guan
|
361c21a35c
|
refactor: adjust logs
|
2022-07-08 17:27:06 +08:00 |
|
Shengliang Guan
|
dca93b18cc
|
refactor: adjust logs
|
2022-07-08 16:57:54 +08:00 |
|
Liu Jicong
|
4a648d711f
|
feat(wal): support filter
|
2022-07-07 13:56:47 +08:00 |
|
Liu Jicong
|
1ec57798d2
|
ci: remove unstable case
|
2022-07-07 11:45:28 +08:00 |
|
Liu Jicong
|
ca3d918004
|
fix(wal): mutex
|
2022-07-07 09:58:23 +08:00 |
|
Liu Jicong
|
8c5dbde918
|
refactor(stream): stream reader created in scanner
|
2022-07-06 14:20:07 +08:00 |
|
Shengliang Guan
|
3cc215bdcc
|
fix: crash while write wal in multi-threaded way
|
2022-07-04 17:54:00 +08:00 |
|
Liu Jicong
|
52d09b4173
|
refactor(wal)
|
2022-07-01 14:39:21 +08:00 |
|
Liu Jicong
|
7a65589525
|
feat(wal): add api to check log existance
|
2022-07-01 10:15:05 +08:00 |
|
Liu Jicong
|
996f995644
|
fix(sma): drop stream when drop sma
|
2022-06-25 18:14:42 +08:00 |
|
Liu Jicong
|
bdd4134fc1
|
Revert "fix(sma): drop stream when drop sma"
|
2022-06-25 18:11:11 +08:00 |
|
Liu Jicong
|
47ae534c0f
|
fix(sma): drop stream when drop sma
|
2022-06-25 17:44:54 +08:00 |
|
Liu Jicong
|
81ed902d7f
|
fix(stream): stream rsp to retrieve msg if data is empty
|
2022-06-25 14:03:06 +08:00 |
|
Liu Jicong
|
f53521cb8c
|
test(stream): partition by tbname
|
2022-06-24 16:50:11 +08:00 |
|
Liu Jicong
|
ef554e9884
|
Merge pull request #14191 from taosdata/feature/stream
fix(wal): set first version to -1 if all log rollbacked
|
2022-06-24 11:45:24 +08:00 |
|
Liu Jicong
|
a1cc2571ee
|
fix(wal): set first version to -1 if all log rollbacked
|
2022-06-24 11:13:40 +08:00 |
Minghao Li
|
983bf5b865
|
fix(wal): read handle version
|
2022-06-23 15:26:42 +08:00 |
|
Liu Jicong
|
04f11e2646
|
feat(wal): provide is empty api
|
2022-06-22 19:40:37 +08:00 |
|
Liu Jicong
|
82a1cc8e41
|
fix(wal): return correct msg for open wal file
|
2022-06-22 11:21:33 +08:00 |
|
Minghao Li
|
363c98e9ed
|
refactor(sync): abstract for log store
|
2022-06-21 17:45:08 +08:00 |
|
Liu Jicong
|
5572abe1b4
|
feat(stream): drop task
|
2022-06-15 21:41:59 +08:00 |
|
Liu Jicong
|
7ab3a1e42c
|
feat(wal): support restore from snapshot
|
2022-06-09 23:08:06 +08:00 |
|
Liu Jicong
|
b23fa19bc4
|
feat(stream): sink table can be other db
|
2022-06-09 16:50:11 +08:00 |
|
Liu Jicong
|
0ead238adb
|
feat(tmq): support check col and tag modifiable
|
2022-06-02 15:53:30 +08:00 |
|
Liu Jicong
|
361332505c
|
feat(wal): support restore from snapshot
|
2022-06-02 11:38:04 +08:00 |
|
Liu Jicong
|
0ad9c4cebd
|
fix: init once
|
2022-05-23 20:58:40 +08:00 |
|
Liu Jicong
|
3629958b43
|
feat(tmq): serializer and deserializer for tq exec
|
2022-05-23 20:31:35 +08:00 |
afwerar
|
5acf419019
|
fix(os): win not close file ctest error
|
2022-05-21 23:47:39 +08:00 |
|
Shengliang Guan
|
77575d1e70
|
refactor: shm queue in multi process mode
|
2022-05-18 14:20:46 +08:00 |
|
Liu Jicong
|
acea83e535
|
fix(wal): wal read error
|
2022-05-13 01:22:29 +08:00 |
|
Liu Jicong
|
a8831af513
|
fix(wal): int overflow
|
2022-05-12 22:40:32 +08:00 |
|
Liu Jicong
|
af2d2db5d3
|
fix(wal): int overflow
|
2022-05-12 20:56:29 +08:00 |
|
Liu Jicong
|
1c98d780a0
|
fix(wal): int overflow
|
2022-05-12 20:51:08 +08:00 |
|
Liu Jicong
|
2218213134
|
enh(wal): add log
|
2022-05-12 17:01:33 +08:00 |
|
Liu Jicong
|
06853043bd
|
feat(tmq): add config msg.with.table.name
|
2022-05-12 14:57:58 +08:00 |
|
Liu Jicong
|
1dbe0650e0
|
enh(wal): set errno code
|
2022-05-12 14:20:50 +08:00 |
|
Liu Jicong
|
714dd4f497
|
enh(tmq): only read committed log
|
2022-05-11 14:42:20 +08:00 |
|
Liu Jicong
|
661fbd2e46
|
enh(stream): improve topic show
|
2022-05-09 16:35:59 +08:00 |
|
Liu Jicong
|
861fde2508
|
fix(stream): create stb in stream
|
2022-05-07 10:21:51 +08:00 |
|
Liu Jicong
|
6b18948884
|
enh(wal): set error code
|
2022-05-07 00:14:52 +08:00 |
|
Liu Jicong
|
fa03303bad
|
reject wal write if exceeds limit
|
2022-04-26 17:19:09 +08:00 |
|
Liu Jicong
|
28325c9080
|
reject wal write if exceeds limit
|
2022-04-26 17:18:10 +08:00 |