Haojun Liao
fbc9e77004
Merge branch '3.0' into refact/submit_req
2022-12-26 10:26:17 +08:00
kailixu
ed3a0c1dc1
chore: vgId format uniform
2022-12-24 23:44:01 +08:00
Xiaoyu Wang
0c269c317b
merge 3.0
2022-12-23 17:50:05 +08:00
Liu Jicong
50729f0cc4
refactor: remove assert
2022-12-21 14:16:28 +08:00
Shengliang Guan
41dcd32b8e
refact: adjust some logs
2022-12-20 15:01:03 +08:00
Liu Jicong
271822ebc4
refactor: support submitreq2
2022-12-08 01:55:47 +08:00
Shengliang Guan
6d94afe48f
Revert "refact: adjust some assert cases"
2022-12-07 21:51:17 +08:00
Shengliang Guan
d5126d469a
refact: replcase ASSERT with tAssert
2022-12-07 18:42:48 +08:00
Shengliang Guan
f69a188f7e
refact: replcase ASSERT with tAssert
2022-12-07 18:37:40 +08:00
Benguang Zhao
3f1a0cefbb
fix: walSaveMeta ahead of deleting WAL files as gc in walEndSnapshot
...
delete WAL files in descending order during walRollback
2022-12-06 00:51:45 +08:00
Shengliang Guan
d9c261cd13
refact: remove some error codes
2022-12-03 10:17:02 +08:00
Liu Jicong
f0a66602da
fix(taosx): set version
2022-11-01 19:28:42 +08:00
Liu Jicong
94e7c79ca0
fix(tmq): handle adding subtable for subscribing stb
2022-11-01 18:18:26 +08:00
Liu Jicong
ce1b6147a0
enh(client): add debug log
2022-10-20 15:34:27 +08:00
Benguang Zhao
3b0968d7f9
enh: enable the -Wformat=2 compiler option
2022-10-19 09:24:15 +08:00
Benguang Zhao
616eb5f903
Merge branch '3.0' into FIX/TD-19239-3.0
2022-10-16 00:29:01 +08:00
Benguang Zhao
7fb827debd
fix: refactor walScanLogGetLastVer, walCheckAndRepairMeta, and walCheckAndRepairIdx.
...
* search for the last entry in the contiguous range of valid WAL from the last pos fsynced as firstTrial
* find the last entry before the last pos fsynced backwards as second trial
* reserve sufficient space for computing CRC32 checksum, esp. of WAL record body
* rebuild meta info to resolve potential misalignment between lists of meta and actual log files
* retract commitIndex and appliedIndex to lastLogIndex if needed
* put an upper size limit on possibly corrupted WAL range to be recovered
2022-10-15 23:56:31 +08:00
Benguang Zhao
c693384ec4
enh: replace asserts with error logs in walReadVer
2022-10-14 22:57:28 +08:00
Benguang Zhao
63b13db10f
fix: eliminate asserts on getting and committing log entries
2022-10-14 22:57:27 +08:00
Liu Jicong
6f8d4d6955
fix(tmq): push msg
2022-10-14 13:31:05 +08:00
Liu Jicong
db6b0503a1
refactor(stream): change state table name
2022-10-12 14:34:04 +08:00
Liu Jicong
69352e6e89
fix tbanme length check
2022-10-12 10:50:54 +08:00
Liu Jicong
b1594a6857
fix coverity scan
2022-10-10 11:44:17 +08:00
Minglei Jin
b6ddf5bfd7
fix: update wal reader's curFileFirstVer
2022-09-08 18:30:15 +08:00
wangmm0220
c5874ca892
fix: add filter logic for tmq in stable wal
2022-08-31 18:32:28 +08:00
Shengliang Guan
56f2e49764
refactor: adjust logs
2022-08-02 17:12:07 +08:00
Shengliang Guan
99f29f6455
refactor: adjust log
2022-08-01 17:23:52 +08:00
Liu Jicong
6d67b17113
enh(wal): add lock to guarantee read behaviour
2022-07-30 16:35:49 +08:00
Liu Jicong
0c942e622a
enh(wal): remove file failure handling
2022-07-28 13:37:57 +08:00
Liu Jicong
222e925644
feat(wal): ref
2022-07-25 16:40:19 +08:00
Shengliang Guan
5b654779ba
Merge pull request #15372 from taosdata/fix/tsim
...
test: regression case
2022-07-25 15:23:41 +08:00
Liu Jicong
095f6aa4e0
fix(tmq): correctly set reader status
2022-07-23 20:07:16 +08:00
Liu Jicong
a3133b9f6d
feat(wal): log applied ver
2022-07-20 10:55:28 +08:00
Liu Jicong
bc1af6deaf
refactor(stream): batch optimization for submit msg
2022-07-19 15:52:08 +08:00
Liu Jicong
053786e6b4
fix(stream): data exec
2022-07-18 15:50:36 +08:00
Liu Jicong
d637ffe22c
refactor(tmq): prepare only needed
2022-07-12 14:10:22 +08:00
Liu Jicong
219d966b25
fix(wal): read after rolling
2022-07-10 21:02:25 +08:00
Liu Jicong
8afb54548f
refactor(stream)
2022-07-10 13:21:37 +08:00
Liu Jicong
e9077c036f
merge from 3.0
2022-07-10 11:24:37 +08:00
Liu Jicong
a2107992e2
refactor(stream)
2022-07-10 11:18:15 +08:00
Shengliang Guan
c53a84b733
Merge remote-tracking branch 'origin/3.0' into fix/valgrind
2022-07-09 20:13:26 +08:00
Liu Jicong
8d01ae00cb
fix(tmq): offset
2022-07-08 21:37:15 +08:00
Liu Jicong
a9e75c87aa
refactor(stream): internal refactor
2022-07-08 19:30:40 +08:00
Shengliang Guan
de644c7d43
refactor: adjust logs
2022-07-08 18:33:52 +08:00
Shengliang Guan
a5e8ddbc56
refactor: adjust logs
2022-07-08 18:00:19 +08:00
Liu Jicong
3cd5a35054
refactor(stream): internal refactor
2022-07-08 17:48:34 +08:00
Shengliang Guan
361c21a35c
refactor: adjust logs
2022-07-08 17:27:06 +08:00
Shengliang Guan
dca93b18cc
refactor: adjust logs
2022-07-08 16:57:54 +08:00
Liu Jicong
4a648d711f
feat(wal): support filter
2022-07-07 13:56:47 +08:00
Liu Jicong
1ec57798d2
ci: remove unstable case
2022-07-07 11:45:28 +08:00
Liu Jicong
52d09b4173
refactor(wal)
2022-07-01 14:39:21 +08:00
Liu Jicong
996f995644
fix(sma): drop stream when drop sma
2022-06-25 18:14:42 +08:00
Liu Jicong
bdd4134fc1
Revert "fix(sma): drop stream when drop sma"
2022-06-25 18:11:11 +08:00
Liu Jicong
47ae534c0f
fix(sma): drop stream when drop sma
2022-06-25 17:44:54 +08:00
Minghao Li
983bf5b865
fix(wal): read handle version
2022-06-23 15:26:42 +08:00
Liu Jicong
82a1cc8e41
fix(wal): return correct msg for open wal file
2022-06-22 11:21:33 +08:00
Minghao Li
363c98e9ed
refactor(sync): abstract for log store
2022-06-21 17:45:08 +08:00
Liu Jicong
5572abe1b4
feat(stream): drop task
2022-06-15 21:41:59 +08:00
Liu Jicong
acea83e535
fix(wal): wal read error
2022-05-13 01:22:29 +08:00
Liu Jicong
a8831af513
fix(wal): int overflow
2022-05-12 22:40:32 +08:00
Liu Jicong
af2d2db5d3
fix(wal): int overflow
2022-05-12 20:56:29 +08:00
Liu Jicong
1c98d780a0
fix(wal): int overflow
2022-05-12 20:51:08 +08:00
Liu Jicong
2218213134
enh(wal): add log
2022-05-12 17:01:33 +08:00
Liu Jicong
06853043bd
feat(tmq): add config msg.with.table.name
2022-05-12 14:57:58 +08:00
Liu Jicong
1dbe0650e0
enh(wal): set errno code
2022-05-12 14:20:50 +08:00
Liu Jicong
714dd4f497
enh(tmq): only read committed log
2022-05-11 14:42:20 +08:00
Liu Jicong
661fbd2e46
enh(stream): improve topic show
2022-05-09 16:35:59 +08:00
Liu Jicong
861fde2508
fix(stream): create stb in stream
2022-05-07 10:21:51 +08:00
Liu Jicong
575f64197d
enh(wal): skip read for specific msg
2022-04-24 16:51:32 +08:00
Liu Jicong
3d972f81a2
refacor(wal): rename len to bodyLen
2022-04-24 13:42:54 +08:00
Liu Jicong
3e5da8bedb
fix
2022-03-31 15:52:54 +08:00
Liu Jicong
a00a42759e
fix
2022-03-26 20:33:08 +08:00
Liu Jicong
71097ea56a
put schema into stream
2022-03-26 16:48:14 +08:00
afwerar
222db126bc
[TD-13758]<fix>: redefine memory api.
2022-03-26 00:29:53 +08:00
Shuduo Sang
23bef711fc
Feature/sangshuduo/td 13063 3.0 windows ( #10720 )
...
* [TD-13063]<feature>: 3.0 on Windows
* add pthread in contrib
* fix linux compile
* fix osSemaphore
* add gnu regex for Windows
* fix compile error for Windows
* support arm platform
* port more OS files
* fix for Windows compile
* port more files
* fix macOS on x86_64
* port osFile
* port osSemaphone.h
* port osSocket.c
* port tconfig.c
* port ttimer.c
* add couple files
2022-03-15 21:35:04 +08:00
Shengliang Guan
68f3de6111
remove tfile
2022-02-28 13:49:38 +08:00
afwerar
5a37fdf28f
[TD-13062]<fix>: cross platform file system.
2022-02-25 01:47:20 +08:00
Liu Jicong
573aad5cc1
fix uninitialized
2022-02-03 19:47:27 +08:00
Liu Jicong
3534852812
improve mq consume
2022-01-29 04:49:06 +08:00
Liu Jicong
df554c03fc
handle merge conflict
2022-01-06 10:44:34 +08:00
Liu Jicong
0ba5427a9b
handle subscribe
2022-01-06 10:28:34 +08:00
Shengliang Guan
5ac3398f3a
Mnode intergate with wal module
2022-01-03 21:36:31 +08:00
Liu Jicong
6beee204d8
add tq query
2021-12-21 20:07:32 +08:00
Liu Jicong
d037b24e05
refactor wal
2021-12-17 13:40:27 +08:00
Liu Jicong
dfc8c4e0b7
format code
2021-12-16 15:04:13 +08:00
Liu Jicong
5874463cb1
refactor wal
2021-12-14 18:14:45 +08:00
Liu Jicong
43a2bcdce3
fix wal read handle
2021-12-14 14:38:52 +08:00
Liu Jicong
dc24592929
add wal read handle
2021-12-13 18:33:30 +08:00
Liu Jicong
9e4b890727
add test for wal snapshot
2021-12-11 17:18:18 +08:00
Liu Jicong
03a54b5a35
make tfinit called once
2021-12-10 10:30:57 +08:00
Liu Jicong
cf93f4c239
add unit test for wal
2021-12-09 18:32:38 +08:00
Liu Jicong
2e859aa138
refactor wal
2021-11-30 16:44:11 +08:00