Haojun Liao
|
00fac852e8
|
fix(tsdb): fix invalid delete check.
|
2023-12-25 09:55:24 +08:00 |
Haojun Liao
|
0877e0bfad
|
other: merge 3.0
|
2023-12-25 09:13:31 +08:00 |
Haojun Liao
|
30498a4028
|
refactor: do some internal refactor.
|
2023-12-24 02:24:46 +08:00 |
Haojun Liao
|
25f798e42f
|
fix(stream): record the start failure tasks
|
2023-12-23 23:29:30 +08:00 |
Bob Liu
|
e3098accc4
|
support count empty table
|
2023-12-22 18:14:26 +08:00 |
Haojun Liao
|
b175a4b7b3
|
refactor(stream): async stop tasks, and do some internal refactor.
|
2023-12-22 17:56:16 +08:00 |
Haojun Liao
|
7ce545bcd4
|
refactor: refactor the lock type.
|
2023-12-22 16:14:49 +08:00 |
Haojun Liao
|
e91afa7df2
|
fix(stream): fix deadlock.
|
2023-12-22 14:51:04 +08:00 |
Haojun Liao
|
90898a16e0
|
refactor: do some internal refactor.
|
2023-12-22 13:57:15 +08:00 |
Hongze Cheng
|
02bb9e90d2
|
Merge pull request #24189 from taosdata/fix/TD-27974
fix(tsdb/cache): prepend ts col to load stt
|
2023-12-22 13:53:15 +08:00 |
Minglei Jin
|
16ad59fb18
|
fix(tsdb/cache): prepend ts col to load stt
|
2023-12-22 12:14:27 +08:00 |
Hongze Cheng
|
46211258b3
|
Merge pull request #24173 from taosdata/fix/TD-27974
fix(tsdb/cache): plus 1 to nCols to load stt data
|
2023-12-22 09:43:20 +08:00 |
Haojun Liao
|
c9475060de
|
fix(stream): fix race condition.
|
2023-12-22 09:34:49 +08:00 |
Minglei Jin
|
9d3eb02f3c
|
fix(tsdb/cache): plus 1 to nCols to load stt data
|
2023-12-21 17:53:44 +08:00 |
Haojun Liao
|
2acc8423c5
|
fix(stream): send msg to mnode before closing all tasks.
|
2023-12-21 16:00:50 +08:00 |
Alex Duan
|
9d4a75b0be
|
coverage: vnodeSrv.c tmsg.c trow.c
|
2023-12-21 14:22:22 +08:00 |
Haojun Liao
|
71f6d9f06f
|
fix(stream): handle the case that recvs drop msg twice.
|
2023-12-21 11:52:45 +08:00 |
Haojun Liao
|
1a8583887f
|
fix(stream): remove clear backendcache.
|
2023-12-20 15:35:43 +08:00 |
Haojun Liao
|
d25a323a4c
|
fix(stream): record the launch failure.
|
2023-12-20 13:55:12 +08:00 |
Haojun Liao
|
81d8b2434f
|
refactor: do some internal refactor.
|
2023-12-20 10:25:31 +08:00 |
Haojun Liao
|
541967e99e
|
refactor: do some internal refactor.
|
2023-12-20 10:24:03 +08:00 |
Haojun Liao
|
2de0f6e971
|
test(stream): lock the update procedure.
|
2023-12-19 18:56:15 +08:00 |
Haojun Liao
|
92045f5485
|
fix(stream): add snode check, and handle the task status reset from checkpoint when it is in the snode.
|
2023-12-19 18:34:30 +08:00 |
Haojun Liao
|
17e9e84aa9
|
Merge branch '3.0' into fix/3_liaohj
|
2023-12-19 16:43:08 +08:00 |
Haojun Liao
|
fee198f9ad
|
refactor: do some internal refactor.
|
2023-12-19 16:21:11 +08:00 |
Haojun Liao
|
ec3183b6a8
|
other: merge 3.0
|
2023-12-18 23:16:37 +08:00 |
Haojun Liao
|
579366ec00
|
Merge pull request #24121 from taosdata/fix/liaohj
other: merge main into 3.0
|
2023-12-18 23:11:36 +08:00 |
Haojun Liao
|
e734569de0
|
fix(stream): fix dead lock.
|
2023-12-18 18:42:57 +08:00 |
Haojun Liao
|
bba5a4f08b
|
other: merge main into 3.0
|
2023-12-18 18:26:42 +08:00 |
Minglei Jin
|
64378be7f4
|
fix(tsdb/cache): fix buffer-overflow with column adding
|
2023-12-18 18:06:40 +08:00 |
Haojun Liao
|
ea6e78cbaa
|
fix(stream): add async call restart, instead of sync wait.
|
2023-12-18 16:33:44 +08:00 |
wade zhang
|
4cac96d2df
|
Merge pull request #24111 from taosdata/fix/TD-27845
fix(tsdb/cache): use int64_t instead of uint64_t for stt verRange
|
2023-12-18 16:27:18 +08:00 |
Haojun Liao
|
79672f8e5f
|
Merge pull request #24107 from taosdata/fix/3_liaohj
fix(stream): add check for null ptr and leader .
|
2023-12-18 16:24:07 +08:00 |
Minglei Jin
|
5dd9ce8ceb
|
fix(tsdb/cache): use int64_t instead of uint64_t for stt verRange
|
2023-12-18 15:02:34 +08:00 |
Haojun Liao
|
b4a1907fb7
|
fix(stream): add check for null ptr and leader .
|
2023-12-18 11:52:59 +08:00 |
Haojun Liao
|
ef0cab18cb
|
Merge pull request #24098 from taosdata/fix/3_liaohj
fix(stream): send checkpoint complete msg to mnode when dropping it.
|
2023-12-17 11:03:04 +08:00 |
Haojun Liao
|
4f852704f5
|
fix(stream): send checkpoint complete msg to mnode when dropping it.
|
2023-12-17 02:06:01 +08:00 |
Haojun Liao
|
0526e619ad
|
Merge pull request #24095 from taosdata/fix/3_liaohj
fix(tsdb): add desc check for clean file block.
|
2023-12-16 18:10:15 +08:00 |
Haojun Liao
|
4cc0f5be59
|
fix(tsdb): add desc check for clean file block.
|
2023-12-16 15:37:17 +08:00 |
Haojun Liao
|
1a9701d401
|
Merge pull request #23946 from taosdata/fix/snodeBackendCrash
Fix/snode backend crash
|
2023-12-16 13:13:28 +08:00 |
Haojun Liao
|
f9a5485d52
|
fix(stream): refactor the stream trans conflict detection strategy.
|
2023-12-16 01:46:29 +08:00 |
slzhou
|
8a6317b76a
|
Merge branch '3.0' of github.com:taosdata/TDengine into szhou/fix-tms-duration
|
2023-12-15 22:09:43 +08:00 |
Haojun Liao
|
a847bf468a
|
Merge pull request #24088 from taosdata/fix/3_liaohj
fix(query): add rows info if blocks exist.
|
2023-12-15 18:24:45 +08:00 |
yihaoDeng
|
bb5f0d9112
|
Merge branch 'fix/snodeBackendCrash' of https://github.com/taosdata/TDengine into fix/snodeBackendCrash
|
2023-12-15 18:16:38 +08:00 |
yihaoDeng
|
7ab7a64eb3
|
Merge branch '3.0' into fix/snodeBackendCrash
|
2023-12-15 18:16:14 +08:00 |
Hongze Cheng
|
4ae13f411e
|
Merge pull request #24010 from taosdata/feat/TS-4229
feat: compact monitor and kill
|
2023-12-15 16:20:13 +08:00 |
Haojun Liao
|
e2fa4cba8c
|
refactor: do some internal refactor.
|
2023-12-15 15:28:01 +08:00 |
shenglian zhou
|
cc4a6c6d55
|
fix: add new duration block event
|
2023-12-15 15:04:47 +08:00 |
Haojun Liao
|
556eaa22ac
|
Merge pull request #24074 from taosdata/mark/3.0
fix:core dump if tqOpen error in vnodeOpen
|
2023-12-15 13:55:10 +08:00 |
wangmm0220
|
812f0f97a7
|
fix:rollback size to old logic
|
2023-12-15 10:09:18 +08:00 |
slzhou
|
d3146a5bec
|
fix: when no file block, no proc mem before fileset
|
2023-12-15 09:51:06 +08:00 |
Yihao Deng
|
5f2d93d62c
|
Merge branch '3.0' into fix/snodeBackendCrash
|
2023-12-15 09:22:33 +08:00 |
wangmm0220
|
740228a653
|
fix:core dump if tqOpen error in vnodeOpen
|
2023-12-15 09:07:35 +08:00 |
slzhou
|
5bf364cc0a
|
enhance: refactor code
|
2023-12-15 08:23:25 +08:00 |
dmchen
|
d7ac3558f8
|
fix wrong merge
|
2023-12-14 11:21:41 +00:00 |
dm chen
|
81767dfa32
|
Merge branch '3.0' into feat/TS-4229
|
2023-12-14 17:02:51 +08:00 |
slzhou
|
4dc39e74c5
|
fix: the block return from buildBlockFromFiles should be of new fileset
|
2023-12-14 16:57:04 +08:00 |
wade zhang
|
c95c567376
|
Merge pull request #24046 from taosdata/fix/TS-4251-3.0
revert dependency
|
2023-12-14 14:03:04 +08:00 |
Haojun Liao
|
05ca8f1784
|
Merge pull request #24056 from taosdata/fix/3_liaohj
refactor: do some internal refactor.
|
2023-12-14 13:52:04 +08:00 |
Haojun Liao
|
7cf0add513
|
fix(stream): fix error caused by refactor.
|
2023-12-14 11:28:03 +08:00 |
Haojun Liao
|
f0d63a977a
|
refactor: do some internal refactor.
|
2023-12-14 10:01:57 +08:00 |
Haojun Liao
|
8e042e34cb
|
refactor: do some internal refactor.
|
2023-12-14 09:48:14 +08:00 |
Haojun Liao
|
81f96603b0
|
refactor: do some internal refactor.
|
2023-12-14 09:33:51 +08:00 |
Haojun Liao
|
26af397431
|
Merge pull request #24052 from taosdata/fix/3_liaohj
fix(tsdb): fix error in tsdb read.
|
2023-12-13 22:35:08 +08:00 |
Haojun Liao
|
88a8e4e9f0
|
fix(tsdb): fix syntax error.
|
2023-12-13 17:01:55 +08:00 |
Haojun Liao
|
840b457308
|
fix(tsdb): fix error in tsdb read.
|
2023-12-13 17:00:39 +08:00 |
dmchen
|
04366f2e68
|
revert dependency
|
2023-12-13 15:29:32 +08:00 |
Benguang Zhao
|
b1dd76b924
|
fix: assert on offset leq file.size in tsdbDataFileRAWWriterCloseCommit
|
2023-12-12 18:33:42 +08:00 |
Hongze Cheng
|
613ca2c370
|
Merge pull request #23982 from taosdata/fix/PI-30-3.0
fix(tsdb/cache): remove malloc zero bytes
|
2023-12-12 15:22:38 +08:00 |
dmchen
|
1547d95742
|
break dependency
|
2023-12-12 12:19:12 +08:00 |
dmchen
|
67e9f695c9
|
debug info and default setting
|
2023-12-12 12:18:35 +08:00 |
dmchen
|
daa2c2238a
|
fix/TS-4251
|
2023-12-12 12:17:49 +08:00 |
Minglei Jin
|
c4bf9a92bc
|
Merge branch '3.0' into enh/TD-27119
|
2023-12-11 19:38:04 +08:00 |
Minglei Jin
|
fe824c51e2
|
tsdb/cos: not remove cp files
|
2023-12-11 19:36:06 +08:00 |
dmchen
|
a861e55764
|
revert dependency
|
2023-12-11 11:24:31 +00:00 |
slzhou
|
2743228217
|
Merge branch '3.0' of github.com:taosdata/TDengine into feat/TS-4229
|
2023-12-11 14:15:17 +08:00 |
Haojun Liao
|
39ea7d7567
|
Merge pull request #23980 from taosdata/fix/3_liaohj
fix(tsdb): opt read stt file
|
2023-12-09 21:28:52 +08:00 |
Haojun Liao
|
9acd4af1f9
|
fix(tsdb):fix capacity rows value.
|
2023-12-09 01:49:55 +08:00 |
Haojun Liao
|
5528c2bf67
|
fix(tsdb): do some internal refactor.
|
2023-12-08 23:47:49 +08:00 |
Haojun Liao
|
f2592f7399
|
fix(tsdb): prepare the memory buffer.
|
2023-12-08 23:44:05 +08:00 |
Haojun Liao
|
da636ab527
|
fix(tsdb): add null check.
|
2023-12-08 18:55:20 +08:00 |
Haojun Liao
|
67d967e22f
|
fix(tsdb): check the overlap between stt blocks and data file blocks.
|
2023-12-08 18:48:00 +08:00 |
Hongze Cheng
|
853fb6f119
|
Merge pull request #23987 from taosdata/fix/little_fix_3.0
fix: little fix
|
2023-12-08 17:29:24 +08:00 |
Hongze Cheng
|
f830fc2f4c
|
more dev
|
2023-12-08 17:26:44 +08:00 |
Haojun Liao
|
63b34c7acf
|
fix(tsdb): add check for not load stt file blocks.
|
2023-12-08 16:09:58 +08:00 |
Minglei Jin
|
2dbb718101
|
Merge branch '3.0' into enh/TD-27119
|
2023-12-08 14:48:17 +08:00 |
Hongze Cheng
|
a0487529d0
|
more fix
|
2023-12-08 14:37:21 +08:00 |
wade zhang
|
638e4c1f00
|
Merge pull request #23568 from taosdata/FEAT/TD-27125-3.0
feat: support tsdb snap replication of raw data mode
|
2023-12-08 14:36:16 +08:00 |
Haojun Liao
|
9c72ce846e
|
fix(tsdb): add more condition for not load data.
|
2023-12-08 14:23:37 +08:00 |
Hongze Cheng
|
16068bab41
|
Merge pull request #23964 from taosdata/fix/TD-27707
fix(tsdb/cache): del from mem with time range
|
2023-12-08 14:22:08 +08:00 |
Hongze Cheng
|
b9d056c6a8
|
fix: little fix
|
2023-12-08 14:11:36 +08:00 |
dmchen
|
18dbc47949
|
break dependency
|
2023-12-08 04:24:33 +00:00 |
Haojun Liao
|
da1207ef74
|
fix(tsdb): add return flag for stt files.
|
2023-12-08 11:07:45 +08:00 |
Minglei Jin
|
d4dbb55669
|
fix(tsdb/cache): remove malloc zero bytes
|
2023-12-08 11:04:04 +08:00 |
Haojun Liao
|
2e13b0b97d
|
refactor: do some internal refactor.
|
2023-12-08 10:43:17 +08:00 |
Haojun Liao
|
9477146b30
|
fix(tsdb): fix syntax error.
|
2023-12-08 10:29:38 +08:00 |
Haojun Liao
|
4ffaff4d50
|
other: merge 3.0
|
2023-12-08 10:14:42 +08:00 |
Haojun Liao
|
446c14da72
|
fix(tsdb): opt read stt file
|
2023-12-08 10:03:36 +08:00 |
dapan1121
|
a2ee41233e
|
Merge pull request #23835 from taosdata/szhou/tms-duration
feat: tsdb output in duration order
|
2023-12-08 09:07:41 +08:00 |
Haojun Liao
|
7c17d6f313
|
fix(tsdb): opt read performance by check clean stt block if only row number required.
|
2023-12-07 23:12:54 +08:00 |
dmchen
|
348bef49ec
|
message handle
|
2023-12-07 11:42:32 +00:00 |
Hongze Cheng
|
aee070918b
|
more dev
|
2023-12-07 17:37:47 +08:00 |
Benguang Zhao
|
1255b46469
|
fix: destroy dataReaderArr properly in tsdbSnapRAWReaderClose
|
2023-12-07 15:29:42 +08:00 |
Benguang Zhao
|
ebd3b69745
|
enh: control playload size of tsdb snap replication with TSDB_SNAP_DATA_PAYLOAD_SIZE
|
2023-12-07 15:29:42 +08:00 |
Benguang Zhao
|
5cdf2b0b04
|
fixup: remove call to obsolete funcs of BgTask in tsdbSnapRAWWriter open and close
|
2023-12-07 15:29:42 +08:00 |
Benguang Zhao
|
28e1d83662
|
fix: adjust tsdbReadFile call in tsdbDataFileRAWReadBlockData
|
2023-12-07 15:29:42 +08:00 |
Benguang Zhao
|
52672657c1
|
feat: toggle tsdb snap replication mode by snap info handshake ahead of time
|
2023-12-07 15:29:42 +08:00 |
Benguang Zhao
|
ef34176e37
|
fix: close data file readers in tsbSnapRAWReaderClose
|
2023-12-07 15:29:42 +08:00 |
Benguang Zhao
|
6c4c0242fd
|
refact: adjust logging format in tsdbSnapRAWReaderOpen
|
2023-12-07 15:29:42 +08:00 |
Benguang Zhao
|
f136266972
|
feat: support snap replication by file blocks
|
2023-12-07 15:29:42 +08:00 |
Benguang Zhao
|
1dc9019baa
|
feat: add tsdbSnapRAWRead into vnodeSnapRead
|
2023-12-07 15:29:42 +08:00 |
Benguang Zhao
|
ae60e1f810
|
refact: add tsdbSnapRAWReaderIterNext
|
2023-12-07 15:29:42 +08:00 |
Benguang Zhao
|
a504007ade
|
refact: alloc just enough memory for snap data in tsdbSnapRAWReadData
|
2023-12-07 15:29:42 +08:00 |
Benguang Zhao
|
6c419423de
|
feat: impl tsdb snapshot reader and writer for raw files
|
2023-12-07 15:29:42 +08:00 |
Benguang Zhao
|
a4c504169d
|
feat: add file tsdbFSetRAW.c
|
2023-12-07 15:29:42 +08:00 |
Benguang Zhao
|
da646b5a5b
|
feat: add file tsdbDataFileRAW.c
|
2023-12-07 15:29:42 +08:00 |
Benguang Zhao
|
e05914119e
|
feat: add file tsdbSnapshotRAW.c
|
2023-12-07 15:29:42 +08:00 |
Benguang Zhao
|
fe258e226d
|
feat: add data type of SNAP_DATA_RAW for snap replication
|
2023-12-07 15:29:42 +08:00 |
Benguang Zhao
|
de9c9d4f20
|
refact: improve code of tsdbPartitionInfoSerialize
|
2023-12-07 15:28:14 +08:00 |
Benguang Zhao
|
1a9b08fa08
|
refact: relocate func syncSnapInfoDataRealloc
|
2023-12-07 15:28:14 +08:00 |
Benguang Zhao
|
f68804322c
|
refact: improve code of tsdbSnapGetDetails as tsdbSnapPrepDescription
|
2023-12-07 15:28:14 +08:00 |
Benguang Zhao
|
ed39c9a572
|
refact: rename snap range to fset range in tsdbSnapInfo.c
|
2023-12-07 15:28:14 +08:00 |
Benguang Zhao
|
3550347f0c
|
refact: use tsdbFSDestroyCopyRangedSnapshot and tsdbFSDestroyRefRangedSnapshot
|
2023-12-07 15:28:14 +08:00 |
Benguang Zhao
|
962febef02
|
refact: rename tsdb snap range to tsdb fset range
|
2023-12-07 15:28:14 +08:00 |
Benguang Zhao
|
ed916b1a80
|
refact: rename tsdb snap partition to fset partition
|
2023-12-07 15:28:14 +08:00 |
Benguang Zhao
|
20b5cf8d49
|
refact: remove redundent includes from tsdbSnapInfo.c
|
2023-12-07 15:28:14 +08:00 |
Benguang Zhao
|
4487eeacb5
|
refact: improve funcs dealing with SnapInfo for vnode snap reader and writer
|
2023-12-07 15:28:14 +08:00 |
Benguang Zhao
|
b8b53a4b0e
|
refact: put source code of snap info into tsdbSnapInfo.c
|
2023-12-07 15:28:06 +08:00 |
Benguang Zhao
|
3ad68bdfea
|
enh: add tsdbSnapInfo.c
|
2023-12-07 15:20:55 +08:00 |
Benguang Zhao
|
ddcabcfa4a
|
refact: remove unused fn tSerializeSnapRangeArray
|
2023-12-07 15:20:55 +08:00 |
Benguang Zhao
|
e429526789
|
refact: rename STSnapRange to STFileSetRange
|
2023-12-07 15:20:55 +08:00 |
dmchen
|
27a86a6faa
|
debug info and default setting
|
2023-12-07 03:13:23 +00:00 |
dapan1121
|
30eb035447
|
Merge pull request #23940 from taosdata/fix/TS-4327
fix: last/last_row crash with dropped column
|
2023-12-06 17:57:24 +08:00 |
Minglei Jin
|
a9309cb295
|
fix(tsdb/cache): del from mem with time range
|
2023-12-06 17:52:15 +08:00 |
Hongze Cheng
|
04e84ba152
|
Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TS-4229
|
2023-12-06 16:43:00 +08:00 |
dmchen
|
dc9408ed5f
|
fix/TS-4251
|
2023-12-06 07:48:40 +00:00 |
shenglian zhou
|
a2e7c78d27
|
refactor: rename variables
|
2023-12-06 09:39:38 +08:00 |
Haojun Liao
|
85c7dc76e9
|
Merge pull request #23948 from taosdata/mark/3.0
fix:offset out of range if poll offset is read from offsetRestored wh…
|
2023-12-06 09:12:38 +08:00 |
wangmm0220
|
cc51fd47d0
|
fix:offset out of range if poll offset is read from offsetRestored while wal is deleted
|
2023-12-05 19:09:29 +08:00 |
yihaoDeng
|
87c78919a9
|
add stream backend copy
|
2023-12-05 17:09:03 +08:00 |
Minglei Jin
|
e9cc54d87b
|
cos_cp/load: load checkpoint from json
|
2023-12-05 16:37:28 +08:00 |
wangjiaming0909
|
a6c876bbc1
|
fix: last/last_row crash with dropped column
|
2023-12-05 14:16:01 +08:00 |
Minglei Jin
|
e0a14bd359
|
fix(tsdb/cache): remove debug log
|
2023-12-05 14:05:16 +08:00 |
Haojun Liao
|
9d451ab56e
|
Merge pull request #23934 from taosdata/fix/3_liaohj
refactor: do some internal refactor.
|
2023-12-05 12:58:18 +08:00 |
Haojun Liao
|
cb8dfae0cc
|
refactor: do some internal refactor.
|
2023-12-05 10:47:19 +08:00 |
slzhou
|
e690076331
|
Merge branch '3.0' of github.com:taosdata/TDengine into szhou/tms-duration
|
2023-12-05 09:53:29 +08:00 |
Haojun Liao
|
cc5890d56a
|
Merge pull request #23924 from taosdata/fix/3_liaohj
enh(tsdb): extract rows for the given tables in all stt files.
|
2023-12-04 19:21:19 +08:00 |
Hongze Cheng
|
26774f87c9
|
Merge pull request #23920 from taosdata/fix/TD-27619
fix: bg task memory waste
|
2023-12-04 18:10:30 +08:00 |
Haojun Liao
|
7145a7b8a1
|
fix(tsdb): calculate the rows in next fileset.
|
2023-12-04 18:03:32 +08:00 |
Haojun Liao
|
6d82900a32
|
fix(tsdb): fix error in block dist.
|
2023-12-04 18:00:41 +08:00 |