yihaoDeng
|
993ae84398
|
close backend
|
2023-08-16 07:17:15 +00:00 |
Haojun Liao
|
4ea58e5682
|
refactor: do some internal refactor.
|
2023-08-16 11:44:05 +08:00 |
|
Haojun Liao
|
6609882f9f
|
fix(tsdb): add stt statistics block buffer, and do some internal refactor.
|
2023-08-16 10:55:07 +08:00 |
dmchen
|
de5aedd8f3
|
vnode.json
|
2023-08-16 10:20:48 +08:00 |
liuyao
|
919ffbaf72
|
Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/ly_refactor
|
2023-08-16 10:04:07 +08:00 |
Haojun Liao
|
63bc50a723
|
Merge pull request #22427 from taosdata/feature/rebuildIndex0
rebuild index at tag0
|
2023-08-16 09:47:43 +08:00 |
|
liuyao
|
fc09f8ef1e
|
Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/ly_refactor
|
2023-08-16 09:36:28 +08:00 |
|
Haojun Liao
|
ad9f3cbc43
|
other: merge main.
|
2023-08-16 09:14:10 +08:00 |
|
Haojun Liao
|
7628be236d
|
other: merge main.
|
2023-08-16 09:03:54 +08:00 |
dapan1121
|
df13c6fa3e
|
Merge pull request #22410 from taosdata/szhou/tag-scan-opt
enhance: tag scan optimization
|
2023-08-16 08:58:17 +08:00 |
wade zhang
|
1a1a12b7b8
|
Merge pull request #22327 from taosdata/fix/TD-25010-3
feat(tsdb/cos): s3 migration
|
2023-08-16 08:02:20 +08:00 |
slzhou
|
4fdaaba3ce
|
Merge branch '3.0' of github.com:taosdata/TDengine into szhou/tag-scan-opt
|
2023-08-15 17:18:25 +08:00 |
Benguang Zhao
|
239a79d405
|
enh: add some vnode info in SStatusReq
|
2023-08-15 17:06:33 +08:00 |
Minglei Jin
|
1792bf306e
|
vnode: fix cos cache evicting
|
2023-08-15 16:54:26 +08:00 |
|
Haojun Liao
|
39079ab64a
|
fix(stream): load term from sync model to decide if the node is restart or not
|
2023-08-15 15:52:06 +08:00 |
|
Minglei Jin
|
c4e5cfd2fb
|
retention: return code from copy
|
2023-08-15 15:40:40 +08:00 |
|
Minglei Jin
|
bd758e0269
|
retention: remove old files last
|
2023-08-15 15:14:34 +08:00 |
|
Minglei Jin
|
8639c22cc0
|
vnode, common: USE_COS def
|
2023-08-15 14:53:58 +08:00 |
|
liuyao
|
1b4e51ee4a
|
Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/ly_refactor
|
2023-08-15 14:20:49 +08:00 |
|
Haojun Liao
|
b1d35f43ba
|
enh(stream): using term from sync module to denote the upstream node is restarted/replica-modified/vnode-transferred or not.
|
2023-08-15 09:25:05 +08:00 |
|
Haojun Liao
|
ff17763ed6
|
Merge pull request #22417 from taosdata/mark/tmq
opti:wal logic
|
2023-08-15 09:16:29 +08:00 |
|
Haojun Liao
|
9e3733a02c
|
Merge pull request #22358 from taosdata/feat/TD-24559
feat:[TD-24559]support geomety type in schemaless
|
2023-08-14 22:06:41 +08:00 |
|
liuyao
|
9d1e5a512d
|
add stream task id
|
2023-08-14 17:52:39 +08:00 |
|
Haojun Liao
|
2e6263b43f
|
fix(stream): fix memory leak.
|
2023-08-14 17:16:11 +08:00 |
|
yihaoDeng
|
cf9f9ab471
|
rebuild index at tag0
|
2023-08-14 08:01:20 +00:00 |
|
Haojun Liao
|
a1e554fbf3
|
refactor: exec directly not asynchnoized.
|
2023-08-14 15:05:13 +08:00 |
|
Minglei Jin
|
989abc2bf6
|
vnode/cos: move includes into USE_COS
|
2023-08-14 15:03:17 +08:00 |
|
Haojun Liao
|
91710b0c0f
|
fix(stream):
|
2023-08-14 14:56:17 +08:00 |
|
Minglei Jin
|
c97b9249fc
|
cos: only for linux
|
2023-08-14 14:38:28 +08:00 |
|
slzhou
|
692d436d68
|
fix: fix ci error
|
2023-08-14 14:14:16 +08:00 |
|
Haojun Liao
|
5ec6b64aab
|
fix(stream): add logs.
|
2023-08-14 13:12:41 +08:00 |
|
Haojun Liao
|
ead04964fd
|
Merge branch 'main' into fix/liaohj
|
2023-08-14 12:11:15 +08:00 |
|
dapan1121
|
c2417eb5cd
|
Merge pull request #22404 from taosdata/fix/TD-25621-3.0
fix: dup read lock on windows
|
2023-08-14 11:37:05 +08:00 |
|
Haojun Liao
|
2806fe1c56
|
fix(stream): ignore the related stream task destory msg in transfer state.
|
2023-08-14 10:58:24 +08:00 |
|
slzhou
|
646e52ae7f
|
Merge branch '3.0' of github.com:taosdata/TDengine into szhou/tag-scan-opt
|
2023-08-14 10:19:36 +08:00 |
|
yihaoDeng
|
246efd83c6
|
refactor chpt transfer
|
2023-08-14 02:03:41 +00:00 |
wangmm0220
|
dd0bc0e050
|
fix:heap use after free
|
2023-08-14 09:42:55 +08:00 |
|
wade zhang
|
1b51f53c15
|
Merge pull request #22407 from taosdata/fix/TD-25671
fix: infinite tomb data sync loop
|
2023-08-14 09:25:47 +08:00 |
|
shenglian zhou
|
46f92d222d
|
fix: typo error
|
2023-08-14 08:52:25 +08:00 |
|
shenglian zhou
|
db25f6c01b
|
Merge branch 'szhou/tsdb-neigh-block' of github.com:taosdata/TDengine into szhou/tsdb-neigh-block
|
2023-08-14 08:49:25 +08:00 |
|
shenglian zhou
|
c5a6cac34f
|
fix: fix compilation error
|
2023-08-14 08:49:10 +08:00 |
|
Haojun Liao
|
01ac99a651
|
Merge pull request #22413 from taosdata/fix/liaohj
refactor: refactor the transfer state procedure.
|
2023-08-13 23:28:18 +08:00 |
|
slzhou
|
8e7fc91095
|
enhance: set file data block iter
|
2023-08-13 18:30:30 +08:00 |
|
Haojun Liao
|
0d38f389ab
|
refactor: do some internal refactor.
|
2023-08-13 16:25:35 +08:00 |
|
Haojun Liao
|
ce721a0146
|
fix(stream): fix error.
|
2023-08-12 16:32:05 +08:00 |
|
wangmm0220
|
efb472d54a
|
fix:heap use after free
|
2023-08-12 10:15:40 +08:00 |
|
Haojun Liao
|
f24b22000f
|
enh(stream): stop stream task before redistribute vnodes.
|
2023-08-11 23:46:53 +08:00 |
|
wangmm0220
|
767563752a
|
opti:wal logic
|
2023-08-11 20:21:13 +08:00 |
|
wangmm0220
|
deda4b9eed
|
opti:wal logic
|
2023-08-11 19:26:17 +08:00 |
Hongze Cheng
|
847bc0da08
|
fix: infinite tomb data sync loop
|
2023-08-11 18:10:16 +08:00 |
|
slzhou
|
47d2f9ad6d
|
fix: first run without tag cond
|
2023-08-11 17:52:52 +08:00 |
|
wangmm0220
|
7b22d37f12
|
fix:lost data when consumer db
|
2023-08-11 17:25:43 +08:00 |
|
slzhou
|
42a4f364c1
|
Merge branch 'szhou/tag-scan-opt' of github.com:taosdata/TDengine into szhou/tag-scan-opt
|
2023-08-11 16:48:49 +08:00 |
|
Minglei Jin
|
84452c8dee
|
cos: use static sdk
|
2023-08-11 16:36:53 +08:00 |
|
shenglian zhou
|
eb9d77d639
|
ehance: destroy blocklist of table scan info, add block global index list to table scan info
|
2023-08-11 16:33:49 +08:00 |
|
Haojun Liao
|
87c7e4c0fe
|
fix(stream): not launch stream tasks when restarting the stream tasks.
|
2023-08-11 16:19:46 +08:00 |
|
yihaoDeng
|
6e6eb05d5c
|
Merge branch 'enh/triggerCheckPoint2' into enh/chkpTransfer
|
2023-08-11 08:03:02 +00:00 |
|
Haojun Liao
|
e984affe90
|
fix(stream): disable the stream in the followers nodes.
|
2023-08-11 15:58:15 +08:00 |
|
wangmm0220
|
25e32bbf7c
|
fix:offset error in tmq & add test cases
|
2023-08-11 14:25:12 +08:00 |
|
Haojun Liao
|
9322f80343
|
fix(stream): register the rsp callback.
|
2023-08-11 13:31:50 +08:00 |
kailixu
|
64a1636dd2
|
chore: trigger CI
|
2023-08-11 12:54:45 +08:00 |
|
kailixu
|
1d089fe085
|
fix: dup read lock on windows
|
2023-08-11 11:34:57 +08:00 |
|
yihaoDeng
|
99be2836b2
|
Merge branch 'enh/triggerCheckPoint2' into enh/chkpTransfer
|
2023-08-11 02:50:12 +00:00 |
|
Haojun Liao
|
1e636a2ef9
|
Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2
|
2023-08-11 10:37:40 +08:00 |
|
Haojun Liao
|
6a9826cf6e
|
enh(stream): update the stream task epset.
|
2023-08-11 10:37:25 +08:00 |
|
yihaoDeng
|
ba4ce9db02
|
Merge branch 'enh/triggerCheckPoint2' into enh/chkpTransfer
|
2023-08-11 02:15:07 +00:00 |
|
Haojun Liao
|
d9bc881fb3
|
Merge pull request #22384 from taosdata/mark/tmq
fix:offset error in tmq & add test cases
|
2023-08-11 10:00:08 +08:00 |
|
Minglei Jin
|
4513acfee9
|
cos: use static libs for mxml, apr, apu, curl
|
2023-08-11 09:54:54 +08:00 |
yihaoDeng
|
32983a11e1
|
add log and fix crash
|
2023-08-10 20:34:00 +08:00 |
|
shenglian zhou
|
b2e615d4e7
|
enhance: tag scan cursor based block
|
2023-08-10 17:30:01 +08:00 |
|
wangmm0220
|
78fd70202c
|
fix:offset error in tmq & add test cases
|
2023-08-10 16:18:53 +08:00 |
|
Minglei Jin
|
c04ada3573
|
cos: link with static libs
|
2023-08-10 15:28:22 +08:00 |
|
Minglei Jin
|
cd63e81450
|
cos: separate building phase for apr & apr-util
|
2023-08-10 14:18:12 +08:00 |
|
dm chen
|
dd271bca6d
|
Merge pull request #22394 from taosdata/3.0
merge 3.0 to feat/TD-22970
|
2023-08-10 14:14:22 +08:00 |
|
Haojun Liao
|
a713b37f35
|
fix(stream): add more logs.
|
2023-08-10 14:07:29 +08:00 |
|
Haojun Liao
|
161fd6902a
|
fix(stream): fix the acquire task.
|
2023-08-10 12:45:20 +08:00 |
Minglei Jin
|
33967b243b
|
Merge branch '3.0' into fix/TD-25010-3
|
2023-08-10 12:14:01 +08:00 |
|
Haojun Liao
|
f633c7fe2b
|
other: merge 3.0.
|
2023-08-10 11:56:30 +08:00 |
|
Haojun Liao
|
b658608541
|
Merge pull request #22388 from taosdata/fix/3_liaohj
other: merge main.
|
2023-08-10 11:43:02 +08:00 |
|
yihaoDeng
|
ef247cdb1d
|
support reopen stream state
|
2023-08-10 01:49:26 +00:00 |
|
Haojun Liao
|
c10b323188
|
other: merge main.
|
2023-08-10 09:26:33 +08:00 |
|
Haojun Liao
|
4393375e47
|
fix(stream): set correct task id.
|
2023-08-10 02:16:04 +08:00 |
|
Haojun Liao
|
0757e88ced
|
fix(stream): set the correct hash keys.
|
2023-08-09 23:52:14 +08:00 |
|
Haojun Liao
|
7e3f1d92fc
|
Merge branch 'main' into fix/liaohj
|
2023-08-09 19:43:24 +08:00 |
|
wangmm0220
|
1f5532fd67
|
fix:offset error in tmq & add test cases
|
2023-08-09 19:41:22 +08:00 |
|
Minglei Jin
|
a853d9d40c
|
mxml: use ~/local/include
|
2023-08-09 18:21:55 +08:00 |
|
Haojun Liao
|
1e8579e8c5
|
fix(stream): fix other cases.
|
2023-08-09 16:04:48 +08:00 |
|
Haojun Liao
|
4c92997328
|
fix(stream): use streamId&taskId to identify the stream task in the stream meta.
|
2023-08-09 15:52:23 +08:00 |
Hui Li
|
584427dd44
|
Merge pull request #22374 from taosdata/szhou/restore-minglei-main
fix: restore stt/block merge back
|
2023-08-09 14:40:03 +08:00 |
|
Minglei Jin
|
b08d5b4d42
|
mxml: add include dir to vnode
|
2023-08-09 14:02:10 +08:00 |
|
Minglei Jin
|
7e2859ed43
|
apr: use tarball to avoid ./buildconf
|
2023-08-09 13:03:37 +08:00 |
|
Haojun Liao
|
3cdb16352c
|
fix(stream): avoid launching check downstream when failed to add stream task into stream meta.
|
2023-08-09 12:03:14 +08:00 |
|
Minglei Jin
|
2e0519b960
|
apr: fix apr & apr-util project names
|
2023-08-09 11:01:42 +08:00 |
|
Minglei Jin
|
7114ad63e5
|
apr：makefile for apr & apr-util
|
2023-08-09 10:54:17 +08:00 |
|
Minglei Jin
|
4d1155a5cf
|
curl: makefile for curl
|
2023-08-09 10:43:27 +08:00 |
|
shenglian zhou
|
e9e06d1eae
|
fix: restore stt block/data block merge back
|
2023-08-09 10:36:54 +08:00 |
|
shenglian zhou
|
2b1478f46e
|
Revert "fix(tsdb/read2): reset stt reader when suspended"
This reverts commit 079d7ff69e.
|
2023-08-09 10:36:26 +08:00 |
|
Haojun Liao
|
f3c5f20ee2
|
enh(stream): add timer to check the node changing.
|
2023-08-09 10:25:16 +08:00 |
|
Minglei Jin
|
16e015253b
|
s3/mxml: remove os external dependency
|
2023-08-09 10:10:25 +08:00 |
|
Haojun Liao
|
bb39d94f9c
|
Merge pull request #22357 from taosdata/fix/liaohj
other: merge fix from 3.0 to main.
|
2023-08-09 09:05:54 +08:00 |
|
wangmm0220
|
d322cfce50
|
fix:add hashIteratorCancel for hash iterator
|
2023-08-08 16:28:51 +08:00 |
|
Haojun Liao
|
17c6143471
|
fix(stream): check more status when handling the state transfer.
|
2023-08-08 15:08:11 +08:00 |
|
Hongze Cheng
|
c8f106106a
|
fix: update assert issue
|
2023-08-08 14:49:05 +08:00 |
|
dm chen
|
70a598f072
|
Merge pull request #22355 from taosdata/3.0
merge 3.0 to TD-22970
|
2023-08-08 09:53:07 +08:00 |
|
Hui Li
|
05e356cd81
|
Merge pull request #22346 from taosdata/fix/TD-25612
fix: snapshot invalid read
|
2023-08-08 09:19:55 +08:00 |
|
Haojun Liao
|
458143c8b7
|
Merge pull request #22348 from taosdata/szhou/restore-tsdb-minglei
fix: restore stt block and data block merge back
|
2023-08-08 08:58:02 +08:00 |
|
Haojun Liao
|
f8ee055641
|
other: merge 3.0
|
2023-08-08 00:19:08 +08:00 |
|
Haojun Liao
|
ad3e231b2f
|
Merge pull request #22350 from taosdata/fix/3_liaohj
other: merge main and fix bugs in stop stream tasks.
|
2023-08-07 22:57:13 +08:00 |
|
Haojun Liao
|
aea1690cd1
|
fix(stream): fix the stream task after checking if it is in the timer activities.
|
2023-08-07 17:49:36 +08:00 |
|
shenglian zhou
|
ec1270f75c
|
fix: restore stt block/data block merge back
|
2023-08-07 17:17:12 +08:00 |
|
Minglei Jin
|
9e4da6c089
|
s3/config: parsing s3 configuration
|
2023-08-07 17:14:58 +08:00 |
|
shenglian zhou
|
9ddab11d98
|
Revert "fix(tsdb/read2): reset stt reader when suspended"
This reverts commit 079d7ff69e.
|
2023-08-07 17:13:49 +08:00 |
|
yihaoDeng
|
b6c991f896
|
support reopen stream state
|
2023-08-07 08:59:04 +00:00 |
|
yihaoDeng
|
eeb97351e8
|
support reopen stream state
|
2023-08-07 08:51:01 +00:00 |
|
Haojun Liao
|
e6b80e6c52
|
Merge branch '3.0' into fix/3_liaohj
|
2023-08-07 16:26:31 +08:00 |
|
Haojun Liao
|
225c0e61dc
|
hen(stream): support the rollback and checkdown stream tasks.
|
2023-08-07 16:13:39 +08:00 |
|
Hongze Cheng
|
a545d45b5e
|
fix: snapshot invalid read
|
2023-08-07 16:12:03 +08:00 |
|
Minglei Jin
|
fac7e521e9
|
s3/evict: fetch atime from stat file
|
2023-08-07 15:59:37 +08:00 |
|
Hongze Cheng
|
661f2aca98
|
fix: memory leak
|
2023-08-07 14:13:44 +08:00 |
|
wangmm0220
|
9ecabb30f5
|
fix:ref is not there
|
2023-08-07 10:27:44 +08:00 |
|
wangmm0220
|
5f02e2ddfb
|
fix:ref is not there
|
2023-08-07 09:31:29 +08:00 |
|
Haojun Liao
|
8a11a0418f
|
other: merge 3.0
|
2023-08-07 09:19:26 +08:00 |
|
wangmm0220
|
d9a1695257
|
fix:add log
|
2023-08-04 18:07:44 +08:00 |
|
Minglei Jin
|
65d8af19ed
|
s3: new api s3Size
|
2023-08-04 16:35:35 +08:00 |
|
Minglei Jin
|
87783a9650
|
s3query/get: pull object to local
|
2023-08-04 15:37:52 +08:00 |
|
Minglei Jin
|
ebd09ca532
|
tsdb/write: use keep1 as minKey instead of keep2
|
2023-08-04 13:44:17 +08:00 |
|
Minglei Jin
|
88d755be76
|
feat(tsdb/cos): s3 migration
|
2023-08-04 13:31:00 +08:00 |
|
wade zhang
|
abe15cc68e
|
Merge pull request #22315 from taosdata/szhou/fix-td25385-main
fix: keep stt iterator valid in the list
|
2023-08-04 08:02:16 +08:00 |
|
slzhou
|
fef091b13d
|
fix: keep the stt iterator valid
|
2023-08-03 21:50:50 +08:00 |
|
shenglian zhou
|
b85c1ae8a1
|
fix: remove the core
|
2023-08-03 21:50:50 +08:00 |
|
shenglian zhou
|
5322e38dfe
|
fix: add init add check it
|
2023-08-03 21:50:50 +08:00 |
|
shenglian zhou
|
97b15ed718
|
fix: delete SLDataItem if stt level files num is smaller
|
2023-08-03 21:50:50 +08:00 |
|
slzhou
|
1cb1451e41
|
fix: set nextIndex when get neighbouring index
|
2023-08-03 18:26:29 +08:00 |
|
dm chen
|
5b03ab1705
|
Merge branch '3.0' into feat/TD-22970
|
2023-08-03 17:43:51 +08:00 |
|
yihaoDeng
|
f9d0874e45
|
support reopen stream state
|
2023-08-03 08:24:50 +00:00 |
|
wade zhang
|
68f2018246
|
Merge pull request #22289 from taosdata/szhou/fix-25385
fix: keep stt iterator valid
|
2023-08-02 20:22:54 +08:00 |
|
wade zhang
|
13c713d33b
|
Merge pull request #22290 from taosdata/3.0_main
merge 3.0 into branch main
|
2023-08-02 16:04:08 +08:00 |
|
Hongze Cheng
|
f90f0b7047
|
disable infinite count loop
|
2023-08-02 15:51:51 +08:00 |
|
Minglei Jin
|
cff85550f9
|
Merge branch '3.0' into 3.0_main
|
2023-08-02 14:10:45 +08:00 |
|
wade zhang
|
c24b52ad82
|
Merge pull request #22277 from taosdata/fix/TD-25400
enh(tsdb/cache/read): lazy init table map hash and entries
|
2023-08-02 14:08:43 +08:00 |
|
Haojun Liao
|
0feffc687b
|
fix(tsdb): check uid in multiple stt statistics blocks.
|
2023-08-02 12:44:45 +08:00 |
|
Minglei Jin
|
0e51277521
|
cache/reader: cleanup contiue nex row
|
2023-08-02 12:43:57 +08:00 |
|
Haojun Liao
|
2c357f1958
|
fix(stream): enable filter table based on table statistics.
|
2023-08-02 11:18:35 +08:00 |
|
Minglei Jin
|
7fca057a81
|
cache/reader: move pLastCols into single block
|
2023-08-02 11:10:12 +08:00 |
|
slzhou
|
dd8e893508
|
fix: keep the stt iterator valid
|
2023-08-02 11:02:27 +08:00 |
|
Minglei Jin
|
95cc540d9b
|
cache/reader: clean uid in all loop
|
2023-08-02 10:48:55 +08:00 |
|
shenglian zhou
|
38e797b4ff
|
fix: remove the core
|
2023-08-02 10:43:26 +08:00 |
|
shenglian zhou
|
d5ca51e94d
|
fix: add init add check it
|
2023-08-02 10:43:26 +08:00 |
|
shenglian zhou
|
6bf95c0c4d
|
fix: delete SLDataItem if stt level files num is smaller
|
2023-08-02 10:43:26 +08:00 |
|
Haojun Liao
|
13543f7daa
|
feature(stream): handle task update in tq module.
|
2023-08-02 10:33:41 +08:00 |
|
Minglei Jin
|
ed76525c4f
|
cache/reader: cleanup uid in signle loop
|
2023-08-02 10:28:13 +08:00 |
|
Minglei Jin
|
29b2f32821
|
cache reader: cleanup stt init
|
2023-08-02 09:49:41 +08:00 |
|
Haojun Liao
|
53aefa531f
|
Merge branch '3.0' into fix/3_liaohj
|
2023-08-02 09:45:21 +08:00 |
|
Haojun Liao
|
e1e5e9bb0f
|
enh(stream): check stream tasks dag.
|
2023-08-02 09:44:39 +08:00 |
|
Hongze Cheng
|
4ba4e83b5b
|
fix: retention file corruption
|
2023-08-01 20:19:13 +08:00 |
|
Minglei Jin
|
7d294cac5f
|
tsdb/cache: load current fileset's brinblk once
|
2023-08-01 18:56:10 +08:00 |
|
Minglei Jin
|
a593e887fa
|
cache: remove nFileset from fs state
|
2023-08-01 18:37:23 +08:00 |
|
Minglei Jin
|
7ad628417a
|
fix mem issue: stack-use-after-scope
|
2023-08-01 17:57:38 +08:00 |
|
Minglei Jin
|
4716fc6400
|
cache/fs: remove fs state's tsdb handle
|
2023-08-01 17:49:05 +08:00 |
|
Minglei Jin
|
1d5532019f
|
tsdb/merge-tree: cleanup comment
|
2023-08-01 17:25:15 +08:00 |
|
Minglei Jin
|
f72f129d41
|
cache/skyline: cleanup del array
|
2023-08-01 17:23:53 +08:00 |
|
Minglei Jin
|
c997662ba0
|
tsdb/cache: build skyline only if there's del data
|
2023-08-01 16:50:00 +08:00 |
|
Minglei Jin
|
94b9599f95
|
fix null pointer dereference
|
2023-08-01 16:39:14 +08:00 |
|
Haojun Liao
|
637f09359a
|
other: merge main.
|
2023-08-01 16:15:34 +08:00 |
|
Minglei Jin
|
72ac5a4e3b
|
tsdb/cache: use read util's uid compare functor
|
2023-08-01 16:08:20 +08:00 |
|
Minglei Jin
|
c0a0e07597
|
cache/read: lazy init uidList when laoding from tsdb
|
2023-08-01 16:02:09 +08:00 |
|
Minglei Jin
|
b3fae65d90
|
enh(tsdb/cache/read): lazy init table map hash and entries
|
2023-08-01 15:53:42 +08:00 |
|
Hongze Cheng
|
78c23f407e
|
fix compile issue
|
2023-08-01 15:04:14 +08:00 |
|
Hongze Cheng
|
07c40943a4
|
fix: TD-25408
|
2023-08-01 15:01:06 +08:00 |
|
wade zhang
|
347e78ecb5
|
Merge pull request #22272 from taosdata/fix/TD-25466
Fix/td 25466
|
2023-08-01 14:22:24 +08:00 |
|
Hongze Cheng
|
1b39147496
|
more refact
|
2023-08-01 11:36:37 +08:00 |
|
Hongze Cheng
|
0e46041c1a
|
fix: tsdbRetention memory leak
|
2023-08-01 11:21:40 +08:00 |
|
Haojun Liao
|
ae9745ecf2
|
Merge pull request #22258 from taosdata/mark/tmq-3.0
fix:add committed & seek process logic
|
2023-08-01 09:52:09 +08:00 |
|
Haojun Liao
|
ea875c58f2
|
Merge pull request #22263 from taosdata/mark/tmq-main
fix:add committed & seek process logic
|
2023-08-01 09:43:23 +08:00 |
|
Haojun Liao
|
36ef9a537f
|
Merge pull request #22256 from taosdata/fix/TD-25457
check update data
|
2023-07-31 22:56:05 +08:00 |
|
Haojun Liao
|
2640e41705
|
Merge pull request #22261 from taosdata/fix/3_liaohj
fix(stream): set the correct end key of delete block.
|
2023-07-31 22:55:50 +08:00 |
|
wangmm0220
|
68ae64cdb2
|
fix:add committed & seek process logic
|
2023-07-31 18:53:25 +08:00 |
|
wangmm0220
|
cddf27e8b4
|
fix:add committed & seek process logic
|
2023-07-31 18:48:50 +08:00 |
|
Haojun Liao
|
d45596bb33
|
fix(stream): kill task when pause the stream execution.
|
2023-07-31 18:07:37 +08:00 |
|
wangmm0220
|
6179618b17
|
fix:add committed & seek process logic
|
2023-07-31 17:56:04 +08:00 |
|
liuyao
|
32b59af4b1
|
check update data
|
2023-07-31 17:32:24 +08:00 |
|
wangmm0220
|
8093ef2dc8
|
Merge branch 'main' of https://github.com/taosdata/TDengine into mark/tmq
|
2023-07-31 16:14:25 +08:00 |
|
Haojun Liao
|
9981cecbed
|
refactor: do some internal refactor.
|
2023-07-31 15:24:35 +08:00 |
|
Minglei Jin
|
079d7ff69e
|
fix(tsdb/read2): reset stt reader when suspended
|
2023-07-31 15:21:47 +08:00 |
|
wade zhang
|
c7fa5ed6ef
|
Merge pull request #22247 from taosdata/fix/TD-25436
fix(tsdb/cache): check stt data with empty brin index
|
2023-07-31 11:24:37 +08:00 |
|
Minglei Jin
|
135beebc0a
|
fix(tsdb/cache): check stt data with empty brin index
|
2023-07-31 09:15:08 +08:00 |
|
wade zhang
|
bae028d65c
|
Merge pull request #22230 from taosdata/mark/tmq
fix:semaphore always wait in tmq commit logic
|
2023-07-31 09:10:13 +08:00 |
|
wade zhang
|
c26165975d
|
Merge pull request #22227 from taosdata/fix/TS-3728
fix:add macro ASSERT_NOT_CORE to control ASSERT not core in release version
|
2023-07-30 14:28:56 +08:00 |
|
Haojun Liao
|
8dfef8768a
|
other: merge 3.0
|
2023-07-29 22:54:16 +08:00 |
|
Haojun Liao
|
0bd2548937
|
fix(stream): initialize the filter window initial range.
|
2023-07-29 16:41:01 +08:00 |
|
Haojun Liao
|
f6e07d1fdb
|
other: merge 3.0
|
2023-07-29 01:32:02 +08:00 |
|
wade zhang
|
c19feb2fa1
|
Merge pull request #22236 from taosdata/fix/TD-25416
fix(tsdb/cache/del): use lru mutex to fix race with committing
|
2023-07-28 23:17:45 +08:00 |
|
Haojun Liao
|
936afeb5ac
|
refactor: do internal refactor to simple the pause/resume in case of fill history exists.
|
2023-07-28 19:13:03 +08:00 |
|
Haojun Liao
|
d5974a8f25
|
refactor(stream): refactor the pause/resume for fill history execution.
|
2023-07-28 18:05:32 +08:00 |
|
Minglei Jin
|
1fcbf3432c
|
tsdb/cache/del: remove duplicate lruMutex lock
|
2023-07-28 17:20:20 +08:00 |
|
wangmm0220
|
d982a7cb80
|
fix:heap use after free for wal
|
2023-07-28 16:59:35 +08:00 |
|
Minglei Jin
|
b0f65dfa62
|
fix(tsdb/cache/del): use lru mutex to fix race with committing
|
2023-07-28 16:32:07 +08:00 |
|
wangmm0220
|
6e673072cd
|
fix:conflicts
|
2023-07-28 14:57:13 +08:00 |
|
Haojun Liao
|
9f943213ed
|
enh(stream): update the hb info.
|
2023-07-28 14:23:53 +08:00 |
|
Haojun Liao
|
74834aea11
|
enh(stream): prepare hb to mnode from stream meta.
|
2023-07-28 13:07:16 +08:00 |
|
Haojun Liao
|
2a78cd2d23
|
Merge pull request #22215 from taosdata/fix/liaohj
other: merge main.
|
2023-07-28 13:06:17 +08:00 |
|
wangmm0220
|
2f6c565392
|
fix:pHandle not load if taosd restart
|
2023-07-28 11:48:53 +08:00 |
|
wade zhang
|
b3e5b5bd24
|
Merge pull request #22217 from taosdata/fix/TD-25386
fix(tsdb/cache): move to stt next row if data file exausted
|
2023-07-28 08:56:29 +08:00 |
|
Haojun Liao
|
ccc0f13649
|
Merge pull request #22214 from taosdata/fix/3_liaohj
fix(stream): scan wal in step2
|
2023-07-28 00:42:15 +08:00 |
|
Haojun Liao
|
7f3d1dc464
|
fix(stream): fix memory leak.
|
2023-07-27 23:06:53 +08:00 |
|
wangmm0220
|
77d43ef5fd
|
fix:tmq ci error
|
2023-07-27 20:28:45 +08:00 |
|
Haojun Liao
|
fbb33be85d
|
other: add some comments.
|
2023-07-27 18:59:38 +08:00 |
|
Haojun Liao
|
22a5a18fff
|
fix(stream): 1. set correct timewindow after step2. 2. handle the case when the task is failed to be added into the meta store.
|
2023-07-27 18:57:36 +08:00 |
|
Minglei Jin
|
cc9b9bd0b9
|
fix(tsdb/cache): move to stt next row if data file exausted
|
2023-07-27 17:19:42 +08:00 |
|
Haojun Liao
|
b145771a1b
|
other: merge 3.0
|
2023-07-27 16:38:57 +08:00 |
|
Haojun Liao
|
3d403dca5a
|
other: merge main.
|
2023-07-27 16:23:41 +08:00 |
|
Haojun Liao
|
6ff50d4eaf
|
fix(stream): update the step2 scan wal files.
|
2023-07-27 16:10:55 +08:00 |
|
wangmm0220
|
75eacd56f1
|
fix:add log
|
2023-07-27 15:58:32 +08:00 |
|
wade zhang
|
a72c11c8de
|
Merge pull request #22205 from taosdata/fix/TD-25315
fix(tsdb/commit2): new maxDelKey for commit context
|
2023-07-27 15:48:46 +08:00 |
|
wangmm0220
|
2d41a42976
|
Merge branch 'main' of https://github.com/taosdata/TDengine into fix/TS-3728
|
2023-07-27 15:31:16 +08:00 |
|
Haojun Liao
|
40fe3ef4f6
|
fix(stream): refactor the step2 wal scan.
|
2023-07-27 14:49:20 +08:00 |
|
Minglei Jin
|
fe495f7013
|
tsdb/commit2: fix commit minKey for del
|
2023-07-27 13:54:48 +08:00 |
|
Haojun Liao
|
e89f530db2
|
fix(stream): scan wal in step2
|
2023-07-27 10:55:59 +08:00 |
|
Minglei Jin
|
8a2764c698
|
tsdb/commit2: use max fileset's maxKey as initial maxDelKey
|
2023-07-27 10:51:17 +08:00 |
|
Minglei Jin
|
dd32f12f92
|
tsdb/commit2: reset nextKey to max to stop commit
|
2023-07-27 09:50:32 +08:00 |
|
Minglei Jin
|
992d623ae5
|
fix(tsdb/commit2): initialize ctx's maxDelKey with TSKEY_MIN
|
2023-07-27 09:34:47 +08:00 |
|
Minglei Jin
|
580b7124cf
|
fix(tsdb/commit2): new maxDelKey for commit context
|
2023-07-27 09:16:28 +08:00 |
|
Haojun Liao
|
087d54a807
|
Merge pull request #22198 from taosdata/fix/3_liaohj
fix(stream): do filter before the update check.
|
2023-07-26 18:57:48 +08:00 |
|
yihaoDeng
|
287088ae3f
|
fix stream state transfer
|
2023-07-26 10:16:06 +00:00 |
|
Haojun Liao
|
c57defa1c9
|
Merge pull request #22195 from taosdata/szhou/fix-td25369
fix: stt and data block merge
|
2023-07-26 17:11:18 +08:00 |
|
Haojun Liao
|
6a6830761d
|
fix(tsdb): check for null ptr of pScanInfo
|
2023-07-26 17:08:29 +08:00 |
|
Haojun Liao
|
3c387f6e91
|
fix(stream): fix syntax error.
|
2023-07-26 17:00:41 +08:00 |
|
Haojun Liao
|
432c943c25
|
fix(stream): do filter before the update check.
|
2023-07-26 16:34:39 +08:00 |
|
Haojun Liao
|
610f9d19c1
|
Merge pull request #22188 from taosdata/fix/3_liaohj
fix(stream): set the correct step2 scan time window range.
|
2023-07-26 16:34:10 +08:00 |
|
shenglian zhou
|
1357e623d0
|
fix: fix compilation error
|
2023-07-26 15:43:50 +08:00 |
|
shenglian zhou
|
79020ea4a4
|
fix: stt and data block merge
|
2023-07-26 15:01:20 +08:00 |
|
Haojun Liao
|
df57768a3e
|
Merge branch '3.0' into fix/3_liaohj
|
2023-07-26 14:45:11 +08:00 |
|
Haojun Liao
|
cdffabcdad
|
fix(stream): fix memory leak.
|
2023-07-26 14:37:04 +08:00 |
|
Haojun Liao
|
728112ed89
|
fix(stream): set correct upstream epinfo.
|
2023-07-26 10:26:59 +08:00 |
|
wade zhang
|
d8fd5b9394
|
Merge pull request #22190 from taosdata/fix/TD-25315
fix(tsdb/del): reset next key to del record's ekey
|
2023-07-26 10:23:01 +08:00 |
|
yihaoDeng
|
c61393a7a1
|
fix stream state transfer
|
2023-07-26 01:33:41 +00:00 |
|
Haojun Liao
|
b6eb739ae0
|
fix(tsdb): fix the
|
2023-07-26 09:14:19 +08:00 |
|
Minglei Jin
|
fb860726de
|
fix(tsdb/del): reset next key to del record's ekey
|
2023-07-26 08:40:44 +08:00 |
|
Haojun Liao
|
1c1bf63e1f
|
other: merge 3.0
|
2023-07-25 18:17:11 +08:00 |
|
wade zhang
|
02bc1b2a8f
|
Merge pull request #22186 from taosdata/fix/TD-25315
fix(tsdb/del): continue committing fileset if more del left
|
2023-07-25 17:41:30 +08:00 |
|
Haojun Liao
|
0bdccd2681
|
refactor: do some internal refactor.
|
2023-07-25 17:31:54 +08:00 |
|
Minglei Jin
|
7bfb4e0f88
|
fix(tsdb/del): continue committing fileset if more del left
|
2023-07-25 16:42:45 +08:00 |
|
wangmm0220
|
be4e47e9a7
|
fix:add macro ASSERT_NOT_CORE to control ASSERT not core in release version
|
2023-07-25 16:15:33 +08:00 |
|
Haojun Liao
|
d29f835a63
|
fix(stream): set the correct step2 scan time window range.
|
2023-07-25 15:09:22 +08:00 |
|
Haojun Liao
|
c2588d71c3
|
Merge pull request #22173 from taosdata/fix/TS-3728
fix:avoid request offset type is 0
|
2023-07-25 14:59:30 +08:00 |
|
wade zhang
|
2bf84c2676
|
Merge pull request #22179 from taosdata/FIX/TS-3702-3.0
enh: compatibility between getFileNamePrefix and tsdbTFileName
|
2023-07-25 14:26:14 +08:00 |
|
Benguang Zhao
|
01f45b2a99
|
enh: compatibility between getFileNamePrefix and tsdbTFileName
|
2023-07-25 11:35:35 +08:00 |
|
Minglei Jin
|
1bce96ea27
|
fix(tsdb/pageSize): use tsdbPageSize instead of szPage(tdb's)
|
2023-07-25 10:46:03 +08:00 |
|
wade zhang
|
7ea9cf1ddc
|
Merge pull request #22166 from taosdata/fix/TD-24422
fix(tsdb/cache): reuse data file reader
|
2023-07-25 10:28:59 +08:00 |
|
Haojun Liao
|
96722a07b1
|
Merge pull request #22174 from taosdata/fix/3_liaohj
fix(stream): fix the invalid check of step2 .
|
2023-07-25 00:30:06 +08:00 |
|
Haojun Liao
|
a2694b9ce9
|
fix(stream): fix the invalid check of step2 .
|
2023-07-24 19:44:28 +08:00 |
|
wangmm0220
|
6a0e994169
|
fix:avoid request offset type is 0
|
2023-07-24 19:24:05 +08:00 |
|
Haojun Liao
|
d36903bf08
|
Merge pull request #22162 from taosdata/fix/3_liaohj
fix(stream): add some logs, and remove the invalid loop.
|
2023-07-24 16:29:51 +08:00 |
|
wangmm0220
|
9628a9f74e
|
fix:open info log in tmq & ignore wal apply ver when read wal
|
2023-07-24 15:53:02 +08:00 |
|
Haojun Liao
|
01f11bf5a6
|
Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2
# Conflicts:
# source/common/src/tglobal.c
# source/libs/executor/src/timewindowoperator.c
|
2023-07-24 15:25:43 +08:00 |
|
Haojun Liao
|
1e34f84f78
|
other: merge 3.0
|
2023-07-24 15:23:03 +08:00 |
|
Minglei Jin
|
424dd40078
|
tsdb/cache: reuse pDataFileReader for same fileset
|
2023-07-24 14:45:35 +08:00 |
|
Haojun Liao
|
9bae91bcba
|
fix(stream): add some logs, and remove the invalid loop.
|
2023-07-24 13:37:44 +08:00 |
|
Haojun Liao
|
13bab114cb
|
Merge pull request #22155 from taosdata/fix/3_liaohj
fix(stream): refactor the halt status to check more status.
|
2023-07-24 11:04:08 +08:00 |
|
Minglei Jin
|
968cfd9e65
|
tsdb/cache: pLastIter null pointer check
|
2023-07-24 11:03:07 +08:00 |
|
wade zhang
|
5f25d70fc2
|
Merge pull request #22154 from taosdata/enh/tsdb_optimize
fix(tsdb/cache): new next stt row state for fs tranverse
|
2023-07-24 10:47:51 +08:00 |
|
Haojun Liao
|
1367552f38
|
fix(stream): refactor the halt status to check more status.
|
2023-07-24 10:04:15 +08:00 |
|
Haojun Liao
|
6a19ad3127
|
Merge pull request #22151 from taosdata/fix/3_liaohj
fix(stream): set the correct flag of pause/resume.
|
2023-07-24 09:07:49 +08:00 |
|
Minglei Jin
|
13491fab95
|
tsdb/cache: new next stt row state for fs tranverse
|
2023-07-24 08:51:20 +08:00 |
|
Haojun Liao
|
0b6e1a12bb
|
refactor: do some internal refactor.
|
2023-07-23 19:09:43 +08:00 |
|
Haojun Liao
|
e387b2f932
|
refactor: do some internal refactor.
|
2023-07-23 18:59:34 +08:00 |
|
Haojun Liao
|
4e0f7ffbf8
|
fix(stream): set the correct flag of pause/resume.
|
2023-07-23 18:49:56 +08:00 |
|
Haojun Liao
|
321be1f83f
|
Merge pull request #22135 from taosdata/fix/3_liaohj
refactor: do some internal refactor.
|
2023-07-22 15:06:28 +08:00 |
|
Haojun Liao
|
bfc4a07207
|
fix(stream): fix memory leak.
|
2023-07-22 00:20:02 +08:00 |
|
Haojun Liao
|
1b2636028a
|
fix(stream): fix memory leak.
|
2023-07-21 23:05:42 +08:00 |
|
Haojun Liao
|
16d7707b90
|
fix(stream): align the scan real time data for stream task.
|
2023-07-21 19:33:43 +08:00 |
|
wade zhang
|
7b1e809d98
|
Merge pull request #21794 from taosdata/enh/tsdb_optimize
for test purpose
|
2023-07-21 14:18:32 +08:00 |
|
wangmm0220
|
bb86f5c580
|
fix:commit offset should not plus 1
|
2023-07-21 11:13:05 +08:00 |
|
wangmm0220
|
10ebf1f438
|
fix:subscribeStb.py maybe failed
|
2023-07-21 11:07:34 +08:00 |
|
dmchen
|
7d480cf3ac
|
compatible old sync config
|
2023-07-21 10:31:53 +08:00 |
|
Haojun Liao
|
39ca9b537f
|
fix(stream): fix syntax error
|
2023-07-21 09:43:08 +08:00 |
|
Haojun Liao
|
c9d75eab5a
|
refactor: do some internal refactor.
|
2023-07-21 09:16:13 +08:00 |
|
Haojun Liao
|
db46d31ca5
|
fix(stream): refactor the halt function.
|
2023-07-21 01:32:42 +08:00 |
|
yihaoDeng
|
519d3b74d1
|
fix stream state transfer
|
2023-07-20 09:51:18 +00:00 |
|
Haojun Liao
|
9353f7c8cf
|
refactor: do some internal refactor.
|
2023-07-20 16:35:02 +08:00 |
|
Haojun Liao
|
c9fa170e65
|
refactor: do some internal refactor.
|
2023-07-20 16:31:46 +08:00 |
|
Haojun Liao
|
45cb478b31
|
refactor: do some internal refactor.
|
2023-07-20 15:36:46 +08:00 |
|
Haojun Liao
|
87fa8f0c4c
|
Merge branch '3.0' into fix/3_liaohj
|
2023-07-20 12:15:23 +08:00 |
|
Haojun Liao
|
aed99da6c1
|
refactor: refactor the stream task starting order.
|
2023-07-20 12:14:53 +08:00 |
|
yihaoDeng
|
6e5be0d30e
|
fix stream state transfer
|
2023-07-20 03:49:32 +00:00 |
|
Minglei Jin
|
48222f5dc3
|
tsdb/cache: move data file reader for fs iter to cache reader
|
2023-07-20 09:11:26 +08:00 |
|
Minglei Jin
|
6dd4ec41ae
|
tsdb/cache cleanup: remove unused fs methods
|
2023-07-20 08:51:03 +08:00 |
|
Minglei Jin
|
7f0ea10573
|
Merge branch 'enh/tsdb_optimize' of https://github.com/taosdata/TDengine into enh/tsdb_optimize
|
2023-07-20 08:42:12 +08:00 |
|
Minglei Jin
|
46d6dcda3e
|
tsdb/cache: reset skyline when clearing fileset
|
2023-07-20 08:41:32 +08:00 |
|
Haojun Liao
|
bfcc538205
|
fix(tsdb):disable stt statistics.
|
2023-07-20 00:01:30 +08:00 |
|
yihaoDeng
|
733db123ad
|
refactor code
|
2023-07-19 13:24:59 +00:00 |
|
Haojun Liao
|
97c44e7c18
|
refactor: do some internal refactor.
|
2023-07-19 18:42:02 +08:00 |
|
wangmm0220
|
d7d81d82a0
|
feat:add committed & position & commite_offset interface
|
2023-07-19 18:27:19 +08:00 |
|
Yihao Deng
|
91a15fd7bd
|
Merge branch '3.0' into enh/triggerCheckPoint2
|
2023-07-19 18:14:08 +08:00 |
|
Minglei Jin
|
ce71b8bbe7
|
Merge branch 'enh/tsdb_optimize' of https://github.com/taosdata/TDengine into enh/tsdb_optimize
|
2023-07-19 18:11:14 +08:00 |
|
Minglei Jin
|
4eaecd11de
|
tsdb/cache: merge fs & stt row
|
2023-07-19 18:10:36 +08:00 |
|
wangmm0220
|
5cb35f2fa6
|
feat:add committed & position & commite_offset interface
|
2023-07-19 17:29:39 +08:00 |
|
Haojun Liao
|
37ae80d135
|
fix(tsdb): fix memory leak.
|
2023-07-19 16:42:51 +08:00 |
|
Haojun Liao
|
d82fb45a4f
|
Merge remote-tracking branch 'origin/enh/tsdb_optimize' into enh/tsdb_optimize
|
2023-07-19 15:01:37 +08:00 |
|
Haojun Liao
|
a84efab2c8
|
enh(tsdb): add table filter according to stt block statistics data.
|
2023-07-19 15:01:25 +08:00 |