e76e6bbb84
Update tsdbReadUtil.c
2023-08-24 11:34:56 +08:00
1965703d53
Merge branch '3.0' into szhou/tsdb-neigh-block
2023-08-24 10:58:23 +08:00
3afea998ac
refactor log
2023-08-24 10:15:15 +08:00
230d8c2d80
fix(stream): fix error in stream computing after vnode is transferred to other dnodes.
2023-08-23 17:50:44 +08:00
b0c5fa8290
fix(stream): reset the task status.
2023-08-23 14:10:41 +08:00
a601cd21bd
fix: alter stt_trigger bug
2023-08-23 13:31:19 +08:00
458fd07976
enh: ttl split flush and drop table
...
config:
1. ttlFlushThreshold: maximum number of dirty items in memory
2. tsTtlBatchDropNum: number of tables dropped per batch
3. tsTrimVDbIntervalSec: interval of trimming db in all vgroups
2023-08-23 11:13:34 +08:00
8c4062c1b0
Merge pull request #22515 from taosdata/fix/TD-25819-2
...
fix(tsdb/file): save errno for shell reporting
2023-08-23 10:49:48 +08:00
e069d72229
Merge pull request #22513 from taosdata/FIX/TD-25864-3.0
...
enh: adjust the order of pre-close actions in vnodePreClose
2023-08-22 17:27:17 +08:00
af80d94a88
refactor: do some internal refactor.
2023-08-22 15:43:50 +08:00
345743aba5
fix(tsdb/file): save errno for shell reporting
2023-08-22 14:44:32 +08:00
cc8b2263cb
fix(stream): fix error in heartbeat from vnode.
2023-08-22 13:37:38 +08:00
8be670aee8
enh: place vnodeSyncPreStop ahead of vnodeQueryPreStop in vnodePreClose
2023-08-22 11:30:40 +08:00
64556c9f1d
Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2
2023-08-22 10:47:02 +08:00
def0877980
fix(stream): add timer to check stream task status.
2023-08-22 10:46:49 +08:00
b899a8b7df
Merge branch '3.0' into feat/TD-22970
2023-08-22 10:12:30 +08:00
1531e2d7d3
Merge branch 'enh/3.0' into enh/triggerCheckPoint2
2023-08-22 09:51:38 +08:00
873c22abb1
fix(stream): reset update stream tasks.
2023-08-21 19:32:27 +08:00
8b27f98ee4
refactor: do some internal refactor.
2023-08-21 19:08:27 +08:00
387b4d365e
refactor checkpoint
2023-08-21 19:07:15 +08:00
b8d62a86ed
feat: clean useless file
2023-08-21 16:29:48 +08:00
29bb5854cc
fix(stream): fix error in check stream state.
2023-08-21 11:48:55 +08:00
dda51d8019
Merge branch '3.0' into feat/TD-22970
2023-08-21 10:50:45 +08:00
54e1f69db4
Merge pull request #22481 from taosdata/fix/TD-25822
...
enh(tsdb/write): timestamp out of range with s3's last tier storage
2023-08-21 09:33:06 +08:00
6fe649c458
Merge branch 'enh/3.0' into enh/triggerCheckPoint2
2023-08-21 09:12:40 +08:00
b8101afbe2
fix(stream): refactor the tasks restart mechanism.
2023-08-18 22:36:38 +08:00
c4a3a5da35
vnode: fix write to s3 last tier
2023-08-18 18:02:53 +08:00
a7e11c2520
Merge pull request #22482 from taosdata/fix/TD-25818
...
fix(vnode/destroy): delete objects
2023-08-18 17:49:22 +08:00
87a8fe34ef
Merge pull request #22480 from taosdata/fix/TD-25819
...
fix(tsdb/reader): use ENOENT for not found objects
2023-08-18 16:49:54 +08:00
7b4bb72392
fix(vnode/destroy): delete objects
2023-08-18 16:38:26 +08:00
0242d4ce33
enh(tsdb/write): timestamp out of range with s3's last tier storage
2023-08-18 16:07:15 +08:00
c26d625152
Merge branch '3.0' into enh/triggerCheckPoint2
2023-08-18 15:51:07 +08:00
73ae493fa7
tsdb/reader: use ENOENT for not found objects
2023-08-18 15:43:08 +08:00
9afd5155ed
Merge branch 'enh/triggerCheckPoint2' of https://github.com/taosdata/TDengine into enh/triggerCheckPoint2
2023-08-18 15:33:37 +08:00
87c65f3b68
Merge remote-tracking branch 'origin/3.0' into enh/triggerCheckPoint2
2023-08-18 15:27:02 +08:00
9b953707b8
Merge remote-tracking branch 'origin/main' into fix/mainto3.0
2023-08-18 14:42:43 +08:00
edbad45772
other: add logs.
2023-08-18 13:45:08 +08:00
e393a98ee9
Merge branch '3.0' into feat/TD-22970
2023-08-18 13:37:18 +08:00
a8b53c2e69
other: add logs.
2023-08-18 10:51:59 +08:00
633ecf66e5
other: add logs.
2023-08-18 10:39:32 +08:00
9ad8cf48dc
other: add logs.
2023-08-18 10:38:24 +08:00
87785b1d9c
refactor: add some logs.
2023-08-18 10:30:00 +08:00
4e2a26e8be
Merge branch '3.0' of github.com:taosdata/TDengine into szhou/select-tags-scan
2023-08-18 08:46:17 +08:00
8582e0c71a
fix: important fix for compact file corruption
2023-08-17 18:13:37 +08:00
5f138941f8
tsdb snap core
2023-08-17 17:58:35 +08:00
85d1dbe00a
Merge branch '3.0' of github.com:taosdata/TDengine into szhou/select-tags-scan
2023-08-17 16:27:37 +08:00
7735e6f388
Merge branch 3.0 to FEAT/TD-25699-3.0
2023-08-17 16:04:23 +08:00
4a9391929c
fix: select tags - ctb cursor pause/unlock and lock/resume
2023-08-17 14:59:17 +08:00
0e10e94a40
Merge pull request #22453 from taosdata/feat/TD-25685
...
feat: support column comment
2023-08-17 14:23:54 +08:00
16754b5ac1
feat: show create table, desc table with col comments
2023-08-17 11:39:34 +08:00
5ce7688a93
Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/ly_refactor
2023-08-17 09:06:46 +08:00
e493a30a0b
Merge pull request #22460 from taosdata/fix/tsdb_snapshot_bug
...
fix: tsdb snapshot bug
2023-08-17 08:25:32 +08:00
6746339609
Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2
...
# Conflicts:
# source/libs/stream/src/streamSnapshot.c
2023-08-17 00:08:44 +08:00
ea6574b3c7
other: merge 3.0
2023-08-17 00:07:55 +08:00
f8f8e7a8f0
Merge pull request #22465 from taosdata/fix/3_liaohj
...
fix(stream): add the back pressure for sink node.
2023-08-16 22:59:36 +08:00
114df7c349
fix transfer error
2023-08-16 11:37:15 +00:00
80506b564b
Merge pull request #22461 from taosdata/fix/liaohj
...
refactor: do some internal refactcor
2023-08-16 19:26:39 +08:00
9a76ae72d6
fix(stream): add the back pressure for sink node.
2023-08-16 19:11:43 +08:00
32c5b6a947
fix: tsdb snapshot bug
2023-08-16 18:21:02 +08:00
cbd24bb254
refactor: do some internal refactor
2023-08-16 18:20:34 +08:00
fee4b875d1
error code
2023-08-16 17:49:17 +08:00
cedc7bf1b6
fix: memory leak when commit
2023-08-16 17:21:51 +08:00
ab7e2b3122
Merge branch 'enh/chkpTransfer' into enh/triggerCheckPoint2
2023-08-16 09:00:30 +00:00
e020c4e8c5
Merge pull request #22456 from taosdata/3.0
...
merge 3.0 to feat/TD-22970
2023-08-16 16:49:43 +08:00
f1359076c1
Merge pull request #22450 from taosdata/fix/3_liaohj
...
other: merge main.
2023-08-16 16:48:33 +08:00
d63758a1c5
fix(stream): fix error in execute task on a tranferred node.
2023-08-16 15:24:24 +08:00
993ae84398
close backend
2023-08-16 07:17:15 +00:00
4ea58e5682
refactor: do some internal refactor.
2023-08-16 11:44:05 +08:00
6609882f9f
fix(tsdb): add stt statistics block buffer, and do some internal refactor.
2023-08-16 10:55:07 +08:00
de5aedd8f3
vnode.json
2023-08-16 10:20:48 +08:00
919ffbaf72
Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/ly_refactor
2023-08-16 10:04:07 +08:00
63bc50a723
Merge pull request #22427 from taosdata/feature/rebuildIndex0
...
rebuild index at tag0
2023-08-16 09:47:43 +08:00
fc09f8ef1e
Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/ly_refactor
2023-08-16 09:36:28 +08:00
ad9f3cbc43
other: merge main.
2023-08-16 09:14:10 +08:00
7628be236d
other: merge main.
2023-08-16 09:03:54 +08:00
df13c6fa3e
Merge pull request #22410 from taosdata/szhou/tag-scan-opt
...
enhance: tag scan optimization
2023-08-16 08:58:17 +08:00
1a1a12b7b8
Merge pull request #22327 from taosdata/fix/TD-25010-3
...
feat(tsdb/cos): s3 migration
2023-08-16 08:02:20 +08:00
4fdaaba3ce
Merge branch '3.0' of github.com:taosdata/TDengine into szhou/tag-scan-opt
2023-08-15 17:18:25 +08:00
239a79d405
enh: add some vnode info in SStatusReq
2023-08-15 17:06:33 +08:00
1792bf306e
vnode: fix cos cache evicting
2023-08-15 16:54:26 +08:00
39079ab64a
fix(stream): load term from sync model to decide if the node is restart or not
2023-08-15 15:52:06 +08:00
c4e5cfd2fb
retention: return code from copy
2023-08-15 15:40:40 +08:00
bd758e0269
retention: remove old files last
2023-08-15 15:14:34 +08:00
8639c22cc0
vnode, common: USE_COS def
2023-08-15 14:53:58 +08:00
1b4e51ee4a
Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/ly_refactor
2023-08-15 14:20:49 +08:00
b1d35f43ba
enh(stream): using term from sync module to denote the upstream node is restarted/replica-modified/vnode-transferred or not.
2023-08-15 09:25:05 +08:00
ff17763ed6
Merge pull request #22417 from taosdata/mark/tmq
...
opti:wal logic
2023-08-15 09:16:29 +08:00
9e3733a02c
Merge pull request #22358 from taosdata/feat/TD-24559
...
feat:[TD-24559]support geomety type in schemaless
2023-08-14 22:06:41 +08:00
9d1e5a512d
add stream task id
2023-08-14 17:52:39 +08:00
2e6263b43f
fix(stream): fix memory leak.
2023-08-14 17:16:11 +08:00
cf9f9ab471
rebuild index at tag0
2023-08-14 08:01:20 +00:00
a1e554fbf3
refactor: exec directly not asynchnoized.
2023-08-14 15:05:13 +08:00
989abc2bf6
vnode/cos: move includes into USE_COS
2023-08-14 15:03:17 +08:00
91710b0c0f
fix(stream):
2023-08-14 14:56:17 +08:00
c97b9249fc
cos: only for linux
2023-08-14 14:38:28 +08:00
692d436d68
fix: fix ci error
2023-08-14 14:14:16 +08:00
5ec6b64aab
fix(stream): add logs.
2023-08-14 13:12:41 +08:00
ead04964fd
Merge branch 'main' into fix/liaohj
2023-08-14 12:11:15 +08:00
c2417eb5cd
Merge pull request #22404 from taosdata/fix/TD-25621-3.0
...
fix: dup read lock on windows
2023-08-14 11:37:05 +08:00
2806fe1c56
fix(stream): ignore the related stream task destory msg in transfer state.
2023-08-14 10:58:24 +08:00
646e52ae7f
Merge branch '3.0' of github.com:taosdata/TDengine into szhou/tag-scan-opt
2023-08-14 10:19:36 +08:00
246efd83c6
refactor chpt transfer
2023-08-14 02:03:41 +00:00
dd0bc0e050
fix:heap use after free
2023-08-14 09:42:55 +08:00
1b51f53c15
Merge pull request #22407 from taosdata/fix/TD-25671
...
fix: infinite tomb data sync loop
2023-08-14 09:25:47 +08:00
46f92d222d
fix: typo error
2023-08-14 08:52:25 +08:00
db25f6c01b
Merge branch 'szhou/tsdb-neigh-block' of github.com:taosdata/TDengine into szhou/tsdb-neigh-block
2023-08-14 08:49:25 +08:00
c5a6cac34f
fix: fix compilation error
2023-08-14 08:49:10 +08:00
01ac99a651
Merge pull request #22413 from taosdata/fix/liaohj
...
refactor: refactor the transfer state procedure.
2023-08-13 23:28:18 +08:00
8e7fc91095
enhance: set file data block iter
2023-08-13 18:30:30 +08:00
0d38f389ab
refactor: do some internal refactor.
2023-08-13 16:25:35 +08:00
ce721a0146
fix(stream): fix error.
2023-08-12 16:32:05 +08:00
efb472d54a
fix:heap use after free
2023-08-12 10:15:40 +08:00
f24b22000f
enh(stream): stop stream task before redistribute vnodes.
2023-08-11 23:46:53 +08:00
767563752a
opti:wal logic
2023-08-11 20:21:13 +08:00
deda4b9eed
opti:wal logic
2023-08-11 19:26:17 +08:00
847bc0da08
fix: infinite tomb data sync loop
2023-08-11 18:10:16 +08:00
47d2f9ad6d
fix: first run without tag cond
2023-08-11 17:52:52 +08:00
7b22d37f12
fix:lost data when consumer db
2023-08-11 17:25:43 +08:00
42a4f364c1
Merge branch 'szhou/tag-scan-opt' of github.com:taosdata/TDengine into szhou/tag-scan-opt
2023-08-11 16:48:49 +08:00
84452c8dee
cos: use static sdk
2023-08-11 16:36:53 +08:00
eb9d77d639
ehance: destroy blocklist of table scan info, add block global index list to table scan info
2023-08-11 16:33:49 +08:00
87c7e4c0fe
fix(stream): not launch stream tasks when restarting the stream tasks.
2023-08-11 16:19:46 +08:00
6e6eb05d5c
Merge branch 'enh/triggerCheckPoint2' into enh/chkpTransfer
2023-08-11 08:03:02 +00:00
e984affe90
fix(stream): disable the stream in the followers nodes.
2023-08-11 15:58:15 +08:00
25e32bbf7c
fix:offset error in tmq & add test cases
2023-08-11 14:25:12 +08:00
9322f80343
fix(stream): register the rsp callback.
2023-08-11 13:31:50 +08:00
64a1636dd2
chore: trigger CI
2023-08-11 12:54:45 +08:00
1d089fe085
fix: dup read lock on windows
2023-08-11 11:34:57 +08:00
99be2836b2
Merge branch 'enh/triggerCheckPoint2' into enh/chkpTransfer
2023-08-11 02:50:12 +00:00
1e636a2ef9
Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2
2023-08-11 10:37:40 +08:00
6a9826cf6e
enh(stream): update the stream task epset.
2023-08-11 10:37:25 +08:00
ba4ce9db02
Merge branch 'enh/triggerCheckPoint2' into enh/chkpTransfer
2023-08-11 02:15:07 +00:00
d9bc881fb3
Merge pull request #22384 from taosdata/mark/tmq
...
fix:offset error in tmq & add test cases
2023-08-11 10:00:08 +08:00
4513acfee9
cos: use static libs for mxml, apr, apu, curl
2023-08-11 09:54:54 +08:00
32983a11e1
add log and fix crash
2023-08-10 20:34:00 +08:00
b2e615d4e7
enhance: tag scan cursor based block
2023-08-10 17:30:01 +08:00
78fd70202c
fix:offset error in tmq & add test cases
2023-08-10 16:18:53 +08:00
c04ada3573
cos: link with static libs
2023-08-10 15:28:22 +08:00
cd63e81450
cos: separate building phase for apr & apr-util
2023-08-10 14:18:12 +08:00
dd271bca6d
Merge pull request #22394 from taosdata/3.0
...
merge 3.0 to feat/TD-22970
2023-08-10 14:14:22 +08:00
a713b37f35
fix(stream): add more logs.
2023-08-10 14:07:29 +08:00
161fd6902a
fix(stream): fix the acquire task.
2023-08-10 12:45:20 +08:00
33967b243b
Merge branch '3.0' into fix/TD-25010-3
2023-08-10 12:14:01 +08:00
f633c7fe2b
other: merge 3.0.
2023-08-10 11:56:30 +08:00
b658608541
Merge pull request #22388 from taosdata/fix/3_liaohj
...
other: merge main.
2023-08-10 11:43:02 +08:00
ef247cdb1d
support reopen stream state
2023-08-10 01:49:26 +00:00
c10b323188
other: merge main.
2023-08-10 09:26:33 +08:00
4393375e47
fix(stream): set correct task id.
2023-08-10 02:16:04 +08:00
0757e88ced
fix(stream): set the correct hash keys.
2023-08-09 23:52:14 +08:00
7e3f1d92fc
Merge branch 'main' into fix/liaohj
2023-08-09 19:43:24 +08:00
1f5532fd67
fix:offset error in tmq & add test cases
2023-08-09 19:41:22 +08:00
a853d9d40c
mxml: use ~/local/include
2023-08-09 18:21:55 +08:00
1e8579e8c5
fix(stream): fix other cases.
2023-08-09 16:04:48 +08:00
4c92997328
fix(stream): use streamId&taskId to identify the stream task in the stream meta.
2023-08-09 15:52:23 +08:00
584427dd44
Merge pull request #22374 from taosdata/szhou/restore-minglei-main
...
fix: restore stt/block merge back
2023-08-09 14:40:03 +08:00
b08d5b4d42
mxml: add include dir to vnode
2023-08-09 14:02:10 +08:00
7e2859ed43
apr: use tarball to avoid ./buildconf
2023-08-09 13:03:37 +08:00
3cdb16352c
fix(stream): avoid launching check downstream when failed to add stream task into stream meta.
2023-08-09 12:03:14 +08:00
2e0519b960
apr: fix apr & apr-util project names
2023-08-09 11:01:42 +08:00
7114ad63e5
apr：makefile for apr & apr-util
2023-08-09 10:54:17 +08:00
4d1155a5cf
curl: makefile for curl
2023-08-09 10:43:27 +08:00
e9e06d1eae
fix: restore stt block/data block merge back
2023-08-09 10:36:54 +08:00
2b1478f46e
Revert "fix(tsdb/read2): reset stt reader when suspended"
...
This reverts commit 079d7ff69e
2023-08-09 10:36:26 +08:00
f3c5f20ee2
enh(stream): add timer to check the node changing.
2023-08-09 10:25:16 +08:00
16e015253b
s3/mxml: remove os external dependency
2023-08-09 10:10:25 +08:00
bb39d94f9c
Merge pull request #22357 from taosdata/fix/liaohj
...
other: merge fix from 3.0 to main.
2023-08-09 09:05:54 +08:00
d322cfce50
fix:add hashIteratorCancel for hash iterator
2023-08-08 16:28:51 +08:00
17c6143471
fix(stream): check more status when handling the state transfer.
2023-08-08 15:08:11 +08:00
c8f106106a
fix: update assert issue
2023-08-08 14:49:05 +08:00
70a598f072
Merge pull request #22355 from taosdata/3.0
...
merge 3.0 to TD-22970
2023-08-08 09:53:07 +08:00
05e356cd81
Merge pull request #22346 from taosdata/fix/TD-25612
...
fix: snapshot invalid read
2023-08-08 09:19:55 +08:00
458143c8b7
Merge pull request #22348 from taosdata/szhou/restore-tsdb-minglei
...
fix: restore stt block and data block merge back
2023-08-08 08:58:02 +08:00
f8ee055641
other: merge 3.0
2023-08-08 00:19:08 +08:00
ad3e231b2f
Merge pull request #22350 from taosdata/fix/3_liaohj
...
other: merge main and fix bugs in stop stream tasks.
2023-08-07 22:57:13 +08:00
aea1690cd1
fix(stream): fix the stream task after checking if it is in the timer activities.
2023-08-07 17:49:36 +08:00
ec1270f75c
fix: restore stt block/data block merge back
2023-08-07 17:17:12 +08:00
9e4da6c089
s3/config: parsing s3 configuration
2023-08-07 17:14:58 +08:00
9ddab11d98
Revert "fix(tsdb/read2): reset stt reader when suspended"
...
This reverts commit 079d7ff69e
2023-08-07 17:13:49 +08:00
b6c991f896
support reopen stream state
2023-08-07 08:59:04 +00:00
eeb97351e8
support reopen stream state
2023-08-07 08:51:01 +00:00
e6b80e6c52
Merge branch '3.0' into fix/3_liaohj
2023-08-07 16:26:31 +08:00
225c0e61dc
hen(stream): support the rollback and checkdown stream tasks.
2023-08-07 16:13:39 +08:00
a545d45b5e
fix: snapshot invalid read
2023-08-07 16:12:03 +08:00
fac7e521e9
s3/evict: fetch atime from stat file
2023-08-07 15:59:37 +08:00
661f2aca98
fix: memory leak
2023-08-07 14:13:44 +08:00
9ecabb30f5
fix:ref is not there
2023-08-07 10:27:44 +08:00
5f02e2ddfb
fix:ref is not there
2023-08-07 09:31:29 +08:00
8a11a0418f
other: merge 3.0
2023-08-07 09:19:26 +08:00
d9a1695257
fix:add log
2023-08-04 18:07:44 +08:00
65d8af19ed
s3: new api s3Size
2023-08-04 16:35:35 +08:00
87783a9650
s3query/get: pull object to local
2023-08-04 15:37:52 +08:00
ebd09ca532
tsdb/write: use keep1 as minKey instead of keep2
2023-08-04 13:44:17 +08:00
88d755be76
feat(tsdb/cos): s3 migration
2023-08-04 13:31:00 +08:00
abe15cc68e
Merge pull request #22315 from taosdata/szhou/fix-td25385-main
...
fix: keep stt iterator valid in the list
2023-08-04 08:02:16 +08:00
fef091b13d
fix: keep the stt iterator valid
2023-08-03 21:50:50 +08:00
b85c1ae8a1
fix: remove the core
2023-08-03 21:50:50 +08:00
5322e38dfe
fix: add init add check it
2023-08-03 21:50:50 +08:00
97b15ed718
fix: delete SLDataItem if stt level files num is smaller
2023-08-03 21:50:50 +08:00
1cb1451e41
fix: set nextIndex when get neighbouring index
2023-08-03 18:26:29 +08:00
5b03ab1705
Merge branch '3.0' into feat/TD-22970
2023-08-03 17:43:51 +08:00
f9d0874e45
support reopen stream state
2023-08-03 08:24:50 +00:00
68f2018246
Merge pull request #22289 from taosdata/szhou/fix-25385
...
fix: keep stt iterator valid
2023-08-02 20:22:54 +08:00
13c713d33b
Merge pull request #22290 from taosdata/3.0_main
...
merge 3.0 into branch main
2023-08-02 16:04:08 +08:00
f90f0b7047
disable infinite count loop
2023-08-02 15:51:51 +08:00
cff85550f9
Merge branch '3.0' into 3.0_main
2023-08-02 14:10:45 +08:00
c24b52ad82
Merge pull request #22277 from taosdata/fix/TD-25400
...
enh(tsdb/cache/read): lazy init table map hash and entries
2023-08-02 14:08:43 +08:00
0feffc687b
fix(tsdb): check uid in multiple stt statistics blocks.
2023-08-02 12:44:45 +08:00
0e51277521
cache/reader: cleanup contiue nex row
2023-08-02 12:43:57 +08:00
2c357f1958
fix(stream): enable filter table based on table statistics.
2023-08-02 11:18:35 +08:00
7fca057a81
cache/reader: move pLastCols into single block
2023-08-02 11:10:12 +08:00
dd8e893508
fix: keep the stt iterator valid
2023-08-02 11:02:27 +08:00
95cc540d9b
cache/reader: clean uid in all loop
2023-08-02 10:48:55 +08:00
38e797b4ff
fix: remove the core
2023-08-02 10:43:26 +08:00
d5ca51e94d
fix: add init add check it
2023-08-02 10:43:26 +08:00
6bf95c0c4d
fix: delete SLDataItem if stt level files num is smaller
2023-08-02 10:43:26 +08:00
13543f7daa
feature(stream): handle task update in tq module.
2023-08-02 10:33:41 +08:00
ed76525c4f
cache/reader: cleanup uid in signle loop
2023-08-02 10:28:13 +08:00
29b2f32821
cache reader: cleanup stt init
2023-08-02 09:49:41 +08:00
53aefa531f
Merge branch '3.0' into fix/3_liaohj
2023-08-02 09:45:21 +08:00
e1e5e9bb0f
enh(stream): check stream tasks dag.
2023-08-02 09:44:39 +08:00
4ba4e83b5b
fix: retention file corruption
2023-08-01 20:19:13 +08:00
7d294cac5f
tsdb/cache: load current fileset's brinblk once
2023-08-01 18:56:10 +08:00
a593e887fa
cache: remove nFileset from fs state
2023-08-01 18:37:23 +08:00
7ad628417a
fix mem issue: stack-use-after-scope
2023-08-01 17:57:38 +08:00
4716fc6400
cache/fs: remove fs state's tsdb handle
2023-08-01 17:49:05 +08:00
1d5532019f
tsdb/merge-tree: cleanup comment
2023-08-01 17:25:15 +08:00
f72f129d41
cache/skyline: cleanup del array
2023-08-01 17:23:53 +08:00
c997662ba0
tsdb/cache: build skyline only if there's del data
2023-08-01 16:50:00 +08:00
94b9599f95
fix null pointer dereference
2023-08-01 16:39:14 +08:00
637f09359a
other: merge main.
2023-08-01 16:15:34 +08:00
72ac5a4e3b
tsdb/cache: use read util's uid compare functor
2023-08-01 16:08:20 +08:00
c0a0e07597
cache/read: lazy init uidList when laoding from tsdb
2023-08-01 16:02:09 +08:00
b3fae65d90
enh(tsdb/cache/read): lazy init table map hash and entries
2023-08-01 15:53:42 +08:00
78c23f407e
fix compile issue
2023-08-01 15:04:14 +08:00
07c40943a4
fix: TD-25408
2023-08-01 15:01:06 +08:00
347e78ecb5
Merge pull request #22272 from taosdata/fix/TD-25466
...
Fix/td 25466
2023-08-01 14:22:24 +08:00
1b39147496
more refact
2023-08-01 11:36:37 +08:00
0e46041c1a
fix: tsdbRetention memory leak
2023-08-01 11:21:40 +08:00
ae9745ecf2
Merge pull request #22258 from taosdata/mark/tmq-3.0
...
fix:add committed & seek process logic
2023-08-01 09:52:09 +08:00
ea875c58f2
Merge pull request #22263 from taosdata/mark/tmq-main
...
fix:add committed & seek process logic
2023-08-01 09:43:23 +08:00
36ef9a537f
Merge pull request #22256 from taosdata/fix/TD-25457
...
check update data
2023-07-31 22:56:05 +08:00
2640e41705
Merge pull request #22261 from taosdata/fix/3_liaohj
...
fix(stream): set the correct end key of delete block.
2023-07-31 22:55:50 +08:00
68ae64cdb2
fix:add committed & seek process logic
2023-07-31 18:53:25 +08:00
cddf27e8b4
fix:add committed & seek process logic
2023-07-31 18:48:50 +08:00
d45596bb33
fix(stream): kill task when pause the stream execution.
2023-07-31 18:07:37 +08:00
6179618b17
fix:add committed & seek process logic
2023-07-31 17:56:04 +08:00
32b59af4b1
check update data
2023-07-31 17:32:24 +08:00
8093ef2dc8
Merge branch 'main' of https://github.com/taosdata/TDengine into mark/tmq
2023-07-31 16:14:25 +08:00
9981cecbed
refactor: do some internal refactor.
2023-07-31 15:24:35 +08:00
079d7ff69e
fix(tsdb/read2): reset stt reader when suspended
2023-07-31 15:21:47 +08:00
c7fa5ed6ef
Merge pull request #22247 from taosdata/fix/TD-25436
...
fix(tsdb/cache): check stt data with empty brin index
2023-07-31 11:24:37 +08:00
135beebc0a
fix(tsdb/cache): check stt data with empty brin index
2023-07-31 09:15:08 +08:00
bae028d65c
Merge pull request #22230 from taosdata/mark/tmq
...
fix:semaphore always wait in tmq commit logic
2023-07-31 09:10:13 +08:00
c26165975d
Merge pull request #22227 from taosdata/fix/TS-3728
...
fix:add macro ASSERT_NOT_CORE to control ASSERT not core in release version
2023-07-30 14:28:56 +08:00
8dfef8768a
other: merge 3.0
2023-07-29 22:54:16 +08:00
0bd2548937
fix(stream): initialize the filter window initial range.
2023-07-29 16:41:01 +08:00
f6e07d1fdb
other: merge 3.0
2023-07-29 01:32:02 +08:00
c19feb2fa1
Merge pull request #22236 from taosdata/fix/TD-25416
...
fix(tsdb/cache/del): use lru mutex to fix race with committing
2023-07-28 23:17:45 +08:00
936afeb5ac
refactor: do internal refactor to simple the pause/resume in case of fill history exists.
2023-07-28 19:13:03 +08:00
d5974a8f25
refactor(stream): refactor the pause/resume for fill history execution.
2023-07-28 18:05:32 +08:00
1fcbf3432c
tsdb/cache/del: remove duplicate lruMutex lock
2023-07-28 17:20:20 +08:00
d982a7cb80
fix:heap use after free for wal
2023-07-28 16:59:35 +08:00
b0f65dfa62
fix(tsdb/cache/del): use lru mutex to fix race with committing
2023-07-28 16:32:07 +08:00
6e673072cd
fix:conflicts
2023-07-28 14:57:13 +08:00
9f943213ed
enh(stream): update the hb info.
2023-07-28 14:23:53 +08:00
74834aea11
enh(stream): prepare hb to mnode from stream meta.
2023-07-28 13:07:16 +08:00
2a78cd2d23
Merge pull request #22215 from taosdata/fix/liaohj
...
other: merge main.
2023-07-28 13:06:17 +08:00
2f6c565392
fix:pHandle not load if taosd restart
2023-07-28 11:48:53 +08:00
b3e5b5bd24
Merge pull request #22217 from taosdata/fix/TD-25386
...
fix(tsdb/cache): move to stt next row if data file exausted
2023-07-28 08:56:29 +08:00
ccc0f13649
Merge pull request #22214 from taosdata/fix/3_liaohj
...
fix(stream): scan wal in step2
2023-07-28 00:42:15 +08:00
7f3d1dc464
fix(stream): fix memory leak.
2023-07-27 23:06:53 +08:00
77d43ef5fd
fix:tmq ci error
2023-07-27 20:28:45 +08:00
fbb33be85d
other: add some comments.
2023-07-27 18:59:38 +08:00
22a5a18fff
fix(stream): 1. set correct timewindow after step2. 2. handle the case when the task is failed to be added into the meta store.
2023-07-27 18:57:36 +08:00
cc9b9bd0b9
fix(tsdb/cache): move to stt next row if data file exausted
2023-07-27 17:19:42 +08:00
b145771a1b
other: merge 3.0
2023-07-27 16:38:57 +08:00
3d403dca5a
other: merge main.
2023-07-27 16:23:41 +08:00
6ff50d4eaf
fix(stream): update the step2 scan wal files.
2023-07-27 16:10:55 +08:00
75eacd56f1
fix:add log
2023-07-27 15:58:32 +08:00
a72c11c8de
Merge pull request #22205 from taosdata/fix/TD-25315
...
fix(tsdb/commit2): new maxDelKey for commit context
2023-07-27 15:48:46 +08:00
2d41a42976
Merge branch 'main' of https://github.com/taosdata/TDengine into fix/TS-3728
2023-07-27 15:31:16 +08:00
40fe3ef4f6
fix(stream): refactor the step2 wal scan.
2023-07-27 14:49:20 +08:00
fe495f7013
tsdb/commit2: fix commit minKey for del
2023-07-27 13:54:48 +08:00
e89f530db2
fix(stream): scan wal in step2
2023-07-27 10:55:59 +08:00
8a2764c698
tsdb/commit2: use max fileset's maxKey as initial maxDelKey
2023-07-27 10:51:17 +08:00
dd32f12f92
tsdb/commit2: reset nextKey to max to stop commit
2023-07-27 09:50:32 +08:00
992d623ae5
fix(tsdb/commit2): initialize ctx's maxDelKey with TSKEY_MIN
2023-07-27 09:34:47 +08:00
580b7124cf
fix(tsdb/commit2): new maxDelKey for commit context
2023-07-27 09:16:28 +08:00
087d54a807
Merge pull request #22198 from taosdata/fix/3_liaohj
...
fix(stream): do filter before the update check.
2023-07-26 18:57:48 +08:00
287088ae3f
fix stream state transfer
2023-07-26 10:16:06 +00:00
c57defa1c9
Merge pull request #22195 from taosdata/szhou/fix-td25369
...
fix: stt and data block merge
2023-07-26 17:11:18 +08:00
6a6830761d
fix(tsdb): check for null ptr of pScanInfo
2023-07-26 17:08:29 +08:00
3c387f6e91
fix(stream): fix syntax error.
2023-07-26 17:00:41 +08:00
432c943c25
fix(stream): do filter before the update check.
2023-07-26 16:34:39 +08:00
610f9d19c1
Merge pull request #22188 from taosdata/fix/3_liaohj
...
fix(stream): set the correct step2 scan time window range.
2023-07-26 16:34:10 +08:00
1357e623d0
fix: fix compilation error
2023-07-26 15:43:50 +08:00
79020ea4a4
fix: stt and data block merge
2023-07-26 15:01:20 +08:00
df57768a3e
Merge branch '3.0' into fix/3_liaohj
2023-07-26 14:45:11 +08:00
cdffabcdad
fix(stream): fix memory leak.
2023-07-26 14:37:04 +08:00
728112ed89
fix(stream): set correct upstream epinfo.
2023-07-26 10:26:59 +08:00
d8fd5b9394
Merge pull request #22190 from taosdata/fix/TD-25315
...
fix(tsdb/del): reset next key to del record's ekey
2023-07-26 10:23:01 +08:00
c61393a7a1
fix stream state transfer
2023-07-26 01:33:41 +00:00
b6eb739ae0
fix(tsdb): fix the
2023-07-26 09:14:19 +08:00
fb860726de
fix(tsdb/del): reset next key to del record's ekey
2023-07-26 08:40:44 +08:00
1c1bf63e1f
other: merge 3.0
2023-07-25 18:17:11 +08:00
02bc1b2a8f
Merge pull request #22186 from taosdata/fix/TD-25315
...
fix(tsdb/del): continue committing fileset if more del left
2023-07-25 17:41:30 +08:00
0bdccd2681
refactor: do some internal refactor.
2023-07-25 17:31:54 +08:00
7bfb4e0f88
fix(tsdb/del): continue committing fileset if more del left
2023-07-25 16:42:45 +08:00
be4e47e9a7
fix:add macro ASSERT_NOT_CORE to control ASSERT not core in release version
2023-07-25 16:15:33 +08:00
d29f835a63
fix(stream): set the correct step2 scan time window range.
2023-07-25 15:09:22 +08:00
c2588d71c3
Merge pull request #22173 from taosdata/fix/TS-3728
...
fix:avoid request offset type is 0
2023-07-25 14:59:30 +08:00
2bf84c2676
Merge pull request #22179 from taosdata/FIX/TS-3702-3.0
...
enh: compatibility between getFileNamePrefix and tsdbTFileName
2023-07-25 14:26:14 +08:00
01f45b2a99
enh: compatibility between getFileNamePrefix and tsdbTFileName
2023-07-25 11:35:35 +08:00
1bce96ea27
fix(tsdb/pageSize): use tsdbPageSize instead of szPage(tdb's)
2023-07-25 10:46:03 +08:00
7ea9cf1ddc
Merge pull request #22166 from taosdata/fix/TD-24422
...
fix(tsdb/cache): reuse data file reader
2023-07-25 10:28:59 +08:00
96722a07b1
Merge pull request #22174 from taosdata/fix/3_liaohj
...
fix(stream): fix the invalid check of step2 .
2023-07-25 00:30:06 +08:00
a2694b9ce9
fix(stream): fix the invalid check of step2 .
2023-07-24 19:44:28 +08:00
6a0e994169
fix:avoid request offset type is 0
2023-07-24 19:24:05 +08:00
d36903bf08
Merge pull request #22162 from taosdata/fix/3_liaohj
...
fix(stream): add some logs, and remove the invalid loop.
2023-07-24 16:29:51 +08:00
9628a9f74e
fix:open info log in tmq & ignore wal apply ver when read wal
2023-07-24 15:53:02 +08:00
01f11bf5a6
Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2
...
# Conflicts:
# source/common/src/tglobal.c
# source/libs/executor/src/timewindowoperator.c
2023-07-24 15:25:43 +08:00
1e34f84f78
other: merge 3.0
2023-07-24 15:23:03 +08:00
424dd40078
tsdb/cache: reuse pDataFileReader for same fileset
2023-07-24 14:45:35 +08:00
9bae91bcba
fix(stream): add some logs, and remove the invalid loop.
2023-07-24 13:37:44 +08:00
13bab114cb
Merge pull request #22155 from taosdata/fix/3_liaohj
...
fix(stream): refactor the halt status to check more status.
2023-07-24 11:04:08 +08:00
968cfd9e65
tsdb/cache: pLastIter null pointer check
2023-07-24 11:03:07 +08:00
5f25d70fc2
Merge pull request #22154 from taosdata/enh/tsdb_optimize
...
fix(tsdb/cache): new next stt row state for fs tranverse
2023-07-24 10:47:51 +08:00
1367552f38
fix(stream): refactor the halt status to check more status.
2023-07-24 10:04:15 +08:00
6a19ad3127
Merge pull request #22151 from taosdata/fix/3_liaohj
...
fix(stream): set the correct flag of pause/resume.
2023-07-24 09:07:49 +08:00
13491fab95
tsdb/cache: new next stt row state for fs tranverse
2023-07-24 08:51:20 +08:00
0b6e1a12bb
refactor: do some internal refactor.
2023-07-23 19:09:43 +08:00
e387b2f932
refactor: do some internal refactor.
2023-07-23 18:59:34 +08:00
4e0f7ffbf8
fix(stream): set the correct flag of pause/resume.
2023-07-23 18:49:56 +08:00
321be1f83f
Merge pull request #22135 from taosdata/fix/3_liaohj
...
refactor: do some internal refactor.
2023-07-22 15:06:28 +08:00
bfc4a07207
fix(stream): fix memory leak.
2023-07-22 00:20:02 +08:00
1b2636028a
fix(stream): fix memory leak.
2023-07-21 23:05:42 +08:00
16d7707b90
fix(stream): align the scan real time data for stream task.
2023-07-21 19:33:43 +08:00
7b1e809d98
Merge pull request #21794 from taosdata/enh/tsdb_optimize
...
for test purpose
2023-07-21 14:18:32 +08:00
bb86f5c580
fix:commit offset should not plus 1
2023-07-21 11:13:05 +08:00
10ebf1f438
fix:subscribeStb.py maybe failed
2023-07-21 11:07:34 +08:00
7d480cf3ac
compatible old sync config
2023-07-21 10:31:53 +08:00
39ca9b537f
fix(stream): fix syntax error
2023-07-21 09:43:08 +08:00
c9d75eab5a
refactor: do some internal refactor.
2023-07-21 09:16:13 +08:00
db46d31ca5
fix(stream): refactor the halt function.
2023-07-21 01:32:42 +08:00
519d3b74d1
fix stream state transfer
2023-07-20 09:51:18 +00:00
9353f7c8cf
refactor: do some internal refactor.
2023-07-20 16:35:02 +08:00
c9fa170e65
refactor: do some internal refactor.
2023-07-20 16:31:46 +08:00
45cb478b31
refactor: do some internal refactor.
2023-07-20 15:36:46 +08:00
87fa8f0c4c
Merge branch '3.0' into fix/3_liaohj
2023-07-20 12:15:23 +08:00
aed99da6c1
refactor: refactor the stream task starting order.
2023-07-20 12:14:53 +08:00
6e5be0d30e
fix stream state transfer
2023-07-20 03:49:32 +00:00
48222f5dc3
tsdb/cache: move data file reader for fs iter to cache reader
2023-07-20 09:11:26 +08:00
6dd4ec41ae
tsdb/cache cleanup: remove unused fs methods
2023-07-20 08:51:03 +08:00
7f0ea10573
Merge branch 'enh/tsdb_optimize' of https://github.com/taosdata/TDengine into enh/tsdb_optimize
2023-07-20 08:42:12 +08:00
46d6dcda3e
tsdb/cache: reset skyline when clearing fileset
2023-07-20 08:41:32 +08:00
bfcc538205
fix(tsdb):disable stt statistics.
2023-07-20 00:01:30 +08:00
733db123ad
refactor code
2023-07-19 13:24:59 +00:00
97c44e7c18
refactor: do some internal refactor.
2023-07-19 18:42:02 +08:00
d7d81d82a0
feat:add committed & position & commite_offset interface
2023-07-19 18:27:19 +08:00
91a15fd7bd
Merge branch '3.0' into enh/triggerCheckPoint2
2023-07-19 18:14:08 +08:00
ce71b8bbe7
Merge branch 'enh/tsdb_optimize' of https://github.com/taosdata/TDengine into enh/tsdb_optimize
2023-07-19 18:11:14 +08:00
4eaecd11de
tsdb/cache: merge fs & stt row
2023-07-19 18:10:36 +08:00
5cb35f2fa6
feat:add committed & position & commite_offset interface
2023-07-19 17:29:39 +08:00
37ae80d135
fix(tsdb): fix memory leak.
2023-07-19 16:42:51 +08:00
d82fb45a4f
Merge remote-tracking branch 'origin/enh/tsdb_optimize' into enh/tsdb_optimize
2023-07-19 15:01:37 +08:00
a84efab2c8
enh(tsdb): add table filter according to stt block statistics data.
2023-07-19 15:01:25 +08:00
913cfe43e8
tsdb/cache: remove input[3]
2023-07-19 12:20:54 +08:00
7a716d452e
tsdb/fs2: fix vnode get primary dir args
2023-07-19 11:36:26 +08:00
4b96bc7147
Merge branch '3.0' into enh/tsdb_optimize
2023-07-19 11:15:57 +08:00
1d88a6a7c6
enh: ttlMgrFlush adjust log level
2023-07-19 11:15:54 +08:00
185081a948
tsdb/fsreader: clear last fileset's resources
2023-07-19 11:04:28 +08:00
141004bf77
Merge branch '3.0' into feat/TD-22970
2023-07-19 10:57:40 +08:00
b1f3dfe88f
Merge branch 'enh/triggerChpt' into enh/triggerCheckPoint2
2023-07-19 02:17:42 +00:00
34c2e6a180
forbidden streamsnapshot reader
2023-07-19 02:15:12 +00:00
a32c650248
Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2
2023-07-19 10:05:48 +08:00
2ae95217bd
fix(stream): open inputQ by default for task deployed on snode.
2023-07-19 10:05:35 +08:00
fd02b9a71e
Merge branch '3.0' into enh/triggerCheckPoint2
2023-07-19 10:02:06 +08:00
c3e5375f15
Merge pull request #22085 from taosdata/FEAT/TS-2699-3.0
...
feat: distribute vnode primary dirs among disks of level 0
2023-07-19 09:44:43 +08:00
5c344b0159
fix:conflicts from main
2023-07-19 09:05:05 +08:00
9513f76172
fix(stream): set downstream task ready state.
2023-07-18 19:02:24 +08:00
a127e91534
tsdb/cache skyline: first round implementation of cache skyline
2023-07-18 17:17:06 +08:00
3711fdd865
feat/TD-22970
2023-07-18 16:09:38 +08:00
2faa3d2e7b
enh: check validity of diskPrimary during vnodeOpen
2023-07-18 15:39:29 +08:00
9f9efe9a5e
tsdb/cache reader: remove dataf & dataf last readers
2023-07-18 15:30:31 +08:00
901b7d8ecc
fix(stream): if a source task is set to be non-normal, no data should be put into inputQ anymore.
2023-07-18 15:18:57 +08:00
24fed51137
enh: tfsRename dir on primary disk at last
2023-07-18 13:58:43 +08:00
5624ecc8df
fix: prepare vnode dir recursively in vnodeCreate
2023-07-18 11:32:23 +08:00
6b6b7d8d8f
enh: alloc disk of vnode primary dir in vmAllocPrimaryDisk
2023-07-18 11:32:23 +08:00
92106312d2
fix(stream): not dispatch checkpoint block result to downstream.
2023-07-18 09:43:38 +08:00
998fbe574d
tsdb/cache reader: move suid into reader's info field
2023-07-17 19:10:33 +08:00
40eb50676d
add checkpoint
2023-07-17 11:04:19 +00:00
463b5b608b
tsdb/read2: fix null pointer runtime error
2023-07-17 18:35:56 +08:00
62cfda1a88
tsdb/read2: fix UAF
2023-07-17 17:35:08 +08:00
832b68e17d
tsdb/cache: load mem del data
2023-07-17 15:48:08 +08:00
a05383e29e
tsdb/cache: new load tomb callback from tsdb mergetree
2023-07-17 15:07:10 +08:00
27b8671f97
tsdb/cache: new cacheReader field for tsdb & cache reader
2023-07-17 14:27:27 +08:00
9b0b4061e0
tsdb/cache: relayout cache row reader
2023-07-17 14:16:54 +08:00
eaaf306c81
fix(stream): fix syntax error
2023-07-17 12:54:05 +08:00
d7f7a7d6cf
fix(stream): fix syntax error
2023-07-17 12:53:36 +08:00
b2a905bd91
Merge branch '3.0' into enh/triggerCheckPoint2
2023-07-17 11:50:12 +08:00
b21e603481
enh: add the field diskPrimary to vnodeGetPrimaryDir, and entries of vnodes.json
2023-07-17 11:48:48 +08:00
8263c49c17
tsdb/cache: fix compilation
2023-07-17 09:00:17 +08:00
2b21c5e0f6
tsdb2: adapt cache with tsdb2 API
2023-07-17 08:50:54 +08:00
a9757637d9
Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2
2023-07-16 12:47:24 +08:00
c6a322e0ef
refactor(stream): back pressure is active, which is trigger by dispatch rsp.
2023-07-16 12:47:08 +08:00
e18c9ea672
add checkpoint
2023-07-15 04:26:34 +00:00
3c4631ef1f
add checkpoint
2023-07-14 10:06:24 +00:00
c2b3c2db52
Merge pull request #22066 from taosdata/fix/TD-25215-main
...
fix/TD-25215: ttlMgrDeleteTtl should ignore ttl 0 tables for main
2023-07-14 17:53:25 +08:00
021fcf2a59
Merge pull request #22059 from taosdata/fix/TD-25215
...
fix/TD-25215: ttlMgrDeleteTtl should ignore ttl 0 tables
2023-07-14 17:53:06 +08:00
b16432280e
Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2
2023-07-14 17:21:37 +08:00
eb7e6152ae
refactor(stream): do some internal refactor.
2023-07-14 17:21:20 +08:00
6762a01d88
Merge branch 'main' of https://github.com/taosdata/TDengine into mark/tmq
2023-07-14 16:44:00 +08:00
bbdcbcb75b
fix:modify commit version to next validate version
2023-07-14 16:43:28 +08:00
145c43e346
little fix
2023-07-14 16:38:35 +08:00
15f5fd19eb
fix recover error
2023-07-14 14:47:06 +08:00
e16a3935a5
fix coverity scan problem
2023-07-14 14:40:32 +08:00
a48d359f8b
fix: ttlMgrDeleteTtl should ignore ttl 0 tables
2023-07-14 14:37:17 +08:00
25120cede4
fix sma merge error
2023-07-14 13:46:01 +08:00
5a89b96e91
make compile
2023-07-14 10:21:06 +08:00
1fad69df3b
Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize
2023-07-14 10:13:15 +08:00
9bf7180074
Merge pull request #21969 from taosdata/enh/TD-23769-3.0
...
enh: rsma stream state adaption
2023-07-13 19:19:37 +08:00
e0ea0f2df4
Merge pull request #22020 from taosdata/fix/liaohj
...
other: merge main
2023-07-13 17:55:28 +08:00
a39a9428af
fix: ttlMgrDeleteTtl should ignore ttl 0 tables
2023-07-13 17:43:32 +08:00
81a2cd16e7
enh: unify handling of vnode primary dir in current_fname
2023-07-13 17:37:53 +08:00
6ee135cb52
chore: more code
2023-07-13 17:37:31 +08:00
67461d92a7
chore: merge 3.0 and solve conflict
2023-07-13 17:35:55 +08:00
d81d2790ea
Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize
2023-07-13 17:20:45 +08:00
e2ae868377
Merge pull request #22032 from taosdata/mark/tmq
...
fix:set firset version to reqOffset of response
2023-07-13 16:35:21 +08:00
813f4cb363
refactor: do some internal refactor.
2023-07-13 16:32:25 +08:00
ec86a68b6f
Merge pull request #22045 from taosdata/FEAT/TS-2699-3.0
...
enh: unify handling of vnode primary dir for vnd, tsdb and sma
2023-07-13 13:55:46 +08:00
dc75f7ce21
enh: use VNODE_RSMA_DIR in tdRSmaGetCurrentFName
2023-07-13 11:27:31 +08:00
f41bcd73b0
other: merge main.
2023-07-13 11:02:09 +08:00
e209b487c6
enh: rename func name vnodeGetPrimaryDir
2023-07-13 10:38:05 +08:00
2f90a53548
fix(stream): set checkpoint id when expanding task.
2023-07-13 10:16:57 +08:00
08a4fb06ae
fix(stream): dispatch checkpoint msg to downstream by puting message into input queue.
2023-07-13 09:17:20 +08:00
466f1037b4
Merge branch '3.0' into enh/TD-23769-3.0
2023-07-12 18:50:16 +08:00
c388802bda
Merge pull request #22024 from taosdata/fix/3_liaohj
...
fix(stream): fix concurrent bug in save task meta.
2023-07-12 18:17:27 +08:00
8f58f9aa5b
fix: skip primary key for block sma
2023-07-12 18:07:01 +08:00
05e8af4837
enh: unify handling of vnode primary dir for vnd and tsdb
2023-07-12 17:58:18 +08:00
4c3bf41178
enh: unify handling of vnode primary dir for sma
2023-07-12 17:56:21 +08:00
bbf58d2d9d
enh: unify handling of vnode primary dir in vnodeCreate and metaOpen
2023-07-12 17:56:21 +08:00
cf64d4c9c5
fix:set get_assignment offset to first version of response block
2023-07-12 17:22:23 +08:00
3fc282f035
Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize
2023-07-12 11:57:19 +08:00
3ce54423a5
Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2
2023-07-12 11:38:27 +08:00
d392bb60ba
refactor(stream): set the initial version from the checkpoint.
2023-07-12 11:38:13 +08:00
8cb6356b99
chore: more code
2023-07-12 10:47:02 +08:00
9484f3da94
Merge branch '3.0' into enh/triggerCheckPoint2
2023-07-12 10:20:18 +08:00
f282acbc4c
chore: rsma refactor
2023-07-12 10:13:50 +08:00
8c8bcabdd4
Merge branch '3.0' into enh/TD-23769-3.0
2023-07-12 09:11:34 +08:00
2cfdd234b3
Merge pull request #22034 from taosdata/feat/TS-3239
...
feat/TS-3239/TS-3596: port 'keepTimeOffset' from 2.6 to 3.0
2023-07-12 08:18:38 +08:00
fed3803739
fix(stream): fix memory leak.
2023-07-11 19:29:52 +08:00
ba0bce8092
chore: code revert
2023-07-11 18:52:51 +08:00
30f8c9c79e
chore: more check
2023-07-11 18:08:48 +08:00
4886cb4674
feat: port 'keepTimeOffset' from 2.6 to 3.0
2023-07-11 17:40:35 +08:00
7c85f7701d
chore: more check
2023-07-11 16:32:29 +08:00
8dd7f36993
fix:set firset version to reqOffset of response
2023-07-11 16:19:38 +08:00
7bc19df0ef
fix:set firset version to reqOffset of response
2023-07-11 15:48:19 +08:00
2e386a6fdf
fix(stream): check if stream task is in normal state.
2023-07-11 15:23:49 +08:00
cb62d4cb97
fix:set firset version to reqOffset of response
2023-07-11 14:49:53 +08:00
6d78816d22
fix(stream): fix syntax error.
2023-07-11 14:06:25 +08:00
314123ef34
chore: add check
2023-07-11 14:05:09 +08:00
09b764494d
fix(stream): set correct checkpoint version when starting stream tasks.
2023-07-11 14:03:43 +08:00
d5435926c2
chore: more code
2023-07-11 12:37:01 +08:00
3ffdbe923d
other: merge 3.0
2023-07-11 09:12:57 +08:00
04f5bcd23a
fix(stream): remove invalid set of task status .
2023-07-11 08:51:13 +08:00
14b438ec64
chore: bug fix
2023-07-11 07:02:36 +08:00
f391462e34
chore: more code
2023-07-10 20:01:50 +08:00
57ceaed535
chore: code revert
2023-07-10 19:55:01 +08:00
f16fa6d000
enh: exclude tk log from time series check
2023-07-10 19:48:50 +08:00
87bedef2cd
fix(stream): fix error in checkpointing.
2023-07-10 19:20:05 +08:00
385a5c9651
fix(stream): fix error in generating checkpoint.
2023-07-10 18:20:50 +08:00
7014f790a0
optmize table statistic info
2023-07-10 17:35:26 +08:00
84f0dfd6d4
stream operator checkpoint
2023-07-10 11:07:08 +08:00
802112c00a
chore: more code
2023-07-09 21:49:37 +08:00
98349a4265
refactor(tsdb): do some internal refactor.
2023-07-09 18:05:24 +08:00
a7253fc390
Merge branch '3.0' into enh/TD-25083-3.0
2023-07-09 16:04:38 +08:00
35ba132a29
fix:conflicts from main
2023-07-09 12:52:18 +08:00
a5363e6e03
fix:test case in tmq
2023-07-09 12:49:50 +08:00
ba4d726af6
fix(tsdb): fix error in tsdbread.
2023-07-09 01:31:02 +08:00
b39198a53a
refactor: do some internal refactor.
2023-07-08 21:44:58 +08:00
1470e51dc1
Merge remote-tracking branch 'origin/enh/tsdb_optimize' into enh/tsdb_optimize
2023-07-08 21:25:24 +08:00
14844c7b4b
refactor(tsdb): opt tsdb read perf
2023-07-08 21:25:11 +08:00
f9f656b21a
fix:return offset stored if get assignment in init mode
2023-07-08 13:25:39 +08:00
4f534ce6e9
fix(stream): fix error in generating checkpoint.
2023-07-08 10:29:09 +08:00
a5c19427e7
fix(stream): send correct rsp to mnode.
2023-07-08 09:39:44 +08:00
9c30abf95b
fix(stream): fix error in generating checkpoint.
2023-07-07 21:38:53 +08:00
4436eb7e0f
fix:set commitOffset is send msg success & optimize log & add test cases for TD-25129
2023-07-07 19:12:18 +08:00
a746d288a1
chore: add debug info
2023-07-07 18:53:01 +08:00
128f67784a
fix(stream): fix error in parsing checkpoint msg.
2023-07-07 18:17:50 +08:00
8298f30e56
fix(stream): fix bug in checkpoint.
2023-07-07 17:16:08 +08:00
106e273157
fix:bugs in get_assignment
2023-07-07 16:12:15 +08:00
47877898d0
enh(stream): generate the checkpoint framework.
2023-07-07 16:07:52 +08:00
0865b1a828
Merge pull request #21973 from luckeverda/fix/TD-25074-main
...
fix/TD-25074 for main
2023-07-07 11:24:33 +08:00
090ca39132
Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize
2023-07-07 10:38:04 +08:00
cb8b10f6a2
Merge branch '3.0' into enh/TD-23769-3.0
2023-07-07 10:19:43 +08:00
64ef48e0dd
Merge branch '3.0' into enh/TD-23769-3.0
2023-07-07 10:17:25 +08:00
06c52af2c2
enh: exclude tk_log from timeseries check
2023-07-07 10:14:37 +08:00
47a7a45d1d
Merge pull request #21978 from taosdata/fix/TD-24962
...
fix(coverity): fix coverity scan issues
2023-07-07 08:20:07 +08:00
0928bd5510
fix:send rsp offset to client if unregister push mgr
2023-07-06 19:35:48 +08:00
b2d41ce907
Merge branch 'main' of https://github.com/taosdata/TDengine into fix/TD-25071
2023-07-06 19:34:22 +08:00
aad906f2b0
fix(stream): fix syntax error.
2023-07-06 18:26:44 +08:00
d7101f7109
enh(stream): support dispatch checkpoint msg.
2023-07-06 18:26:22 +08:00
09222801c4
fix(coverity): fix coverity scan issues
2023-07-06 17:52:48 +08:00
f1ce91f600
fix:race condition for pTq->pStore->pHash
2023-07-06 16:49:59 +08:00
9e6e59adc2
fix:race condition for pTq->pStore->pHash
2023-07-06 16:47:48 +08:00
a31e054146
fix: ttlmgr convert in metaUpgrade
2023-07-06 15:47:32 +08:00
a1a2b8331f
fix: ttl fill cache only in initialization
2023-07-06 15:47:32 +08:00
84740e96ee
Merge pull request #21939 from luckeverda/fix/TD-25074
...
fix/TD-25074
2023-07-06 15:44:22 +08:00
a94ace4cc8
refactor:do some internal refactor.
2023-07-06 15:10:45 +08:00
47ae92af93
fix:conflicts from main
2023-07-06 13:40:04 +08:00
11e6856d3e
fix:init char array
2023-07-06 13:37:58 +08:00
c1393fb2e2
chore: invoke streamStateCommit for rsma
2023-07-06 13:26:25 +08:00
5a9461a69a
other: merge 3.0
2023-07-06 11:52:21 +08:00
e8cdf132fb
chore: rsma code refactor
2023-07-06 11:32:20 +08:00
f4a3567935
other: merge 3.0
2023-07-06 11:24:30 +08:00
61380b7822
chore: test case adaption
2023-07-06 11:09:44 +08:00
851f6df094
enh(tsdb): opt perf.
2023-07-06 09:58:15 +08:00
34a62c3f38
fix:vginfo assigment not in same time,we should get vginfo by vg,not all vg
2023-07-05 22:55:41 +08:00
3f6768d8cf
chore: rsma rocksdb adaption
2023-07-05 19:43:29 +08:00
aeb9473382
enh(tsdb): add some logs.
2023-07-05 19:41:34 +08:00
a0a116b674
fix(tsdb): fix error in sma extracting and do NOT clear fileDelData when extracting data from stt files.
2023-07-05 19:11:14 +08:00
df7866e9f6
chore: refactor
2023-07-05 19:08:43 +08:00
59e83fca5d
chore: build fix
2023-07-05 18:33:09 +08:00
9b477eed81
enh: terminate on failure to recover WAL from writing errors, or to commit vnode
2023-07-05 17:54:56 +08:00
74f5b3f80e
Merge pull request #21959 from taosdata/refact/fillhistory
...
refactor: do some internal refactor.
2023-07-05 17:47:00 +08:00
e6e52c3641
fix: ttlmgr convert in metaUpgrade
2023-07-05 17:44:17 +08:00
8f8dfc593b
Merge remote-tracking branch 'origin/enh/tsdb_optimize' into enh/tsdb_optimize
2023-07-05 17:43:56 +08:00
a738b6eba6
fix(tsdb): add empty del skyline check.
2023-07-05 17:43:41 +08:00
21d972938f
more fix
2023-07-05 17:43:15 +08:00
f35db3ba6c
fix(tsdb): add none check.
2023-07-05 17:36:55 +08:00
f0cec22d4f
fix(tsdb): fix some error.
2023-07-05 17:20:17 +08:00
d093b0e20f
chore: merge 3.0
2023-07-05 16:45:12 +08:00
8c8aa5cd57
fix(tsdb): fix error in extract brinblock.
2023-07-05 16:39:04 +08:00
bdfeb32923
fix:bugs in tmq_get_topic_assignment
2023-07-05 16:04:34 +08:00
03dbcbf055
refactor: do some internal refactor.
2023-07-05 15:55:55 +08:00
7d7e12a5e7
fix(tsdb): fix syntax error.
2023-07-05 11:22:58 +08:00
1304c08cdd
Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize
2023-07-05 10:57:55 +08:00
9b3e34d589
Merge pull request #21735 from taosdata/refact/fillhistory
...
refactor: refactor the fill history operation
2023-07-05 10:48:51 +08:00
6e15478c43
fix(tsdb): do some internal refactor.
2023-07-05 10:31:38 +08:00
6fb1e716c0
Merge remote-tracking branch 'origin/enh/tsdb_optimize' into enh/tsdb_optimize
2023-07-05 10:31:09 +08:00
8ab10a8da1
fix(tsdb): fix error in check tomb record. #TD-25117
2023-07-05 10:30:55 +08:00
23a743fd66
fix snapshot coredump
2023-07-05 10:01:00 +08:00
37ff3a419a
fix(tsdb): fix error in load tomb from stt files.
2023-07-04 23:35:52 +08:00
bc8efd7014
Merge pull request #21949 from taosdata/FIX/TD-25103-3.0
...
enh: tfsRename in the reverse order of levels with tiered storages
2023-07-04 17:34:49 +08:00
1ca4256927
enh: use var prefixLen instead in vnodeRenameVgroupId
2023-07-04 15:36:42 +08:00
ff2bf35603
fix(stream): fix error in set the version range for secondary scan.
2023-07-04 15:08:39 +08:00
35a35ad4f9
Merge pull request #21930 from taosdata/fix/TD-24966
...
fix: coverity scan
2023-07-04 14:55:54 +08:00
acde8586e0
ignore file check
2023-07-04 14:16:09 +08:00
2e88ad2c14
fix: upgrade bug
2023-07-04 14:00:44 +08:00
82342ebdc7
Merge pull request #21934 from taosdata/feature/TD-20678
...
feat:subscribe only meta info
2023-07-04 11:28:27 +08:00
dbf47f5fc1
fix: ttl fill cache only in initialization
2023-07-03 21:30:53 -04:00
dbcd33a402
fix:memory leak
2023-07-03 18:43:12 +08:00
ddaba463c0
enh: check failure of tfsMkdirRecurAt
2023-07-03 16:16:27 +08:00
200575647c
Merge branch '3.0' into refact/fillhistory
2023-07-03 15:16:18 +08:00
20d099dfa6
Merge pull request #21901 from taosdata/fix/liaohj
...
fix: fix coverity issue.
2023-07-03 15:15:21 +08:00
8384b6ce29
fix CI case
2023-07-03 15:01:05 +08:00
5390732f42
fix: coverity scan
2023-07-03 14:13:01 +08:00
214c92264c
Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize
2023-07-03 11:27:26 +08:00
136bc379d1
feat:ignore delete info
2023-07-03 11:02:08 +08:00
9e98c64b1e
fix(tsdb): set correct stt load info. update the test case.
2023-06-30 22:57:49 +08:00
450a9f3ca1
Merge remote-tracking branch 'origin/enh/tsdb_optimize' into enh/tsdb_optimize
2023-06-30 18:22:35 +08:00
c2a7c37b00
fix(tsdb): opt perf for reading data from stt files.
2023-06-30 18:22:20 +08:00
84c20463f3
Merge pull request #21907 from luckeverda/fix/ttlpresubmit
...
fix: ttl compatibility for main
2023-06-30 16:47:25 +08:00
617115ba85
Merge pull request #21906 from luckeverda/fix/ttlpresubmit
...
fix: ttl compatibility for 3.0
2023-06-30 16:45:58 +08:00
9fd453d78a
more code
2023-06-30 16:13:48 +08:00
93391f73e5
vnode snapshot read
2023-06-30 07:46:56 +00:00
2f57c8439b
more fix
2023-06-30 15:04:18 +08:00
e79fe91ba0
more code
2023-06-30 14:57:57 +08:00
8f164a7922
fix: ttl compatibility
2023-06-30 14:57:34 +08:00
c714138e9e
fix snapshot problem
2023-06-30 14:37:26 +08:00
55840709ed
skip dropped table tomb data commit
2023-06-30 13:54:49 +08:00
58c7011e0e
feat:support only meta in tmq subscriptions
2023-06-30 11:42:40 +08:00
e25df41536
vnode snapshot read
2023-06-30 03:11:55 +00:00
ee5e3b7cc0
fix(tsdb): fix error in tsdb2
2023-06-30 00:38:53 +08:00
9740d1353c
fix(tsdb): opt perf for read data in stt files.
2023-06-29 23:16:07 +08:00
15487c9c8f
fix(tsdb): fix memory leak.
2023-06-29 22:52:07 +08:00
60a0b1e1bd
vnode snapshot read
2023-06-29 11:52:34 +00:00
17c6b9f81b
fix(tsdb): fix error in set file reader.
2023-06-29 18:40:14 +08:00
eee8007736
fix bug
2023-06-29 17:48:36 +08:00
9eb6d8cf1e
vnode snapshot read
2023-06-29 09:35:09 +00:00
622e1cb608
fix: fix coverity issue.
2023-06-29 15:54:09 +08:00
63834713b2
Merge remote-tracking branch 'origin/enh/tsdb_optimize' into enh/tsdb_optimize
2023-06-29 15:09:14 +08:00
81eb8523f1
fix(tsdb): fix invalid ptr.
2023-06-29 15:09:01 +08:00
1e5fef9dbe
fix retention CI cases
2023-06-29 15:01:54 +08:00
5cebd36c1c
add checkpoint
2023-06-29 06:56:14 +00:00
c8435de64a
Merge branch '3.0' into fix/m23.0
2023-06-29 14:03:56 +08:00
1556dedb85
fix file remove by edit
2023-06-29 14:03:01 +08:00
ba38a625cf
fix(stream): remove the shared ptr between reader ptr.
2023-06-29 13:42:23 +08:00
3519e9170e
Merge remote-tracking branch 'origin/main' into 3.0
2023-06-29 11:13:45 +08:00
c4a6b85bdf
fix(tsdb): support stt and file block overlap.
2023-06-28 22:38:51 +08:00
3d532a54a8
add checkpoint
2023-06-28 12:22:27 +00:00
6b6e237079
add checkpoint
2023-06-28 09:57:08 +00:00
2fc5eeb810
session win range
2023-06-28 17:20:08 +08:00
9be13427f6
fix tomb record loss bug
2023-06-28 17:01:08 +08:00
871f66565d
add checkpoint
2023-06-28 07:02:20 +00:00
8867a57262
fix(stream): fix syntax error.
2023-06-28 14:48:59 +08:00
57fcd553f8
refactor: do some internal refactor.
2023-06-28 13:13:13 +08:00
1fc664693e
fix:continue consume if wal is dropped
2023-06-28 11:54:48 +08:00
f6d5d0c8ca
add checkpoint
2023-06-28 02:39:01 +00:00
3710ea4aca
refactor: do some internal refactor.
2023-06-28 09:41:08 +08:00
shenglian-zhou
yihaoDeng
Haojun Liao
Hongze Cheng
Shungang Li
wade zhang
Minglei Jin
Benguang Zhao
dm chen
Haojun Liao
liuyao
dapan1121
dapan1121
wangjiaming0909
yihaoDeng
wangmm0220
kailixu
Minglei Jin
Hui Li
liuyao