Commit Graph

11715 Commits

Author SHA1 Message Date
Hongze Cheng c8f106106a fix: update assert issue 2023-08-08 14:49:05 +08:00
Hui Li 4f03ae2c65
Merge pull request #22335 from taosdata/temp/open_case
open split vgroup case
2023-08-08 11:49:28 +08:00
Haojun Liao a0dcec5890 enh(stream): add function handler for hb message. 2023-08-08 11:23:19 +08:00
dm chen 70a598f072
Merge pull request #22355 from taosdata/3.0
merge 3.0 to TD-22970
2023-08-08 09:53:07 +08:00
dapan1121 44717ddbea
Merge pull request #22288 from taosdata/fix/3.0/TD-25499
fix: memory leak when drop db which acquired by user with grant/revoke
2023-08-08 09:29:55 +08:00
Hui Li 05e356cd81
Merge pull request #22346 from taosdata/fix/TD-25612
fix: snapshot invalid read
2023-08-08 09:19:55 +08:00
Haojun Liao af3a87560a refactor: do some refactor. 2023-08-08 09:11:41 +08:00
Haojun Liao 458143c8b7
Merge pull request #22348 from taosdata/szhou/restore-tsdb-minglei
fix: restore stt block and data block merge back
2023-08-08 08:58:02 +08:00
Haojun Liao f8ee055641 other: merge 3.0 2023-08-08 00:19:08 +08:00
Haojun Liao ad3e231b2f
Merge pull request #22350 from taosdata/fix/3_liaohj
other: merge main and fix bugs in stop stream tasks.
2023-08-07 22:57:13 +08:00
wangmm0220 864d07e1bc feat:[TD-24559]support geomety type in schemaless 2023-08-07 19:39:06 +08:00
dapan1121 11f6f203ed
Merge pull request #22331 from taosdata/fix/TD-25515
fix: ins_indexes vgroup_id using null value instead of -1 for invalid
2023-08-07 19:03:01 +08:00
Haojun Liao aea1690cd1 fix(stream): fix the stream task after checking if it is in the timer activities. 2023-08-07 17:49:36 +08:00
shenglian zhou ec1270f75c fix: restore stt block/data block merge back 2023-08-07 17:17:12 +08:00
Minglei Jin 9e4da6c089 s3/config: parsing s3 configuration 2023-08-07 17:14:58 +08:00
shenglian zhou 9ddab11d98 Revert "fix(tsdb/read2): reset stt reader when suspended"
This reverts commit 079d7ff69e.
2023-08-07 17:13:49 +08:00
yihaoDeng b6c991f896 support reopen stream state 2023-08-07 08:59:04 +00:00
yihaoDeng eeb97351e8 support reopen stream state 2023-08-07 08:51:01 +00:00
Haojun Liao e6b80e6c52 Merge branch '3.0' into fix/3_liaohj 2023-08-07 16:26:31 +08:00
Haojun Liao 225c0e61dc hen(stream): support the rollback and checkdown stream tasks. 2023-08-07 16:13:39 +08:00
Hongze Cheng a545d45b5e fix: snapshot invalid read 2023-08-07 16:12:03 +08:00
Minglei Jin fac7e521e9 s3/evict: fetch atime from stat file 2023-08-07 15:59:37 +08:00
Hongze Cheng 661f2aca98 fix: memory leak 2023-08-07 14:13:44 +08:00
wangmm0220 5daf38c0d5 fix:ref is not there 2023-08-07 11:29:54 +08:00
Benguang Zhao 0e4f1942f1 fix: resolve Vgroup refcount leak in drop topic 2023-08-07 11:13:52 +08:00
Haojun Liao 76288f311f
Merge pull request #22311 from taosdata/fix/TD-25543
delete atomic_exchange_64
2023-08-07 10:34:50 +08:00
wangmm0220 9ecabb30f5 fix:ref is not there 2023-08-07 10:27:44 +08:00
wangmm0220 5f02e2ddfb fix:ref is not there 2023-08-07 09:31:29 +08:00
Haojun Liao 8a11a0418f other: merge 3.0 2023-08-07 09:19:26 +08:00
wangmm0220 d9a1695257 fix:add log 2023-08-04 18:07:44 +08:00
Hui Li f19826fa9d
Merge pull request #22313 from taosdata/fix/addStreamVer
add stream verion
2023-08-04 17:36:21 +08:00
Shungang Li 5154d0e1a3 fix: alter ttlChangeOnWrite note info 2023-08-04 17:24:35 +08:00
liuyao 944c1f68d2 delete atomic_exchange_64 2023-08-04 16:49:02 +08:00
Minglei Jin 65d8af19ed s3: new api s3Size 2023-08-04 16:35:35 +08:00
Minglei Jin 87783a9650 s3query/get: pull object to local 2023-08-04 15:37:52 +08:00
Ganlin Zhao f7a2e0cdab fix: ins_indexes vgroup_id using null value instead of -1 for invalid
value
2023-08-04 15:21:23 +08:00
yihaoDeng 56ed422f88 add stream ver 2023-08-04 14:09:00 +08:00
yihaoDeng 6dc93a8dec add stream ver 2023-08-04 13:52:20 +08:00
Minglei Jin ebd09ca532 tsdb/write: use keep1 as minKey instead of keep2 2023-08-04 13:44:17 +08:00
Minglei Jin 88d755be76 feat(tsdb/cos): s3 migration 2023-08-04 13:31:00 +08:00
wade zhang abe15cc68e
Merge pull request #22315 from taosdata/szhou/fix-td25385-main
fix: keep stt iterator valid in the list
2023-08-04 08:02:16 +08:00
slzhou fef091b13d fix: keep the stt iterator valid 2023-08-03 21:50:50 +08:00
shenglian zhou b85c1ae8a1 fix: remove the core 2023-08-03 21:50:50 +08:00
shenglian zhou 5322e38dfe fix: add init add check it 2023-08-03 21:50:50 +08:00
shenglian zhou 97b15ed718 fix: delete SLDataItem if stt level files num is smaller 2023-08-03 21:50:50 +08:00
yihaoDeng f7dc9497ef add stream verion 2023-08-03 20:28:34 +08:00
slzhou 1cb1451e41 fix: set nextIndex when get neighbouring index 2023-08-03 18:26:29 +08:00
dm chen 5b03ab1705
Merge branch '3.0' into feat/TD-22970 2023-08-03 17:43:51 +08:00
yihaoDeng f9d0874e45 support reopen stream state 2023-08-03 08:24:50 +00:00
wade zhang 68f2018246
Merge pull request #22289 from taosdata/szhou/fix-25385
fix: keep stt iterator valid
2023-08-02 20:22:54 +08:00
wade zhang 13c713d33b
Merge pull request #22290 from taosdata/3.0_main
merge 3.0 into branch main
2023-08-02 16:04:08 +08:00
Hongze Cheng f90f0b7047 disable infinite count loop 2023-08-02 15:51:51 +08:00
Minglei Jin cff85550f9 Merge branch '3.0' into 3.0_main 2023-08-02 14:10:45 +08:00
wade zhang c24b52ad82
Merge pull request #22277 from taosdata/fix/TD-25400
enh(tsdb/cache/read): lazy init table map hash and entries
2023-08-02 14:08:43 +08:00
Haojun Liao 0feffc687b fix(tsdb): check uid in multiple stt statistics blocks. 2023-08-02 12:44:45 +08:00
Minglei Jin 0e51277521 cache/reader: cleanup contiue nex row 2023-08-02 12:43:57 +08:00
Haojun Liao 2c357f1958 fix(stream): enable filter table based on table statistics. 2023-08-02 11:18:35 +08:00
yihaoDeng 4aef18733f fix state mem leak 2023-08-02 03:16:24 +00:00
Minglei Jin 7fca057a81 cache/reader: move pLastCols into single block 2023-08-02 11:10:12 +08:00
slzhou dd8e893508 fix: keep the stt iterator valid 2023-08-02 11:02:27 +08:00
Minglei Jin 95cc540d9b cache/reader: clean uid in all loop 2023-08-02 10:48:55 +08:00
shenglian zhou 38e797b4ff fix: remove the core 2023-08-02 10:43:26 +08:00
shenglian zhou d5ca51e94d fix: add init add check it 2023-08-02 10:43:26 +08:00
shenglian zhou 6bf95c0c4d fix: delete SLDataItem if stt level files num is smaller 2023-08-02 10:43:26 +08:00
Haojun Liao 13543f7daa feature(stream): handle task update in tq module. 2023-08-02 10:33:41 +08:00
Minglei Jin ed76525c4f cache/reader: cleanup uid in signle loop 2023-08-02 10:28:13 +08:00
wangjiaming0909 72dc46600e fix: memory leak when drop db which acquired by user with grant/revoke 2023-08-02 10:09:50 +08:00
Minglei Jin 29b2f32821 cache reader: cleanup stt init 2023-08-02 09:49:41 +08:00
Haojun Liao 53aefa531f Merge branch '3.0' into fix/3_liaohj 2023-08-02 09:45:21 +08:00
Haojun Liao e1e5e9bb0f enh(stream): check stream tasks dag. 2023-08-02 09:44:39 +08:00
Hongze Cheng 4ba4e83b5b fix: retention file corruption 2023-08-01 20:19:13 +08:00
Haojun Liao c016a58623 enh(stream): do some internal refactor. 2023-08-01 19:22:59 +08:00
Minglei Jin 7d294cac5f tsdb/cache: load current fileset's brinblk once 2023-08-01 18:56:10 +08:00
Minglei Jin a593e887fa cache: remove nFileset from fs state 2023-08-01 18:37:23 +08:00
Haojun Liao ad4c5916e7 enh(stream): update the stream task. 2023-08-01 18:14:58 +08:00
Minglei Jin 7ad628417a fix mem issue: stack-use-after-scope 2023-08-01 17:57:38 +08:00
Minglei Jin 4716fc6400 cache/fs: remove fs state's tsdb handle 2023-08-01 17:49:05 +08:00
Minglei Jin 1d5532019f tsdb/merge-tree: cleanup comment 2023-08-01 17:25:15 +08:00
Minglei Jin f72f129d41 cache/skyline: cleanup del array 2023-08-01 17:23:53 +08:00
Minglei Jin c997662ba0 tsdb/cache: build skyline only if there's del data 2023-08-01 16:50:00 +08:00
Minglei Jin 94b9599f95 fix null pointer dereference 2023-08-01 16:39:14 +08:00
Haojun Liao 637f09359a other: merge main. 2023-08-01 16:15:34 +08:00
Haojun Liao 164bfd5408 enh(stream): prepare update trans. 2023-08-01 16:12:35 +08:00
Minglei Jin 72ac5a4e3b tsdb/cache: use read util's uid compare functor 2023-08-01 16:08:20 +08:00
Minglei Jin c0a0e07597 cache/read: lazy init uidList when laoding from tsdb 2023-08-01 16:02:09 +08:00
Minglei Jin b3fae65d90 enh(tsdb/cache/read): lazy init table map hash and entries 2023-08-01 15:53:42 +08:00
Hongze Cheng 78c23f407e fix compile issue 2023-08-01 15:04:14 +08:00
Hongze Cheng 07c40943a4 fix: TD-25408 2023-08-01 15:01:06 +08:00
wade zhang 347e78ecb5
Merge pull request #22272 from taosdata/fix/TD-25466
Fix/td 25466
2023-08-01 14:22:24 +08:00
Haojun Liao 75b1520be0 enh(stream): create task update info 2023-08-01 14:04:07 +08:00
Hongze Cheng 1b39147496 more refact 2023-08-01 11:36:37 +08:00
Hongze Cheng 0e46041c1a fix: tsdbRetention memory leak 2023-08-01 11:21:40 +08:00
wade zhang 6da5276259
Merge pull request #22264 from taosdata/szhou/fix-ts3749
fix: restore user privilege processing if the rows generated by the u…
2023-08-01 11:21:11 +08:00
Haojun Liao ae9745ecf2
Merge pull request #22258 from taosdata/mark/tmq-3.0
fix:add committed & seek process logic
2023-08-01 09:52:09 +08:00
slzhou 785326c494 fix: dedicated max privileges rows to 2048 2023-08-01 09:46:08 +08:00
Haojun Liao ea875c58f2
Merge pull request #22263 from taosdata/mark/tmq-main
fix:add committed & seek process logic
2023-08-01 09:43:23 +08:00
slzhou 411b5d4cf4 fix: increase privileges max block row number to 4096 2023-08-01 09:41:59 +08:00
slzhou 65e028ea5a enhance: add log 2023-07-31 23:27:35 +08:00
Haojun Liao 36ef9a537f
Merge pull request #22256 from taosdata/fix/TD-25457
check update data
2023-07-31 22:56:05 +08:00
Haojun Liao 2640e41705
Merge pull request #22261 from taosdata/fix/3_liaohj
fix(stream): set the correct end key of delete block.
2023-07-31 22:55:50 +08:00
Haojun Liao 7e8ecceada
Merge pull request #22260 from taosdata/fix/3_liaohj
fix(stream): kill task when pause the stream execution.
2023-07-31 22:55:36 +08:00
slzhou 215e358ce3 fix: restore user privilege processing if the rows generated by the user exceeds max block rows 2023-07-31 19:20:54 +08:00
wangmm0220 68ae64cdb2 fix:add committed & seek process logic 2023-07-31 18:53:25 +08:00
wangmm0220 cddf27e8b4 fix:add committed & seek process logic 2023-07-31 18:48:50 +08:00
Haojun Liao d45596bb33 fix(stream): kill task when pause the stream execution. 2023-07-31 18:07:37 +08:00
Haojun Liao 0b732e512a
Merge pull request #22251 from taosdata/fix/3_liaohj
fix(stream): set the correct end key of delete block.
2023-07-31 18:06:48 +08:00
wangmm0220 6179618b17 fix:add committed & seek process logic 2023-07-31 17:56:04 +08:00
wade zhang 9675384b05
Merge pull request #22252 from taosdata/fix/TD-25391
fix(tsdb/read2): reset stt reader when suspended
2023-07-31 17:36:43 +08:00
liuyao 32b59af4b1 check update data 2023-07-31 17:32:24 +08:00
wade zhang 64d63b0584
Merge pull request #22212 from taosdata/fix/TD-24809-3.0
fix: taos print version
2023-07-31 16:31:03 +08:00
wangmm0220 8093ef2dc8 Merge branch 'main' of https://github.com/taosdata/TDengine into mark/tmq 2023-07-31 16:14:25 +08:00
Haojun Liao 9981cecbed refactor: do some internal refactor. 2023-07-31 15:24:35 +08:00
Minglei Jin 079d7ff69e fix(tsdb/read2): reset stt reader when suspended 2023-07-31 15:21:47 +08:00
wade zhang 79646fff10
Merge pull request #22246 from taosdata/szhou/fix-ts3744
fix: increase condition size
2023-07-31 14:48:06 +08:00
Haojun Liao e61aa83594 enh(stream): handle the stream hb. 2023-07-31 14:07:18 +08:00
slzhou 6151b790d9 fix: increase the condition size of user privileges to 48k 2023-07-31 13:25:56 +08:00
wade zhang c7fa5ed6ef
Merge pull request #22247 from taosdata/fix/TD-25436
fix(tsdb/cache): check stt data with empty brin index
2023-07-31 11:24:37 +08:00
Minglei Jin 135beebc0a fix(tsdb/cache): check stt data with empty brin index 2023-07-31 09:15:08 +08:00
wade zhang bae028d65c
Merge pull request #22230 from taosdata/mark/tmq
fix:semaphore always wait in tmq commit logic
2023-07-31 09:10:13 +08:00
kailixu ff39aadb34 fix: mac OS for community 2023-07-31 08:42:17 +08:00
Haojun Liao cc5ff44604 enh(stream): handle the stream hb. 2023-07-30 19:25:00 +08:00
wade zhang c26165975d
Merge pull request #22227 from taosdata/fix/TS-3728
fix:add macro ASSERT_NOT_CORE to control ASSERT not core in release version
2023-07-30 14:28:56 +08:00
Haojun Liao 8dfef8768a other: merge 3.0 2023-07-29 22:54:16 +08:00
Haojun Liao c3c9e32ddd
Merge pull request #22244 from taosdata/fix/3_liaohj
other: merge 3.0
2023-07-29 22:38:51 +08:00
Haojun Liao 0bd2548937 fix(stream): initialize the filter window initial range. 2023-07-29 16:41:01 +08:00
kailixu 2deeed87ae fix: community for mac os 2023-07-29 13:18:17 +08:00
Haojun Liao f6e07d1fdb other: merge 3.0 2023-07-29 01:32:02 +08:00
wade zhang c19feb2fa1
Merge pull request #22236 from taosdata/fix/TD-25416
fix(tsdb/cache/del): use lru mutex to fix race with committing
2023-07-28 23:17:45 +08:00
Haojun Liao 936afeb5ac refactor: do internal refactor to simple the pause/resume in case of fill history exists. 2023-07-28 19:13:03 +08:00
Haojun Liao d5974a8f25 refactor(stream): refactor the pause/resume for fill history execution. 2023-07-28 18:05:32 +08:00
Minglei Jin 1fcbf3432c tsdb/cache/del: remove duplicate lruMutex lock 2023-07-28 17:20:20 +08:00
wangmm0220 d982a7cb80 fix:heap use after free for wal 2023-07-28 16:59:35 +08:00
Minglei Jin b0f65dfa62 fix(tsdb/cache/del): use lru mutex to fix race with committing 2023-07-28 16:32:07 +08:00
wangmm0220 ce7db7bf90 fix:subscribe time & return -1 if wal not exist 2023-07-28 15:07:15 +08:00
wangmm0220 6e673072cd fix:conflicts 2023-07-28 14:57:13 +08:00
Haojun Liao 9f943213ed enh(stream): update the hb info. 2023-07-28 14:23:53 +08:00
Haojun Liao 74834aea11 enh(stream): prepare hb to mnode from stream meta. 2023-07-28 13:07:16 +08:00
Haojun Liao 2a78cd2d23
Merge pull request #22215 from taosdata/fix/liaohj
other: merge main.
2023-07-28 13:06:17 +08:00
wangmm0220 2f6c565392 fix:pHandle not load if taosd restart 2023-07-28 11:48:53 +08:00
wade zhang b3e5b5bd24
Merge pull request #22217 from taosdata/fix/TD-25386
fix(tsdb/cache): move to stt next row if data file exausted
2023-07-28 08:56:29 +08:00
Haojun Liao ccc0f13649
Merge pull request #22214 from taosdata/fix/3_liaohj
fix(stream): scan wal in step2
2023-07-28 00:42:15 +08:00
Haojun Liao 7f3d1dc464 fix(stream): fix memory leak. 2023-07-27 23:06:53 +08:00
wangmm0220 77d43ef5fd fix:tmq ci error 2023-07-27 20:28:45 +08:00
Haojun Liao fbb33be85d other: add some comments. 2023-07-27 18:59:38 +08:00
Haojun Liao 22a5a18fff fix(stream): 1. set correct timewindow after step2. 2. handle the case when the task is failed to be added into the meta store. 2023-07-27 18:57:36 +08:00
Minglei Jin cc9b9bd0b9 fix(tsdb/cache): move to stt next row if data file exausted 2023-07-27 17:19:42 +08:00
Shungang Li fb226c2cdb enh: check cluster ttlChangeOnWrite consistency 2023-07-27 16:49:56 +08:00
Haojun Liao b145771a1b other: merge 3.0 2023-07-27 16:38:57 +08:00
Haojun Liao 3d403dca5a other: merge main. 2023-07-27 16:23:41 +08:00
Haojun Liao 6ff50d4eaf fix(stream): update the step2 scan wal files. 2023-07-27 16:10:55 +08:00
wangmm0220 75eacd56f1 fix:add log 2023-07-27 15:58:32 +08:00
wade zhang a72c11c8de
Merge pull request #22205 from taosdata/fix/TD-25315
fix(tsdb/commit2): new maxDelKey for commit context
2023-07-27 15:48:46 +08:00
wade zhang cc3cc73cfc
Merge pull request #22199 from taosdata/fix/TS-3708
fix/TS-3708: check term for role time
2023-07-27 15:43:23 +08:00
wangmm0220 2d41a42976 Merge branch 'main' of https://github.com/taosdata/TDengine into fix/TS-3728 2023-07-27 15:31:16 +08:00
Haojun Liao 40fe3ef4f6 fix(stream): refactor the step2 wal scan. 2023-07-27 14:49:20 +08:00
Shungang Li 167ecea705 fix: check term for role time
1. time of mnode becomes current role in this term
2. show 0 for offline mnodes
2023-07-27 14:16:54 +08:00
Minglei Jin fe495f7013 tsdb/commit2: fix commit minKey for del 2023-07-27 13:54:48 +08:00
Haojun Liao e89f530db2 fix(stream): scan wal in step2 2023-07-27 10:55:59 +08:00
Minglei Jin 8a2764c698 tsdb/commit2: use max fileset's maxKey as initial maxDelKey 2023-07-27 10:51:17 +08:00
Haojun Liao 2ef67b326a
Merge pull request #22207 from taosdata/fix/3_liaohj
fix(stream): set the value of ratio of vnode stream thread factor to be 4.0 by default.
2023-07-27 10:36:37 +08:00
Minglei Jin dd32f12f92 tsdb/commit2: reset nextKey to max to stop commit 2023-07-27 09:50:32 +08:00
Minglei Jin 992d623ae5 fix(tsdb/commit2): initialize ctx's maxDelKey with TSKEY_MIN 2023-07-27 09:34:47 +08:00
Minglei Jin 580b7124cf fix(tsdb/commit2): new maxDelKey for commit context 2023-07-27 09:16:28 +08:00
Haojun Liao b1596f8e3e refactor: do some internal refactor. 2023-07-27 01:55:42 +08:00
Haojun Liao 087d54a807
Merge pull request #22198 from taosdata/fix/3_liaohj
fix(stream): do filter before the update check.
2023-07-26 18:57:48 +08:00
yihaoDeng 287088ae3f fix stream state transfer 2023-07-26 10:16:06 +00:00
Haojun Liao c57defa1c9
Merge pull request #22195 from taosdata/szhou/fix-td25369
fix: stt and data block merge
2023-07-26 17:11:18 +08:00
Haojun Liao 6a6830761d fix(tsdb): check for null ptr of pScanInfo 2023-07-26 17:08:29 +08:00
Haojun Liao 3c387f6e91 fix(stream): fix syntax error. 2023-07-26 17:00:41 +08:00
Haojun Liao 432c943c25 fix(stream): do filter before the update check. 2023-07-26 16:34:39 +08:00
Haojun Liao 610f9d19c1
Merge pull request #22188 from taosdata/fix/3_liaohj
fix(stream): set the correct step2 scan time window range.
2023-07-26 16:34:10 +08:00
shenglian zhou 1357e623d0 fix: fix compilation error 2023-07-26 15:43:50 +08:00
shenglian zhou 79020ea4a4 fix: stt and data block merge 2023-07-26 15:01:20 +08:00
Haojun Liao df57768a3e Merge branch '3.0' into fix/3_liaohj 2023-07-26 14:45:11 +08:00
Haojun Liao cdffabcdad fix(stream): fix memory leak. 2023-07-26 14:37:04 +08:00
Haojun Liao 728112ed89 fix(stream): set correct upstream epinfo. 2023-07-26 10:26:59 +08:00
wade zhang d8fd5b9394
Merge pull request #22190 from taosdata/fix/TD-25315
fix(tsdb/del): reset next key to del record's ekey
2023-07-26 10:23:01 +08:00
yihaoDeng c61393a7a1 fix stream state transfer 2023-07-26 01:33:41 +00:00
Haojun Liao b6eb739ae0 fix(tsdb): fix the 2023-07-26 09:14:19 +08:00
Minglei Jin fb860726de fix(tsdb/del): reset next key to del record's ekey 2023-07-26 08:40:44 +08:00
Haojun Liao 1c1bf63e1f other: merge 3.0 2023-07-25 18:17:11 +08:00
wade zhang 02bc1b2a8f
Merge pull request #22186 from taosdata/fix/TD-25315
fix(tsdb/del): continue committing fileset if more del left
2023-07-25 17:41:30 +08:00
Haojun Liao 0bdccd2681 refactor: do some internal refactor. 2023-07-25 17:31:54 +08:00
Minglei Jin 7bfb4e0f88 fix(tsdb/del): continue committing fileset if more del left 2023-07-25 16:42:45 +08:00
wangmm0220 a3614ca5d2 fix:add assert if exception occurs 2023-07-25 16:18:11 +08:00
wangmm0220 be4e47e9a7 fix:add macro ASSERT_NOT_CORE to control ASSERT not core in release version 2023-07-25 16:15:33 +08:00
Haojun Liao d29f835a63 fix(stream): set the correct step2 scan time window range. 2023-07-25 15:09:22 +08:00
Haojun Liao c2588d71c3
Merge pull request #22173 from taosdata/fix/TS-3728
fix:avoid request offset type is 0
2023-07-25 14:59:30 +08:00
wade zhang 2bf84c2676
Merge pull request #22179 from taosdata/FIX/TS-3702-3.0
enh: compatibility between getFileNamePrefix and tsdbTFileName
2023-07-25 14:26:14 +08:00
Benguang Zhao 01f45b2a99 enh: compatibility between getFileNamePrefix and tsdbTFileName 2023-07-25 11:35:35 +08:00
Minglei Jin 1bce96ea27 fix(tsdb/pageSize): use tsdbPageSize instead of szPage(tdb's) 2023-07-25 10:46:03 +08:00
wade zhang 7ea9cf1ddc
Merge pull request #22166 from taosdata/fix/TD-24422
fix(tsdb/cache): reuse data file reader
2023-07-25 10:28:59 +08:00
Haojun Liao 96722a07b1
Merge pull request #22174 from taosdata/fix/3_liaohj
fix(stream): fix the invalid check of step2 .
2023-07-25 00:30:06 +08:00
Haojun Liao a2694b9ce9 fix(stream): fix the invalid check of step2 . 2023-07-24 19:44:28 +08:00
Haojun Liao c0e35df927
Merge pull request #22131 from taosdata/mark/tmq
fix:optimize log & change return value for async interface
2023-07-24 19:40:01 +08:00
wangmm0220 6a0e994169 fix:avoid request offset type is 0 2023-07-24 19:24:05 +08:00
Haojun Liao d36903bf08
Merge pull request #22162 from taosdata/fix/3_liaohj
fix(stream): add some logs, and remove the invalid loop.
2023-07-24 16:29:51 +08:00
dapan1121 dce1f579ea
Merge pull request #22143 from taosdata/enh/TD-24987-3.0
enh: expire time optimize
2023-07-24 16:18:59 +08:00
wangmm0220 9628a9f74e fix:open info log in tmq & ignore wal apply ver when read wal 2023-07-24 15:53:02 +08:00
Haojun Liao 01f11bf5a6 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2
# Conflicts:
#	source/common/src/tglobal.c
#	source/libs/executor/src/timewindowoperator.c
2023-07-24 15:25:43 +08:00
Haojun Liao 1e34f84f78 other: merge 3.0 2023-07-24 15:23:03 +08:00
kailixu 7946ce4994 chore: code optimization 2023-07-24 14:46:59 +08:00
Minglei Jin 424dd40078 tsdb/cache: reuse pDataFileReader for same fileset 2023-07-24 14:45:35 +08:00
kailixu cf59a6cff0 chore: set user for dm transport 2023-07-24 14:24:47 +08:00
Haojun Liao 9bae91bcba fix(stream): add some logs, and remove the invalid loop. 2023-07-24 13:37:44 +08:00
Haojun Liao 13bab114cb
Merge pull request #22155 from taosdata/fix/3_liaohj
fix(stream): refactor the halt status to check more status.
2023-07-24 11:04:08 +08:00
Minglei Jin 968cfd9e65 tsdb/cache: pLastIter null pointer check 2023-07-24 11:03:07 +08:00
wade zhang 5f25d70fc2
Merge pull request #22154 from taosdata/enh/tsdb_optimize
fix(tsdb/cache): new next stt row state for fs tranverse
2023-07-24 10:47:51 +08:00
Haojun Liao 1367552f38 fix(stream): refactor the halt status to check more status. 2023-07-24 10:04:15 +08:00
Haojun Liao 6a19ad3127
Merge pull request #22151 from taosdata/fix/3_liaohj
fix(stream): set the correct flag of pause/resume.
2023-07-24 09:07:49 +08:00
Minglei Jin 13491fab95 tsdb/cache: new next stt row state for fs tranverse 2023-07-24 08:51:20 +08:00
Haojun Liao 0b6e1a12bb refactor: do some internal refactor. 2023-07-23 19:09:43 +08:00
Haojun Liao e387b2f932 refactor: do some internal refactor. 2023-07-23 18:59:34 +08:00
Haojun Liao 4e0f7ffbf8 fix(stream): set the correct flag of pause/resume. 2023-07-23 18:49:56 +08:00
Haojun Liao 321be1f83f
Merge pull request #22135 from taosdata/fix/3_liaohj
refactor: do some internal refactor.
2023-07-22 15:06:28 +08:00
Haojun Liao bfc4a07207 fix(stream): fix memory leak. 2023-07-22 00:20:02 +08:00
Haojun Liao 1b2636028a fix(stream): fix memory leak. 2023-07-21 23:05:42 +08:00
wangmm0220 8f15795cc1 fix:judge if pTopic is NULL 2023-07-21 19:47:31 +08:00
Haojun Liao 16d7707b90 fix(stream): align the scan real time data for stream task. 2023-07-21 19:33:43 +08:00
wade zhang 7b1e809d98
Merge pull request #21794 from taosdata/enh/tsdb_optimize
for test purpose
2023-07-21 14:18:32 +08:00
wangmm0220 bb86f5c580 fix:commit offset should not plus 1 2023-07-21 11:13:05 +08:00
wangmm0220 10ebf1f438 fix:subscribeStb.py maybe failed 2023-07-21 11:07:34 +08:00
dmchen 7d480cf3ac compatible old sync config 2023-07-21 10:31:53 +08:00
liuyao d45563684b
Merge branch '3.0' into enh/triggerCheckPoint2 2023-07-21 10:23:41 +08:00
Haojun Liao d0da988b7d Merge branch '3.0' into fix/3_liaohj 2023-07-21 09:47:44 +08:00
Haojun Liao 39ca9b537f fix(stream): fix syntax error 2023-07-21 09:43:08 +08:00
dapan1121 d81727afa9
Merge pull request #22130 from taosdata/fix/TD-25270
enh: support show create table for system tables
2023-07-21 09:26:11 +08:00
Haojun Liao c9d75eab5a refactor: do some internal refactor. 2023-07-21 09:16:13 +08:00
Haojun Liao db46d31ca5 fix(stream): refactor the halt function. 2023-07-21 01:32:42 +08:00
yihaoDeng 519d3b74d1 fix stream state transfer 2023-07-20 09:51:18 +00:00
Ganlin Zhao 076a425d53 fix: fix show create table issue for system tables 2023-07-20 17:21:24 +08:00
Haojun Liao 9353f7c8cf refactor: do some internal refactor. 2023-07-20 16:35:02 +08:00
Haojun Liao c9fa170e65 refactor: do some internal refactor. 2023-07-20 16:31:46 +08:00
Haojun Liao 45cb478b31 refactor: do some internal refactor. 2023-07-20 15:36:46 +08:00
Haojun Liao 87fa8f0c4c Merge branch '3.0' into fix/3_liaohj 2023-07-20 12:15:23 +08:00
Haojun Liao aed99da6c1 refactor: refactor the stream task starting order. 2023-07-20 12:14:53 +08:00
yihaoDeng 6e5be0d30e fix stream state transfer 2023-07-20 03:49:32 +00:00
Minglei Jin 48222f5dc3 tsdb/cache: move data file reader for fs iter to cache reader 2023-07-20 09:11:26 +08:00
Minglei Jin 6dd4ec41ae tsdb/cache cleanup: remove unused fs methods 2023-07-20 08:51:03 +08:00
Minglei Jin 7f0ea10573 Merge branch 'enh/tsdb_optimize' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-07-20 08:42:12 +08:00
Minglei Jin 46d6dcda3e tsdb/cache: reset skyline when clearing fileset 2023-07-20 08:41:32 +08:00
Haojun Liao bfcc538205 fix(tsdb):disable stt statistics. 2023-07-20 00:01:30 +08:00
wangmm0220 9378a0ef83 Merge branch 'main' of https://github.com/taosdata/TDengine into mark/tmq 2023-07-19 23:42:23 +08:00
yihaoDeng 733db123ad refactor code 2023-07-19 13:24:59 +00:00
Haojun Liao 97c44e7c18 refactor: do some internal refactor. 2023-07-19 18:42:02 +08:00
wangmm0220 d7d81d82a0 feat:add committed & position & commite_offset interface 2023-07-19 18:27:19 +08:00
Yihao Deng 91a15fd7bd
Merge branch '3.0' into enh/triggerCheckPoint2 2023-07-19 18:14:08 +08:00
Minglei Jin ce71b8bbe7 Merge branch 'enh/tsdb_optimize' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-07-19 18:11:14 +08:00
Minglei Jin 4eaecd11de tsdb/cache: merge fs & stt row 2023-07-19 18:10:36 +08:00
dapan1121 cbe03ef212
Merge pull request #22069 from taosdata/enh/TS-2288
enh: add scope for show xx variables
2023-07-19 18:01:11 +08:00
wangmm0220 5cb35f2fa6 feat:add committed & position & commite_offset interface 2023-07-19 17:29:39 +08:00
Haojun Liao 37ae80d135 fix(tsdb): fix memory leak. 2023-07-19 16:42:51 +08:00
dmchen 8062d603b7 restore old change replica 2023-07-19 15:35:37 +08:00
tangfangzhi 69fae62003 error message 2023-07-19 15:04:39 +08:00
Haojun Liao d82fb45a4f Merge remote-tracking branch 'origin/enh/tsdb_optimize' into enh/tsdb_optimize 2023-07-19 15:01:37 +08:00
Haojun Liao a84efab2c8 enh(tsdb): add table filter according to stt block statistics data. 2023-07-19 15:01:25 +08:00
Minglei Jin 913cfe43e8 tsdb/cache: remove input[3] 2023-07-19 12:20:54 +08:00
Minglei Jin 7a716d452e tsdb/fs2: fix vnode get primary dir args 2023-07-19 11:36:26 +08:00
Minglei Jin 4b96bc7147
Merge branch '3.0' into enh/tsdb_optimize 2023-07-19 11:15:57 +08:00
Shungang Li 1d88a6a7c6 enh: ttlMgrFlush adjust log level 2023-07-19 11:15:54 +08:00
Minglei Jin 185081a948 tsdb/fsreader: clear last fileset's resources 2023-07-19 11:04:28 +08:00
dm chen 141004bf77
Merge branch '3.0' into feat/TD-22970 2023-07-19 10:57:40 +08:00
tangfangzhi 4cdfd0e1e8 conflict 2023-07-19 10:50:46 +08:00
yihaoDeng b1f3dfe88f Merge branch 'enh/triggerChpt' into enh/triggerCheckPoint2 2023-07-19 02:17:42 +00:00
yihaoDeng 34c2e6a180 forbidden streamsnapshot reader 2023-07-19 02:15:12 +00:00
Haojun Liao a32c650248 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-07-19 10:05:48 +08:00
Haojun Liao 2ae95217bd fix(stream): open inputQ by default for task deployed on snode. 2023-07-19 10:05:35 +08:00
liuyao fd02b9a71e
Merge branch '3.0' into enh/triggerCheckPoint2 2023-07-19 10:02:06 +08:00
wade zhang c3e5375f15
Merge pull request #22085 from taosdata/FEAT/TS-2699-3.0
feat: distribute vnode primary dirs among disks of level 0
2023-07-19 09:44:43 +08:00
wangmm0220 5c344b0159 fix:conflicts from main 2023-07-19 09:05:05 +08:00
dmchen 93766f8c96 memory leak 2023-07-19 08:32:16 +08:00
Haojun Liao 9513f76172 fix(stream): set downstream task ready state. 2023-07-18 19:02:24 +08:00
wade zhang 5f6afc6661
Merge pull request #22107 from taosdata/fix/TD-25232
fix/TD-25232: alter keeptimeoffset by 'k v' or 'k' 'v'
2023-07-18 18:30:30 +08:00
Minglei Jin a127e91534 tsdb/cache skyline: first round implementation of cache skyline 2023-07-18 17:17:06 +08:00
Benguang Zhao 224f90761e fix: set wrapperCfg.diskPrimary in vmProcessAlterVnodeTypeReq 2023-07-18 16:57:52 +08:00
dmchen 3711fdd865 feat/TD-22970 2023-07-18 16:09:38 +08:00
Shungang Li dfaf9134c6 fix: alter keeptimeoffset by 'k v' or 'k' 'v' 2023-07-18 16:04:38 +08:00
Benguang Zhao 02f4613154 enh: report VND_INIT_FAILED on vnodes open failure in vmOpenVnodes 2023-07-18 15:44:51 +08:00
Benguang Zhao 2faa3d2e7b enh: check validity of diskPrimary during vnodeOpen 2023-07-18 15:39:29 +08:00
Minglei Jin 9f9efe9a5e tsdb/cache reader: remove dataf & dataf last readers 2023-07-18 15:30:31 +08:00
wangmm0220 08c50dfbb4 fix:add sdbFetchCancel to release hash node 2023-07-18 15:21:35 +08:00
Haojun Liao 901b7d8ecc fix(stream): if a source task is set to be non-normal, no data should be put into inputQ anymore. 2023-07-18 15:18:57 +08:00
wangmm0220 2c80d7e621 Merge branch 'main' of https://github.com/taosdata/TDengine into fix/TS-3672 2023-07-18 14:59:06 +08:00
Benguang Zhao 24fed51137 enh: tfsRename dir on primary disk at last 2023-07-18 13:58:43 +08:00
Benguang Zhao 5624ecc8df fix: prepare vnode dir recursively in vnodeCreate 2023-07-18 11:32:23 +08:00
Benguang Zhao 6b6b7d8d8f enh: alloc disk of vnode primary dir in vmAllocPrimaryDisk 2023-07-18 11:32:23 +08:00
dmchen 97a81bd8ed fix/TD-25179 2023-07-18 11:27:01 +08:00
Haojun Liao 0c64e67fda fix(stream): fix set upstream info for history task. 2023-07-18 10:19:13 +08:00
wangmm0220 6c35081507 fix:add sdbFetchCancel to release hash node 2023-07-18 09:54:35 +08:00
Haojun Liao 92106312d2 fix(stream): not dispatch checkpoint block result to downstream. 2023-07-18 09:43:38 +08:00
yihaoDeng 8ab545ac77 fillhistory task not trigger checkpoint 2023-07-18 01:16:48 +00:00
wade zhang 7e89622149
Merge pull request #22092 from taosdata/fix/TD-25232
fix/TD-25232: alter dnode keeptimeoffset err
2023-07-18 09:10:40 +08:00
dapan1121 73c6666e62
Merge pull request #22096 from taosdata/fix/TD-25210-3.0
fix: add sma option when show create table for stb/ntb
2023-07-18 09:09:49 +08:00
Haojun Liao 2f24f776fb fix(stream): fix error in generating checkpoint for state_window. 2023-07-18 09:04:28 +08:00
kailixu cf39fcdd12 fix: add sma option when show create table for stb/ntb 2023-07-17 22:24:27 +08:00
wangmm0220 da9e30434a fix:add sdbFetchCancel to release hash node 2023-07-17 20:21:23 +08:00
wangmm0220 8d8e12ee0d fix:add sdbFetchCancel to release hash node 2023-07-17 20:20:34 +08:00
yihaoDeng b56e442478 Merge branch 'enh/dev33' into enh/triggerCheckPoint2 2023-07-17 11:41:38 +00:00
Minglei Jin 998fbe574d tsdb/cache reader: move suid into reader's info field 2023-07-17 19:10:33 +08:00
yihaoDeng 40eb50676d add checkpoint 2023-07-17 11:04:19 +00:00
Shungang Li 1d0c73feb6 fix: alter dnode keeptimeoffset err 2023-07-17 18:37:00 +08:00
Minglei Jin 463b5b608b tsdb/read2: fix null pointer runtime error 2023-07-17 18:35:56 +08:00
Minglei Jin 62cfda1a88 tsdb/read2: fix UAF 2023-07-17 17:35:08 +08:00
dapan1121 3c7924ed8d
Merge pull request #22081 from taosdata/enh/TD-24920-3.0
enh: dm monitor refactor
2023-07-17 17:12:50 +08:00
Ganlin Zhao 929db3d647 Merge branch '3.0' into enh/TS-2288 2023-07-17 16:09:07 +08:00
Ganlin Zhao 13e6a04e8f fix scope 2023-07-17 15:56:21 +08:00
Minglei Jin 832b68e17d tsdb/cache: load mem del data 2023-07-17 15:48:08 +08:00
Minglei Jin a05383e29e tsdb/cache: new load tomb callback from tsdb mergetree 2023-07-17 15:07:10 +08:00
Minglei Jin 27b8671f97 tsdb/cache: new cacheReader field for tsdb & cache reader 2023-07-17 14:27:27 +08:00
Minglei Jin 9b0b4061e0 tsdb/cache: relayout cache row reader 2023-07-17 14:16:54 +08:00
Haojun Liao eaaf306c81 fix(stream): fix syntax error 2023-07-17 12:54:05 +08:00
Haojun Liao d7f7a7d6cf fix(stream): fix syntax error 2023-07-17 12:53:36 +08:00
Haojun Liao b2a905bd91
Merge branch '3.0' into enh/triggerCheckPoint2 2023-07-17 11:50:12 +08:00
Benguang Zhao b21e603481 enh: add the field diskPrimary to vnodeGetPrimaryDir, and entries of vnodes.json 2023-07-17 11:48:48 +08:00
kailixu 0e6b982682 chore: more code 2023-07-17 09:19:24 +08:00
Minglei Jin 8263c49c17 tsdb/cache: fix compilation 2023-07-17 09:00:17 +08:00
Minglei Jin 2b21c5e0f6 tsdb2: adapt cache with tsdb2 API 2023-07-17 08:50:54 +08:00
Haojun Liao a9757637d9 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-07-16 12:47:24 +08:00
Haojun Liao c6a322e0ef refactor(stream): back pressure is active, which is trigger by dispatch rsp. 2023-07-16 12:47:08 +08:00
kailixu 3ab2ad20b4 chore: more check 2023-07-16 10:23:39 +08:00
kailixu 0bfc1cc920 chore: windows check 2023-07-16 10:13:17 +08:00
kailixu 918d3cca0c chore: more check 2023-07-16 07:13:53 +08:00
yihaoDeng e18c9ea672 add checkpoint 2023-07-15 04:26:34 +00:00
kailixu 9117888853 chore: more code 2023-07-14 19:19:46 +08:00
yihaoDeng 3c4631ef1f add checkpoint 2023-07-14 10:06:24 +00:00
wade zhang c2b3c2db52
Merge pull request #22066 from taosdata/fix/TD-25215-main
fix/TD-25215: ttlMgrDeleteTtl should ignore ttl 0 tables for main
2023-07-14 17:53:25 +08:00
wade zhang 021fcf2a59
Merge pull request #22059 from taosdata/fix/TD-25215
fix/TD-25215: ttlMgrDeleteTtl should ignore ttl 0 tables
2023-07-14 17:53:06 +08:00
Haojun Liao b16432280e Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-07-14 17:21:37 +08:00
Haojun Liao eb7e6152ae refactor(stream): do some internal refactor. 2023-07-14 17:21:20 +08:00
Haojun Liao da0bd2a681
Merge pull request #22067 from taosdata/fix/coverity_scan
fix coverity scan problem
2023-07-14 16:54:17 +08:00
wangmm0220 6762a01d88 Merge branch 'main' of https://github.com/taosdata/TDengine into mark/tmq 2023-07-14 16:44:00 +08:00
wangmm0220 bbdcbcb75b fix:modify commit version to next validate version 2023-07-14 16:43:28 +08:00
Hongze Cheng 145c43e346 little fix 2023-07-14 16:38:35 +08:00
Ganlin Zhao b402782784 add scope for information_schema.ins_dnode_variables 2023-07-14 15:56:29 +08:00
Haojun Liao 572d9d25d9
Merge pull request #22063 from taosdata/fix/TD-25201
sma not support multiple replicas
2023-07-14 15:21:34 +08:00
yihaoDeng 0bf74d096c Merge branch 'enh/triggerCheckPoint2' of https://github.com/taosdata/TDengine into enh/triggerCheckPoint2 2023-07-14 14:47:18 +08:00
yihaoDeng 15f5fd19eb fix recover error 2023-07-14 14:47:06 +08:00
yihaoDeng e16a3935a5 fix coverity scan problem 2023-07-14 14:40:32 +08:00
Shungang Li a48d359f8b fix: ttlMgrDeleteTtl should ignore ttl 0 tables 2023-07-14 14:37:17 +08:00
Ganlin Zhao 7935d824b6 enhance show variables output 2023-07-14 13:57:02 +08:00
Hongze Cheng 25120cede4 fix sma merge error 2023-07-14 13:46:01 +08:00
Markus Mayer 55ee9d6c25
Correct some typos in string literals (#22062) 2023-07-14 13:39:03 +08:00
kailixu 163adf1908 chore: dm monitor refactor 2023-07-14 13:27:19 +08:00
yihaoDeng dd4740e5a4 add checkpoint 2023-07-14 03:45:30 +00:00
liuyao 52f749f8cc sma not support multiple replicas 2023-07-14 10:36:32 +08:00
yihaoDeng 44170b9b16 fix recover error 2023-07-14 10:36:27 +08:00
Hongze Cheng 5a89b96e91 make compile 2023-07-14 10:21:06 +08:00
Hongze Cheng 1fad69df3b Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-07-14 10:13:15 +08:00
yihaoDeng 17b7e3cc82 Merge branch 'enh/triggerCheckPoint2' of https://github.com/taosdata/TDengine into enh/triggerCheckPoint2 2023-07-13 20:47:18 +08:00
yihaoDeng e588640e02 fix recover error 2023-07-13 20:46:58 +08:00
dapan1121 9bf7180074
Merge pull request #21969 from taosdata/enh/TD-23769-3.0
enh: rsma stream state adaption
2023-07-13 19:19:37 +08:00
Haojun Liao e0ea0f2df4
Merge pull request #22020 from taosdata/fix/liaohj
other: merge main
2023-07-13 17:55:28 +08:00
Shungang Li a39a9428af fix: ttlMgrDeleteTtl should ignore ttl 0 tables 2023-07-13 17:43:32 +08:00
Benguang Zhao 81a2cd16e7 enh: unify handling of vnode primary dir in current_fname 2023-07-13 17:37:53 +08:00
kailixu 6ee135cb52 chore: more code 2023-07-13 17:37:31 +08:00
kailixu 67461d92a7 chore: merge 3.0 and solve conflict 2023-07-13 17:35:55 +08:00
Hongze Cheng d81d2790ea Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-07-13 17:20:45 +08:00
Haojun Liao e2ae868377
Merge pull request #22032 from taosdata/mark/tmq
fix:set firset version to reqOffset of response
2023-07-13 16:35:21 +08:00
Haojun Liao 813f4cb363 refactor: do some internal refactor. 2023-07-13 16:32:25 +08:00
wade zhang ec86a68b6f
Merge pull request #22045 from taosdata/FEAT/TS-2699-3.0
enh: unify handling of vnode primary dir for vnd, tsdb and sma
2023-07-13 13:55:46 +08:00
Benguang Zhao dc75f7ce21 enh: use VNODE_RSMA_DIR in tdRSmaGetCurrentFName 2023-07-13 11:27:31 +08:00
Haojun Liao f41bcd73b0 other: merge main. 2023-07-13 11:02:09 +08:00
Benguang Zhao e209b487c6 enh: rename func name vnodeGetPrimaryDir 2023-07-13 10:38:05 +08:00
Haojun Liao 2f90a53548 fix(stream): set checkpoint id when expanding task. 2023-07-13 10:16:57 +08:00
dapan1121 c5e41bffea
Merge pull request #22051 from taosdata/fix/TD-25197-M
fix: skip primary key for block sma
2023-07-13 09:55:29 +08:00
Haojun Liao 08a4fb06ae fix(stream): dispatch checkpoint msg to downstream by puting message into input queue. 2023-07-13 09:17:20 +08:00
kailixu 466f1037b4 Merge branch '3.0' into enh/TD-23769-3.0 2023-07-12 18:50:16 +08:00
Haojun Liao c388802bda
Merge pull request #22024 from taosdata/fix/3_liaohj
fix(stream): fix concurrent bug in save task meta.
2023-07-12 18:17:27 +08:00
kailixu 8f58f9aa5b fix: skip primary key for block sma 2023-07-12 18:07:01 +08:00
Benguang Zhao b7e134af20 enh: remove unused code in vmProcessCreateVnodeReq 2023-07-12 17:58:30 +08:00
Benguang Zhao 05e8af4837 enh: unify handling of vnode primary dir for vnd and tsdb 2023-07-12 17:58:18 +08:00
Benguang Zhao 4c3bf41178 enh: unify handling of vnode primary dir for sma 2023-07-12 17:56:21 +08:00
Benguang Zhao bbf58d2d9d enh: unify handling of vnode primary dir in vnodeCreate and metaOpen 2023-07-12 17:56:21 +08:00
wangmm0220 cf64d4c9c5 fix:set get_assignment offset to first version of response block 2023-07-12 17:22:23 +08:00
Hongze Cheng 3fc282f035 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-07-12 11:57:19 +08:00
Haojun Liao 3ce54423a5 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-07-12 11:38:27 +08:00
Haojun Liao d392bb60ba refactor(stream): set the initial version from the checkpoint. 2023-07-12 11:38:13 +08:00
kailixu 8cb6356b99 chore: more code 2023-07-12 10:47:02 +08:00
Haojun Liao 9484f3da94
Merge branch '3.0' into enh/triggerCheckPoint2 2023-07-12 10:20:18 +08:00
kailixu f282acbc4c chore: rsma refactor 2023-07-12 10:13:50 +08:00
kailixu 8c8bcabdd4 Merge branch '3.0' into enh/TD-23769-3.0 2023-07-12 09:11:34 +08:00
wade zhang 2cfdd234b3
Merge pull request #22034 from taosdata/feat/TS-3239
feat/TS-3239/TS-3596: port 'keepTimeOffset' from 2.6 to 3.0
2023-07-12 08:18:38 +08:00
Haojun Liao fed3803739 fix(stream): fix memory leak. 2023-07-11 19:29:52 +08:00
kailixu ba0bce8092 chore: code revert 2023-07-11 18:52:51 +08:00
kailixu 30f8c9c79e chore: more check 2023-07-11 18:08:48 +08:00
Shungang Li 4886cb4674 feat: port 'keepTimeOffset' from 2.6 to 3.0 2023-07-11 17:40:35 +08:00
kailixu 7c85f7701d chore: more check 2023-07-11 16:32:29 +08:00
wangmm0220 8dd7f36993 fix:set firset version to reqOffset of response 2023-07-11 16:19:38 +08:00
dapan1121 e7e923a396
Merge pull request #22017 from taosdata/enh/TD-25083-3.0
enh: exclude tk_log from timeseries check
2023-07-11 16:12:30 +08:00
wangmm0220 7bc19df0ef fix:set firset version to reqOffset of response 2023-07-11 15:48:19 +08:00
Haojun Liao 2e386a6fdf fix(stream): check if stream task is in normal state. 2023-07-11 15:23:49 +08:00
wangmm0220 cb62d4cb97 fix:set firset version to reqOffset of response 2023-07-11 14:49:53 +08:00
Haojun Liao 6d78816d22 fix(stream): fix syntax error. 2023-07-11 14:06:25 +08:00
kailixu 314123ef34 chore: add check 2023-07-11 14:05:09 +08:00
Haojun Liao 09b764494d fix(stream): set correct checkpoint version when starting stream tasks. 2023-07-11 14:03:43 +08:00
kailixu d5435926c2 chore: more code 2023-07-11 12:37:01 +08:00
Haojun Liao 3ffdbe923d other: merge 3.0 2023-07-11 09:12:57 +08:00
Haojun Liao 04f5bcd23a fix(stream): remove invalid set of task status . 2023-07-11 08:51:13 +08:00
kailixu 14b438ec64 chore: bug fix 2023-07-11 07:02:36 +08:00
kailixu f391462e34 chore: more code 2023-07-10 20:01:50 +08:00
kailixu 57ceaed535 chore: code revert 2023-07-10 19:55:01 +08:00
kailixu f16fa6d000 enh: exclude tk log from time series check 2023-07-10 19:48:50 +08:00
Haojun Liao 87bedef2cd fix(stream): fix error in checkpointing. 2023-07-10 19:20:05 +08:00
Haojun Liao ab5b2fe0a8 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-07-10 18:21:02 +08:00
Haojun Liao 385a5c9651 fix(stream): fix error in generating checkpoint. 2023-07-10 18:20:50 +08:00
Hongze Cheng 7014f790a0 optmize table statistic info 2023-07-10 17:35:26 +08:00
yihaoDeng e263d5f55f add checkpoint 2023-07-10 17:33:48 +08:00
Ganlin Zhao b9c3ee387e remove wal_roll_period/wal_retention_size from
information_schema.ins_databases
2023-07-10 16:16:27 +08:00
yihaoDeng 4d838d3dff add checkpoint 2023-07-10 15:51:35 +08:00
dmchen 0a86523bcb fix/TS-3589 2023-07-10 14:58:28 +08:00
Haojun Liao 17debe6a28 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-07-10 13:58:04 +08:00
Haojun Liao 16ee72ab06 fix(stream): free msg after send checkpoint rsp. 2023-07-10 13:57:51 +08:00
Haojun Liao f6515e2a2c fix(stream): fix error in checkpointing. 2023-07-10 11:43:37 +08:00
liuyao 84f0dfd6d4 stream operator checkpoint 2023-07-10 11:07:08 +08:00
Haojun Liao 516fcc53ad
Merge pull request #21943 from taosdata/fix/TD-25071
fix:[TD-25071] pSub is null & return wal not exist if no data
2023-07-10 10:21:36 +08:00
dapan1121 977f28e750
Merge pull request #21984 from taosdata/fix/td-24871
fix: ask jemalloc to use background_threads to return vm to os
2023-07-10 10:16:07 +08:00
kailixu 802112c00a chore: more code 2023-07-09 21:49:37 +08:00
Haojun Liao 98349a4265 refactor(tsdb): do some internal refactor. 2023-07-09 18:05:24 +08:00
kailixu a7253fc390 Merge branch '3.0' into enh/TD-25083-3.0 2023-07-09 16:04:38 +08:00
wangmm0220 35ba132a29 fix:conflicts from main 2023-07-09 12:52:18 +08:00
wangmm0220 a5363e6e03 fix:test case in tmq 2023-07-09 12:49:50 +08:00
Haojun Liao ba4d726af6 fix(tsdb): fix error in tsdbread. 2023-07-09 01:31:02 +08:00
Haojun Liao b39198a53a refactor: do some internal refactor. 2023-07-08 21:44:58 +08:00
Haojun Liao 1470e51dc1 Merge remote-tracking branch 'origin/enh/tsdb_optimize' into enh/tsdb_optimize 2023-07-08 21:25:24 +08:00
Haojun Liao 14844c7b4b refactor(tsdb): opt tsdb read perf 2023-07-08 21:25:11 +08:00
wangmm0220 f9f656b21a fix:return offset stored if get assignment in init mode 2023-07-08 13:25:39 +08:00
Haojun Liao 4f534ce6e9 fix(stream): fix error in generating checkpoint. 2023-07-08 10:29:09 +08:00
Haojun Liao a5c19427e7 fix(stream): send correct rsp to mnode. 2023-07-08 09:39:44 +08:00
Haojun Liao 9c30abf95b fix(stream): fix error in generating checkpoint. 2023-07-07 21:38:53 +08:00
wangmm0220 4436eb7e0f fix:set commitOffset is send msg success & optimize log & add test cases for TD-25129 2023-07-07 19:12:18 +08:00
kailixu a746d288a1 chore: add debug info 2023-07-07 18:53:01 +08:00
Haojun Liao 4e0b32cddc Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-07-07 18:18:04 +08:00
Haojun Liao 128f67784a fix(stream): fix error in parsing checkpoint msg. 2023-07-07 18:17:50 +08:00
yihaoDeng 2dc041929a add checkpoint 2023-07-07 10:13:31 +00:00
Haojun Liao 8298f30e56 fix(stream): fix bug in checkpoint. 2023-07-07 17:16:08 +08:00
wangmm0220 106e273157 fix:bugs in get_assignment 2023-07-07 16:12:15 +08:00
Haojun Liao 47877898d0 enh(stream): generate the checkpoint framework. 2023-07-07 16:07:52 +08:00
wade zhang 0865b1a828
Merge pull request #21973 from luckeverda/fix/TD-25074-main
fix/TD-25074 for main
2023-07-07 11:24:33 +08:00
Hongze Cheng 090ca39132 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-07-07 10:38:04 +08:00
kailixu cb8b10f6a2 Merge branch '3.0' into enh/TD-23769-3.0 2023-07-07 10:19:43 +08:00
kailixu 64ef48e0dd Merge branch '3.0' into enh/TD-23769-3.0 2023-07-07 10:17:25 +08:00
kailixu 06c52af2c2 enh: exclude tk_log from timeseries check 2023-07-07 10:14:37 +08:00
Haojun Liao ca27220000
Merge pull request #21962 from taosdata/fix/TD-25102
add version check in rpc
2023-07-07 08:59:31 +08:00
shenglian zhou 74d05af3ca fix: ask jemalloc to use background_threads to return vm to os 2023-07-07 08:34:19 +08:00
wade zhang 47a7a45d1d
Merge pull request #21978 from taosdata/fix/TD-24962
fix(coverity): fix coverity scan issues
2023-07-07 08:20:07 +08:00
wangmm0220 0928bd5510 fix:send rsp offset to client if unregister push mgr 2023-07-06 19:35:48 +08:00
wangmm0220 b2d41ce907 Merge branch 'main' of https://github.com/taosdata/TDengine into fix/TD-25071 2023-07-06 19:34:22 +08:00
Haojun Liao aad906f2b0 fix(stream): fix syntax error. 2023-07-06 18:26:44 +08:00
Haojun Liao d7101f7109 enh(stream): support dispatch checkpoint msg. 2023-07-06 18:26:22 +08:00
Minglei Jin 09222801c4 fix(coverity): fix coverity scan issues 2023-07-06 17:52:48 +08:00
wangmm0220 f1ce91f600 fix:race condition for pTq->pStore->pHash 2023-07-06 16:49:59 +08:00
wangmm0220 9e6e59adc2 fix:race condition for pTq->pStore->pHash 2023-07-06 16:47:48 +08:00
Shungang Li a31e054146 fix: ttlmgr convert in metaUpgrade 2023-07-06 15:47:32 +08:00
Shungang Li a1a2b8331f fix: ttl fill cache only in initialization 2023-07-06 15:47:32 +08:00
wade zhang 84740e96ee
Merge pull request #21939 from luckeverda/fix/TD-25074
fix/TD-25074
2023-07-06 15:44:22 +08:00
Haojun Liao a94ace4cc8 refactor:do some internal refactor. 2023-07-06 15:10:45 +08:00
yihaoDeng 5e156aa0a9 add ver check 2023-07-06 06:43:07 +00:00
wangmm0220 47ae92af93 fix:conflicts from main 2023-07-06 13:40:04 +08:00
wangmm0220 11e6856d3e fix:init char array 2023-07-06 13:37:58 +08:00
kailixu c1393fb2e2 chore: invoke streamStateCommit for rsma 2023-07-06 13:26:25 +08:00
Haojun Liao 5a9461a69a other: merge 3.0 2023-07-06 11:52:21 +08:00
yihaoDeng 483f9ab896 add other 2023-07-06 03:39:28 +00:00
kailixu e8cdf132fb chore: rsma code refactor 2023-07-06 11:32:20 +08:00
Haojun Liao f4a3567935 other: merge 3.0 2023-07-06 11:24:30 +08:00
kailixu 61380b7822 chore: test case adaption 2023-07-06 11:09:44 +08:00
yihaoDeng a630d1284c add version check in rpc 2023-07-06 02:03:31 +00:00
Haojun Liao 851f6df094 enh(tsdb): opt perf. 2023-07-06 09:58:15 +08:00
wangmm0220 34a62c3f38 fix:vginfo assigment not in same time,we should get vginfo by vg,not all vg 2023-07-05 22:55:41 +08:00
kailixu 3f6768d8cf chore: rsma rocksdb adaption 2023-07-05 19:43:29 +08:00
Haojun Liao aeb9473382 enh(tsdb): add some logs. 2023-07-05 19:41:34 +08:00
yihaoDeng af053ec75b add version check in rpc 2023-07-05 11:15:12 +00:00
Haojun Liao a0a116b674 fix(tsdb): fix error in sma extracting and do NOT clear fileDelData when extracting data from stt files. 2023-07-05 19:11:14 +08:00
kailixu df7866e9f6 chore: refactor 2023-07-05 19:08:43 +08:00
kailixu 59e83fca5d chore: build fix 2023-07-05 18:33:09 +08:00
Benguang Zhao 9b477eed81 enh: terminate on failure to recover WAL from writing errors, or to commit vnode 2023-07-05 17:54:56 +08:00
Haojun Liao 74f5b3f80e
Merge pull request #21959 from taosdata/refact/fillhistory
refactor: do some internal refactor.
2023-07-05 17:47:00 +08:00
Shungang Li e6e52c3641 fix: ttlmgr convert in metaUpgrade 2023-07-05 17:44:17 +08:00
Haojun Liao 8f8dfc593b Merge remote-tracking branch 'origin/enh/tsdb_optimize' into enh/tsdb_optimize 2023-07-05 17:43:56 +08:00
Haojun Liao a738b6eba6 fix(tsdb): add empty del skyline check. 2023-07-05 17:43:41 +08:00
Hongze Cheng 21d972938f more fix 2023-07-05 17:43:15 +08:00
Haojun Liao f35db3ba6c fix(tsdb): add none check. 2023-07-05 17:36:55 +08:00
Haojun Liao f0cec22d4f fix(tsdb): fix some error. 2023-07-05 17:20:17 +08:00
kailixu d093b0e20f chore: merge 3.0 2023-07-05 16:45:12 +08:00
Haojun Liao 8c8aa5cd57 fix(tsdb): fix error in extract brinblock. 2023-07-05 16:39:04 +08:00
yihaoDeng 79f01ad655 add version check in rpc 2023-07-05 08:16:25 +00:00
wangmm0220 bdfeb32923 fix:bugs in tmq_get_topic_assignment 2023-07-05 16:04:34 +08:00
Haojun Liao 03dbcbf055 refactor: do some internal refactor. 2023-07-05 15:55:55 +08:00
Haojun Liao 7d7e12a5e7 fix(tsdb): fix syntax error. 2023-07-05 11:22:58 +08:00
Hongze Cheng 1304c08cdd Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-07-05 10:57:55 +08:00
Haojun Liao 9b3e34d589
Merge pull request #21735 from taosdata/refact/fillhistory
refactor: refactor the fill history operation
2023-07-05 10:48:51 +08:00
Haojun Liao 6e15478c43 fix(tsdb): do some internal refactor. 2023-07-05 10:31:38 +08:00
Haojun Liao 6fb1e716c0 Merge remote-tracking branch 'origin/enh/tsdb_optimize' into enh/tsdb_optimize 2023-07-05 10:31:09 +08:00
Haojun Liao 8ab10a8da1 fix(tsdb): fix error in check tomb record. #TD-25117 2023-07-05 10:30:55 +08:00
Hongze Cheng 23a743fd66 fix snapshot coredump 2023-07-05 10:01:00 +08:00
dapan1121 8554709b1f
Merge pull request #21946 from taosdata/fix/TD-25104
fix: fix show queries output wrongly displayed
2023-07-05 08:51:51 +08:00
Haojun Liao 37ff3a419a fix(tsdb): fix error in load tomb from stt files. 2023-07-04 23:35:52 +08:00
wade zhang bc8efd7014
Merge pull request #21949 from taosdata/FIX/TD-25103-3.0
enh: tfsRename in the reverse order of levels with tiered storages
2023-07-04 17:34:49 +08:00
Benguang Zhao 1ca4256927 enh: use var prefixLen instead in vnodeRenameVgroupId 2023-07-04 15:36:42 +08:00
Haojun Liao ff2bf35603 fix(stream): fix error in set the version range for secondary scan. 2023-07-04 15:08:39 +08:00
wade zhang 35a35ad4f9
Merge pull request #21930 from taosdata/fix/TD-24966
fix: coverity scan
2023-07-04 14:55:54 +08:00
Hongze Cheng acde8586e0 ignore file check 2023-07-04 14:16:09 +08:00
Hongze Cheng 2e88ad2c14 fix: upgrade bug 2023-07-04 14:00:44 +08:00
Ganlin Zhao e84ca5b838 fix: fix show queries output wrongly displayed 2023-07-04 13:53:09 +08:00
Haojun Liao 82342ebdc7
Merge pull request #21934 from taosdata/feature/TD-20678
feat:subscribe only meta info
2023-07-04 11:28:27 +08:00
wangmm0220 a641a07085 fix:[TD-25071] pSub is null & return wal not exist if no data 2023-07-04 11:13:03 +08:00
Shungang Li dbf47f5fc1 fix: ttl fill cache only in initialization 2023-07-03 21:30:53 -04:00
wangmm0220 dbcd33a402 fix:memory leak 2023-07-03 18:43:12 +08:00
Benguang Zhao ddaba463c0 enh: check failure of tfsMkdirRecurAt 2023-07-03 16:16:27 +08:00
Haojun Liao 200575647c
Merge branch '3.0' into refact/fillhistory 2023-07-03 15:16:18 +08:00
Haojun Liao 20d099dfa6
Merge pull request #21901 from taosdata/fix/liaohj
fix: fix coverity issue.
2023-07-03 15:15:21 +08:00
Hongze Cheng 8384b6ce29 fix CI case 2023-07-03 15:01:05 +08:00
dapan1121 a36dac2008
Merge pull request #21893 from taosdata/fix/TS-3551-M
enh: update of user auth version
2023-07-03 14:58:09 +08:00
Hongze Cheng 5390732f42 fix: coverity scan 2023-07-03 14:13:01 +08:00
liuyao bc5e709d31 set task status of ins_stream_tasks 2023-07-03 14:00:30 +08:00
Hongze Cheng 214c92264c Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-07-03 11:27:26 +08:00
liuyao 863da2ae05 set task status of ins_stream_tasks 2023-07-03 11:10:38 +08:00
wangmm0220 136bc379d1 feat:ignore delete info 2023-07-03 11:02:08 +08:00
wade zhang 1a069970c0
Merge pull request #21911 from taosdata/fix/TD-25052
fix/TD-25052
2023-07-03 09:37:01 +08:00
wade zhang e9022f24ee
Merge pull request #21904 from taosdata/fix/TS-3589
fix/TS-3589
2023-07-03 09:33:48 +08:00
Ganlin Zhao e1c62d17bc Merge branch '3.0' into fix/TD-25064 2023-07-03 09:08:53 +08:00
Haojun Liao 9e98c64b1e fix(tsdb): set correct stt load info. update the test case. 2023-06-30 22:57:49 +08:00
kailixu c16088fffa chore: remove obsolete code 2023-06-30 19:31:56 +08:00
kailixu c81ecb1771 chore: make jenkins happy 2023-06-30 19:22:14 +08:00
Haojun Liao 450a9f3ca1 Merge remote-tracking branch 'origin/enh/tsdb_optimize' into enh/tsdb_optimize 2023-06-30 18:22:35 +08:00
Haojun Liao c2a7c37b00 fix(tsdb): opt perf for reading data from stt files. 2023-06-30 18:22:20 +08:00
Ganlin Zhao e14a0e154f fix asan error 2023-06-30 17:37:06 +08:00
wade zhang 84c20463f3
Merge pull request #21907 from luckeverda/fix/ttlpresubmit
fix: ttl compatibility for main
2023-06-30 16:47:25 +08:00
wade zhang 617115ba85
Merge pull request #21906 from luckeverda/fix/ttlpresubmit
fix: ttl compatibility for 3.0
2023-06-30 16:45:58 +08:00
kailixu 067a8334fd chore: code optimization 2023-06-30 16:30:04 +08:00
Hongze Cheng 9fd453d78a more code 2023-06-30 16:13:48 +08:00
yihaoDeng 93391f73e5 vnode snapshot read 2023-06-30 07:46:56 +00:00
Hongze Cheng 2f57c8439b more fix 2023-06-30 15:04:18 +08:00
Hongze Cheng e79fe91ba0 more code 2023-06-30 14:57:57 +08:00
Shungang Li 8f164a7922 fix: ttl compatibility 2023-06-30 14:57:34 +08:00
kailixu 387d611179 chore: passVer and authVer refact 2023-06-30 14:52:20 +08:00
Hongze Cheng c714138e9e fix snapshot problem 2023-06-30 14:37:26 +08:00
Hongze Cheng 55840709ed skip dropped table tomb data commit 2023-06-30 13:54:49 +08:00
dmchen 99192b2998 fix/TD-25052 2023-06-30 12:38:52 +08:00
wangmm0220 58c7011e0e feat:support only meta in tmq subscriptions 2023-06-30 11:42:40 +08:00
yihaoDeng e25df41536 vnode snapshot read 2023-06-30 03:11:55 +00:00
Haojun Liao ee5e3b7cc0 fix(tsdb): fix error in tsdb2 2023-06-30 00:38:53 +08:00
Haojun Liao 9740d1353c fix(tsdb): opt perf for read data in stt files. 2023-06-29 23:16:07 +08:00
Haojun Liao 15487c9c8f fix(tsdb): fix memory leak. 2023-06-29 22:52:07 +08:00
yihaoDeng 60a0b1e1bd vnode snapshot read 2023-06-29 11:52:34 +00:00
Haojun Liao 17c6b9f81b fix(tsdb): fix error in set file reader. 2023-06-29 18:40:14 +08:00
dmchen 1b68bfb473 fix/TS-3589 2023-06-29 18:14:35 +08:00
Hongze Cheng eee8007736 fix bug 2023-06-29 17:48:36 +08:00
yihaoDeng 9eb6d8cf1e vnode snapshot read 2023-06-29 09:35:09 +00:00
yihaoDeng b377fcffad fix:show subscriptions error 2023-06-29 16:04:02 +08:00
Haojun Liao 622e1cb608 fix: fix coverity issue. 2023-06-29 15:54:09 +08:00
Haojun Liao 63834713b2 Merge remote-tracking branch 'origin/enh/tsdb_optimize' into enh/tsdb_optimize 2023-06-29 15:09:14 +08:00
Haojun Liao 81eb8523f1 fix(tsdb): fix invalid ptr. 2023-06-29 15:09:01 +08:00
Hongze Cheng 1e5fef9dbe fix retention CI cases 2023-06-29 15:01:54 +08:00
yihaoDeng 5cebd36c1c add checkpoint 2023-06-29 06:56:14 +00:00
yihaoDeng 0b3fbfd87f fix:compile error 2023-06-29 14:40:32 +08:00
dapan1121 c8435de64a
Merge branch '3.0' into fix/m23.0 2023-06-29 14:03:56 +08:00
Hongze Cheng 1556dedb85 fix file remove by edit 2023-06-29 14:03:01 +08:00
dapan1121 5ee1fbee7e fix: code merge issue 2023-06-29 14:01:19 +08:00
dapan1121 bb1e24dda4 Merge remote-tracking branch 'origin/main' into fix/m23.0 2023-06-29 13:59:56 +08:00
dapan1121 edf5b8c936 fix: code merge issue 2023-06-29 13:59:39 +08:00
Haojun Liao ba38a625cf fix(stream): remove the shared ptr between reader ptr. 2023-06-29 13:42:23 +08:00
wangmm0220 b264640ca1 fix:error in limit for tmq group 2023-06-29 11:15:53 +08:00
dapan1121 3519e9170e Merge remote-tracking branch 'origin/main' into 3.0 2023-06-29 11:13:45 +08:00
wangmm0220 4c39629d3c Merge branch 'main' of https://github.com/taosdata/TDengine into mark/tmq 2023-06-29 10:48:41 +08:00
wangmm0220 64d8d63f3d fix:error in limit for tmq group 2023-06-29 10:47:55 +08:00
Haojun Liao c4a6b85bdf fix(tsdb): support stt and file block overlap. 2023-06-28 22:38:51 +08:00
kailixu 1e9b85545b chore: more code 2023-06-28 20:57:05 +08:00
kailixu aefebfca7f enh: update of user auth version 2023-06-28 20:49:29 +08:00
yihaoDeng 3d532a54a8 add checkpoint 2023-06-28 12:22:27 +00:00
yihaoDeng 0bf6675f39 add checkpoint 2023-06-28 09:58:29 +00:00
yihaoDeng 6b6e237079 add checkpoint 2023-06-28 09:57:08 +00:00
Haojun Liao d0542f99e2
Merge pull request #21744 from taosdata/mark/tmq
opti:tmq logic
2023-06-28 17:23:56 +08:00
liuyao 2fc5eeb810 session win range 2023-06-28 17:20:08 +08:00
Hongze Cheng 9be13427f6 fix tomb record loss bug 2023-06-28 17:01:08 +08:00
wangmm0220 4ead47bcbd fix:add rows to pSub if rebalance 2023-06-28 16:43:30 +08:00
wangmm0220 865a3b2509 fix:add rows to pSub if rebalance 2023-06-28 16:37:57 +08:00
dapan1121 27a201441a
Merge pull request #21821 from taosdata/fix/ts-3572
fix: udfd can not connect to taosd since authentification failure
2023-06-28 16:31:59 +08:00
wangmm0220 ce0b71c634 fix:add rows to pSub if rebalance 2023-06-28 15:57:30 +08:00
yihaoDeng 871f66565d add checkpoint 2023-06-28 07:02:20 +00:00
wangmm0220 4a17f4b9f5 fix:add rows to pSub if rebalance 2023-06-28 14:57:31 +08:00
Haojun Liao 8867a57262 fix(stream): fix syntax error. 2023-06-28 14:48:59 +08:00
slzhou fc3fe9dff8 fix: remove connect to mnode 2023-06-28 13:49:13 +08:00
Haojun Liao 57fcd553f8 refactor: do some internal refactor. 2023-06-28 13:13:13 +08:00
wangmm0220 1fc664693e fix:continue consume if wal is dropped 2023-06-28 11:54:48 +08:00
yihaoDeng f6d5d0c8ca add checkpoint 2023-06-28 02:39:01 +00:00
wangmm0220 fb82b61d2f fix:pSub is null 2023-06-28 10:35:38 +08:00
wangmm0220 d34dc1242f fix:memory leak 2023-06-28 09:41:20 +08:00
Haojun Liao 3710ea4aca refactor: do some internal refactor. 2023-06-28 09:41:08 +08:00
Hongze Cheng c3a34f5012 Merge branch 'enh/tsdb_optimize' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-06-28 09:16:48 +08:00
Hongze Cheng b13010c490 fix retention infinit loop 2023-06-28 09:16:43 +08:00
Haojun Liao 9116a4092a fix(tsdb):fix memory leak. 2023-06-28 01:04:58 +08:00
Haojun Liao 15c55508ac fix(stream): fix error in read tombblock in stt files. 2023-06-27 23:37:11 +08:00
Haojun Liao a19e63fd23 fix(stream): fix error in handling fill history. 2023-06-27 23:00:14 +08:00
yihaoDeng 9adccf5715 add checkpoint 2023-06-27 14:31:50 +00:00
yihaoDeng 977d6b7803 add checkpoint 2023-06-27 12:52:27 +00:00
yihaoDeng 74764108fd add checkpoint 2023-06-27 12:46:08 +00:00
yihaoDeng f2b96fb4b3 add checkpoint 2023-06-27 12:28:28 +00:00
yihaoDeng 9d69b284db add checkpoint 2023-06-27 12:03:29 +00:00
wangmm0220 18b7042a45 Merge branch 'mark/tmq' of https://github.com/taosdata/TDengine into mark/tmq 2023-06-27 18:35:39 +08:00
wangmm0220 7d15958509 Merge branch 'main' of https://github.com/taosdata/TDengine into mark/tmq 2023-06-27 18:18:27 +08:00
Yihao Deng 4de7db06f9
Merge branch '3.0' into enh/triggerCheckPoint2 2023-06-27 17:57:14 +08:00
yihaoDeng 0a0410cd09 add checkpoint 2023-06-27 09:56:14 +00:00
wangmm0220 7e38ef7091 fix:add limit for topic and group num 2023-06-27 17:44:51 +08:00
wangmm0220 4b95ea9cad fix:clear consumer if normal close 2023-06-27 17:11:20 +08:00
Haojun Liao 4bb78df27c fix(stream): reduce the sleep time. 2023-06-27 16:44:35 +08:00
Haojun Liao 32fddeff18 fix(stream): fix error retrieve data from source task.And optimize the test cases. 2023-06-27 16:24:47 +08:00
yihaoDeng a824db4fd5 add checkpoint 2023-06-27 07:46:30 +00:00
Hongze Cheng d23902877e make it compile on win 2023-06-27 14:33:55 +08:00
Haojun Liao 1ad05a06d6
Merge branch '3.0' into enh/tsdb_optimize 2023-06-27 11:46:37 +08:00
Haojun Liao 3289ad62be other: merge 3.0 2023-06-27 11:33:40 +08:00
Haojun Liao 1073b5e4c2 fix(tsdb): support to read multi-level of stt files. 2023-06-27 11:15:53 +08:00
wade zhang d7e9eda6bc
Merge pull request #21844 from taosdata/FIX/TD-24924-3.0
enh:  change trans conflict scope of create topic
2023-06-27 10:47:53 +08:00
liuyao 71f4226e15 fix coverity san issues 2023-06-27 10:39:38 +08:00
Haojun Liao b73444b291 fix(stream): start stream task in case of scan history completing. 2023-06-27 09:44:51 +08:00
Hongze Cheng 3edee3fe9f fix memory leak 2023-06-26 22:04:29 +08:00
Benguang Zhao 69d451db26 enh: check trans conflict in mndCreateTopic ahead of time 2023-06-26 19:49:47 +08:00
Benguang Zhao 9e2062f54a fix: resolve memory leak on exceptions in mndCreateTopic 2023-06-26 19:49:47 +08:00
Haojun Liao 437eb93a4d fix(stream): fix error while fill history exists. 2023-06-26 18:44:59 +08:00
dapan1121 4dae9f4eff merge main to 3.0 2023-06-26 18:43:00 +08:00
Benguang Zhao 14e2e1e574 fix: change conflict scope of create topic to be DB inside 2023-06-26 18:23:19 +08:00
wangmm0220 0ae6cd7a89 fix:memory leak 2023-06-26 17:27:13 +08:00
Haojun Liao 01c0bbb3f8
Merge pull request #21827 from taosdata/feature/TS-3495
fear:fix error for report offset & rows in tmq
2023-06-26 16:54:42 +08:00
Hongze Cheng 3172306f65 more fix 2023-06-26 16:38:26 +08:00
Hongze Cheng 5a0218d1ca fix memory leak 2023-06-26 16:34:58 +08:00
Hongze Cheng 58ce6a3f26 fix vnode close 2023-06-26 16:28:33 +08:00
Haojun Liao 6a29bce44e Merge remote-tracking branch 'origin/enh/tsdb_optimize' into enh/tsdb_optimize 2023-06-26 15:56:11 +08:00
Haojun Liao 9f664cbf14 fix(tsdb): fix error in extracting block distribution. 2023-06-26 15:54:44 +08:00
Hongze Cheng 5ad9bd938f change default stt trigger as 2 2023-06-26 15:47:36 +08:00
Haojun Liao daafe240ed fix(stream): fix memory leak. 2023-06-26 14:18:47 +08:00
Hongze Cheng e79683a684 fix more 2023-06-26 13:57:18 +08:00
Benguang Zhao e8649670aa enh: not allow to split vgroup when streams or topics exist 2023-06-26 11:57:24 +08:00
wangmm0220 7c9168f4b4 Merge branch 'mark/tmq' of https://github.com/taosdata/TDengine into mark/tmq 2023-06-26 11:42:52 +08:00
Minglei Jin 020678391c fix(tsdb/cache): refine del locks 2023-06-26 11:19:31 +08:00
Hongze Cheng 27e17048ac fix: retention coredump 2023-06-26 09:06:59 +08:00
Minglei Jin 5eb57f2e6e enh(tsdb/cache): writebatch with rcache locked 2023-06-26 08:41:14 +08:00
shenglian zhou 2f9c8417b6 fix: use appname to see whether it is udfd 2023-06-26 07:53:00 +08:00
yihaoDeng 04ab8e19d0 Merge branch 'enh/dev30' into enh/triggerCheckPoint2 2023-06-25 19:58:45 +08:00
Haojun Liao 402c091df0 fix(stream): fix sma error. 2023-06-25 19:41:44 +08:00
Haojun Liao 9d8f6f37fe Merge remote-tracking branch 'origin/refact/fillhistory' into refact/fillhistory 2023-06-25 19:30:34 +08:00
Haojun Liao 000325f716 fix(stream): fix memory leak. 2023-06-25 19:30:21 +08:00
Hongze Cheng b881b87218 more code 2023-06-25 18:02:31 +08:00
liuyao e236bf818c set fill history info 2023-06-25 17:47:10 +08:00
Hongze Cheng cc0727aee3 more code 2023-06-25 17:13:12 +08:00
Hongze Cheng 014bfc4ad4 more code 2023-06-25 16:27:14 +08:00
Hongze Cheng 5b1492cb4b refact code 2023-06-25 15:09:15 +08:00
wangmm0220 7a49d67078 Merge branch '3.0' of https://github.com/taosdata/TDengine into feature/TS-3495 2023-06-25 14:54:16 +08:00
Haojun Liao 7e7feeffdf fix: fix memory leak. 2023-06-25 14:38:31 +08:00
shenglian zhou fd754eaa08 fix: udfd can not connect to taosd since authentification failure 2023-06-25 11:31:33 +08:00
liuyao c950c7379d Merge branch 'refact/fillhistory' of https://github.com/taosdata/TDengine into refact/fillhistory 2023-06-25 10:58:43 +08:00
liuyao e9d3198e05 mem leak 2023-06-25 10:57:10 +08:00
Haojun Liao 6ac179501a fix: fix syntax error. 2023-06-25 10:46:21 +08:00
Haojun Liao 6857881742 Merge branch '3.0' into refact/fillhistory 2023-06-25 10:41:32 +08:00
Hongze Cheng c161943fe0 fix snapshot problem 2023-06-25 10:01:30 +08:00
Hongze Cheng 3582046129 fix coredump 2023-06-25 09:45:58 +08:00
Haojun Liao 3099ec31cb fix(tsdb): fix syntax error. 2023-06-25 09:36:43 +08:00
Haojun Liao dad1854cbb other: merge 3.0 2023-06-25 09:33:37 +08:00
Haojun Liao 7c23630fe4 fix(stream): set correct stream error code. 2023-06-25 09:26:37 +08:00
wade zhang 254a20bdf3
Merge pull request #21660 from luckeverda/feat/TD-23739
feat/TD-23739: enhance ttl, deletetime modified by writing-op
2023-06-25 09:06:57 +08:00
Haojun Liao a8de3694fa Merge branch 'refact/fillhistory' of github.com:taosdata/tdengine into refact/fillhistory 2023-06-24 18:55:03 +08:00
Haojun Liao ceb78fdad2
Merge branch '3.0' into refact/fillhistory 2023-06-24 18:53:48 +08:00
Haojun Liao 4a7698d4ab fix(tsdb): add null ptr check. 2023-06-24 00:41:05 +08:00
Haojun Liao 4ce1614045 fix(tsdb): fix error in retrieve sma. 2023-06-24 00:33:47 +08:00
Haojun Liao 5cac7c7a02 fix(tsdb): fix error in query super table. 2023-06-23 02:06:50 +08:00
yihaoDeng c36d14df77 add compile opt 2023-06-22 13:19:14 +08:00
Hongze Cheng a5049b4861 fix bug 2023-06-21 20:26:52 +08:00
Haojun Liao 0c2273daf2 fix(tsdb): fix memory leak. 2023-06-21 19:38:25 +08:00
Haojun Liao 3ca3dc54ae Merge branch 'enh/tsdb_optimize' of github.com:taosdata/tdengine into enh/tsdb_optimize 2023-06-21 19:22:58 +08:00
Haojun Liao cf02ac7229 fix(tsdb): extract tomb data in stt files. 2023-06-21 18:57:14 +08:00
Haojun Liao 92249d892a
Merge pull request #21717 from taosdata/enh/staticLibMain
Enh/static lib main
2023-06-21 17:46:30 +08:00
Hongze Cheng feda122fdc more code 2023-06-21 17:29:41 +08:00
Haojun Liao f49f96049e Merge branch 'enh/tsdb_optimize' of github.com:taosdata/tdengine into enh/tsdb_optimize 2023-06-21 16:56:11 +08:00
Hongze Cheng 32a256bfee fix commit bug 2023-06-21 16:55:31 +08:00
Haojun Liao e76ae4ffc5 fix(tsdb) : fix memory leak. 2023-06-21 16:53:47 +08:00
Hongze Cheng 1160f53062 more code 2023-06-21 16:35:06 +08:00
Haojun Liao 84bd2fb7a1 Merge branch 'enh/tsdb_optimize' of github.com:taosdata/tdengine into enh/tsdb_optimize 2023-06-21 16:15:04 +08:00
Hongze Cheng 5e9d263e19 fix: infinite loop 2023-06-21 15:08:16 +08:00
Hongze Cheng 0e97340e50 more code 2023-06-21 14:53:36 +08:00
Haojun Liao 6261359efe fix(tsdb): reset the stt reader for new files. 2023-06-21 14:46:35 +08:00
yihaoDeng ff3ad6c65f add static lib to 3.0 2023-06-21 14:38:52 +08:00
Hongze Cheng 4a1010cdec more 2023-06-21 13:39:29 +08:00
wade zhang e95b430e89
Merge pull request #21786 from taosdata/FIX/TD-24817-3.0
enh: make alter-hashrange atomic and idempotent
2023-06-21 13:29:04 +08:00
Haojun Liao ea7b8e91d3 fix(stream): fix memory leak. 2023-06-21 12:03:26 +08:00
Haojun Liao f6e3ad27f0 fix(tsdb): fix memory leak. 2023-06-21 11:38:35 +08:00
Haojun Liao a92d16a508 fix(tsdb): adjust invalid assert. 2023-06-21 00:12:08 +08:00
Hongze Cheng 413d00db9e fix memory leak 2023-06-20 20:10:57 +08:00
yihaoDeng daa3b5238f add static lib 2023-06-20 19:29:43 +08:00
Haojun Liao f8437789f9 Merge remote-tracking branch 'origin/enh/tsdb_optimize' into enh/tsdb_optimize 2023-06-20 18:38:59 +08:00
Haojun Liao a16dce1873 fix(tsdb): set correct callback fp. 2023-06-20 18:38:45 +08:00
Hongze Cheng a3f784a5bc more code 2023-06-20 18:25:24 +08:00
Hongze Cheng ccc8faf3ee Merge branch 'enh/tsdb_optimize' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-06-20 18:24:02 +08:00
Hongze Cheng 8855659534 more code 2023-06-20 18:23:58 +08:00
liuyao 74bea44300 stream op transform 2023-06-20 17:30:59 +08:00
Haojun Liao 2d4eed4234 other: merge other branch. 2023-06-20 17:12:31 +08:00
Hongze Cheng fbc4cc9053 fix commit issue 2023-06-20 16:48:54 +08:00
Haojun Liao 7627035629 fix(tsdb): set the hasVal initial value. 2023-06-20 15:58:22 +08:00
Benguang Zhao 424086e324 enh: restore vgroup id in vmOpenVnodes for vnodeAlterHashRange 2023-06-20 15:40:09 +08:00
Haojun Liao a87c3cfd24 fix(tsdb):check null ptr. 2023-06-20 15:39:53 +08:00
liuyao aafbdcb492 set task status 2023-06-20 15:20:04 +08:00
Haojun Liao a1f2ce389b fix(tsdb): fix memory leak. 2023-06-20 14:46:32 +08:00
Hongze Cheng 09f2858927 fix some coredump 2023-06-20 14:34:52 +08:00