xxq250
/
homework-jianmu
1
0
Fork 0
Code Issues Pull Requests 1 Actions Packages Projects Releases Wiki Activity
57,206 Commits 3 Branches 0 Tags 479 MiB
Commit Graph

11715 Commits

Author SHA1 Message Date
wade zhang 54e1f69db4
Merge pull request #22481 from taosdata/fix/TD-25822 
enh(tsdb/write): timestamp out of range with s3's last tier storage
 2023-08-21 09:33:06 +08:00
yihaoDeng 6fe649c458 Merge branch 'enh/3.0' into enh/triggerCheckPoint2 2023-08-21 09:12:40 +08:00
Haojun Liao b8101afbe2 fix(stream): refactor the tasks restart mechanism. 2023-08-18 22:36:38 +08:00
Benguang Zhao f30d1ebacd enh: refactor func name as mndTransAppendPrepareLog 2023-08-18 18:35:44 +08:00
Benguang Zhao 9f1c8cc7b8 enh: unify validation of prepare actions with cb validateFp 2023-08-18 18:21:30 +08:00
Minglei Jin c4a3a5da35 vnode: fix write to s3 last tier 2023-08-18 18:02:53 +08:00
wade zhang a7e11c2520
Merge pull request #22482 from taosdata/fix/TD-25818 
fix(vnode/destroy): delete objects
 2023-08-18 17:49:22 +08:00
Benguang Zhao e7411183d9 enh: create SDB_DB entry in prepareAction 2023-08-18 17:08:24 +08:00
Haojun Liao 41fe441dad fix(stream): update the conflict scope. 2023-08-18 17:00:35 +08:00
wade zhang 87a8fe34ef
Merge pull request #22480 from taosdata/fix/TD-25819 
fix(tsdb/reader): use ENOENT for not found objects
 2023-08-18 16:49:54 +08:00
Minglei Jin 7b4bb72392 fix(vnode/destroy): delete objects 2023-08-18 16:38:26 +08:00
Minglei Jin 0242d4ce33 enh(tsdb/write): timestamp out of range with s3's last tier storage 2023-08-18 16:07:15 +08:00
Haojun Liao c26d625152
Merge branch '3.0' into enh/triggerCheckPoint2 2023-08-18 15:51:07 +08:00
Minglei Jin 73ae493fa7 tsdb/reader: use ENOENT for not found objects 2023-08-18 15:43:08 +08:00
liuyao 9afd5155ed Merge branch 'enh/triggerCheckPoint2' of https://github.com/taosdata/TDengine into enh/triggerCheckPoint2 2023-08-18 15:33:37 +08:00
liuyao 87c65f3b68 Merge remote-tracking branch 'origin/3.0' into enh/triggerCheckPoint2 2023-08-18 15:27:02 +08:00
dapan1121 9b953707b8 Merge remote-tracking branch 'origin/main' into fix/mainto3.0 2023-08-18 14:42:43 +08:00
Benguang Zhao f01a26f68a enh: refactor func names of new Vg prepare actions 2023-08-18 14:26:58 +08:00
Haojun Liao edbad45772 other: add logs. 2023-08-18 13:45:08 +08:00
dm chen e393a98ee9
Merge branch '3.0' into feat/TD-22970 2023-08-18 13:37:18 +08:00
Haojun Liao f68650fef9 other: add logs. 2023-08-18 10:53:58 +08:00
Haojun Liao a8b53c2e69 other: add logs. 2023-08-18 10:51:59 +08:00
Haojun Liao 633ecf66e5 other: add logs. 2023-08-18 10:39:32 +08:00
Haojun Liao 9ad8cf48dc other: add logs. 2023-08-18 10:38:24 +08:00
Haojun Liao 2a9668da67 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 
# Conflicts:
#	source/dnode/mnode/impl/src/mndStream.c
 2023-08-18 10:30:30 +08:00
Haojun Liao 87785b1d9c refactor: add some logs. 2023-08-18 10:30:00 +08:00
wangjiaming0909 4dcdb549c9 fix: get systable cols error 2023-08-18 10:19:12 +08:00
Haojun Liao fbf80fb4c3
Merge pull request #22459 from taosdata/mark/tmq 
fix:set terrno = 0 to avoid affect next fetch msg
 2023-08-18 09:11:35 +08:00
slzhou 4e2a26e8be Merge branch '3.0' of github.com:taosdata/TDengine into szhou/select-tags-scan 2023-08-18 08:46:17 +08:00
yihaoDeng 80f6d092a1 add trace log 2023-08-18 08:43:37 +08:00
yihaoDeng ebd4cac36b Merge branch 'enh/triggerCheckPoint2' of https://github.com/taosdata/TDengine into enh/triggerCheckPoint2 2023-08-17 18:58:18 +08:00
yihaoDeng 46574c385f fix mem leak 2023-08-17 18:52:33 +08:00
Haojun Liao a18989df88 fix(stream): add lost codes caused by merge 3.0. 2023-08-17 18:51:39 +08:00
Hongze Cheng 8582e0c71a fix: important fix for compact file corruption 2023-08-17 18:13:37 +08:00
dmchen 5f138941f8 tsdb snap core 2023-08-17 17:58:35 +08:00
slzhou 85d1dbe00a Merge branch '3.0' of github.com:taosdata/TDengine into szhou/select-tags-scan 2023-08-17 16:27:37 +08:00
Benguang Zhao 7735e6f388 Merge branch 3.0 to FEAT/TD-25699-3.0 2023-08-17 16:04:23 +08:00
shenglian zhou 4a9391929c fix: select tags - ctb cursor pause/unlock and lock/resume 2023-08-17 14:59:17 +08:00
dapan1121 0e10e94a40
Merge pull request #22453 from taosdata/feat/TD-25685 
feat: support column comment
 2023-08-17 14:23:54 +08:00
Benguang Zhao 9b089d6446 enh: wrap state updating of vnodes and mnodes in mndProcessStatusReq 2023-08-17 11:59:53 +08:00
dmchen 4448e7d159 revert drop vnode 2023-08-17 11:57:17 +08:00
kailixu 49efb4ae72 fix: modify column length for super table 2023-08-17 11:43:07 +08:00
wangjiaming0909 16754b5ac1 feat: show create table, desc table with col comments 2023-08-17 11:39:34 +08:00
liuyao 5ce7688a93 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/ly_refactor 2023-08-17 09:06:46 +08:00
wade zhang e493a30a0b
Merge pull request #22460 from taosdata/fix/tsdb_snapshot_bug 
fix: tsdb snapshot bug
 2023-08-17 08:25:32 +08:00
Haojun Liao 6746339609 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 
# Conflicts:
#	source/libs/stream/src/streamSnapshot.c
 2023-08-17 00:08:44 +08:00
Haojun Liao ea6574b3c7 other: merge 3.0 2023-08-17 00:07:55 +08:00
Haojun Liao f8f8e7a8f0
Merge pull request #22465 from taosdata/fix/3_liaohj 
fix(stream): add the back pressure for sink node.
 2023-08-16 22:59:36 +08:00
Benguang Zhao a94b8aeea6 feat: update vnodesSchema and mndRetrieveVnodes for show vnodes 2023-08-16 20:17:11 +08:00
yihaoDeng 114df7c349 fix transfer error 2023-08-16 11:37:15 +00:00
wangmm0220 b3f945c4c5 fix:conflict 2023-08-16 19:35:05 +08:00
Haojun Liao 80506b564b
Merge pull request #22461 from taosdata/fix/liaohj 
refactor: do some internal refactcor
 2023-08-16 19:26:39 +08:00
Haojun Liao 9a76ae72d6 fix(stream): add the back pressure for sink node. 2023-08-16 19:11:43 +08:00
dmchen d85d698074 drop vnode 2023-08-16 18:48:12 +08:00
Hongze Cheng 32c5b6a947 fix: tsdb snapshot bug 2023-08-16 18:21:02 +08:00
Haojun Liao cbd24bb254 refactor: do some internal refactor 2023-08-16 18:20:34 +08:00
dmchen fee4b875d1 error code 2023-08-16 17:49:17 +08:00
wangmm0220 5c5721571f fix:set terrno = 0 to avoid affect next fetch msg 2023-08-16 17:45:18 +08:00
Hongze Cheng cedc7bf1b6 fix: memory leak when commit 2023-08-16 17:21:51 +08:00
yihaoDeng ab7e2b3122 Merge branch 'enh/chkpTransfer' into enh/triggerCheckPoint2 2023-08-16 09:00:30 +00:00
dm chen e020c4e8c5
Merge pull request #22456 from taosdata/3.0 
merge 3.0 to feat/TD-22970
 2023-08-16 16:49:43 +08:00
Haojun Liao f1359076c1
Merge pull request #22450 from taosdata/fix/3_liaohj 
other: merge main.
 2023-08-16 16:48:33 +08:00
Haojun Liao d63758a1c5 fix(stream): fix error in execute task on a tranferred node. 2023-08-16 15:24:24 +08:00
yihaoDeng 993ae84398 close backend 2023-08-16 07:17:15 +00:00
dapan1121 39ae880597
Merge pull request #22445 from taosdata/enh/TD-25708-3.0 
enh: disable stream/udf on windows
 2023-08-16 13:20:01 +08:00
Haojun Liao 4ea58e5682 refactor: do some internal refactor. 2023-08-16 11:44:05 +08:00
Haojun Liao 6609882f9f fix(tsdb): add stt statistics block buffer, and do some internal refactor. 2023-08-16 10:55:07 +08:00
dmchen de5aedd8f3 vnode.json 2023-08-16 10:20:48 +08:00
liuyao 919ffbaf72 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/ly_refactor 2023-08-16 10:04:07 +08:00
Benguang Zhao 33cb9dce78 enh: set roleTimeMs default as statusReq.rebootTime for both of vnodes and mnodes 2023-08-16 09:57:26 +08:00
kailixu 777ece27ae chore: code format 2023-08-16 09:56:25 +08:00
kailixu b54d6e2982 chore: set default value of tsStartUdfd false on windows 2023-08-16 09:55:30 +08:00
Haojun Liao 63bc50a723
Merge pull request #22427 from taosdata/feature/rebuildIndex0 
rebuild index at tag0
 2023-08-16 09:47:43 +08:00
liuyao fc09f8ef1e Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/ly_refactor 2023-08-16 09:36:28 +08:00
Haojun Liao ad9f3cbc43 other: merge main. 2023-08-16 09:14:10 +08:00
Haojun Liao 7628be236d other: merge main. 2023-08-16 09:03:54 +08:00
dapan1121 df13c6fa3e
Merge pull request #22410 from taosdata/szhou/tag-scan-opt 
enhance: tag scan optimization
 2023-08-16 08:58:17 +08:00
wade zhang 1a1a12b7b8
Merge pull request #22327 from taosdata/fix/TD-25010-3 
feat(tsdb/cos): s3 migration
 2023-08-16 08:02:20 +08:00
Benguang Zhao 94e0d97aa2 enh: update pDb stateTs on stateChanged 2023-08-15 19:48:15 +08:00
Benguang Zhao dbdfee4c41 enh: update SVnodeGid of vnode info in mndProcessStatusReq 2023-08-15 19:25:08 +08:00
slzhou 4fdaaba3ce Merge branch '3.0' of github.com:taosdata/TDengine into szhou/tag-scan-opt 2023-08-15 17:18:25 +08:00
dmchen 18ef0f7d82 vgroup version 2023-08-15 17:13:58 +08:00
Benguang Zhao 239a79d405 enh: add some vnode info in SStatusReq 2023-08-15 17:06:33 +08:00
kailixu ccce04ceb9 enh: disable udf on windows 2023-08-15 17:01:45 +08:00
Minglei Jin 1792bf306e vnode: fix cos cache evicting 2023-08-15 16:54:26 +08:00
wangjiaming0909 dcbef83dea feat: support column comment 2023-08-15 16:30:02 +08:00
kailixu 242bf77f4c chore: code optimization 2023-08-15 16:13:51 +08:00
kailixu 8a84dce641 enh: disable udf/stream/rsma/tsma for windows 2023-08-15 16:04:30 +08:00
Haojun Liao 39079ab64a fix(stream): load term from sync model to decide if the node is restart or not 2023-08-15 15:52:06 +08:00
Minglei Jin c4e5cfd2fb retention: return code from copy 2023-08-15 15:40:40 +08:00
yihaoDeng 0f0d0953cd rebuild index at tag0 2023-08-15 07:26:53 +00:00
Minglei Jin bd758e0269 retention: remove old files last 2023-08-15 15:14:34 +08:00
Minglei Jin 8639c22cc0 vnode, common: USE_COS def 2023-08-15 14:53:58 +08:00
dmchen f0090cf799 vgroup version 2023-08-15 14:46:54 +08:00
kailixu 27db6cfd67 enh: disable udf/stream for mnd on windows 2023-08-15 14:25:31 +08:00
liuyao 1b4e51ee4a Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/ly_refactor 2023-08-15 14:20:49 +08:00
wangmm0220 7441801e9d feat:support varbinary type 2023-08-15 13:57:05 +08:00
kailixu f7a5bef17d enh: disable stream/udf on windows 2023-08-15 13:02:32 +08:00
yihaoDeng 9ec64b9201 rebuild index at tag0 2023-08-15 02:01:13 +00:00
Haojun Liao b1d35f43ba enh(stream): using term from sync module to denote the upstream node is restarted/replica-modified/vnode-transferred or not. 2023-08-15 09:25:05 +08:00
Haojun Liao ff17763ed6
Merge pull request #22417 from taosdata/mark/tmq 
opti:wal logic
 2023-08-15 09:16:29 +08:00
dapan1121 f9f74eaaf4
Merge pull request #22406 from taosdata/fix/TD-24684 
fix: remove ins_modules table
 2023-08-15 08:42:08 +08:00
yihaoDeng ef7f762c62 rebuild index at tag0 2023-08-15 00:41:48 +00:00
yihaoDeng 1447d1d55c rebuild index at tag0 2023-08-15 00:40:12 +00:00
Haojun Liao 9e3733a02c
Merge pull request #22358 from taosdata/feat/TD-24559 
feat:[TD-24559]support geomety type in schemaless
 2023-08-14 22:06:41 +08:00
yihaoDeng 3067417ea3 rebuild index at tag0 2023-08-14 12:01:17 +00:00
yihaoDeng a48d137d32 rebuild index at tag0 2023-08-14 11:56:47 +00:00
yihaoDeng 1d33a8d4c0 rebuild index at tag0 2023-08-14 10:06:33 +00:00
liuyao 9d1e5a512d add stream task id 2023-08-14 17:52:39 +08:00
Haojun Liao 2e6263b43f fix(stream): fix memory leak. 2023-08-14 17:16:11 +08:00
yihaoDeng cf9f9ab471 rebuild index at tag0 2023-08-14 08:01:20 +00:00
dmchen 8fd6b122d3 mnode ver 2023-08-14 15:26:59 +08:00
Haojun Liao a1e554fbf3 refactor: exec directly not asynchnoized. 2023-08-14 15:05:13 +08:00
Minglei Jin 989abc2bf6 vnode/cos: move includes into USE_COS 2023-08-14 15:03:17 +08:00
Haojun Liao 91710b0c0f fix(stream): 2023-08-14 14:56:17 +08:00
Minglei Jin c97b9249fc cos: only for linux 2023-08-14 14:38:28 +08:00
slzhou 692d436d68 fix: fix ci error 2023-08-14 14:14:16 +08:00
Haojun Liao 5ec6b64aab fix(stream): add logs. 2023-08-14 13:12:41 +08:00
Haojun Liao ead04964fd Merge branch 'main' into fix/liaohj 2023-08-14 12:11:15 +08:00
dapan1121 c2417eb5cd
Merge pull request #22404 from taosdata/fix/TD-25621-3.0 
fix: dup read lock on windows
 2023-08-14 11:37:05 +08:00
Haojun Liao 2806fe1c56 fix(stream): ignore the related stream task destory msg in transfer state. 2023-08-14 10:58:24 +08:00
Haojun Liao 1f792f09c4 fix(stream): remove invalid code. 2023-08-14 10:39:47 +08:00
slzhou 646e52ae7f Merge branch '3.0' of github.com:taosdata/TDengine into szhou/tag-scan-opt 2023-08-14 10:19:36 +08:00
yihaoDeng 246efd83c6 refactor chpt transfer 2023-08-14 02:03:41 +00:00
wangmm0220 dd0bc0e050 fix:heap use after free 2023-08-14 09:42:55 +08:00
wade zhang 1b51f53c15
Merge pull request #22407 from taosdata/fix/TD-25671 
fix: infinite tomb data sync loop
 2023-08-14 09:25:47 +08:00
shenglian zhou 46f92d222d fix: typo error 2023-08-14 08:52:25 +08:00
shenglian zhou db25f6c01b Merge branch 'szhou/tsdb-neigh-block' of github.com:taosdata/TDengine into szhou/tsdb-neigh-block 2023-08-14 08:49:25 +08:00
shenglian zhou c5a6cac34f fix: fix compilation error 2023-08-14 08:49:10 +08:00
Haojun Liao 01ac99a651
Merge pull request #22413 from taosdata/fix/liaohj 
refactor: refactor the transfer state procedure.
 2023-08-13 23:28:18 +08:00
Haojun Liao 98f40325e9 fix(stream): fix memory leak. 2023-08-13 20:02:15 +08:00
slzhou 8e7fc91095 enhance: set file data block iter 2023-08-13 18:30:30 +08:00
Haojun Liao 0d38f389ab refactor: do some internal refactor. 2023-08-13 16:25:35 +08:00
Haojun Liao ce721a0146 fix(stream): fix error. 2023-08-12 16:32:05 +08:00
wangmm0220 efb472d54a fix:heap use after free 2023-08-12 10:15:40 +08:00
Haojun Liao f24b22000f enh(stream): stop stream task before redistribute vnodes. 2023-08-11 23:46:53 +08:00
wangmm0220 767563752a opti:wal logic 2023-08-11 20:21:13 +08:00
wangmm0220 deda4b9eed opti:wal logic 2023-08-11 19:26:17 +08:00
Hongze Cheng 847bc0da08 fix: infinite tomb data sync loop 2023-08-11 18:10:16 +08:00
slzhou 47d2f9ad6d fix: first run without tag cond 2023-08-11 17:52:52 +08:00
wangmm0220 7b22d37f12 fix:lost data when consumer db 2023-08-11 17:25:43 +08:00
slzhou 42a4f364c1 Merge branch 'szhou/tag-scan-opt' of github.com:taosdata/TDengine into szhou/tag-scan-opt 2023-08-11 16:48:49 +08:00
Minglei Jin 84452c8dee cos: use static sdk 2023-08-11 16:36:53 +08:00
shenglian zhou eb9d77d639 ehance: destroy blocklist of table scan info, add block global index list to table scan info 2023-08-11 16:33:49 +08:00
Haojun Liao 87c7e4c0fe fix(stream): not launch stream tasks when restarting the stream tasks. 2023-08-11 16:19:46 +08:00
yihaoDeng 6e6eb05d5c Merge branch 'enh/triggerCheckPoint2' into enh/chkpTransfer 2023-08-11 08:03:02 +00:00
Haojun Liao e984affe90 fix(stream): disable the stream in the followers nodes. 2023-08-11 15:58:15 +08:00
dapan1121 8987553d9c fix: remove ins_modules 2023-08-11 15:56:38 +08:00
wangmm0220 25e32bbf7c fix:offset error in tmq & add test cases 2023-08-11 14:25:12 +08:00
Haojun Liao ba7825141f fix(stream): enable the checkpoint . 2023-08-11 13:33:14 +08:00
Haojun Liao 9322f80343 fix(stream): register the rsp callback. 2023-08-11 13:31:50 +08:00
kailixu 64a1636dd2 chore: trigger CI 2023-08-11 12:54:45 +08:00
kailixu 1d089fe085 fix: dup read lock on windows 2023-08-11 11:34:57 +08:00
yihaoDeng 99be2836b2 Merge branch 'enh/triggerCheckPoint2' into enh/chkpTransfer 2023-08-11 02:50:12 +00:00
Haojun Liao 1e636a2ef9 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-08-11 10:37:40 +08:00
Haojun Liao 6a9826cf6e enh(stream): update the stream task epset. 2023-08-11 10:37:25 +08:00
yihaoDeng ba4ce9db02 Merge branch 'enh/triggerCheckPoint2' into enh/chkpTransfer 2023-08-11 02:15:07 +00:00
Haojun Liao d9bc881fb3
Merge pull request #22384 from taosdata/mark/tmq 
fix:offset error in tmq & add test cases
 2023-08-11 10:00:08 +08:00
Minglei Jin 4513acfee9 cos: use static libs for mxml, apr, apu, curl 2023-08-11 09:54:54 +08:00
yihaoDeng 32983a11e1 add log and fix crash 2023-08-10 20:34:00 +08:00
shenglian zhou b2e615d4e7 enhance: tag scan cursor based block 2023-08-10 17:30:01 +08:00
wangmm0220 78fd70202c fix:offset error in tmq & add test cases 2023-08-10 16:18:53 +08:00
Minglei Jin c04ada3573 cos: link with static libs 2023-08-10 15:28:22 +08:00
Minglei Jin cd63e81450 cos: separate building phase for apr & apr-util 2023-08-10 14:18:12 +08:00
dm chen dd271bca6d
Merge pull request #22394 from taosdata/3.0 
merge 3.0 to feat/TD-22970
 2023-08-10 14:14:22 +08:00
Haojun Liao a713b37f35 fix(stream): add more logs. 2023-08-10 14:07:29 +08:00
Haojun Liao 161fd6902a fix(stream): fix the acquire task. 2023-08-10 12:45:20 +08:00
Minglei Jin 33967b243b
Merge branch '3.0' into fix/TD-25010-3 2023-08-10 12:14:01 +08:00
Haojun Liao f633c7fe2b other: merge 3.0. 2023-08-10 11:56:30 +08:00
Haojun Liao b658608541
Merge pull request #22388 from taosdata/fix/3_liaohj 
other: merge main.
 2023-08-10 11:43:02 +08:00
yihaoDeng ef247cdb1d support reopen stream state 2023-08-10 01:49:26 +00:00
Haojun Liao c10b323188 other: merge main. 2023-08-10 09:26:33 +08:00
Haojun Liao 4393375e47 fix(stream): set correct task id. 2023-08-10 02:16:04 +08:00
Haojun Liao 0757e88ced fix(stream): set the correct hash keys. 2023-08-09 23:52:14 +08:00
Haojun Liao 7e3f1d92fc Merge branch 'main' into fix/liaohj 2023-08-09 19:43:24 +08:00
wangmm0220 1f5532fd67 fix:offset error in tmq & add test cases 2023-08-09 19:41:22 +08:00
Haojun Liao d34b9af054 enh(stream): create update stream trans. 2023-08-09 19:38:13 +08:00
Hui Li 10f5d223bb
Merge pull request #22370 from taosdata/FIX/TD-25605-3.0 
enh: check if disk space sufficient at primary dir with tfs
 2023-08-09 18:32:07 +08:00
Minglei Jin a853d9d40c mxml: use ~/local/include 2023-08-09 18:21:55 +08:00
Haojun Liao 1e8579e8c5 fix(stream): fix other cases. 2023-08-09 16:04:48 +08:00
Haojun Liao 4c92997328 fix(stream): use streamId&taskId to identify the stream task in the stream meta. 2023-08-09 15:52:23 +08:00
Haojun Liao 1d649bccb6
Merge pull request #22372 from taosdata/fix/TD-25626 
fix taosd cannot quit
 2023-08-09 15:46:14 +08:00
Hui Li 584427dd44
Merge pull request #22374 from taosdata/szhou/restore-minglei-main 
fix: restore stt/block merge back
 2023-08-09 14:40:03 +08:00
Minglei Jin b08d5b4d42 mxml: add include dir to vnode 2023-08-09 14:02:10 +08:00
Minglei Jin 7e2859ed43 apr: use tarball to avoid ./buildconf 2023-08-09 13:03:37 +08:00
Haojun Liao 3cdb16352c fix(stream): avoid launching check downstream when failed to add stream task into stream meta. 2023-08-09 12:03:14 +08:00
Minglei Jin 2e0519b960 apr: fix apr & apr-util project names 2023-08-09 11:01:42 +08:00
Minglei Jin 7114ad63e5 apr：makefile for apr & apr-util 2023-08-09 10:54:17 +08:00
Minglei Jin 4d1155a5cf curl: makefile for curl 2023-08-09 10:43:27 +08:00
shenglian zhou e9e06d1eae fix: restore stt block/data block merge back 2023-08-09 10:36:54 +08:00
shenglian zhou 2b1478f46e Revert "fix(tsdb/read2): reset stt reader when suspended" 
This reverts commit 079d7ff69e.
 2023-08-09 10:36:26 +08:00
Haojun Liao f3c5f20ee2 enh(stream): add timer to check the node changing. 2023-08-09 10:25:16 +08:00
Minglei Jin 16e015253b s3/mxml: remove os external dependency 2023-08-09 10:10:25 +08:00
yihaoDeng fb7dec00e1 support reopen stream state 2023-08-09 01:50:49 +00:00
Haojun Liao bb39d94f9c
Merge pull request #22357 from taosdata/fix/liaohj 
other: merge fix from 3.0 to main.
 2023-08-09 09:05:54 +08:00
yihaoDeng cfb5247e30 change var name 2023-08-09 00:46:18 +00:00
Hui Li 8d7e8f5734
Merge pull request #22336 from taosdata/fix/TD-25445 
fix/TD-25445: alter ttlChangeOnWrite note info
 2023-08-08 18:19:02 +08:00
Benguang Zhao e4d16e594c enh: check if disk space sufficient at primary dir with tfs 2023-08-08 17:53:11 +08:00
wangmm0220 d322cfce50 fix:add hashIteratorCancel for hash iterator 2023-08-08 16:28:51 +08:00
Haojun Liao 17c6143471 fix(stream): check more status when handling the state transfer. 2023-08-08 15:08:11 +08:00
Hongze Cheng c8f106106a fix: update assert issue 2023-08-08 14:49:05 +08:00
Hui Li 4f03ae2c65
Merge pull request #22335 from taosdata/temp/open_case 
open split vgroup case
 2023-08-08 11:49:28 +08:00
Haojun Liao a0dcec5890 enh(stream): add function handler for hb message. 2023-08-08 11:23:19 +08:00
dm chen 70a598f072
Merge pull request #22355 from taosdata/3.0 
merge 3.0 to TD-22970
 2023-08-08 09:53:07 +08:00
dapan1121 44717ddbea
Merge pull request #22288 from taosdata/fix/3.0/TD-25499 
fix: memory leak when drop db which acquired by user with grant/revoke
 2023-08-08 09:29:55 +08:00
Hui Li 05e356cd81
Merge pull request #22346 from taosdata/fix/TD-25612 
fix: snapshot invalid read
 2023-08-08 09:19:55 +08:00
Haojun Liao af3a87560a refactor: do some refactor. 2023-08-08 09:11:41 +08:00
Haojun Liao 458143c8b7
Merge pull request #22348 from taosdata/szhou/restore-tsdb-minglei 
fix: restore stt block and data block merge back
 2023-08-08 08:58:02 +08:00
Haojun Liao f8ee055641 other: merge 3.0 2023-08-08 00:19:08 +08:00
Haojun Liao ad3e231b2f
Merge pull request #22350 from taosdata/fix/3_liaohj 
other: merge main and fix bugs in stop stream tasks.
 2023-08-07 22:57:13 +08:00
wangmm0220 864d07e1bc feat:[TD-24559]support geomety type in schemaless 2023-08-07 19:39:06 +08:00
dapan1121 11f6f203ed
Merge pull request #22331 from taosdata/fix/TD-25515 
fix: ins_indexes vgroup_id using null value instead of -1 for invalid
 2023-08-07 19:03:01 +08:00
Haojun Liao aea1690cd1 fix(stream): fix the stream task after checking if it is in the timer activities. 2023-08-07 17:49:36 +08:00
shenglian zhou ec1270f75c fix: restore stt block/data block merge back 2023-08-07 17:17:12 +08:00
Minglei Jin 9e4da6c089 s3/config: parsing s3 configuration 2023-08-07 17:14:58 +08:00
shenglian zhou 9ddab11d98 Revert "fix(tsdb/read2): reset stt reader when suspended" 
This reverts commit 079d7ff69e.
 2023-08-07 17:13:49 +08:00
yihaoDeng b6c991f896 support reopen stream state 2023-08-07 08:59:04 +00:00
yihaoDeng eeb97351e8 support reopen stream state 2023-08-07 08:51:01 +00:00
Haojun Liao e6b80e6c52 Merge branch '3.0' into fix/3_liaohj 2023-08-07 16:26:31 +08:00
Haojun Liao 225c0e61dc hen(stream): support the rollback and checkdown stream tasks. 2023-08-07 16:13:39 +08:00
Hongze Cheng a545d45b5e fix: snapshot invalid read 2023-08-07 16:12:03 +08:00
Minglei Jin fac7e521e9 s3/evict: fetch atime from stat file 2023-08-07 15:59:37 +08:00
Hongze Cheng 661f2aca98 fix: memory leak 2023-08-07 14:13:44 +08:00
wangmm0220 5daf38c0d5 fix:ref is not there 2023-08-07 11:29:54 +08:00
Benguang Zhao 0e4f1942f1 fix: resolve Vgroup refcount leak in drop topic 2023-08-07 11:13:52 +08:00
Haojun Liao 76288f311f
Merge pull request #22311 from taosdata/fix/TD-25543 
delete atomic_exchange_64
 2023-08-07 10:34:50 +08:00
wangmm0220 9ecabb30f5 fix:ref is not there 2023-08-07 10:27:44 +08:00
wangmm0220 5f02e2ddfb fix:ref is not there 2023-08-07 09:31:29 +08:00
Haojun Liao 8a11a0418f other: merge 3.0 2023-08-07 09:19:26 +08:00
wangmm0220 d9a1695257 fix:add log 2023-08-04 18:07:44 +08:00
Hui Li f19826fa9d
Merge pull request #22313 from taosdata/fix/addStreamVer 
add stream verion
 2023-08-04 17:36:21 +08:00
Shungang Li 5154d0e1a3 fix: alter ttlChangeOnWrite note info 2023-08-04 17:24:35 +08:00
liuyao 944c1f68d2 delete atomic_exchange_64 2023-08-04 16:49:02 +08:00
Minglei Jin 65d8af19ed s3: new api s3Size 2023-08-04 16:35:35 +08:00
Minglei Jin 87783a9650 s3query/get: pull object to local 2023-08-04 15:37:52 +08:00
Ganlin Zhao f7a2e0cdab fix: ins_indexes vgroup_id using null value instead of -1 for invalid 
value
 2023-08-04 15:21:23 +08:00
yihaoDeng 56ed422f88 add stream ver 2023-08-04 14:09:00 +08:00
yihaoDeng 6dc93a8dec add stream ver 2023-08-04 13:52:20 +08:00
Minglei Jin ebd09ca532 tsdb/write: use keep1 as minKey instead of keep2 2023-08-04 13:44:17 +08:00
Minglei Jin 88d755be76 feat(tsdb/cos): s3 migration 2023-08-04 13:31:00 +08:00
wade zhang abe15cc68e
Merge pull request #22315 from taosdata/szhou/fix-td25385-main 
fix: keep stt iterator valid in the list
 2023-08-04 08:02:16 +08:00
slzhou fef091b13d fix: keep the stt iterator valid 2023-08-03 21:50:50 +08:00
shenglian zhou b85c1ae8a1 fix: remove the core 2023-08-03 21:50:50 +08:00
shenglian zhou 5322e38dfe fix: add init add check it 2023-08-03 21:50:50 +08:00
shenglian zhou 97b15ed718 fix: delete SLDataItem if stt level files num is smaller 2023-08-03 21:50:50 +08:00
yihaoDeng f7dc9497ef add stream verion 2023-08-03 20:28:34 +08:00
slzhou 1cb1451e41 fix: set nextIndex when get neighbouring index 2023-08-03 18:26:29 +08:00
dm chen 5b03ab1705
Merge branch '3.0' into feat/TD-22970 2023-08-03 17:43:51 +08:00
yihaoDeng f9d0874e45 support reopen stream state 2023-08-03 08:24:50 +00:00
wade zhang 68f2018246
Merge pull request #22289 from taosdata/szhou/fix-25385 
fix: keep stt iterator valid
 2023-08-02 20:22:54 +08:00
wade zhang 13c713d33b
Merge pull request #22290 from taosdata/3.0_main 
merge 3.0 into branch main
 2023-08-02 16:04:08 +08:00
Hongze Cheng f90f0b7047 disable infinite count loop 2023-08-02 15:51:51 +08:00
Minglei Jin cff85550f9 Merge branch '3.0' into 3.0_main 2023-08-02 14:10:45 +08:00
wade zhang c24b52ad82
Merge pull request #22277 from taosdata/fix/TD-25400 
enh(tsdb/cache/read): lazy init table map hash and entries
 2023-08-02 14:08:43 +08:00
Haojun Liao 0feffc687b fix(tsdb): check uid in multiple stt statistics blocks. 2023-08-02 12:44:45 +08:00
Minglei Jin 0e51277521 cache/reader: cleanup contiue nex row 2023-08-02 12:43:57 +08:00
Haojun Liao 2c357f1958 fix(stream): enable filter table based on table statistics. 2023-08-02 11:18:35 +08:00
yihaoDeng 4aef18733f fix state mem leak 2023-08-02 03:16:24 +00:00
Minglei Jin 7fca057a81 cache/reader: move pLastCols into single block 2023-08-02 11:10:12 +08:00
slzhou dd8e893508 fix: keep the stt iterator valid 2023-08-02 11:02:27 +08:00
Minglei Jin 95cc540d9b cache/reader: clean uid in all loop 2023-08-02 10:48:55 +08:00
shenglian zhou 38e797b4ff fix: remove the core 2023-08-02 10:43:26 +08:00
shenglian zhou d5ca51e94d fix: add init add check it 2023-08-02 10:43:26 +08:00
shenglian zhou 6bf95c0c4d fix: delete SLDataItem if stt level files num is smaller 2023-08-02 10:43:26 +08:00
Haojun Liao 13543f7daa feature(stream): handle task update in tq module. 2023-08-02 10:33:41 +08:00
Minglei Jin ed76525c4f cache/reader: cleanup uid in signle loop 2023-08-02 10:28:13 +08:00
wangjiaming0909 72dc46600e fix: memory leak when drop db which acquired by user with grant/revoke 2023-08-02 10:09:50 +08:00
Minglei Jin 29b2f32821 cache reader: cleanup stt init 2023-08-02 09:49:41 +08:00
Haojun Liao 53aefa531f Merge branch '3.0' into fix/3_liaohj 2023-08-02 09:45:21 +08:00
Haojun Liao e1e5e9bb0f enh(stream): check stream tasks dag. 2023-08-02 09:44:39 +08:00
Hongze Cheng 4ba4e83b5b fix: retention file corruption 2023-08-01 20:19:13 +08:00
Haojun Liao c016a58623 enh(stream): do some internal refactor. 2023-08-01 19:22:59 +08:00
Minglei Jin 7d294cac5f tsdb/cache: load current fileset's brinblk once 2023-08-01 18:56:10 +08:00
Minglei Jin a593e887fa cache: remove nFileset from fs state 2023-08-01 18:37:23 +08:00
Haojun Liao ad4c5916e7 enh(stream): update the stream task. 2023-08-01 18:14:58 +08:00
Minglei Jin 7ad628417a fix mem issue: stack-use-after-scope 2023-08-01 17:57:38 +08:00
Minglei Jin 4716fc6400 cache/fs: remove fs state's tsdb handle 2023-08-01 17:49:05 +08:00
Minglei Jin 1d5532019f tsdb/merge-tree: cleanup comment 2023-08-01 17:25:15 +08:00
Minglei Jin f72f129d41 cache/skyline: cleanup del array 2023-08-01 17:23:53 +08:00
Minglei Jin c997662ba0 tsdb/cache: build skyline only if there's del data 2023-08-01 16:50:00 +08:00
Minglei Jin 94b9599f95 fix null pointer dereference 2023-08-01 16:39:14 +08:00
Haojun Liao 637f09359a other: merge main. 2023-08-01 16:15:34 +08:00
Haojun Liao 164bfd5408 enh(stream): prepare update trans. 2023-08-01 16:12:35 +08:00
Minglei Jin 72ac5a4e3b tsdb/cache: use read util's uid compare functor 2023-08-01 16:08:20 +08:00
Minglei Jin c0a0e07597 cache/read: lazy init uidList when laoding from tsdb 2023-08-01 16:02:09 +08:00
Minglei Jin b3fae65d90 enh(tsdb/cache/read): lazy init table map hash and entries 2023-08-01 15:53:42 +08:00
Hongze Cheng 78c23f407e fix compile issue 2023-08-01 15:04:14 +08:00
Hongze Cheng 07c40943a4 fix: TD-25408 2023-08-01 15:01:06 +08:00
wade zhang 347e78ecb5
Merge pull request #22272 from taosdata/fix/TD-25466 
Fix/td 25466
 2023-08-01 14:22:24 +08:00
Haojun Liao 75b1520be0 enh(stream): create task update info 2023-08-01 14:04:07 +08:00
Hongze Cheng 1b39147496 more refact 2023-08-01 11:36:37 +08:00
Hongze Cheng 0e46041c1a fix: tsdbRetention memory leak 2023-08-01 11:21:40 +08:00
wade zhang 6da5276259
Merge pull request #22264 from taosdata/szhou/fix-ts3749 
fix: restore user privilege processing if the rows generated by the u…
 2023-08-01 11:21:11 +08:00
Haojun Liao ae9745ecf2
Merge pull request #22258 from taosdata/mark/tmq-3.0 
fix:add committed & seek process logic
 2023-08-01 09:52:09 +08:00
slzhou 785326c494 fix: dedicated max privileges rows to 2048 2023-08-01 09:46:08 +08:00
Haojun Liao ea875c58f2
Merge pull request #22263 from taosdata/mark/tmq-main 
fix:add committed & seek process logic
 2023-08-01 09:43:23 +08:00
slzhou 411b5d4cf4 fix: increase privileges max block row number to 4096 2023-08-01 09:41:59 +08:00
slzhou 65e028ea5a enhance: add log 2023-07-31 23:27:35 +08:00
Haojun Liao 36ef9a537f
Merge pull request #22256 from taosdata/fix/TD-25457 
check update data
 2023-07-31 22:56:05 +08:00
Haojun Liao 2640e41705
Merge pull request #22261 from taosdata/fix/3_liaohj 
fix(stream): set the correct end key of delete block.
 2023-07-31 22:55:50 +08:00
Haojun Liao 7e8ecceada
Merge pull request #22260 from taosdata/fix/3_liaohj 
fix(stream): kill task when pause the stream execution.
 2023-07-31 22:55:36 +08:00
slzhou 215e358ce3 fix: restore user privilege processing if the rows generated by the user exceeds max block rows 2023-07-31 19:20:54 +08:00
wangmm0220 68ae64cdb2 fix:add committed & seek process logic 2023-07-31 18:53:25 +08:00
wangmm0220 cddf27e8b4 fix:add committed & seek process logic 2023-07-31 18:48:50 +08:00
Haojun Liao d45596bb33 fix(stream): kill task when pause the stream execution. 2023-07-31 18:07:37 +08:00
Haojun Liao 0b732e512a
Merge pull request #22251 from taosdata/fix/3_liaohj 
fix(stream): set the correct end key of delete block.
 2023-07-31 18:06:48 +08:00
wangmm0220 6179618b17 fix:add committed & seek process logic 2023-07-31 17:56:04 +08:00
wade zhang 9675384b05
Merge pull request #22252 from taosdata/fix/TD-25391 
fix(tsdb/read2): reset stt reader when suspended
 2023-07-31 17:36:43 +08:00
liuyao 32b59af4b1 check update data 2023-07-31 17:32:24 +08:00
wade zhang 64d63b0584
Merge pull request #22212 from taosdata/fix/TD-24809-3.0 
fix: taos print version
 2023-07-31 16:31:03 +08:00
wangmm0220 8093ef2dc8 Merge branch 'main' of https://github.com/taosdata/TDengine into mark/tmq 2023-07-31 16:14:25 +08:00
Haojun Liao 9981cecbed refactor: do some internal refactor. 2023-07-31 15:24:35 +08:00
Minglei Jin 079d7ff69e fix(tsdb/read2): reset stt reader when suspended 2023-07-31 15:21:47 +08:00
wade zhang 79646fff10
Merge pull request #22246 from taosdata/szhou/fix-ts3744 
fix: increase condition size
 2023-07-31 14:48:06 +08:00
Haojun Liao e61aa83594 enh(stream): handle the stream hb. 2023-07-31 14:07:18 +08:00
slzhou 6151b790d9 fix: increase the condition size of user privileges to 48k 2023-07-31 13:25:56 +08:00
wade zhang c7fa5ed6ef
Merge pull request #22247 from taosdata/fix/TD-25436 
fix(tsdb/cache): check stt data with empty brin index
 2023-07-31 11:24:37 +08:00
Minglei Jin 135beebc0a fix(tsdb/cache): check stt data with empty brin index 2023-07-31 09:15:08 +08:00
wade zhang bae028d65c
Merge pull request #22230 from taosdata/mark/tmq 
fix:semaphore always wait in tmq commit logic
 2023-07-31 09:10:13 +08:00
kailixu ff39aadb34 fix: mac OS for community 2023-07-31 08:42:17 +08:00
Haojun Liao cc5ff44604 enh(stream): handle the stream hb. 2023-07-30 19:25:00 +08:00
wade zhang c26165975d
Merge pull request #22227 from taosdata/fix/TS-3728 
fix:add macro ASSERT_NOT_CORE to control ASSERT not core in release version
 2023-07-30 14:28:56 +08:00
Haojun Liao 8dfef8768a other: merge 3.0 2023-07-29 22:54:16 +08:00
Haojun Liao c3c9e32ddd
Merge pull request #22244 from taosdata/fix/3_liaohj 
other: merge 3.0
 2023-07-29 22:38:51 +08:00
Haojun Liao 0bd2548937 fix(stream): initialize the filter window initial range. 2023-07-29 16:41:01 +08:00
kailixu 2deeed87ae fix: community for mac os 2023-07-29 13:18:17 +08:00
Haojun Liao f6e07d1fdb other: merge 3.0 2023-07-29 01:32:02 +08:00
wade zhang c19feb2fa1
Merge pull request #22236 from taosdata/fix/TD-25416 
fix(tsdb/cache/del): use lru mutex to fix race with committing
 2023-07-28 23:17:45 +08:00
Haojun Liao 936afeb5ac refactor: do internal refactor to simple the pause/resume in case of fill history exists. 2023-07-28 19:13:03 +08:00
Haojun Liao d5974a8f25 refactor(stream): refactor the pause/resume for fill history execution. 2023-07-28 18:05:32 +08:00
Minglei Jin 1fcbf3432c tsdb/cache/del: remove duplicate lruMutex lock 2023-07-28 17:20:20 +08:00
wangmm0220 d982a7cb80 fix:heap use after free for wal 2023-07-28 16:59:35 +08:00
Minglei Jin b0f65dfa62 fix(tsdb/cache/del): use lru mutex to fix race with committing 2023-07-28 16:32:07 +08:00
wangmm0220 ce7db7bf90 fix:subscribe time & return -1 if wal not exist 2023-07-28 15:07:15 +08:00
wangmm0220 6e673072cd fix:conflicts 2023-07-28 14:57:13 +08:00
Haojun Liao 9f943213ed enh(stream): update the hb info. 2023-07-28 14:23:53 +08:00
Haojun Liao 74834aea11 enh(stream): prepare hb to mnode from stream meta. 2023-07-28 13:07:16 +08:00
Haojun Liao 2a78cd2d23
Merge pull request #22215 from taosdata/fix/liaohj 
other: merge main.
 2023-07-28 13:06:17 +08:00
wangmm0220 2f6c565392 fix:pHandle not load if taosd restart 2023-07-28 11:48:53 +08:00
wade zhang b3e5b5bd24
Merge pull request #22217 from taosdata/fix/TD-25386 
fix(tsdb/cache): move to stt next row if data file exausted
 2023-07-28 08:56:29 +08:00
Haojun Liao ccc0f13649
Merge pull request #22214 from taosdata/fix/3_liaohj 
fix(stream): scan wal in step2
 2023-07-28 00:42:15 +08:00
Haojun Liao 7f3d1dc464 fix(stream): fix memory leak. 2023-07-27 23:06:53 +08:00
wangmm0220 77d43ef5fd fix:tmq ci error 2023-07-27 20:28:45 +08:00
Haojun Liao fbb33be85d other: add some comments. 2023-07-27 18:59:38 +08:00
Haojun Liao 22a5a18fff fix(stream): 1. set correct timewindow after step2. 2. handle the case when the task is failed to be added into the meta store. 2023-07-27 18:57:36 +08:00
Minglei Jin cc9b9bd0b9 fix(tsdb/cache): move to stt next row if data file exausted 2023-07-27 17:19:42 +08:00
Shungang Li fb226c2cdb enh: check cluster ttlChangeOnWrite consistency 2023-07-27 16:49:56 +08:00
Haojun Liao b145771a1b other: merge 3.0 2023-07-27 16:38:57 +08:00
Haojun Liao 3d403dca5a other: merge main. 2023-07-27 16:23:41 +08:00
Haojun Liao 6ff50d4eaf fix(stream): update the step2 scan wal files. 2023-07-27 16:10:55 +08:00
wangmm0220 75eacd56f1 fix:add log 2023-07-27 15:58:32 +08:00
wade zhang a72c11c8de
Merge pull request #22205 from taosdata/fix/TD-25315 
fix(tsdb/commit2): new maxDelKey for commit context
 2023-07-27 15:48:46 +08:00
wade zhang cc3cc73cfc
Merge pull request #22199 from taosdata/fix/TS-3708 
fix/TS-3708: check term for role time
 2023-07-27 15:43:23 +08:00
wangmm0220 2d41a42976 Merge branch 'main' of https://github.com/taosdata/TDengine into fix/TS-3728 2023-07-27 15:31:16 +08:00
Haojun Liao 40fe3ef4f6 fix(stream): refactor the step2 wal scan. 2023-07-27 14:49:20 +08:00
Shungang Li 167ecea705 fix: check term for role time 
1. time of mnode becomes current role in this term
2. show 0 for offline mnodes
 2023-07-27 14:16:54 +08:00
Minglei Jin fe495f7013 tsdb/commit2: fix commit minKey for del 2023-07-27 13:54:48 +08:00
Haojun Liao e89f530db2 fix(stream): scan wal in step2 2023-07-27 10:55:59 +08:00
Minglei Jin 8a2764c698 tsdb/commit2: use max fileset's maxKey as initial maxDelKey 2023-07-27 10:51:17 +08:00
Haojun Liao 2ef67b326a
Merge pull request #22207 from taosdata/fix/3_liaohj 
fix(stream): set the value of ratio of vnode stream thread factor to be 4.0 by default.
 2023-07-27 10:36:37 +08:00
Minglei Jin dd32f12f92 tsdb/commit2: reset nextKey to max to stop commit 2023-07-27 09:50:32 +08:00
Minglei Jin 992d623ae5 fix(tsdb/commit2): initialize ctx's maxDelKey with TSKEY_MIN 2023-07-27 09:34:47 +08:00
Minglei Jin 580b7124cf fix(tsdb/commit2): new maxDelKey for commit context 2023-07-27 09:16:28 +08:00
Haojun Liao b1596f8e3e refactor: do some internal refactor. 2023-07-27 01:55:42 +08:00
Haojun Liao 087d54a807
Merge pull request #22198 from taosdata/fix/3_liaohj 
fix(stream): do filter before the update check.
 2023-07-26 18:57:48 +08:00
yihaoDeng 287088ae3f fix stream state transfer 2023-07-26 10:16:06 +00:00
Haojun Liao c57defa1c9
Merge pull request #22195 from taosdata/szhou/fix-td25369 
fix: stt and data block merge
 2023-07-26 17:11:18 +08:00
Haojun Liao 6a6830761d fix(tsdb): check for null ptr of pScanInfo 2023-07-26 17:08:29 +08:00
Haojun Liao 3c387f6e91 fix(stream): fix syntax error. 2023-07-26 17:00:41 +08:00
Haojun Liao 432c943c25 fix(stream): do filter before the update check. 2023-07-26 16:34:39 +08:00
Haojun Liao 610f9d19c1
Merge pull request #22188 from taosdata/fix/3_liaohj 
fix(stream): set the correct step2 scan time window range.
 2023-07-26 16:34:10 +08:00
shenglian zhou 1357e623d0 fix: fix compilation error 2023-07-26 15:43:50 +08:00
shenglian zhou 79020ea4a4 fix: stt and data block merge 2023-07-26 15:01:20 +08:00
Haojun Liao df57768a3e Merge branch '3.0' into fix/3_liaohj 2023-07-26 14:45:11 +08:00
Haojun Liao cdffabcdad fix(stream): fix memory leak. 2023-07-26 14:37:04 +08:00
Haojun Liao 728112ed89 fix(stream): set correct upstream epinfo. 2023-07-26 10:26:59 +08:00
wade zhang d8fd5b9394
Merge pull request #22190 from taosdata/fix/TD-25315 
fix(tsdb/del): reset next key to del record's ekey
 2023-07-26 10:23:01 +08:00
yihaoDeng c61393a7a1 fix stream state transfer 2023-07-26 01:33:41 +00:00
Haojun Liao b6eb739ae0 fix(tsdb): fix the 2023-07-26 09:14:19 +08:00
Minglei Jin fb860726de fix(tsdb/del): reset next key to del record's ekey 2023-07-26 08:40:44 +08:00
Haojun Liao 1c1bf63e1f other: merge 3.0 2023-07-25 18:17:11 +08:00
wade zhang 02bc1b2a8f
Merge pull request #22186 from taosdata/fix/TD-25315 
fix(tsdb/del): continue committing fileset if more del left
 2023-07-25 17:41:30 +08:00
Haojun Liao 0bdccd2681 refactor: do some internal refactor. 2023-07-25 17:31:54 +08:00
Minglei Jin 7bfb4e0f88 fix(tsdb/del): continue committing fileset if more del left 2023-07-25 16:42:45 +08:00
wangmm0220 a3614ca5d2 fix:add assert if exception occurs 2023-07-25 16:18:11 +08:00
wangmm0220 be4e47e9a7 fix:add macro ASSERT_NOT_CORE to control ASSERT not core in release version 2023-07-25 16:15:33 +08:00
Haojun Liao d29f835a63 fix(stream): set the correct step2 scan time window range. 2023-07-25 15:09:22 +08:00
Haojun Liao c2588d71c3
Merge pull request #22173 from taosdata/fix/TS-3728 
fix:avoid request offset type is 0
 2023-07-25 14:59:30 +08:00
wade zhang 2bf84c2676
Merge pull request #22179 from taosdata/FIX/TS-3702-3.0 
enh: compatibility between getFileNamePrefix and tsdbTFileName
 2023-07-25 14:26:14 +08:00
Benguang Zhao 01f45b2a99 enh: compatibility between getFileNamePrefix and tsdbTFileName 2023-07-25 11:35:35 +08:00
Minglei Jin 1bce96ea27 fix(tsdb/pageSize): use tsdbPageSize instead of szPage(tdb's) 2023-07-25 10:46:03 +08:00
wade zhang 7ea9cf1ddc
Merge pull request #22166 from taosdata/fix/TD-24422 
fix(tsdb/cache): reuse data file reader
 2023-07-25 10:28:59 +08:00
Haojun Liao 96722a07b1
Merge pull request #22174 from taosdata/fix/3_liaohj 
fix(stream): fix the invalid check of step2 .
 2023-07-25 00:30:06 +08:00
Haojun Liao a2694b9ce9 fix(stream): fix the invalid check of step2 . 2023-07-24 19:44:28 +08:00
Haojun Liao c0e35df927
Merge pull request #22131 from taosdata/mark/tmq 
fix:optimize log & change return value for async interface
 2023-07-24 19:40:01 +08:00
wangmm0220 6a0e994169 fix:avoid request offset type is 0 2023-07-24 19:24:05 +08:00
Haojun Liao d36903bf08
Merge pull request #22162 from taosdata/fix/3_liaohj 
fix(stream): add some logs, and remove the invalid loop.
 2023-07-24 16:29:51 +08:00
dapan1121 dce1f579ea
Merge pull request #22143 from taosdata/enh/TD-24987-3.0 
enh: expire time optimize
 2023-07-24 16:18:59 +08:00
wangmm0220 9628a9f74e fix:open info log in tmq & ignore wal apply ver when read wal 2023-07-24 15:53:02 +08:00
Haojun Liao 01f11bf5a6 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 
# Conflicts:
#	source/common/src/tglobal.c
#	source/libs/executor/src/timewindowoperator.c
 2023-07-24 15:25:43 +08:00
Haojun Liao 1e34f84f78 other: merge 3.0 2023-07-24 15:23:03 +08:00
kailixu 7946ce4994 chore: code optimization 2023-07-24 14:46:59 +08:00
Minglei Jin 424dd40078 tsdb/cache: reuse pDataFileReader for same fileset 2023-07-24 14:45:35 +08:00
kailixu cf59a6cff0 chore: set user for dm transport 2023-07-24 14:24:47 +08:00
Haojun Liao 9bae91bcba fix(stream): add some logs, and remove the invalid loop. 2023-07-24 13:37:44 +08:00
Haojun Liao 13bab114cb
Merge pull request #22155 from taosdata/fix/3_liaohj 
fix(stream): refactor the halt status to check more status.
 2023-07-24 11:04:08 +08:00
Minglei Jin 968cfd9e65 tsdb/cache: pLastIter null pointer check 2023-07-24 11:03:07 +08:00
wade zhang 5f25d70fc2
Merge pull request #22154 from taosdata/enh/tsdb_optimize 
fix(tsdb/cache): new next stt row state for fs tranverse
 2023-07-24 10:47:51 +08:00
Haojun Liao 1367552f38 fix(stream): refactor the halt status to check more status. 2023-07-24 10:04:15 +08:00
Haojun Liao 6a19ad3127
Merge pull request #22151 from taosdata/fix/3_liaohj 
fix(stream): set the correct flag of pause/resume.
 2023-07-24 09:07:49 +08:00
Minglei Jin 13491fab95 tsdb/cache: new next stt row state for fs tranverse 2023-07-24 08:51:20 +08:00
Haojun Liao 0b6e1a12bb refactor: do some internal refactor. 2023-07-23 19:09:43 +08:00
Haojun Liao e387b2f932 refactor: do some internal refactor. 2023-07-23 18:59:34 +08:00
Haojun Liao 4e0f7ffbf8 fix(stream): set the correct flag of pause/resume. 2023-07-23 18:49:56 +08:00
Haojun Liao 321be1f83f
Merge pull request #22135 from taosdata/fix/3_liaohj 
refactor: do some internal refactor.
 2023-07-22 15:06:28 +08:00
Haojun Liao bfc4a07207 fix(stream): fix memory leak. 2023-07-22 00:20:02 +08:00
Haojun Liao 1b2636028a fix(stream): fix memory leak. 2023-07-21 23:05:42 +08:00
wangmm0220 8f15795cc1 fix:judge if pTopic is NULL 2023-07-21 19:47:31 +08:00
Haojun Liao 16d7707b90 fix(stream): align the scan real time data for stream task. 2023-07-21 19:33:43 +08:00
wade zhang 7b1e809d98
Merge pull request #21794 from taosdata/enh/tsdb_optimize 
for test purpose
 2023-07-21 14:18:32 +08:00
wangmm0220 bb86f5c580 fix:commit offset should not plus 1 2023-07-21 11:13:05 +08:00
wangmm0220 10ebf1f438 fix:subscribeStb.py maybe failed 2023-07-21 11:07:34 +08:00
dmchen 7d480cf3ac compatible old sync config 2023-07-21 10:31:53 +08:00
liuyao d45563684b
Merge branch '3.0' into enh/triggerCheckPoint2 2023-07-21 10:23:41 +08:00
Haojun Liao d0da988b7d Merge branch '3.0' into fix/3_liaohj 2023-07-21 09:47:44 +08:00
Haojun Liao 39ca9b537f fix(stream): fix syntax error 2023-07-21 09:43:08 +08:00
dapan1121 d81727afa9
Merge pull request #22130 from taosdata/fix/TD-25270 
enh: support show create table for system tables
 2023-07-21 09:26:11 +08:00
Haojun Liao c9d75eab5a refactor: do some internal refactor. 2023-07-21 09:16:13 +08:00
Haojun Liao db46d31ca5 fix(stream): refactor the halt function. 2023-07-21 01:32:42 +08:00
yihaoDeng 519d3b74d1 fix stream state transfer 2023-07-20 09:51:18 +00:00
Ganlin Zhao 076a425d53 fix: fix show create table issue for system tables 2023-07-20 17:21:24 +08:00
Haojun Liao 9353f7c8cf refactor: do some internal refactor. 2023-07-20 16:35:02 +08:00
Haojun Liao c9fa170e65 refactor: do some internal refactor. 2023-07-20 16:31:46 +08:00
Haojun Liao 45cb478b31 refactor: do some internal refactor. 2023-07-20 15:36:46 +08:00
Haojun Liao 87fa8f0c4c Merge branch '3.0' into fix/3_liaohj 2023-07-20 12:15:23 +08:00
Haojun Liao aed99da6c1 refactor: refactor the stream task starting order. 2023-07-20 12:14:53 +08:00
yihaoDeng 6e5be0d30e fix stream state transfer 2023-07-20 03:49:32 +00:00
Minglei Jin 48222f5dc3 tsdb/cache: move data file reader for fs iter to cache reader 2023-07-20 09:11:26 +08:00
Minglei Jin 6dd4ec41ae tsdb/cache cleanup: remove unused fs methods 2023-07-20 08:51:03 +08:00
Minglei Jin 7f0ea10573 Merge branch 'enh/tsdb_optimize' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-07-20 08:42:12 +08:00
Minglei Jin 46d6dcda3e tsdb/cache: reset skyline when clearing fileset 2023-07-20 08:41:32 +08:00
Haojun Liao bfcc538205 fix(tsdb):disable stt statistics. 2023-07-20 00:01:30 +08:00
wangmm0220 9378a0ef83 Merge branch 'main' of https://github.com/taosdata/TDengine into mark/tmq 2023-07-19 23:42:23 +08:00
yihaoDeng 733db123ad refactor code 2023-07-19 13:24:59 +00:00
Haojun Liao 97c44e7c18 refactor: do some internal refactor. 2023-07-19 18:42:02 +08:00
wangmm0220 d7d81d82a0 feat:add committed & position & commite_offset interface 2023-07-19 18:27:19 +08:00
Yihao Deng 91a15fd7bd
Merge branch '3.0' into enh/triggerCheckPoint2 2023-07-19 18:14:08 +08:00
Minglei Jin ce71b8bbe7 Merge branch 'enh/tsdb_optimize' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-07-19 18:11:14 +08:00
Minglei Jin 4eaecd11de tsdb/cache: merge fs & stt row 2023-07-19 18:10:36 +08:00
dapan1121 cbe03ef212
Merge pull request #22069 from taosdata/enh/TS-2288 
enh: add scope for show xx variables
 2023-07-19 18:01:11 +08:00
wangmm0220 5cb35f2fa6 feat:add committed & position & commite_offset interface 2023-07-19 17:29:39 +08:00
Haojun Liao 37ae80d135 fix(tsdb): fix memory leak. 2023-07-19 16:42:51 +08:00
dmchen 8062d603b7 restore old change replica 2023-07-19 15:35:37 +08:00
tangfangzhi 69fae62003 error message 2023-07-19 15:04:39 +08:00
Haojun Liao d82fb45a4f Merge remote-tracking branch 'origin/enh/tsdb_optimize' into enh/tsdb_optimize 2023-07-19 15:01:37 +08:00
Haojun Liao a84efab2c8 enh(tsdb): add table filter according to stt block statistics data. 2023-07-19 15:01:25 +08:00
Minglei Jin 913cfe43e8 tsdb/cache: remove input[3] 2023-07-19 12:20:54 +08:00
Minglei Jin 7a716d452e tsdb/fs2: fix vnode get primary dir args 2023-07-19 11:36:26 +08:00
Minglei Jin 4b96bc7147
Merge branch '3.0' into enh/tsdb_optimize 2023-07-19 11:15:57 +08:00
Shungang Li 1d88a6a7c6 enh: ttlMgrFlush adjust log level 2023-07-19 11:15:54 +08:00
Minglei Jin 185081a948 tsdb/fsreader: clear last fileset's resources 2023-07-19 11:04:28 +08:00
dm chen 141004bf77
Merge branch '3.0' into feat/TD-22970 2023-07-19 10:57:40 +08:00
tangfangzhi 4cdfd0e1e8 conflict 2023-07-19 10:50:46 +08:00
yihaoDeng b1f3dfe88f Merge branch 'enh/triggerChpt' into enh/triggerCheckPoint2 2023-07-19 02:17:42 +00:00
yihaoDeng 34c2e6a180 forbidden streamsnapshot reader 2023-07-19 02:15:12 +00:00
Haojun Liao a32c650248 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-07-19 10:05:48 +08:00
Haojun Liao 2ae95217bd fix(stream): open inputQ by default for task deployed on snode. 2023-07-19 10:05:35 +08:00
liuyao fd02b9a71e
Merge branch '3.0' into enh/triggerCheckPoint2 2023-07-19 10:02:06 +08:00
wade zhang c3e5375f15
Merge pull request #22085 from taosdata/FEAT/TS-2699-3.0 
feat: distribute vnode primary dirs among disks of level 0
 2023-07-19 09:44:43 +08:00
wangmm0220 5c344b0159 fix:conflicts from main 2023-07-19 09:05:05 +08:00
dmchen 93766f8c96 memory leak 2023-07-19 08:32:16 +08:00
Haojun Liao 9513f76172 fix(stream): set downstream task ready state. 2023-07-18 19:02:24 +08:00
wade zhang 5f6afc6661
Merge pull request #22107 from taosdata/fix/TD-25232 
fix/TD-25232: alter keeptimeoffset by 'k v' or 'k' 'v'
 2023-07-18 18:30:30 +08:00
Minglei Jin a127e91534 tsdb/cache skyline: first round implementation of cache skyline 2023-07-18 17:17:06 +08:00
Benguang Zhao 224f90761e fix: set wrapperCfg.diskPrimary in vmProcessAlterVnodeTypeReq 2023-07-18 16:57:52 +08:00
dmchen 3711fdd865 feat/TD-22970 2023-07-18 16:09:38 +08:00
Shungang Li dfaf9134c6 fix: alter keeptimeoffset by 'k v' or 'k' 'v' 2023-07-18 16:04:38 +08:00
Benguang Zhao 02f4613154 enh: report VND_INIT_FAILED on vnodes open failure in vmOpenVnodes 2023-07-18 15:44:51 +08:00
Benguang Zhao 2faa3d2e7b enh: check validity of diskPrimary during vnodeOpen 2023-07-18 15:39:29 +08:00
Minglei Jin 9f9efe9a5e tsdb/cache reader: remove dataf & dataf last readers 2023-07-18 15:30:31 +08:00
wangmm0220 08c50dfbb4 fix:add sdbFetchCancel to release hash node 2023-07-18 15:21:35 +08:00
Haojun Liao 901b7d8ecc fix(stream): if a source task is set to be non-normal, no data should be put into inputQ anymore. 2023-07-18 15:18:57 +08:00
wangmm0220 2c80d7e621 Merge branch 'main' of https://github.com/taosdata/TDengine into fix/TS-3672 2023-07-18 14:59:06 +08:00
Benguang Zhao 24fed51137 enh: tfsRename dir on primary disk at last 2023-07-18 13:58:43 +08:00
Benguang Zhao 5624ecc8df fix: prepare vnode dir recursively in vnodeCreate 2023-07-18 11:32:23 +08:00
Benguang Zhao 6b6b7d8d8f enh: alloc disk of vnode primary dir in vmAllocPrimaryDisk 2023-07-18 11:32:23 +08:00
dmchen 97a81bd8ed fix/TD-25179 2023-07-18 11:27:01 +08:00
Haojun Liao 0c64e67fda fix(stream): fix set upstream info for history task. 2023-07-18 10:19:13 +08:00
wangmm0220 6c35081507 fix:add sdbFetchCancel to release hash node 2023-07-18 09:54:35 +08:00
Haojun Liao 92106312d2 fix(stream): not dispatch checkpoint block result to downstream. 2023-07-18 09:43:38 +08:00
yihaoDeng 8ab545ac77 fillhistory task not trigger checkpoint 2023-07-18 01:16:48 +00:00
wade zhang 7e89622149
Merge pull request #22092 from taosdata/fix/TD-25232 
fix/TD-25232: alter dnode keeptimeoffset err
 2023-07-18 09:10:40 +08:00
dapan1121 73c6666e62
Merge pull request #22096 from taosdata/fix/TD-25210-3.0 
fix: add sma option when show create table for stb/ntb
 2023-07-18 09:09:49 +08:00
Haojun Liao 2f24f776fb fix(stream): fix error in generating checkpoint for state_window. 2023-07-18 09:04:28 +08:00
kailixu cf39fcdd12 fix: add sma option when show create table for stb/ntb 2023-07-17 22:24:27 +08:00
wangmm0220 da9e30434a fix:add sdbFetchCancel to release hash node 2023-07-17 20:21:23 +08:00
wangmm0220 8d8e12ee0d fix:add sdbFetchCancel to release hash node 2023-07-17 20:20:34 +08:00
yihaoDeng b56e442478 Merge branch 'enh/dev33' into enh/triggerCheckPoint2 2023-07-17 11:41:38 +00:00
Minglei Jin 998fbe574d tsdb/cache reader: move suid into reader's info field 2023-07-17 19:10:33 +08:00
yihaoDeng 40eb50676d add checkpoint 2023-07-17 11:04:19 +00:00