Commit Graph

8266 Commits

Author SHA1 Message Date
liuyao 731fe67352 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26644 2023-10-12 16:28:10 +08:00
slzhou b78a32eb1a Merge branch '3.0' of github.com:taosdata/TDengine into szhou/pseudo-column-aliasname 2023-10-12 11:01:50 +08:00
Haojun Liao eb4449999f other: merge 3.0 2023-10-12 10:33:48 +08:00
yihaoDeng f264ffdcd6 refactor backend 2023-10-11 20:12:07 +08:00
yihaoDeng 031506aef8 refactor backend 2023-10-11 19:46:35 +08:00
dapan1121 f5768494b4 feat: support describe view command 2023-10-11 18:49:47 +08:00
wade zhang ee7258bb59
Merge pull request #23214 from taosdata/fix/TS-4135-3.0
fix(tsdb): ensure sst trigger array size for upgrade
2023-10-11 15:37:56 +08:00
dapan1121 3ff3fe7477
Merge pull request #23181 from taosdata/enh/TD-26604
enh: support balance group leader on vgroup_id
2023-10-11 13:25:51 +08:00
dapan1121 478de7ae56 feat: add show create view implement 2023-10-11 10:38:22 +08:00
liuyao e9fc079d26 opt bloom filter 2023-10-11 10:14:11 +08:00
Shungang Li 2c66f44b31 fix(tsdb): ensure sst trigger array size for upgrade 2023-10-10 21:07:08 +08:00
kailixu 2e4711ed92 fix: compile problem for community 2023-10-10 15:03:34 +08:00
Haojun Liao adf6f65d09 fix(stream): set initial version for fill-history task. disable reentry of scan-history task function. 2023-10-10 14:00:30 +08:00
dapan1121 d229492616 Merge remote-tracking branch 'origin/3.0' into feat/TD-25204 2023-10-09 18:34:08 +08:00
dapan1121 6c8db261f3 feat: support show views command 2023-10-09 17:19:36 +08:00
kailixu 5dd277248e fix: alter active code for different server 2023-10-09 17:16:56 +08:00
dapan1121 7c7cf2b1aa enh: support balance group leader on vgroup_id 2023-10-09 15:46:41 +08:00
Haojun Liao d87db2f829 fix(stream): fix the pause failure bug. 2023-10-09 14:48:11 +08:00
liuyao 1fbfdb5ab4 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26174 2023-10-09 11:40:27 +08:00
Haojun Liao ee6516f3c4 enh(stream): add trans to reset task status to avoid being frozen in checkpoint status due to doing checkpoint failure of partial tasks. 2023-10-09 10:13:53 +08:00
dapan1121 5b639a172d feat: support query from view 2023-10-08 18:36:06 +08:00
dm chen 99e930ff8b fix/TD-26547 2023-10-08 16:16:33 +08:00
wangmm0220 b04d57fcc3 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26056 2023-10-08 16:15:19 +08:00
wangmm0220 3f2d890560 feat:[TD-26056] add replay logic 2023-10-08 16:06:15 +08:00
liuyao c75506b271 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26174 2023-10-08 09:02:51 +08:00
slzhou 94b9d0f10a Merge branch '3.0' of github.com:taosdata/TDengine into szhou/pseudo-column-aliasname 2023-10-08 08:58:34 +08:00
Haojun Liao 23fb26798f fix(stream): sleep for 10ms 2023-10-07 19:47:49 +08:00
dapan1121 61382c0793
Merge pull request #23126 from taosdata/fix/TD-26426-3.0
fix: support check/merge active code
2023-10-07 19:31:36 +08:00
Haojun Liao ab17bfdf09 refactor: do some internal refactor. 2023-10-07 19:16:55 +08:00
liuyao c088ee7f91 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26174 2023-10-07 19:13:07 +08:00
liuyao 1aaf873134 fix issue 2023-10-07 17:43:50 +08:00
yihaoDeng c146327da8 refact task backend 2023-10-07 16:48:36 +08:00
yihaoDeng fa70221238 refact task backend 2023-10-07 12:17:55 +08:00
Haojun Liao c20dd002fb enh(stream): add more info for sink task. 2023-10-07 01:14:00 +08:00
kailixu 086213a6c2 enh: dnode notify logic 2023-10-05 21:35:57 +08:00
Haojun Liao 41ef1a45c1 enh(stream): optimize the scan wal perf 2023-10-04 22:06:46 +08:00
Haojun Liao a543f4ca97 refactor: do some internal refactor. 2023-10-03 01:52:03 +08:00
kailixu 638bfe30e4 chore: more code 2023-10-02 17:50:36 +08:00
Haojun Liao 5718158fc0 refactor: do some internal refactor. 2023-10-01 22:27:29 +08:00
kailixu 5067eb8cc5 chore: more code for check active code 2023-09-30 16:00:14 +08:00
kailixu e677e41573 fix: support check and merge activeCode 2023-09-30 12:29:44 +08:00
Haojun Liao f2d8431619 fix(stream): enable new time range for stream task. 2023-09-28 18:26:52 +08:00
yihaoDeng 54e3ac2c1e refact task backend 2023-09-28 15:46:12 +08:00
Haojun Liao 0047d1e1a6 Merge branch 'main' into fix/liaohj 2023-09-28 14:35:14 +08:00
dapan1121 0a0f512023 feat: add view meta processing 2023-09-28 11:44:38 +08:00
Haojun Liao 80ec77cbb6 enh(stream): optimize the stream status when creating without fill-history option. 2023-09-28 11:23:03 +08:00
Haojun Liao 22e485d132 fix(stream): opt perf. 2023-09-28 09:25:23 +08:00
Haojun Liao cc9b9d1054
Merge pull request #23102 from taosdata/fix/liaohj
fix(stream): fix several bugs and do some internal refactor for stream processing.
2023-09-28 09:12:39 +08:00
Haojun Liao e13efd5b04 refactor: optimize the fill-history task launch policy, and do some other internal refactor. 2023-09-27 14:00:48 +08:00
slzhou dee6006ed9 Merge branch '3.0' of github.com:taosdata/TDengine into szhou/continue-coing 2023-09-27 10:02:49 +08:00
xsren a24817e85c semaphore test 2023-09-26 20:48:56 +08:00
liuyao ebf4283e91 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26174 2023-09-26 17:19:41 +08:00
liuyao c95dc167b7 add ci 2023-09-26 17:19:21 +08:00
wade zhang f6134b42d7
Merge pull request #23036 from taosdata/feat/TS-4011-3.0
feat/TS-4011: adjust config 'keep_time_offset' level from dnode to db
2023-09-26 14:25:54 +08:00
Haojun Liao 890d658aea refactor: do some internal refactor. 2023-09-26 14:11:45 +08:00
Haojun Liao 525ee369d3
Merge pull request #23032 from taosdata/fix/liaohj
fix(stream): fix several stability-related bugs in stream framework.
2023-09-26 14:10:58 +08:00
wade zhang 52fef0e33f
Merge pull request #23059 from taosdata/fix/TS-4074
fix: upgrade error when has tomb data
2023-09-26 13:04:57 +08:00
Haojun Liao f3f18b0fa3 fix(stream): add new status for meta. 2023-09-26 12:15:12 +08:00
Hongze Cheng 9e8d761813 more fix 2023-09-26 11:08:20 +08:00
liuyao ca2325f886 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26174 2023-09-26 10:41:31 +08:00
liuyao 82e18e32b0 add ci 2023-09-26 10:41:12 +08:00
Haojun Liao d214a2f6bd fix(stream): do some internal refactor. 2023-09-26 09:32:57 +08:00
Hongze Cheng 03456ce443 fix: upgrade error when has tomb data 2023-09-26 09:23:22 +08:00
Haojun Liao 6cc3618ed9 fix(stream): fix error in pause scan-history data. 2023-09-26 01:09:55 +08:00
dmchen ffa07cbdb0 detail length 2023-09-25 19:21:34 +08:00
Haojun Liao 966ce4f30e Merge remote-tracking branch 'origin/fix/liaohj' into fix/liaohj 2023-09-25 16:00:02 +08:00
Haojun Liao fcf4cc7169 fix(stream): fix the invalid counter for ready tasks in vnode, fix an invalid read. 2023-09-25 15:58:24 +08:00
Alex Duan c9af9eb15b
Merge pull request #22915 from lx1zhong/3.0
add TSZ and ADT-FSE algorithm
2023-09-25 15:48:30 +08:00
Shungang Li 8f0d700fe8 feat: rm dnode config item keepTimeOffset 2023-09-25 15:46:12 +08:00
Shungang Li 743a5b0640 feat: add db config item keep_time_offset 2023-09-25 15:46:08 +08:00
wade zhang 7a711bc687
Merge pull request #22879 from taosdata/enh/TS-3812-3.0
enh: timeseries calculation
2023-09-25 12:23:16 +08:00
wade zhang 928c28fb68
Merge pull request #23021 from taosdata/szhou/star-tbname
feature: bi tools support star expansion to include tbname
2023-09-25 12:22:36 +08:00
Haojun Liao dbc53069db
Merge branch 'main' into fix/liaohj 2023-09-25 10:41:18 +08:00
Haojun Liao eb4078b7f3 fix(stream): record the tasks started info, and do some internal refactor. 2023-09-25 09:59:05 +08:00
Haojun Liao c987f61300 fix(stream): fix race condition. 2023-09-25 01:37:27 +08:00
kailixu 53a9459c20 enh: update timeseries 2023-09-24 07:52:27 +08:00
Haojun Liao 4ea737571d refactor: do some internal refactor. 2023-09-24 01:26:51 +08:00
kailixu bc8ebf1562 Merge branch '3.0' into enh/TS-3812-3.0 2023-09-23 18:19:08 +08:00
Haojun Liao acd3321494 fix(stream): rsp when checkpoint source failed. 2023-09-23 14:13:33 +08:00
Alex Duan b9631fee9e fix: cfgAddFloat with float params1 2023-09-23 12:04:41 +08:00
Alex Duan ea1fb3a195 fix: cfgAddFloat with float params 2023-09-23 12:03:01 +08:00
Alex Duan 141bba6be7 fix: build error 2023-09-23 11:59:30 +08:00
Alex Duan f947eb752a fix: define BUILDIN_CLZ_EX 2023-09-23 11:58:03 +08:00
kailixu 8f828e052b enh: timeseries calculation optimization 2023-09-22 20:07:51 +08:00
liuyao 5cc1ae1266 fix issue 2023-09-22 19:25:19 +08:00
dmchen 09f74cc9ad fix/TD-26434 2023-09-22 18:47:16 +08:00
Haojun Liao 5b12e276cf fix(stream): add msg identifier check. 2023-09-22 18:13:18 +08:00
yihaoDeng 11da631bb5 add cvt state 2023-09-22 09:08:42 +00:00
Haojun Liao 619a9f6d08 fix(stream): refactor re-try dispatch msg for stream tasks. 2023-09-22 15:57:55 +08:00
slzhou fb62588dd3 fix: nodesIsStar and nodesIsTableStar 2023-09-22 15:26:39 +08:00
liuyao 4f8e6d7795 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26174 2023-09-22 15:00:52 +08:00
liuyao 410a177637 fix issue 2023-09-22 15:00:26 +08:00
Haojun Liao 898aea5cfb refactor(stream): refactor send msg. 2023-09-22 14:52:18 +08:00
Haojun Liao 68c329e1f7
Merge pull request #23015 from taosdata/mark/tmq-3.0
fix:add interface tmq_get_connect to get TAOS from tmq
2023-09-22 14:02:19 +08:00
dapan1121 a61d90f672 enh: remove column list 2023-09-22 11:36:53 +08:00
Haojun Liao 87ea745861 fix(stream): add some logs, and remove invalid assert. 2023-09-22 10:53:03 +08:00
Haojun Liao f7bcff862d fix(stream): add check info detailed information. 2023-09-22 10:23:56 +08:00
slzhou 9bb628650c fix: pass basic test 2023-09-22 10:13:17 +08:00
liuyao dc2f7872f8 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26174 2023-09-22 09:41:15 +08:00
liuyao 4979fc5283 fix issue 2023-09-22 09:40:08 +08:00
kailixu 3beb9c5c84 Merge branch '3.0' into enh/TS-3812-3.0 2023-09-21 19:38:27 +08:00
dapan1121 a67b0c99fc feat: support create/drop view 2023-09-21 19:28:07 +08:00
yihaoDeng 470849982e add cvt func 2023-09-21 09:41:30 +00:00
Cary Xu 1bbb812557
Merge branch '3.0' into enh/TS-3934-3.0 2023-09-21 17:32:51 +08:00
shenglian zhou 80f77251b2 merge with 3.0 and finish coding star expansion 2023-09-21 17:04:12 +08:00
dapan1121 64da3f4ef9
Merge pull request #22978 from taosdata/szhou/show-db-table
enhance: show normal/child tables and show user/system databases
2023-09-21 16:55:26 +08:00
kailixu 7445b9ff50 Merge branch '3.0' into enh/TS-3812-3.0 2023-09-21 16:25:06 +08:00
wangmm0220 06afd0bd33 fix:add interface tmq_get_connect to get TAOS from tmq 2023-09-21 15:13:38 +08:00
Haojun Liao 17586af0ce refactor: do refactor the sink task. 2023-09-21 13:32:57 +08:00
liuyao 3b3c5d7cb8 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26174 2023-09-21 10:11:36 +08:00
slzhou de411ebad1 fix: review comments 2023-09-21 09:55:13 +08:00
kailixu 2b25982495 enh: user dropped notification 2023-09-21 09:53:45 +08:00
dapan1121 cc08a5ee87 fix: add query sql 2023-09-20 19:30:40 +08:00
Haojun Liao 6633fb971b fix(stream): update logs. 2023-09-20 18:18:31 +08:00
kailixu 97c87bdbdc enh: mutex/rwlock/pread/pwrite adaption for windows 2023-09-20 15:35:38 +08:00
liuyao 1cebda368a session&state operator buff 2023-09-20 15:06:08 +08:00
dapan1121 6b87d97989 feat: support view in mnode 2023-09-20 15:01:03 +08:00
dapan1121 32a21d766d
Merge pull request #22971 from taosdata/feat/3.0/TD-25522
optimize count()/last() + partition by tbname/tag
2023-09-20 14:01:07 +08:00
dm chen 4497a01168
Merge branch 'main' into feat/TD-26127-audit-sql 2023-09-20 11:13:34 +08:00
slzhou 1c27c2123f enhance: select `tbname` from (select tbname from d.st) 2023-09-20 11:06:59 +08:00
Haojun Liao b4419bda65 enh(stream): add node stage check. 2023-09-20 10:35:01 +08:00
Haojun Liao 779c0c5f19
Merge pull request #22970 from taosdata/fix/liaohj
fix(stream): keep the status entry in hash table, instead entry index.
2023-09-20 10:33:05 +08:00
slzhou ef1e91a6be Merge branch '3.0' of github.com:taosdata/TDengine into szhou/continue-coing 2023-09-20 08:44:15 +08:00
slzhou 951786669d fix: modify show_kind enum value from none to all 2023-09-20 08:39:57 +08:00
dmchen 7f67f41162 ci break 2023-09-19 18:03:22 +08:00
slzhou f4dbd5d9c9 enhance: show normal/child tables and show user/system databases 2023-09-19 16:14:17 +08:00
dmchen c06e012a9d ci break 2023-09-19 16:14:09 +08:00
dmchen 1e2c23d9a3 ci break 2023-09-19 16:11:32 +08:00
dmchen 084719e34e ci break 2023-09-19 15:19:03 +08:00
wangjiaming0909 1e53e6cfeb optimize count()/last() + partition by tbname/tag 2023-09-19 14:56:02 +08:00
dm chen ee913cbfbc
Merge branch 'main' into feat/TD-26127-audit-sql 2023-09-19 14:39:20 +08:00
dapan1121 b9d554275c Merge remote-tracking branch 'origin/3.0' into feat/TD-25204 2023-09-19 14:21:00 +08:00
dapan1121 14e8db289d feat: support view 2023-09-19 14:19:54 +08:00
dapan1121 aabd7a51f7
Merge pull request #22934 from taosdata/fix/xsren/TD-26274/mergeSort_main
merge stable sort intead of qsort as insert unordered data
2023-09-19 14:17:47 +08:00
shenglian zhou 2773f1e9ac fix: continue coding 2023-09-19 14:03:06 +08:00
dmchen e36ff1282c revert dependency 2023-09-19 13:42:02 +08:00
Alex Duan 20cded7d6e fix: build error 2023-09-19 12:57:18 +08:00
wangmm0220 ad70dc178f fix:conflicts from 3.0 2023-09-19 11:56:52 +08:00
Alex Duan 4a4e778a6a fix: remove depends from util to common 2023-09-19 10:46:52 +08:00
slzhou 68c5a7fe50 fix: fix mem leak 2023-09-19 10:38:35 +08:00
Haojun Liao b7efedf4aa enh(stream): log the checkpoint time. 2023-09-19 09:53:33 +08:00
Haojun Liao e76bab7122 fix(stream): not handle the check msg for follower tasks. 2023-09-19 09:43:14 +08:00
slzhou 05ef6e291c fix: fix address sanitizer error 2023-09-19 09:15:12 +08:00
kailixu 6698861c8b chore: timeseries distribute 2023-09-19 08:29:51 +08:00
shenglian zhou 94a616fcc1 fix: save and continue 2023-09-18 16:59:07 +08:00
Haojun Liao c33ef4ce88 fix(stream): add null check 2023-09-18 15:14:51 +08:00
Alex Duan 570ac79a79
Merge branch 'taosdata:3.0' into 3.0 2023-09-18 14:28:00 +08:00
xsren 83d8e3a524 mem exception handle 2023-09-18 13:48:09 +08:00
dmchen b473122dac break dependency 2023-09-18 12:29:08 +08:00
dmchen 5f0274e83d break dependency 2023-09-18 11:44:06 +08:00
dmchen a64ddfc736 break dependency 2023-09-18 10:59:50 +08:00
dm chen fda32dcc51
Merge branch 'main' into feat/TD-26127-audit-sql 2023-09-18 09:41:47 +08:00
Haojun Liao 01144c58a7 fix(stream): fix stream task id error. 2023-09-17 01:19:59 +08:00
Haojun Liao 4846194bbb refactor: do some internal refactor, remove the related fill-history task by sending mesg to replay it in follower node. 2023-09-16 21:37:30 +08:00
xsren 98cbb92ad9 merge stable sort intead of qsort as insert unordered data 2023-09-15 17:53:31 +08:00
Haojun Liao 05e9f40834
Merge pull request #22828 from taosdata/enh/ipWhiteList
Enh/ip white list
2023-09-15 17:49:37 +08:00
Haojun Liao 91e3d70796 fix(stream): remove fill-history sink task. 2023-09-15 17:46:17 +08:00
lx1zhong 6da4088012 add TSZ and ADT-FSE algorithm 2023-09-15 14:30:23 +08:00
Haojun Liao 2bfd6e3355 refactor: do some internal refactor. 2023-09-15 09:25:22 +08:00
dapan1121 8ef01584ee
Merge pull request #22629 from taosdata/feat/TD-25620
feat: optimize partition node, replace with sort node
2023-09-14 17:26:15 +08:00
Haojun Liao f2c3e0a6e8 fix(stream): disable follower send hb to mnode. and do some internal refactor. 2023-09-14 17:22:31 +08:00
yihaoDeng 2d1d74d4e8 Merge branch 'enh/ipWhiteList' of https://github.com/taosdata/TDengine into enh/ipWhiteList 2023-09-14 16:52:23 +08:00
yihaoDeng e36dc50828 Merge branch 'enh/ipWhiteList' of https://github.com/taosdata/TDengine into enh/ipWhiteList 2023-09-14 15:42:17 +08:00
yihaoDeng 2002ed8709 add more error code 2023-09-14 15:34:28 +08:00
slzhou 6dfb939f22 enhance: enhance test case 2023-09-14 14:11:50 +08:00
Haojun Liao fce5be0eb4 fix(stream): fix dead lock. 2023-09-14 14:09:05 +08:00
wangjiaming0909 cb78c54d72 optimize sort perf 2023-09-13 18:37:42 +08:00
wangmm0220 f729150497 fix:opti poll callbak logic & send epoch as -1 to get epset if vnode transformed 2023-09-13 18:32:45 +08:00
Haojun Liao 7305c8dbe1 refactor: do some internal refactor about the sched status set 2023-09-13 14:00:34 +08:00
wangmm0220 1dbd322fa0 fix:remove useless code 2023-09-13 11:42:09 +08:00
Yihao Deng fa302ac6b9
Merge branch '3.0' into enh/ipWhiteList 2023-09-13 10:14:08 +08:00
Haojun Liao 09a15bf340 refactor: do some internal refactor. 2023-09-12 22:07:52 +08:00
Haojun Liao 60f5056ab7 other: merge 3.0 2023-09-12 22:00:40 +08:00
Haojun Liao f6a097d96f refactor: do some internal refactor. 2023-09-12 21:58:22 +08:00
Haojun Liao 4325a0a433
Merge pull request #22866 from taosdata/fix/3_liaohj
refactor: do  some internal refactor.
2023-09-12 21:56:44 +08:00
xsren d14f1ebfcb build failed on linux 2023-09-12 18:46:41 +08:00
Haojun Liao e457d94ac6 refactor: do some internal refactor. 2023-09-12 18:09:02 +08:00
slzhou a44d0bceb6 Merge branch 'szhou/enh/ipWhiteList' into enh/ipWhiteList 2023-09-12 16:21:29 +08:00
yihaoDeng 7ce8f694dc Merge branch 'enh/dev3New' into enh/ipWhiteList 2023-09-12 15:54:06 +08:00
xsren 8787e0d58c build failed on linux 2023-09-12 14:30:11 +08:00
shenglian zhou 8db96a0085 enhance: update notification and get user whitelist api 2023-09-12 14:10:41 +08:00
shenglian zhou 64caae83fd enhance: add hb whitelist version and notify taosadapter 2023-09-12 14:10:41 +08:00
Haojun Liao 93159729f6 fix(stream):check error when vnode is closing. 2023-09-12 11:45:51 +08:00
yihaoDeng 39d04ed15b add rpc update interface 2023-09-11 20:48:24 +08:00
yihaoDeng 2a30e12547 add rpc update interface 2023-09-11 10:45:45 +08:00
yihaoDeng d121b564c0 add rpc update interface 2023-09-10 16:11:14 +08:00
yihaoDeng 25bc0b226b add rpc update interface 2023-09-10 14:09:36 +08:00
Haojun Liao 85a5c45098 fix(stream): limit the already processed data. 2023-09-10 00:01:25 +08:00
Haojun Liao aa8909b267 other: add some logs. 2023-09-09 15:18:54 +08:00
Haojun Liao b317c8ebff fix(stream): disable merge submit blocks. 2023-09-08 12:46:15 +08:00
yihaoDeng 60d6a622e1 add rpc update interface 2023-09-07 20:47:10 +08:00
yihaoDeng 8c5fa3526a add rpc update interface 2023-09-07 16:10:07 +08:00
yihaoDeng 147de26eec add rpc update interface 2023-09-07 11:54:34 +08:00
Haojun Liao 55ac835294 Merge branch 'main' into fix/3_liaohj 2023-09-07 11:47:25 +08:00
dapan1121 fdeb924d0d
Merge pull request #22715 from taosdata/fix/m/TD-26114
fix: desc fill missed one window
2023-09-07 11:36:30 +08:00
wangjiaming0909 4a131000e4 fix: data error of partition by col + interval 2023-09-07 10:49:09 +08:00
Haojun Liao b240e91c91 enh(stream): add token bucket to limit the rate of sink operation. 2023-09-07 09:58:48 +08:00
Haojun Liao 0f909285c4
Merge pull request #22684 from taosdata/mark/tmq-3.0
fix:use vgstatus before if rebalance
2023-09-07 09:20:27 +08:00
yihaoDeng bc27d245b1 add rpc update interface 2023-09-06 21:54:31 +08:00
yihaoDeng ad5639df89 add rpc update interface 2023-09-06 21:36:16 +08:00
Haojun Liao 8edf86b3bb fix(stream): add some logs. 2023-09-06 19:08:09 +08:00
yihaoDeng ac8220012c add rpc update interface 2023-09-06 17:22:30 +08:00
liuyao d7caed1c44 opt stream state 2023-09-06 16:34:25 +08:00
yihaoDeng b5d40d01bb add rpc update interface 2023-09-06 16:24:29 +08:00
dapan1121 ed9085281d
Merge pull request #22623 from taosdata/feat/TD-25964-3.0
feat: get cpu cores from quota
2023-09-06 16:03:33 +08:00
Haojun Liao 8783ebcb02 enh(stream): add some logs and record the submit package performance. 2023-09-06 14:34:36 +08:00
dmchen 231ba12f70 feat/TD-26127 2023-09-06 11:00:24 +08:00
wangjiaming0909 5dedaebb01 fix: desc fill missed one window 2023-09-06 10:53:19 +08:00
wangmm0220 ef87b9c571 fix:conflicts from 3.0 2023-09-05 16:19:04 +08:00
Haojun Liao 5dcbae3594
Merge pull request #22681 from taosdata/fix/3_liaohj
refactor: do some internal refactor.
2023-09-05 12:54:09 +08:00
wangjiaming0909 2c4e0fee07 feat: optimize partition node, replace with sort node 2023-09-05 10:53:30 +08:00
yihaoDeng 685bdea44a add rpc update interface 2023-09-04 21:15:46 +08:00
Haojun Liao aeea699c9c Merge branch '3.0' into fix/3_liaohj 2023-09-04 15:53:39 +08:00
Haojun Liao 037a232bfa refactor: do some internal refactor. 2023-09-01 17:05:36 +08:00
wangmm0220 fd85d5885a fix:add limit time for consume in 1 seconds 2023-09-01 16:57:49 +08:00
wangmm0220 f0fbe08e1d fix:core dump if tmq is null 2023-09-01 16:45:46 +08:00
yihaoDeng 5f78c27535 add enable white list 2023-09-01 15:11:25 +08:00
yihaoDeng 832b78c0e8 Merge branch '3.0' into szhou/ip-whitelist 2023-09-01 13:44:23 +08:00
dapan1121 cc17848b78 fix: merge 3.0 to main 2023-09-01 13:24:47 +08:00
yihaoDeng 8b146f793d Merge branch '3.0' into szhou/ip-whitelist 2023-09-01 10:51:24 +08:00
dapan1121 228e6c6acd Merge remote-tracking branch 'origin/main' into 3.0 2023-09-01 10:01:10 +08:00
Haojun Liao e816d0efa5
Merge pull request #22669 from taosdata/fix/TD-26069
fix invalid insert
2023-08-31 18:29:25 +08:00
yihaoDeng 1833be028f fix invalid insert 2023-08-31 15:28:31 +08:00
Haojun Liao e2bb64eb18 refactor: do some internal refactor. 2023-08-31 14:23:46 +08:00
Haojun Liao 69f95f9324 other: merge 3.0 2023-08-31 13:56:34 +08:00
Haojun Liao 2285b834b0 refactor: do some internal refactor. 2023-08-31 13:53:12 +08:00
Haojun Liao 3fc3dafca6 refactor: do some internal refactor. 2023-08-31 13:46:48 +08:00
Haojun Liao 3ed78ddadd
Merge pull request #22662 from taosdata/fix/3_liaohj
refactor: do some internal refactor.
2023-08-31 13:46:14 +08:00
Haojun Liao 8645f763b5
Merge pull request #22661 from taosdata/enh/reserve
stream change ver
2023-08-31 13:35:23 +08:00
yihaoDeng 83a5e2be4c stream change ver 2023-08-31 11:42:12 +08:00
Haojun Liao e53b5d4392 refactor: do some internal refactor. 2023-08-31 11:01:53 +08:00
Haojun Liao 0facde6ddc
Merge pull request #22659 from taosdata/fix/TD-26035
fix(stream): do not restart the stream tasks when it is running.
2023-08-31 10:16:59 +08:00
yihaoDeng 05ca71d5de stream change ver 2023-08-31 09:28:43 +08:00
dapan1121 62d77c8be2
Merge pull request #22654 from taosdata/fix/TD-26046
fix: trim block and partition by constant function issue
2023-08-31 09:04:46 +08:00
kailixu f4dd1895b2 Merge branch '3.0' into feat/TD-25964-3.0 2023-08-31 08:56:53 +08:00
wade zhang 68e4a72021
Merge pull request #22643 from taosdata/feat/audit-user-typestr
alter user type to str
2023-08-31 07:59:31 +08:00
Haojun Liao d99d8875e1 fix(stream): if stream task is running, do not recheck its status. 2023-08-30 17:24:13 +08:00
slzhou f41783c73f fix: address sanitizer error 2023-08-30 17:12:12 +08:00
slzhou 82dc2de2f4 Merge branch '3.0' of github.com:taosdata/TDengine into szhou/ip-whitelist 2023-08-30 17:11:42 +08:00
dapan1121 2e7897239a fix: trim block and partition by constant function issue 2023-08-30 16:51:44 +08:00
dmchen 04a89b4a49 long fields 2023-08-30 16:03:57 +08:00
Haojun Liao c5b279f045 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-08-30 16:01:08 +08:00
Haojun Liao 24b1a050fc other: merge 3.0 2023-08-30 16:00:14 +08:00
dapan1121 f94c849f23
Merge pull request #22540 from taosdata/fix/TS-3821
fix: use MD5 hash to fix aliasname not enough to hold dbname.tbname
2023-08-30 15:21:23 +08:00
kailixu eb7d2d495a chore: supports obtaining physical/virtual CPU cores 2023-08-30 15:21:03 +08:00
liuyao 0a72e576bd op stream pause
pause data dispatch

opt stream pause
2023-08-30 14:53:49 +08:00
slzhou 1ab94d0992 Merge branch '3.0' of github.com:taosdata/TDengine into szhou/ip-whitelist 2023-08-30 14:42:26 +08:00
slzhou 97f048364b enhance: regenerate sql.c 2023-08-30 14:37:04 +08:00
dapan1121 f6321d0c4f Merge remote-tracking branch 'origin/main' into fix/m23.1 2023-08-30 11:03:33 +08:00
Ganlin Zhao 4b954c0874 fix potential overflow 2023-08-30 10:25:16 +08:00
Haojun Liao 3a7a220d43 fix(stream): fix error found by ci. 2023-08-30 10:14:01 +08:00
shenglian zhou 33966cf856 enhance: continue coding 2023-08-29 17:35:03 +08:00
Haojun Liao 204fb97f68 fix(stream): fix error in snode, fix memory leaks, fix repeatly create bug in sink task. 2023-08-29 17:34:31 +08:00
Ganlin Zhao d0fb485573 fix all possible overflow using md5 2023-08-29 15:51:29 +08:00
slzhou f280da26da Merge branch '3.0' of github.com:taosdata/TDengine into szhou/ip-whitelist 2023-08-29 14:16:37 +08:00
dmchen 1372cede48 init 2023-08-28 17:44:10 +08:00
dapan1121 778e50da79
Merge pull request #22592 from taosdata/fix/m23.0
Fix/m23.0
2023-08-28 17:35:35 +08:00
Haojun Liao 391103bc5a fix(stream): do dome internal refactor. 2023-08-28 15:54:01 +08:00
dapan1121 b00aa1a992
Merge pull request #22458 from taosdata/fix/TD-25719
fix: fix non-root users cannot create log files even if they have write
2023-08-28 13:28:59 +08:00
wade zhang 1797fe50e2
Merge pull request #22590 from taosdata/feat/TD-18801
init
2023-08-28 11:05:38 +08:00
Haojun Liao da0b4e1f92 Merge branch '3.0' into enh/triggerCheckPoint2 2023-08-28 10:55:38 +08:00
dapan1121 0cce255a02 Merge remote-tracking branch 'origin/3.0' into fix/m23.0 2023-08-28 10:06:53 +08:00
Haojun Liao b75ae217f6 fix(stream): notify close for snode. 2023-08-28 09:53:08 +08:00
Haojun Liao 88f6596965
Merge pull request #22464 from taosdata/feat/TD-18789
feat:support varbinary type
2023-08-28 09:45:57 +08:00
dapan1121 1f40da6fef Merge remote-tracking branch 'origin/main' into 3.0 2023-08-28 09:28:55 +08:00
dmchen 06083e1eb9 init 2023-08-28 09:15:51 +08:00
dapan1121 cda08087b9
Merge pull request #22586 from taosdata/fix/TD-25936.3
fix: no explain response issue
2023-08-28 08:52:13 +08:00
yihaoDeng 998dac0ffb fix mem leak 2023-08-26 21:54:36 +08:00
yihaoDeng 7d237d4310 fix UAF 2023-08-26 17:37:09 +08:00
wangmm0220 9cd8df12c2 fix:memory leak 2023-08-25 16:32:01 +08:00
Haojun Liao 60d1df0e25
Merge branch '3.0' into enh/triggerCheckPoint2 2023-08-25 15:49:28 +08:00
wangmm0220 26e025d78d feat:[TD-18789]support varbinary type 2023-08-25 15:43:45 +08:00
dapan1121 e24498b0fd enh: add task notify 2023-08-25 14:59:34 +08:00
dapan1121 178e32fe08
Merge pull request #22551 from taosdata/szhou/tags-after-distinct
fix: select distinct/all tags instead of select tags distinct
2023-08-25 11:21:01 +08:00
Ganlin Zhao c8c30e0a00 fix 2023-08-25 10:15:52 +08:00
Haojun Liao ce1a3a379c fix(stream): handle the case when the task not in ready state, and the checkpoint msg arrived. 2023-08-25 10:12:12 +08:00
Ganlin Zhao af130cc92f Revert "add seperate function for createLogs"
This reverts commit 13d2d72bb6.
2023-08-25 09:55:50 +08:00
Haojun Liao f7dada53b9
Merge pull request #22559 from taosdata/fix/liaohj
other: merge main.
2023-08-24 19:01:18 +08:00
Haojun Liao 82e356a9b5 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2
# Conflicts:
#	source/dnode/vnode/src/tq/tq.c
2023-08-24 18:04:44 +08:00
Haojun Liao 70396aa5a5 fix(stream): wakeup the hb timer every 200ms, to speeup the close db procedure. 2023-08-24 17:54:50 +08:00
yihaoDeng 9310d138a6 Merge branch 'enh/3.0' into enh/triggerCheckPoint2 2023-08-24 17:30:35 +08:00
slzhou d5db4b16ba Merge branch '3.0' of github.com:taosdata/TDengine into szhou/tags-after-distinct 2023-08-24 16:57:25 +08:00
Haojun Liao 3c6870275b fix(parser): update the key words for disk io throttling. 2023-08-24 16:45:47 +08:00
slzhou b16470414a enhance: ip range white list to user 2023-08-24 15:54:10 +08:00
Ganlin Zhao 13d2d72bb6 add seperate function for createLogs 2023-08-24 14:56:14 +08:00
Haojun Liao 2c9f28d97f Merge branch 'main' into fix/liaohj 2023-08-24 14:12:15 +08:00
slzhou f6dbd0b0e4 fix: select distinct/all tags instead of select tags distinct 2023-08-24 14:03:40 +08:00
wangjiaming0909 366a9cc009 Revert "feat: support column comment"
This reverts commit dcbef83dea.
2023-08-24 13:54:27 +08:00
wangjiaming0909 c2af41d0d0 Revert "feat: support alter table add column with comment"
This reverts commit cb027cc5c5.
2023-08-24 13:48:35 +08:00
wangjiaming0909 7fad1de841 Revert "feat: show create table, desc table with col comments"
This reverts commit 16754b5ac1.
2023-08-24 13:38:41 +08:00
wade zhang 0860670d37
Merge pull request #22526 from taosdata/enh/TD-25445-new
enh/TD-25445: ttl split flush and drop table
2023-08-24 13:57:07 +08:00
Shungang Li 171cf049bc fix: new msg should be appended to segment tail 2023-08-24 11:03:06 +08:00
yihaoDeng 3afea998ac refactor log 2023-08-24 10:15:15 +08:00
Ganlin Zhao 962a0cd403 fix 2023-08-23 23:34:02 +08:00
Ganlin Zhao 1190442936 fix: use MD5 hash to fix aliasname not enough to hold dbname.tbname 2023-08-23 22:58:11 +08:00
Hongze Cheng 6a20420f07 feat: add minDiskFreeSize cfg 2023-08-23 16:41:29 +08:00
Shungang Li 458fd07976 enh: ttl split flush and drop table
config:
1. ttlFlushThreshold: maximum number of dirty items in memory
2. tsTtlBatchDropNum: number of tables dropped per batch
3. tsTrimVDbIntervalSec: interval of trimming db in all vgroups
2023-08-23 11:13:34 +08:00
dapan1121 cb70861986 fix: memory leak issue 2023-08-22 18:40:42 +08:00
Haojun Liao af80d94a88 refactor: do some internal refactor. 2023-08-22 15:43:50 +08:00
Haojun Liao cc8b2263cb fix(stream): fix error in heartbeat from vnode. 2023-08-22 13:37:38 +08:00
Haojun Liao def0877980 fix(stream): add timer to check stream task status. 2023-08-22 10:46:49 +08:00
dm chen dda51d8019
Merge branch '3.0' into feat/TD-22970 2023-08-21 10:50:45 +08:00
yihaoDeng 6fe649c458 Merge branch 'enh/3.0' into enh/triggerCheckPoint2 2023-08-21 09:12:40 +08:00
Haojun Liao 8290344349
Merge pull request #22484 from taosdata/fix/liaohj
fix(stream): fix memory leak and do some internal refactor.
2023-08-19 11:02:57 +08:00
Haojun Liao b8101afbe2 fix(stream): refactor the tasks restart mechanism. 2023-08-18 22:36:38 +08:00
Haojun Liao 4b10393c81 fix(stream): fix memory leak and do some internal refactor. 2023-08-18 18:02:08 +08:00
liuyao 87c65f3b68 Merge remote-tracking branch 'origin/3.0' into enh/triggerCheckPoint2 2023-08-18 15:27:02 +08:00
dapan1121 efc5589aa2 Merge remote-tracking branch 'origin/3.0' into feat/TD-24700 2023-08-18 14:11:26 +08:00
dapan1121 daf91648fe fix: invalid read memory issue 2023-08-18 13:57:17 +08:00
dm chen e393a98ee9
Merge branch '3.0' into feat/TD-22970 2023-08-18 13:37:18 +08:00
slzhou 4e2a26e8be Merge branch '3.0' of github.com:taosdata/TDengine into szhou/select-tags-scan 2023-08-18 08:46:17 +08:00
dapan1121 adcd1a2df2 fix: join error msg 2023-08-17 19:20:09 +08:00
Haojun Liao a18989df88 fix(stream): add lost codes caused by merge 3.0. 2023-08-17 18:51:39 +08:00
slzhou 85d1dbe00a Merge branch '3.0' of github.com:taosdata/TDengine into szhou/select-tags-scan 2023-08-17 16:27:37 +08:00
dapan1121 1b038d2dcd Merge remote-tracking branch 'origin/3.0' into feat/TD-24700 2023-08-17 16:08:39 +08:00
dapan1121 d750950594 fix: rebuild sql.c 2023-08-17 16:04:30 +08:00
Benguang Zhao 7735e6f388 Merge branch 3.0 to FEAT/TD-25699-3.0 2023-08-17 16:04:23 +08:00
shenglian zhou 4a9391929c fix: select tags - ctb cursor pause/unlock and lock/resume 2023-08-17 14:59:17 +08:00
dapan1121 0e10e94a40
Merge pull request #22453 from taosdata/feat/TD-25685
feat: support column comment
2023-08-17 14:23:54 +08:00
dapan1121 3045a623e1 Merge remote-tracking branch 'origin/3.0' into feat/TD-24700 2023-08-17 14:16:05 +08:00
dapan1121 e8fa9aa633 fix: join blockId and target issues 2023-08-17 13:50:26 +08:00
wangjiaming0909 16754b5ac1 feat: show create table, desc table with col comments 2023-08-17 11:39:34 +08:00
liuyao 5ce7688a93 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/ly_refactor 2023-08-17 09:06:46 +08:00
Haojun Liao 6746339609 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2
# Conflicts:
#	source/libs/stream/src/streamSnapshot.c
2023-08-17 00:08:44 +08:00
Haojun Liao ea6574b3c7 other: merge 3.0 2023-08-17 00:07:55 +08:00
wangmm0220 dbc1b35d44 feat:support varbinary type 2023-08-16 19:57:01 +08:00
wangmm0220 b3f945c4c5 fix:conflict 2023-08-16 19:35:05 +08:00
wangmm0220 f266d51764 feat:support varbinary type 2023-08-16 19:05:07 +08:00
dmchen fee4b875d1 error code 2023-08-16 17:49:17 +08:00
yihaoDeng ab7e2b3122 Merge branch 'enh/chkpTransfer' into enh/triggerCheckPoint2 2023-08-16 09:00:30 +00:00
dm chen e020c4e8c5
Merge pull request #22456 from taosdata/3.0
merge 3.0 to feat/TD-22970
2023-08-16 16:49:43 +08:00
Haojun Liao f1359076c1
Merge pull request #22450 from taosdata/fix/3_liaohj
other: merge main.
2023-08-16 16:48:33 +08:00
Haojun Liao d63758a1c5 fix(stream): fix error in execute task on a tranferred node. 2023-08-16 15:24:24 +08:00
dapan1121 143c657571 Merge remote-tracking branch 'origin/3.0' into feat/TD-24700 2023-08-16 14:50:31 +08:00
dapan1121 b113d02476
Merge pull request #22438 from taosdata/feat/TD-23299
feat: add irate distributed execution
2023-08-16 14:44:33 +08:00
dapan1121 91d6734b34 fix: join condition push down issue 2023-08-16 14:28:39 +08:00
dapan1121 a6ecb7253e
Merge pull request #22390 from taosdata/feat/3.0/TD-25365
feat: optimize select agg_func partition by tag slimit
2023-08-16 13:32:58 +08:00
dapan1121 39ae880597
Merge pull request #22445 from taosdata/enh/TD-25708-3.0
enh: disable stream/udf on windows
2023-08-16 13:20:01 +08:00
wangjiaming0909 e587cc50e6 feat: optimize select agg_func partition by tag slimit 2023-08-16 11:20:56 +08:00
wangjiaming0909 cb027cc5c5 feat: support alter table add column with comment 2023-08-16 11:07:40 +08:00
dmchen de5aedd8f3 vnode.json 2023-08-16 10:20:48 +08:00
liuyao 919ffbaf72 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/ly_refactor 2023-08-16 10:04:07 +08:00
Haojun Liao 63bc50a723
Merge pull request #22427 from taosdata/feature/rebuildIndex0
rebuild index at tag0
2023-08-16 09:47:43 +08:00
liuyao fc09f8ef1e Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/ly_refactor 2023-08-16 09:36:28 +08:00
Haojun Liao ad9f3cbc43 other: merge main. 2023-08-16 09:14:10 +08:00
slzhou 1c9611ea51 Merge branch '3.0' of github.com:taosdata/TDengine into szhou/select-tags-scan 2023-08-16 09:14:04 +08:00
dapan1121 df13c6fa3e
Merge pull request #22410 from taosdata/szhou/tag-scan-opt
enhance: tag scan optimization
2023-08-16 08:58:17 +08:00
wade zhang 1a1a12b7b8
Merge pull request #22327 from taosdata/fix/TD-25010-3
feat(tsdb/cos): s3 migration
2023-08-16 08:02:20 +08:00
Haojun Liao fdcc6d3446
Merge pull request #22442 from taosdata/mark/doc
fix:tmq interface & remove snapshot code
2023-08-15 17:56:55 +08:00
slzhou 4fdaaba3ce Merge branch '3.0' of github.com:taosdata/TDengine into szhou/tag-scan-opt 2023-08-15 17:18:25 +08:00
Benguang Zhao 239a79d405 enh: add some vnode info in SStatusReq 2023-08-15 17:06:33 +08:00
wangjiaming0909 dcbef83dea feat: support column comment 2023-08-15 16:30:02 +08:00
kailixu 242bf77f4c chore: code optimization 2023-08-15 16:13:51 +08:00
shenglian zhou 84e472ad03 enhance: tag cond col list only once and tag scan derive from scan 2023-08-15 16:10:54 +08:00
Haojun Liao 39079ab64a fix(stream): load term from sync model to decide if the node is restart or not 2023-08-15 15:52:06 +08:00
wangmm0220 beb84b2355 fix:tmq interface & remove snapshot code 2023-08-15 15:37:39 +08:00
slzhou 514da6e1b0 fix: select tags and set tag scan execution mode 2023-08-15 15:16:57 +08:00
wade zhang 778b88a1fb
Merge pull request #22440 from taosdata/fix/retry_resolve_fqdn
merge fix/retry_resolve_fqdn to main
2023-08-15 14:58:52 +08:00
liuyao 1b4e51ee4a Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/ly_refactor 2023-08-15 14:20:49 +08:00
wangmm0220 7441801e9d feat:support varbinary type 2023-08-15 13:57:05 +08:00
kailixu f7a5bef17d enh: disable stream/udf on windows 2023-08-15 13:02:32 +08:00
Ganlin Zhao 01a7dfbc34 feat: add irate distributed execution 2023-08-15 12:59:30 +08:00
Haojun Liao b1d35f43ba enh(stream): using term from sync module to denote the upstream node is restarted/replica-modified/vnode-transferred or not. 2023-08-15 09:25:05 +08:00
Haojun Liao ff17763ed6
Merge pull request #22417 from taosdata/mark/tmq
opti:wal logic
2023-08-15 09:16:29 +08:00
dapan1121 8fc0f1bbd6 Merge remote-tracking branch 'origin/3.0' into feat/TD-24700 2023-08-15 09:00:53 +08:00
dapan1121 31b0bcd716 fix: taosd crash issue 2023-08-15 08:51:23 +08:00
dapan1121 f9f74eaaf4
Merge pull request #22406 from taosdata/fix/TD-24684
fix: remove ins_modules table
2023-08-15 08:42:08 +08:00
yihaoDeng 1447d1d55c rebuild index at tag0 2023-08-15 00:40:12 +00:00
slzhou 012248b681 fix: move the only ctb idx flag to logical plan 2023-08-14 19:26:53 +08:00
liuyao 9d1e5a512d add stream task id 2023-08-14 17:52:39 +08:00
dapan1121 6a78053b51 feat: add hint supporting 2023-08-14 17:21:15 +08:00
wangmm0220 60191bef9e fix:tmq interface & remove snapshot code 2023-08-14 16:24:56 +08:00
Haojun Liao e8c9a019a4 fix(stream): remove the invalid set of scheduler status. 2023-08-14 11:41:24 +08:00
dapan1121 6ce28e8886 Merge remote-tracking branch 'origin/3.0' into feat/TD-24700 2023-08-14 10:49:56 +08:00
slzhou 646e52ae7f Merge branch '3.0' of github.com:taosdata/TDengine into szhou/tag-scan-opt 2023-08-14 10:19:36 +08:00
wangmm0220 dd0bc0e050 fix:heap use after free 2023-08-14 09:42:55 +08:00
Haojun Liao 0d38f389ab refactor: do some internal refactor. 2023-08-13 16:25:35 +08:00
Haojun Liao 03c26a9d6d refactor 2023-08-12 19:16:20 +08:00
Haojun Liao afe9b848a5 fix(tsdb): check the 2023-08-12 18:54:39 +08:00
Haojun Liao 09da6c6840 refactor: do some internal refactor. 2023-08-12 18:51:20 +08:00
Haojun Liao 75e6fb0f16 refactor: do some internal refactor. 2023-08-12 18:47:01 +08:00
Haojun Liao 8f9de93cf0 refactor: do some internal refactor. 2023-08-12 18:37:36 +08:00
Haojun Liao 0d0e30b764 fix(stream): fix the error. 2023-08-12 17:20:10 +08:00
Haojun Liao ce721a0146 fix(stream): fix error. 2023-08-12 16:32:05 +08:00
Haojun Liao a89ce1a20b fix(stream): transfer state by using data block. 2023-08-12 01:24:07 +08:00
Haojun Liao dea30255ec fix(stream): add new datablock type. 2023-08-11 23:51:52 +08:00
Haojun Liao f24b22000f enh(stream): stop stream task before redistribute vnodes. 2023-08-11 23:46:53 +08:00
wangmm0220 f1baed79b4 opti:rm useless code 2023-08-11 20:22:51 +08:00
wangmm0220 deda4b9eed opti:wal logic 2023-08-11 19:26:17 +08:00
dapan1121 c9656d3f77 fix: fix memory issues 2023-08-11 17:39:41 +08:00
wangmm0220 7b22d37f12 fix:lost data when consumer db 2023-08-11 17:25:43 +08:00
slzhou 42a4f364c1 Merge branch 'szhou/tag-scan-opt' of github.com:taosdata/TDengine into szhou/tag-scan-opt 2023-08-11 16:48:49 +08:00
yihaoDeng 6e6eb05d5c Merge branch 'enh/triggerCheckPoint2' into enh/chkpTransfer 2023-08-11 08:03:02 +00:00
Haojun Liao e984affe90 fix(stream): disable the stream in the followers nodes. 2023-08-11 15:58:15 +08:00
dapan1121 8987553d9c fix: remove ins_modules 2023-08-11 15:56:38 +08:00
shenglian zhou 1c7f854a71 enhance: add only meta ctb index to tag scan physi node 2023-08-11 14:47:28 +08:00
yihaoDeng 99be2836b2 Merge branch 'enh/triggerCheckPoint2' into enh/chkpTransfer 2023-08-11 02:50:12 +00:00
Haojun Liao 6a9826cf6e enh(stream): update the stream task epset. 2023-08-11 10:37:25 +08:00
yihaoDeng ba4ce9db02 Merge branch 'enh/triggerCheckPoint2' into enh/chkpTransfer 2023-08-11 02:15:07 +00:00
shenglian zhou b2e615d4e7 enhance: tag scan cursor based block 2023-08-10 17:30:01 +08:00
dm chen dd271bca6d
Merge pull request #22394 from taosdata/3.0
merge 3.0 to feat/TD-22970
2023-08-10 14:14:22 +08:00
Minglei Jin 33967b243b
Merge branch '3.0' into fix/TD-25010-3 2023-08-10 12:14:01 +08:00
Haojun Liao f633c7fe2b other: merge 3.0. 2023-08-10 11:56:30 +08:00
Haojun Liao b658608541
Merge pull request #22388 from taosdata/fix/3_liaohj
other: merge main.
2023-08-10 11:43:02 +08:00
yihaoDeng ef247cdb1d support reopen stream state 2023-08-10 01:49:26 +00:00
Haojun Liao 7e3f1d92fc Merge branch 'main' into fix/liaohj 2023-08-09 19:43:24 +08:00
Hui Li 10f5d223bb
Merge pull request #22370 from taosdata/FIX/TD-25605-3.0
enh: check if disk space sufficient at primary dir with tfs
2023-08-09 18:32:07 +08:00
Haojun Liao 1e8579e8c5 fix(stream): fix other cases. 2023-08-09 16:04:48 +08:00
Haojun Liao 4c92997328 fix(stream): use streamId&taskId to identify the stream task in the stream meta. 2023-08-09 15:52:23 +08:00
Haojun Liao 1d649bccb6
Merge pull request #22372 from taosdata/fix/TD-25626
fix taosd cannot quit
2023-08-09 15:46:14 +08:00
yihaoDeng bbcfa9ab03 support reopen stream state 2023-08-09 06:10:40 +00:00
Haojun Liao 3cdb16352c fix(stream): avoid launching check downstream when failed to add stream task into stream meta. 2023-08-09 12:03:14 +08:00
dapan1121 1d0624bbf1 Merge remote-tracking branch 'origin/3.0' into feat/TD-24700 2023-08-09 10:32:13 +08:00
dapan1121 1aac643a9b enh: support single vnode join 2023-08-09 10:30:35 +08:00
Haojun Liao f3c5f20ee2 enh(stream): add timer to check the node changing. 2023-08-09 10:25:16 +08:00
yihaoDeng fb7dec00e1 support reopen stream state 2023-08-09 01:50:49 +00:00
yihaoDeng cfb5247e30 change var name 2023-08-09 00:46:18 +00:00
Benguang Zhao e4d16e594c enh: check if disk space sufficient at primary dir with tfs 2023-08-08 17:53:11 +08:00
Haojun Liao af3a87560a refactor: do some refactor. 2023-08-08 09:11:41 +08:00
jiacy-jcy 6fd2ae138e fix: taosMktime on windows platform 2023-08-07 17:32:20 +08:00
yihaoDeng b6c991f896 support reopen stream state 2023-08-07 08:59:04 +00:00
yihaoDeng eeb97351e8 support reopen stream state 2023-08-07 08:51:01 +00:00
Haojun Liao 225c0e61dc hen(stream): support the rollback and checkdown stream tasks. 2023-08-07 16:13:39 +08:00
Minglei Jin fac7e521e9 s3/evict: fetch atime from stat file 2023-08-07 15:59:37 +08:00
dapan1121 0546bdceb2 Merge remote-tracking branch 'origin/3.0' into feat/TD-24700 2023-08-07 11:23:15 +08:00
Haojun Liao 8a11a0418f other: merge 3.0 2023-08-07 09:19:26 +08:00
yihaoDeng 6dc93a8dec add stream ver 2023-08-04 13:52:20 +08:00
dm chen 5b03ab1705
Merge branch '3.0' into feat/TD-22970 2023-08-03 17:43:51 +08:00
yihaoDeng f9d0874e45 support reopen stream state 2023-08-03 08:24:50 +00:00
Haojun Liao 13543f7daa feature(stream): handle task update in tq module. 2023-08-02 10:33:41 +08:00
Haojun Liao e1e5e9bb0f enh(stream): check stream tasks dag. 2023-08-02 09:44:39 +08:00
Haojun Liao 6b09566549
Merge pull request #22275 from taosdata/enh/addKeepAliveParam
add keep alive parameter
2023-08-02 09:23:03 +08:00
Haojun Liao ad4c5916e7 enh(stream): update the stream task. 2023-08-01 18:14:58 +08:00
Haojun Liao 164bfd5408 enh(stream): prepare update trans. 2023-08-01 16:12:35 +08:00
Haojun Liao 6365d5000b
Merge pull request #22271 from taosdata/fix/3_liaohj
fix(stream): dump results to sink node before paused.
2023-08-01 15:50:17 +08:00
yihaoDeng 2caaae392a add keep alive parameter 2023-08-01 06:38:30 +00:00
dmchen 8a0e9ff0e0 fix/retry_resolve_fqdn 2023-08-01 14:24:28 +08:00
Haojun Liao 75b1520be0 enh(stream): create task update info 2023-08-01 14:04:07 +08:00
Haojun Liao f6ae9cf9bb fix(stream): fetch all data before paused and dump to sink node. 2023-08-01 10:16:14 +08:00
Haojun Liao 36ef9a537f
Merge pull request #22256 from taosdata/fix/TD-25457
check update data
2023-07-31 22:56:05 +08:00
Haojun Liao 2640e41705
Merge pull request #22261 from taosdata/fix/3_liaohj
fix(stream): set the correct end key of delete block.
2023-07-31 22:55:50 +08:00
wade zhang d0b9c5172c
Merge pull request #22249 from taosdata/feat/3.0/TD-25446
force stt_trigger to be 1
2023-07-31 18:26:18 +08:00
Haojun Liao d45596bb33 fix(stream): kill task when pause the stream execution. 2023-07-31 18:07:37 +08:00
liuyao 32b59af4b1 check update data 2023-07-31 17:32:24 +08:00
Haojun Liao 9981cecbed refactor: do some internal refactor. 2023-07-31 15:24:35 +08:00
wade zhang 79646fff10
Merge pull request #22246 from taosdata/szhou/fix-ts3744
fix: increase condition size
2023-07-31 14:48:06 +08:00
Haojun Liao e61aa83594 enh(stream): handle the stream hb. 2023-07-31 14:07:18 +08:00
wangjiaming0909 196ae283aa force stt_trigger to be 1 2023-07-31 14:03:07 +08:00
slzhou 6151b790d9 fix: increase the condition size of user privileges to 48k 2023-07-31 13:25:56 +08:00
wade zhang e5f3835e48
Merge pull request #22229 from taosdata/fix/TS-3724
fix:modify dot to underline in schemaless supertable name
2023-07-31 09:10:34 +08:00
wade zhang bae028d65c
Merge pull request #22230 from taosdata/mark/tmq
fix:semaphore always wait in tmq commit logic
2023-07-31 09:10:13 +08:00
slzhou 069103be74 fix: increase condition size 2023-07-30 21:17:30 +08:00
Haojun Liao 8dfef8768a other: merge 3.0 2023-07-29 22:54:16 +08:00
Haojun Liao f6e07d1fdb other: merge 3.0 2023-07-29 01:32:02 +08:00
Haojun Liao 936afeb5ac refactor: do internal refactor to simple the pause/resume in case of fill history exists. 2023-07-28 19:13:03 +08:00
Haojun Liao d5974a8f25 refactor(stream): refactor the pause/resume for fill history execution. 2023-07-28 18:05:32 +08:00
dapan1121 b7126b9cc6 Merge remote-tracking branch 'origin/3.0' into feat/TD-24700 2023-07-28 18:01:11 +08:00
wangmm0220 1f8e5eae6a fix:conflicts 2023-07-28 15:04:12 +08:00
Haojun Liao 9f943213ed enh(stream): update the hb info. 2023-07-28 14:23:53 +08:00
Haojun Liao 74834aea11 enh(stream): prepare hb to mnode from stream meta. 2023-07-28 13:07:16 +08:00
Haojun Liao 2a78cd2d23
Merge pull request #22215 from taosdata/fix/liaohj
other: merge main.
2023-07-28 13:06:17 +08:00
Haojun Liao ccc0f13649
Merge pull request #22214 from taosdata/fix/3_liaohj
fix(stream): scan wal in step2
2023-07-28 00:42:15 +08:00
Haojun Liao 22a5a18fff fix(stream): 1. set correct timewindow after step2. 2. handle the case when the task is failed to be added into the meta store. 2023-07-27 18:57:36 +08:00
Shungang Li fb226c2cdb enh: check cluster ttlChangeOnWrite consistency 2023-07-27 16:49:56 +08:00
Haojun Liao b145771a1b other: merge 3.0 2023-07-27 16:38:57 +08:00
Haojun Liao 3d403dca5a other: merge main. 2023-07-27 16:23:41 +08:00
wade zhang cc3cc73cfc
Merge pull request #22199 from taosdata/fix/TS-3708
fix/TS-3708: check term for role time
2023-07-27 15:43:23 +08:00
Haojun Liao 40fe3ef4f6 fix(stream): refactor the step2 wal scan. 2023-07-27 14:49:20 +08:00
Shungang Li 167ecea705 fix: check term for role time
1. time of mnode becomes current role in this term
2. show 0 for offline mnodes
2023-07-27 14:16:54 +08:00
wangmm0220 5fa580960e fix:semaphore always wait in tmq commit logic 2023-07-27 13:53:42 +08:00
Haojun Liao e89f530db2 fix(stream): scan wal in step2 2023-07-27 10:55:59 +08:00
wade zhang 120aa46c22
Merge pull request #22194 from taosdata/FIX/TD-25362-3.0
enh: change default WAL_RETENTION_PERIOD as 3600
2023-07-27 09:16:11 +08:00
dapan1121 e83a46b88f enh: cache necessary file for seq mode 2023-07-26 19:17:59 +08:00
Haojun Liao 610f9d19c1
Merge pull request #22188 from taosdata/fix/3_liaohj
fix(stream): set the correct step2 scan time window range.
2023-07-26 16:34:10 +08:00
Haojun Liao df57768a3e Merge branch '3.0' into fix/3_liaohj 2023-07-26 14:45:11 +08:00
Benguang Zhao c3c48f265f enh: change default WAL_RETENTION_PERIOD as 3600 2023-07-26 14:10:56 +08:00
dapan1121 4e5fbb52ee Merge remote-tracking branch 'origin/3.0' into feat/TD-24700 2023-07-26 13:56:46 +08:00
dapan1121 6a0061ccfb fix: invalid task status update issue 2023-07-26 13:54:58 +08:00
Haojun Liao 728112ed89 fix(stream): set correct upstream epinfo. 2023-07-26 10:26:59 +08:00
wangmm0220 f2553b8718 fix:add configuration to control if change dot to underline in schemaless 2023-07-26 09:52:04 +08:00
Haojun Liao 1c1bf63e1f other: merge 3.0 2023-07-25 18:17:11 +08:00
Haojun Liao 0bdccd2681 refactor: do some internal refactor. 2023-07-25 17:31:54 +08:00
Haojun Liao 96722a07b1
Merge pull request #22174 from taosdata/fix/3_liaohj
fix(stream): fix the invalid check of step2 .
2023-07-25 00:30:06 +08:00
Haojun Liao a2694b9ce9 fix(stream): fix the invalid check of step2 . 2023-07-24 19:44:28 +08:00
dapan1121 dce1f579ea
Merge pull request #22143 from taosdata/enh/TD-24987-3.0
enh: expire time optimize
2023-07-24 16:18:59 +08:00
Haojun Liao 1e34f84f78 other: merge 3.0 2023-07-24 15:23:03 +08:00
dapan1121 4f75eb5655 Merge remote-tracking branch 'origin/3.0' into feat/TD-24700 2023-07-24 11:43:15 +08:00
Haojun Liao 13bab114cb
Merge pull request #22155 from taosdata/fix/3_liaohj
fix(stream): refactor the halt status to check more status.
2023-07-24 11:04:08 +08:00
wade zhang 5f25d70fc2
Merge pull request #22154 from taosdata/enh/tsdb_optimize
fix(tsdb/cache): new next stt row state for fs tranverse
2023-07-24 10:47:51 +08:00
Haojun Liao 1367552f38 fix(stream): refactor the halt status to check more status. 2023-07-24 10:04:15 +08:00
Haojun Liao 6a19ad3127
Merge pull request #22151 from taosdata/fix/3_liaohj
fix(stream): set the correct flag of pause/resume.
2023-07-24 09:07:49 +08:00
Minglei Jin 13491fab95 tsdb/cache: new next stt row state for fs tranverse 2023-07-24 08:51:20 +08:00
Haojun Liao 4e0f7ffbf8 fix(stream): set the correct flag of pause/resume. 2023-07-23 18:49:56 +08:00
Haojun Liao 321be1f83f
Merge pull request #22135 from taosdata/fix/3_liaohj
refactor: do some internal refactor.
2023-07-22 15:06:28 +08:00
Haojun Liao 1b2636028a fix(stream): fix memory leak. 2023-07-21 23:05:42 +08:00
Haojun Liao 16d7707b90 fix(stream): align the scan real time data for stream task. 2023-07-21 19:33:43 +08:00
wade zhang 7b1e809d98
Merge pull request #21794 from taosdata/enh/tsdb_optimize
for test purpose
2023-07-21 14:18:32 +08:00
Minglei Jin 14418fab6f tarray2: remove typeof for vs 2017 ci macros 2023-07-21 13:22:31 +08:00
dmchen 7d480cf3ac compatible old sync config 2023-07-21 10:31:53 +08:00
Haojun Liao d0da988b7d Merge branch '3.0' into fix/3_liaohj 2023-07-21 09:47:44 +08:00
dapan1121 2ef01728ca
Merge pull request #22089 from wangjiaming0909/fix/3.0/TD-23763
feat: optimize partition by tbname slimit
2023-07-21 09:29:36 +08:00
Haojun Liao db46d31ca5 fix(stream): refactor the halt function. 2023-07-21 01:32:42 +08:00
Minglei Jin e333f47f27 tarray2/typeof: remove typeof for windows size 2023-07-20 19:16:17 +08:00
wangmm0220 99c3ebc282 fix:optimize log & change return value for async interface 2023-07-20 18:28:21 +08:00
wangjiaming0909 7d850c1a5e feat: optimize partition by tbname slimit 2023-07-20 15:07:55 +08:00
Haojun Liao 87fa8f0c4c Merge branch '3.0' into fix/3_liaohj 2023-07-20 12:15:23 +08:00
Haojun Liao aed99da6c1 refactor: refactor the stream task starting order. 2023-07-20 12:14:53 +08:00
yihaoDeng 6e5be0d30e fix stream state transfer 2023-07-20 03:49:32 +00:00
Haojun Liao 97c44e7c18 refactor: do some internal refactor. 2023-07-19 18:42:02 +08:00
dapan1121 cbe03ef212
Merge pull request #22069 from taosdata/enh/TS-2288
enh: add scope for show xx variables
2023-07-19 18:01:11 +08:00
wangmm0220 5cb35f2fa6 feat:add committed & position & commite_offset interface 2023-07-19 17:29:39 +08:00
Minglei Jin 4b96bc7147
Merge branch '3.0' into enh/tsdb_optimize 2023-07-19 11:15:57 +08:00
dm chen 141004bf77
Merge branch '3.0' into feat/TD-22970 2023-07-19 10:57:40 +08:00
dapan1121 c45359c989 enh: add batch table scan 2023-07-19 10:37:30 +08:00
Haojun Liao a32c650248 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-07-19 10:05:48 +08:00
Haojun Liao 2ae95217bd fix(stream): open inputQ by default for task deployed on snode. 2023-07-19 10:05:35 +08:00
liuyao fd02b9a71e
Merge branch '3.0' into enh/triggerCheckPoint2 2023-07-19 10:02:06 +08:00
wade zhang c3e5375f15
Merge pull request #22085 from taosdata/FEAT/TS-2699-3.0
feat: distribute vnode primary dirs among disks of level 0
2023-07-19 09:44:43 +08:00
wangmm0220 5c344b0159 fix:conflicts from main 2023-07-19 09:05:05 +08:00
wangmm0220 e812a659a8 fix:add tmq_position() interface & optimize commit logic 2023-07-18 19:30:40 +08:00
dmchen 3711fdd865 feat/TD-22970 2023-07-18 16:09:38 +08:00
Benguang Zhao 02f4613154 enh: report VND_INIT_FAILED on vnodes open failure in vmOpenVnodes 2023-07-18 15:44:51 +08:00
Haojun Liao d2c875e774 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-07-18 15:19:09 +08:00
Haojun Liao 901b7d8ecc fix(stream): if a source task is set to be non-normal, no data should be put into inputQ anymore. 2023-07-18 15:18:57 +08:00
dapan1121 07fca2124d Merge remote-tracking branch 'origin/3.0' into feat/TD-24700 2023-07-18 14:45:26 +08:00
dapan1121 294376de0b enh: add batch table scan 2023-07-18 14:44:53 +08:00
Benguang Zhao 24fed51137 enh: tfsRename dir on primary disk at last 2023-07-18 13:58:43 +08:00
yihaoDeng 40d59990d8 fix mem leak 2023-07-18 04:01:20 +00:00
Benguang Zhao 5624ecc8df fix: prepare vnode dir recursively in vnodeCreate 2023-07-18 11:32:23 +08:00
Benguang Zhao 6b6b7d8d8f enh: alloc disk of vnode primary dir in vmAllocPrimaryDisk 2023-07-18 11:32:23 +08:00
wangmm0220 872222eb77 fix:[TD-25222] error in drop topic if topic num is too long 2023-07-17 19:52:07 +08:00
yihaoDeng b56e442478 Merge branch 'enh/dev33' into enh/triggerCheckPoint2 2023-07-17 11:41:38 +00:00
Ganlin Zhao 929db3d647 Merge branch '3.0' into enh/TS-2288 2023-07-17 16:09:07 +08:00
Ganlin Zhao 707be3a6fe unify scope for client/system/server configs 2023-07-17 15:53:08 +08:00
Haojun Liao 08f43b9d00 fix(stream): fix checkpoint block not fetched bug. 2023-07-17 15:31:54 +08:00
Haojun Liao b2a905bd91
Merge branch '3.0' into enh/triggerCheckPoint2 2023-07-17 11:50:12 +08:00
dapan1121 a1e18ac898 fix: fix global cache issue 2023-07-17 09:25:28 +08:00
kailixu 0e6b982682 chore: more code 2023-07-17 09:19:24 +08:00
Haojun Liao a9757637d9 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-07-16 12:47:24 +08:00
Haojun Liao c6a322e0ef refactor(stream): back pressure is active, which is trigger by dispatch rsp. 2023-07-16 12:47:08 +08:00
yihaoDeng e18c9ea672 add checkpoint 2023-07-15 04:26:34 +00:00
dapan1121 188df1d675 fix: fix bugs 2023-07-14 19:36:56 +08:00
yihaoDeng ed931c1100 Merge branch 'fix/newCheckpoint' into enh/triggerCheckPoint2 2023-07-14 10:11:20 +00:00
yihaoDeng 3c4631ef1f add checkpoint 2023-07-14 10:06:24 +00:00
Haojun Liao 2b85ea62aa refactor: do some internal refactor. 2023-07-14 17:48:47 +08:00
Haojun Liao eb7e6152ae refactor(stream): do some internal refactor. 2023-07-14 17:21:20 +08:00
wangmm0220 6762a01d88 Merge branch 'main' of https://github.com/taosdata/TDengine into mark/tmq 2023-07-14 16:44:00 +08:00
wangmm0220 bbdcbcb75b fix:modify commit version to next validate version 2023-07-14 16:43:28 +08:00
wangjiaming0909 b850c1af47 fix: state/session/event window with order by _wstart/_wend has no effect 2023-07-14 16:03:59 +08:00
Ganlin Zhao cdb3453812 add show local variables scope 2023-07-14 14:38:35 +08:00