Commit Graph

4185 Commits

Author SHA1 Message Date
Haojun Liao 7cf90dde5c refactor: do some internal refactor. 2023-11-01 19:38:13 +08:00
Haojun Liao 00f029e44f refactor: add some logs. 2023-11-01 19:38:12 +08:00
Haojun Liao 246ed4e022 refactor: do some internal refactor. 2023-11-01 17:19:21 +08:00
liuyao 505c44d9aa Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898 2023-11-01 16:50:46 +08:00
Haojun Liao 12bc4f32cf refactor: add some logs. 2023-11-01 16:12:15 +08:00
yihaoDeng 4c8edb5545 Merge branch 'enh/new3.0' into enh/refactorBackend 2023-11-01 16:07:49 +08:00
slzhou 4a2c52783b Merge branch '3.0' of github.com:taosdata/TDengine into szhou/insert-stb-tbname 2023-11-01 14:10:02 +08:00
dapan1121 6305353290 Merge remote-tracking branch 'origin/3.0' into feat/TD-25204 2023-11-01 10:38:50 +08:00
kailixu 1530fe0c49 Merge branch '3.0' into enh/TD-23769-3.0x 2023-11-01 09:52:16 +08:00
kailixu ad1e6accd4 chore: build checkpoint for rsma 2023-11-01 09:45:58 +08:00
yihaoDeng bb8252df16 fix mem leak 2023-10-31 20:59:24 +08:00
dapan1121 91df56fcf0 Merge remote-tracking branch 'origin/3.0' into feat/TD-25204 2023-10-31 18:44:54 +08:00
Haojun Liao a1aa2380ae other: merge 3.0 2023-10-31 16:42:51 +08:00
Haojun Liao 0b18192b23 fix(stream): fix error in finishing event handling. 2023-10-31 16:40:16 +08:00
Haojun Liao 4c0242a58d fix(stream): fix error in finishing event handling. 2023-10-31 16:39:14 +08:00
liuyao 696294c208 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898 2023-10-31 15:41:04 +08:00
wade zhang 76c9b9afc5
Merge pull request #23377 from taosdata/FIX/TD-26596-3.0
feat: support pipelining of snap replication
2023-10-31 15:19:07 +08:00
Haojun Liao 86dfc52a6e fix(stream): add event check when handling the end of event. 2023-10-31 10:45:12 +08:00
liuyao 5b74bf87b1 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898 2023-10-30 17:55:14 +08:00
dapan1121 0a97f18d72
Merge pull request #23344 from taosdata/feat/3.0/TS-4052
feat: support to_timestamp/to_char
2023-10-30 14:04:33 +08:00
Haojun Liao 19c5882cbe fix(stream): add event check when handling the end of event. 2023-10-30 10:22:24 +08:00
Benguang Zhao 70e261f662 enh: terminate snap replication on timeout 2023-10-30 10:14:26 +08:00
Haojun Liao c7285c0ede fix(stream): add expired epset node list for stream tasks in hb to mnode. 2023-10-27 23:41:57 +08:00
Haojun Liao 4c267b538f fix(stream): add expired epset node list for stream tasks in hb to mnode. 2023-10-27 23:05:41 +08:00
dapan1121 9801d5d7b7 fix: desciribe view and memory issues 2023-10-27 19:28:22 +08:00
Haojun Liao dcca6b0868 other: merge 3.0. 2023-10-27 11:41:28 +08:00
dapan1121 099f72e84a fix: memory issues 2023-10-27 11:36:17 +08:00
Haojun Liao 454624516c fix(stream): handle the repeatly issued nodeUpdate msg from dnode. 2023-10-27 09:59:51 +08:00
Haojun Liao 1ccbb77981 fix(stream): fix dead lock when shutdown all tasks. 2023-10-27 09:59:37 +08:00
Haojun Liao b0ef072556 fix(stream): clear flag for checkpoint. 2023-10-27 09:55:07 +08:00
Haojun Liao 091238e7be fix(stream): fix bugs caused by refactor sm. 2023-10-27 09:54:58 +08:00
Haojun Liao e1f6043eed fix(stream): fix bugs caused by refactor sm. 2023-10-27 09:54:57 +08:00
Haojun Liao 1eac7f44c0 fix(stream): fix error in stream. 2023-10-27 09:54:56 +08:00
Haojun Liao 579dd8e6b2 refactor(stream): do some internal refactor. 2023-10-27 09:54:56 +08:00
Haojun Liao 6f3c0d17cc refactor(stream): add state machine to manage the state of stream tasks. 2023-10-27 09:54:49 +08:00
Haojun Liao 596eb073b7 refactor(stream): do some internal refactor. 2023-10-27 09:54:48 +08:00
Haojun Liao 2409a17517 refactor(stream): do some internal refactor. 2023-10-27 09:54:44 +08:00
Haojun Liao 164159f293 enh(stream): add parameter to limit the stream sink task. 2023-10-27 09:54:07 +08:00
liuyao d0e4a5d0f7 opt max delay 2023-10-25 20:29:25 +08:00
yihaoDeng db0f6258fe fix stream case error 2023-10-25 19:38:22 +08:00
liuyao f51c985914 stream event window 2023-10-25 17:50:16 +08:00
Benguang Zhao 7d9d1c6877 enh: terminate snap replication on timeout 2023-10-25 14:50:53 +08:00
slzhou c17300557d fix: memory sanitizer error of simple insert stb 2023-10-25 10:56:28 +08:00
Haojun Liao 03165d5327 fix(stream): handle the repeatly issued nodeUpdate msg from dnode. 2023-10-25 09:55:02 +08:00
dmchen 8e007f199b format 2023-10-24 11:31:50 +00:00
Haojun Liao 8cde39eebd fix(stream): fix dead lock when shutdown all tasks. 2023-10-24 19:11:24 +08:00
shenglian zhou ae1bac251a enhance: finished skeleton 2023-10-24 16:08:08 +08:00
dmchen 7c83d190a4 ts format 2023-10-24 05:29:45 +00:00
dapan1121 dbbceae061 fix: union all view issue 2023-10-24 11:29:04 +08:00
wangjiaming0909 f299a28109 feat: support to_timestamp/to_char 2023-10-23 19:36:03 +08:00
slzhou 8cdcc42283 enhance: add comments to SVnodeModifyOpStmt 2023-10-23 17:03:18 +08:00
dmchen dec257ff59 TD-26529 2023-10-23 08:59:54 +00:00
slzhou 0cfbcd7a13 Merge branch '3.0' of github.com:taosdata/TDengine into szhou/continue-coing 2023-10-23 16:34:21 +08:00
shenglian zhou e713b7c22f enhance: insert stb skeleton development 2023-10-23 16:27:00 +08:00
dapan1121 ab98f7623c Merge remote-tracking branch 'origin/3.0' into feat/TD-25204 2023-10-23 08:44:46 +08:00
Haojun Liao 059e94e428 fix(stream): clear flag for checkpoint. 2023-10-22 01:25:00 +08:00
slzhou 3fe5c447e7 enhance: begin parse cols 2023-10-20 17:16:45 +08:00
yihaoDeng 1a4cfd11a5 Merge branch 'enh/new3.0' into enh/refactorBackend 2023-10-20 15:28:10 +08:00
Haojun Liao 3b8c85f632 fix(stream): fix bugs caused by refactor sm. 2023-10-20 14:19:57 +08:00
Haojun Liao 270a847809 fix(stream): fix bugs caused by refactor sm. 2023-10-20 10:23:48 +08:00
Haojun Liao 9f9fae3b99
Merge pull request #23329 from taosdata/opt/addStatusSend
Opt/add status send
2023-10-20 09:52:12 +08:00
wade zhang 628667f22c
Merge pull request #23231 from taosdata/FEAT/TS-3816-3.0
feat: support restoring vnodes on replaced disks as needed
2023-10-20 09:02:25 +08:00
dapan1121 42f440b0fb Merge remote-tracking branch 'origin/3.0' into feat/TD-25204 2023-10-20 08:46:32 +08:00
dapan1121 969b002936 enh: support view privilege 2023-10-20 08:41:49 +08:00
Haojun Liao c1cebae6ba fix(stream): fix error in stream. 2023-10-19 16:20:27 +08:00
slzhou 332268fd4b set super table name for stb syntax and rename setRefreshMate to setRefreshMeta 2023-10-19 15:55:24 +08:00
Haojun Liao da8f6a4c2f
Merge pull request #23248 from taosdata/feat/TD-26647
recover session buff state
2023-10-19 15:34:03 +08:00
Haojun Liao 402aefd95d refactor(stream): do some internal refactor. 2023-10-19 15:09:47 +08:00
shenglian zhou 8532227a36 fix: first schema clause top - target is supertable 2023-10-19 11:30:44 +08:00
Benguang Zhao a2e0480839 refact: rename as SYNC_FSM_STATE_COMPLETE 2023-10-19 11:18:57 +08:00
Benguang Zhao eb4e2aa58f feat: restore incomplete fsm state with maxVerValid via snapshot replication 2023-10-19 11:04:36 +08:00
Benguang Zhao e1c03118ab enh: extract snapshot info for both of snap reader and writer 2023-10-19 10:51:13 +08:00
Benguang Zhao 410ced8320 feat: use TLV format to encode data of snapshot info 2023-10-19 10:51:13 +08:00
yihaoDeng b9b62a9a00 add rpc sync read timeout 2023-10-19 10:38:45 +08:00
Benguang Zhao 083dd148be feat: exchange difference of snapshot info for replication 2023-10-19 10:37:34 +08:00
Haojun Liao f4caeca24a refactor(stream): add state machine to manage the state of stream tasks. 2023-10-19 10:34:20 +08:00
dapan1121 afe963a9d1 enh: support view privilege 2023-10-19 08:31:31 +08:00
Haojun Liao 54ec679b58 refactor(stream): do some internal refactor. 2023-10-18 15:34:53 +08:00
Haojun Liao c6dd73b68b
Merge pull request #23187 from taosdata/feat/TD-26056
feat:add replay logic
2023-10-18 11:43:43 +08:00
Haojun Liao 2904cfd4d5 Merge branch 'main' into refact/streamsm 2023-10-18 10:29:09 +08:00
yihaoDeng 2004c1a346 fix transfer crash 2023-10-17 18:19:52 +08:00
Haojun Liao 7b7ce10475 refactor(stream): do some internal refactor. 2023-10-17 11:23:04 +08:00
Haojun Liao fdb6ec1fa3 enh(stream): add parameter to limit the stream sink task. 2023-10-16 22:52:39 +08:00
dapan1121 7c8cf28b37 feat: add privileges 2023-10-16 19:53:08 +08:00
wangmm0220 473142fab7 fix:conflicts from 3.0 2023-10-16 11:35:56 +08:00
dapan1121 aab4cb98dc enh: create & drop view meta processing 2023-10-13 19:16:37 +08:00
dapan1121 a0699d758c Merge remote-tracking branch 'origin/3.0' into feat/TD-25204 2023-10-13 16:51:38 +08:00
dapan1121 c0a4328803 feat: support view meta updating 2023-10-13 16:29:34 +08:00
liuyao 7269dedb39 Merge branch '3.0' of https://github.com/taosdata/TDengine into 3.0 2023-10-13 11:35:01 +08:00
liuyao 429125be93 session state recover 2023-10-13 11:32:35 +08:00
shenglian-zhou cbd9749bfe
Merge branch '3.0' into szhou/pseudo-column-aliasname 2023-10-12 19:01:28 -05:00
yihaoDeng a56d831a14 refactor backend 2023-10-12 20:16:41 +08:00
dapan1121 7c67f23469 feat: update view meta 2023-10-12 19:56:17 +08:00
slzhou b78a32eb1a Merge branch '3.0' of github.com:taosdata/TDengine into szhou/pseudo-column-aliasname 2023-10-12 11:01:50 +08:00
Haojun Liao eb4449999f other: merge 3.0 2023-10-12 10:33:48 +08:00
yihaoDeng f264ffdcd6 refactor backend 2023-10-11 20:12:07 +08:00
yihaoDeng 031506aef8 refactor backend 2023-10-11 19:46:35 +08:00
dapan1121 f5768494b4 feat: support describe view command 2023-10-11 18:49:47 +08:00
dapan1121 478de7ae56 feat: add show create view implement 2023-10-11 10:38:22 +08:00
Haojun Liao adf6f65d09 fix(stream): set initial version for fill-history task. disable reentry of scan-history task function. 2023-10-10 14:00:30 +08:00
dapan1121 d229492616 Merge remote-tracking branch 'origin/3.0' into feat/TD-25204 2023-10-09 18:34:08 +08:00
dapan1121 7c7cf2b1aa enh: support balance group leader on vgroup_id 2023-10-09 15:46:41 +08:00
Haojun Liao d87db2f829 fix(stream): fix the pause failure bug. 2023-10-09 14:48:11 +08:00
Haojun Liao ee6516f3c4 enh(stream): add trans to reset task status to avoid being frozen in checkpoint status due to doing checkpoint failure of partial tasks. 2023-10-09 10:13:53 +08:00
dapan1121 5b639a172d feat: support query from view 2023-10-08 18:36:06 +08:00
wangmm0220 b04d57fcc3 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26056 2023-10-08 16:15:19 +08:00
wangmm0220 3f2d890560 feat:[TD-26056] add replay logic 2023-10-08 16:06:15 +08:00
liuyao c75506b271 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26174 2023-10-08 09:02:51 +08:00
slzhou 94b9d0f10a Merge branch '3.0' of github.com:taosdata/TDengine into szhou/pseudo-column-aliasname 2023-10-08 08:58:34 +08:00
Haojun Liao 23fb26798f fix(stream): sleep for 10ms 2023-10-07 19:47:49 +08:00
Haojun Liao ab17bfdf09 refactor: do some internal refactor. 2023-10-07 19:16:55 +08:00
liuyao 1aaf873134 fix issue 2023-10-07 17:43:50 +08:00
yihaoDeng c146327da8 refact task backend 2023-10-07 16:48:36 +08:00
yihaoDeng fa70221238 refact task backend 2023-10-07 12:17:55 +08:00
Haojun Liao c20dd002fb enh(stream): add more info for sink task. 2023-10-07 01:14:00 +08:00
kailixu 086213a6c2 enh: dnode notify logic 2023-10-05 21:35:57 +08:00
Haojun Liao 41ef1a45c1 enh(stream): optimize the scan wal perf 2023-10-04 22:06:46 +08:00
Haojun Liao a543f4ca97 refactor: do some internal refactor. 2023-10-03 01:52:03 +08:00
Haojun Liao 5718158fc0 refactor: do some internal refactor. 2023-10-01 22:27:29 +08:00
Haojun Liao f2d8431619 fix(stream): enable new time range for stream task. 2023-09-28 18:26:52 +08:00
yihaoDeng 54e3ac2c1e refact task backend 2023-09-28 15:46:12 +08:00
Haojun Liao 0047d1e1a6 Merge branch 'main' into fix/liaohj 2023-09-28 14:35:14 +08:00
dapan1121 0a0f512023 feat: add view meta processing 2023-09-28 11:44:38 +08:00
Haojun Liao 80ec77cbb6 enh(stream): optimize the stream status when creating without fill-history option. 2023-09-28 11:23:03 +08:00
Haojun Liao 22e485d132 fix(stream): opt perf. 2023-09-28 09:25:23 +08:00
Haojun Liao cc9b9d1054
Merge pull request #23102 from taosdata/fix/liaohj
fix(stream): fix several bugs and do some internal refactor for stream processing.
2023-09-28 09:12:39 +08:00
Haojun Liao e13efd5b04 refactor: optimize the fill-history task launch policy, and do some other internal refactor. 2023-09-27 14:00:48 +08:00
slzhou dee6006ed9 Merge branch '3.0' of github.com:taosdata/TDengine into szhou/continue-coing 2023-09-27 10:02:49 +08:00
liuyao ebf4283e91 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26174 2023-09-26 17:19:41 +08:00
liuyao c95dc167b7 add ci 2023-09-26 17:19:21 +08:00
wade zhang f6134b42d7
Merge pull request #23036 from taosdata/feat/TS-4011-3.0
feat/TS-4011: adjust config 'keep_time_offset' level from dnode to db
2023-09-26 14:25:54 +08:00
Haojun Liao 890d658aea refactor: do some internal refactor. 2023-09-26 14:11:45 +08:00
Haojun Liao 525ee369d3
Merge pull request #23032 from taosdata/fix/liaohj
fix(stream): fix several stability-related bugs in stream framework.
2023-09-26 14:10:58 +08:00
Haojun Liao f3f18b0fa3 fix(stream): add new status for meta. 2023-09-26 12:15:12 +08:00
liuyao ca2325f886 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26174 2023-09-26 10:41:31 +08:00
liuyao 82e18e32b0 add ci 2023-09-26 10:41:12 +08:00
Haojun Liao d214a2f6bd fix(stream): do some internal refactor. 2023-09-26 09:32:57 +08:00
Haojun Liao 6cc3618ed9 fix(stream): fix error in pause scan-history data. 2023-09-26 01:09:55 +08:00
dmchen ffa07cbdb0 detail length 2023-09-25 19:21:34 +08:00
Haojun Liao 966ce4f30e Merge remote-tracking branch 'origin/fix/liaohj' into fix/liaohj 2023-09-25 16:00:02 +08:00
Haojun Liao fcf4cc7169 fix(stream): fix the invalid counter for ready tasks in vnode, fix an invalid read. 2023-09-25 15:58:24 +08:00
Shungang Li 743a5b0640 feat: add db config item keep_time_offset 2023-09-25 15:46:08 +08:00
wade zhang 7a711bc687
Merge pull request #22879 from taosdata/enh/TS-3812-3.0
enh: timeseries calculation
2023-09-25 12:23:16 +08:00
Haojun Liao dbc53069db
Merge branch 'main' into fix/liaohj 2023-09-25 10:41:18 +08:00
Haojun Liao eb4078b7f3 fix(stream): record the tasks started info, and do some internal refactor. 2023-09-25 09:59:05 +08:00
Haojun Liao c987f61300 fix(stream): fix race condition. 2023-09-25 01:37:27 +08:00
Haojun Liao 4ea737571d refactor: do some internal refactor. 2023-09-24 01:26:51 +08:00
Haojun Liao acd3321494 fix(stream): rsp when checkpoint source failed. 2023-09-23 14:13:33 +08:00
kailixu 8f828e052b enh: timeseries calculation optimization 2023-09-22 20:07:51 +08:00
liuyao 5cc1ae1266 fix issue 2023-09-22 19:25:19 +08:00
dmchen 09f74cc9ad fix/TD-26434 2023-09-22 18:47:16 +08:00
Haojun Liao 5b12e276cf fix(stream): add msg identifier check. 2023-09-22 18:13:18 +08:00
yihaoDeng 11da631bb5 add cvt state 2023-09-22 09:08:42 +00:00
Haojun Liao 619a9f6d08 fix(stream): refactor re-try dispatch msg for stream tasks. 2023-09-22 15:57:55 +08:00
slzhou fb62588dd3 fix: nodesIsStar and nodesIsTableStar 2023-09-22 15:26:39 +08:00
liuyao 410a177637 fix issue 2023-09-22 15:00:26 +08:00
Haojun Liao 898aea5cfb refactor(stream): refactor send msg. 2023-09-22 14:52:18 +08:00
dapan1121 a61d90f672 enh: remove column list 2023-09-22 11:36:53 +08:00
Haojun Liao 87ea745861 fix(stream): add some logs, and remove invalid assert. 2023-09-22 10:53:03 +08:00
Haojun Liao f7bcff862d fix(stream): add check info detailed information. 2023-09-22 10:23:56 +08:00
slzhou 9bb628650c fix: pass basic test 2023-09-22 10:13:17 +08:00
liuyao dc2f7872f8 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26174 2023-09-22 09:41:15 +08:00
liuyao 4979fc5283 fix issue 2023-09-22 09:40:08 +08:00
dapan1121 a67b0c99fc feat: support create/drop view 2023-09-21 19:28:07 +08:00
yihaoDeng 470849982e add cvt func 2023-09-21 09:41:30 +00:00
shenglian zhou 80f77251b2 merge with 3.0 and finish coding star expansion 2023-09-21 17:04:12 +08:00
dapan1121 64da3f4ef9
Merge pull request #22978 from taosdata/szhou/show-db-table
enhance: show normal/child tables and show user/system databases
2023-09-21 16:55:26 +08:00
Haojun Liao 17586af0ce refactor: do refactor the sink task. 2023-09-21 13:32:57 +08:00
liuyao 3b3c5d7cb8 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26174 2023-09-21 10:11:36 +08:00
Haojun Liao 6633fb971b fix(stream): update logs. 2023-09-20 18:18:31 +08:00
liuyao 1cebda368a session&state operator buff 2023-09-20 15:06:08 +08:00
dm chen 4497a01168
Merge branch 'main' into feat/TD-26127-audit-sql 2023-09-20 11:13:34 +08:00
slzhou 1c27c2123f enhance: select `tbname` from (select tbname from d.st) 2023-09-20 11:06:59 +08:00
Haojun Liao b4419bda65 enh(stream): add node stage check. 2023-09-20 10:35:01 +08:00
slzhou 951786669d fix: modify show_kind enum value from none to all 2023-09-20 08:39:57 +08:00
wangjiaming0909 1e53e6cfeb optimize count()/last() + partition by tbname/tag 2023-09-19 14:56:02 +08:00
dm chen ee913cbfbc
Merge branch 'main' into feat/TD-26127-audit-sql 2023-09-19 14:39:20 +08:00
dapan1121 b9d554275c Merge remote-tracking branch 'origin/3.0' into feat/TD-25204 2023-09-19 14:21:00 +08:00
dapan1121 14e8db289d feat: support view 2023-09-19 14:19:54 +08:00
shenglian zhou 2773f1e9ac fix: continue coding 2023-09-19 14:03:06 +08:00
dmchen e36ff1282c revert dependency 2023-09-19 13:42:02 +08:00
Haojun Liao b7efedf4aa enh(stream): log the checkpoint time. 2023-09-19 09:53:33 +08:00
Haojun Liao e76bab7122 fix(stream): not handle the check msg for follower tasks. 2023-09-19 09:43:14 +08:00
shenglian zhou 94a616fcc1 fix: save and continue 2023-09-18 16:59:07 +08:00
Haojun Liao c33ef4ce88 fix(stream): add null check 2023-09-18 15:14:51 +08:00
dmchen b473122dac break dependency 2023-09-18 12:29:08 +08:00
dmchen 5f0274e83d break dependency 2023-09-18 11:44:06 +08:00
dmchen a64ddfc736 break dependency 2023-09-18 10:59:50 +08:00
dm chen fda32dcc51
Merge branch 'main' into feat/TD-26127-audit-sql 2023-09-18 09:41:47 +08:00
Haojun Liao 01144c58a7 fix(stream): fix stream task id error. 2023-09-17 01:19:59 +08:00
Haojun Liao 4846194bbb refactor: do some internal refactor, remove the related fill-history task by sending mesg to replay it in follower node. 2023-09-16 21:37:30 +08:00
Haojun Liao 05e9f40834
Merge pull request #22828 from taosdata/enh/ipWhiteList
Enh/ip white list
2023-09-15 17:49:37 +08:00
Haojun Liao 91e3d70796 fix(stream): remove fill-history sink task. 2023-09-15 17:46:17 +08:00
Haojun Liao 2bfd6e3355 refactor: do some internal refactor. 2023-09-15 09:25:22 +08:00
dapan1121 8ef01584ee
Merge pull request #22629 from taosdata/feat/TD-25620
feat: optimize partition node, replace with sort node
2023-09-14 17:26:15 +08:00
Haojun Liao f2c3e0a6e8 fix(stream): disable follower send hb to mnode. and do some internal refactor. 2023-09-14 17:22:31 +08:00
Haojun Liao fce5be0eb4 fix(stream): fix dead lock. 2023-09-14 14:09:05 +08:00
wangjiaming0909 cb78c54d72 optimize sort perf 2023-09-13 18:37:42 +08:00
Haojun Liao 7305c8dbe1 refactor: do some internal refactor about the sched status set 2023-09-13 14:00:34 +08:00
Yihao Deng fa302ac6b9
Merge branch '3.0' into enh/ipWhiteList 2023-09-13 10:14:08 +08:00
Haojun Liao 09a15bf340 refactor: do some internal refactor. 2023-09-12 22:07:52 +08:00
Haojun Liao 60f5056ab7 other: merge 3.0 2023-09-12 22:00:40 +08:00
Haojun Liao f6a097d96f refactor: do some internal refactor. 2023-09-12 21:58:22 +08:00
Haojun Liao e457d94ac6 refactor: do some internal refactor. 2023-09-12 18:09:02 +08:00
yihaoDeng 7ce8f694dc Merge branch 'enh/dev3New' into enh/ipWhiteList 2023-09-12 15:54:06 +08:00
yihaoDeng d121b564c0 add rpc update interface 2023-09-10 16:11:14 +08:00
yihaoDeng 25bc0b226b add rpc update interface 2023-09-10 14:09:36 +08:00
Haojun Liao 85a5c45098 fix(stream): limit the already processed data. 2023-09-10 00:01:25 +08:00
Haojun Liao aa8909b267 other: add some logs. 2023-09-09 15:18:54 +08:00
Haojun Liao b317c8ebff fix(stream): disable merge submit blocks. 2023-09-08 12:46:15 +08:00
wangjiaming0909 4a131000e4 fix: data error of partition by col + interval 2023-09-07 10:49:09 +08:00
Haojun Liao b240e91c91 enh(stream): add token bucket to limit the rate of sink operation. 2023-09-07 09:58:48 +08:00
yihaoDeng bc27d245b1 add rpc update interface 2023-09-06 21:54:31 +08:00
Haojun Liao 8edf86b3bb fix(stream): add some logs. 2023-09-06 19:08:09 +08:00
liuyao d7caed1c44 opt stream state 2023-09-06 16:34:25 +08:00
Haojun Liao 8783ebcb02 enh(stream): add some logs and record the submit package performance. 2023-09-06 14:34:36 +08:00
dmchen 231ba12f70 feat/TD-26127 2023-09-06 11:00:24 +08:00
Haojun Liao 5dcbae3594
Merge pull request #22681 from taosdata/fix/3_liaohj
refactor: do some internal refactor.
2023-09-05 12:54:09 +08:00
wangjiaming0909 2c4e0fee07 feat: optimize partition node, replace with sort node 2023-09-05 10:53:30 +08:00
Haojun Liao aeea699c9c Merge branch '3.0' into fix/3_liaohj 2023-09-04 15:53:39 +08:00
Haojun Liao 037a232bfa refactor: do some internal refactor. 2023-09-01 17:05:36 +08:00
yihaoDeng 8b146f793d Merge branch '3.0' into szhou/ip-whitelist 2023-09-01 10:51:24 +08:00
Haojun Liao e816d0efa5
Merge pull request #22669 from taosdata/fix/TD-26069
fix invalid insert
2023-08-31 18:29:25 +08:00
yihaoDeng 1833be028f fix invalid insert 2023-08-31 15:28:31 +08:00
Haojun Liao e2bb64eb18 refactor: do some internal refactor. 2023-08-31 14:23:46 +08:00
Haojun Liao 69f95f9324 other: merge 3.0 2023-08-31 13:56:34 +08:00
Haojun Liao 2285b834b0 refactor: do some internal refactor. 2023-08-31 13:53:12 +08:00
Haojun Liao 3fc3dafca6 refactor: do some internal refactor. 2023-08-31 13:46:48 +08:00
Haojun Liao 3ed78ddadd
Merge pull request #22662 from taosdata/fix/3_liaohj
refactor: do some internal refactor.
2023-08-31 13:46:14 +08:00
Haojun Liao 8645f763b5
Merge pull request #22661 from taosdata/enh/reserve
stream change ver
2023-08-31 13:35:23 +08:00
yihaoDeng 83a5e2be4c stream change ver 2023-08-31 11:42:12 +08:00
Haojun Liao e53b5d4392 refactor: do some internal refactor. 2023-08-31 11:01:53 +08:00
Haojun Liao 0facde6ddc
Merge pull request #22659 from taosdata/fix/TD-26035
fix(stream): do not restart the stream tasks when it is running.
2023-08-31 10:16:59 +08:00
yihaoDeng 05ca71d5de stream change ver 2023-08-31 09:28:43 +08:00
dapan1121 62d77c8be2
Merge pull request #22654 from taosdata/fix/TD-26046
fix: trim block and partition by constant function issue
2023-08-31 09:04:46 +08:00
wade zhang 68e4a72021
Merge pull request #22643 from taosdata/feat/audit-user-typestr
alter user type to str
2023-08-31 07:59:31 +08:00
Haojun Liao d99d8875e1 fix(stream): if stream task is running, do not recheck its status. 2023-08-30 17:24:13 +08:00
slzhou f41783c73f fix: address sanitizer error 2023-08-30 17:12:12 +08:00
dapan1121 2e7897239a fix: trim block and partition by constant function issue 2023-08-30 16:51:44 +08:00
dmchen 04a89b4a49 long fields 2023-08-30 16:03:57 +08:00
Haojun Liao c5b279f045 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-08-30 16:01:08 +08:00
Haojun Liao 24b1a050fc other: merge 3.0 2023-08-30 16:00:14 +08:00
liuyao 0a72e576bd op stream pause
pause data dispatch

opt stream pause
2023-08-30 14:53:49 +08:00
Haojun Liao 3a7a220d43 fix(stream): fix error found by ci. 2023-08-30 10:14:01 +08:00
shenglian zhou 33966cf856 enhance: continue coding 2023-08-29 17:35:03 +08:00
Haojun Liao 204fb97f68 fix(stream): fix error in snode, fix memory leaks, fix repeatly create bug in sink task. 2023-08-29 17:34:31 +08:00
dapan1121 778e50da79
Merge pull request #22592 from taosdata/fix/m23.0
Fix/m23.0
2023-08-28 17:35:35 +08:00
Haojun Liao 391103bc5a fix(stream): do dome internal refactor. 2023-08-28 15:54:01 +08:00
wade zhang 1797fe50e2
Merge pull request #22590 from taosdata/feat/TD-18801
init
2023-08-28 11:05:38 +08:00
Haojun Liao da0b4e1f92 Merge branch '3.0' into enh/triggerCheckPoint2 2023-08-28 10:55:38 +08:00
dapan1121 0cce255a02 Merge remote-tracking branch 'origin/3.0' into fix/m23.0 2023-08-28 10:06:53 +08:00
Haojun Liao b75ae217f6 fix(stream): notify close for snode. 2023-08-28 09:53:08 +08:00
Haojun Liao 88f6596965
Merge pull request #22464 from taosdata/feat/TD-18789
feat:support varbinary type
2023-08-28 09:45:57 +08:00
dapan1121 1f40da6fef Merge remote-tracking branch 'origin/main' into 3.0 2023-08-28 09:28:55 +08:00
dmchen 06083e1eb9 init 2023-08-28 09:15:51 +08:00
yihaoDeng 998dac0ffb fix mem leak 2023-08-26 21:54:36 +08:00
yihaoDeng 7d237d4310 fix UAF 2023-08-26 17:37:09 +08:00
wangmm0220 9cd8df12c2 fix:memory leak 2023-08-25 16:32:01 +08:00
Haojun Liao 60d1df0e25
Merge branch '3.0' into enh/triggerCheckPoint2 2023-08-25 15:49:28 +08:00
wangmm0220 26e025d78d feat:[TD-18789]support varbinary type 2023-08-25 15:43:45 +08:00
dapan1121 e24498b0fd enh: add task notify 2023-08-25 14:59:34 +08:00
Haojun Liao ce1a3a379c fix(stream): handle the case when the task not in ready state, and the checkpoint msg arrived. 2023-08-25 10:12:12 +08:00
Haojun Liao f7dada53b9
Merge pull request #22559 from taosdata/fix/liaohj
other: merge main.
2023-08-24 19:01:18 +08:00
Haojun Liao 82e356a9b5 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2
# Conflicts:
#	source/dnode/vnode/src/tq/tq.c
2023-08-24 18:04:44 +08:00
Haojun Liao 70396aa5a5 fix(stream): wakeup the hb timer every 200ms, to speeup the close db procedure. 2023-08-24 17:54:50 +08:00
yihaoDeng 9310d138a6 Merge branch 'enh/3.0' into enh/triggerCheckPoint2 2023-08-24 17:30:35 +08:00
Haojun Liao 2c9f28d97f Merge branch 'main' into fix/liaohj 2023-08-24 14:12:15 +08:00
wangjiaming0909 366a9cc009 Revert "feat: support column comment"
This reverts commit dcbef83dea.
2023-08-24 13:54:27 +08:00
wangjiaming0909 c2af41d0d0 Revert "feat: support alter table add column with comment"
This reverts commit cb027cc5c5.
2023-08-24 13:48:35 +08:00
wangjiaming0909 7fad1de841 Revert "feat: show create table, desc table with col comments"
This reverts commit 16754b5ac1.
2023-08-24 13:38:41 +08:00
yihaoDeng 3afea998ac refactor log 2023-08-24 10:15:15 +08:00
dapan1121 cb70861986 fix: memory leak issue 2023-08-22 18:40:42 +08:00
Haojun Liao af80d94a88 refactor: do some internal refactor. 2023-08-22 15:43:50 +08:00
Haojun Liao cc8b2263cb fix(stream): fix error in heartbeat from vnode. 2023-08-22 13:37:38 +08:00
Haojun Liao def0877980 fix(stream): add timer to check stream task status. 2023-08-22 10:46:49 +08:00
dm chen dda51d8019
Merge branch '3.0' into feat/TD-22970 2023-08-21 10:50:45 +08:00
yihaoDeng 6fe649c458 Merge branch 'enh/3.0' into enh/triggerCheckPoint2 2023-08-21 09:12:40 +08:00
Haojun Liao 8290344349
Merge pull request #22484 from taosdata/fix/liaohj
fix(stream): fix memory leak and do some internal refactor.
2023-08-19 11:02:57 +08:00
Haojun Liao b8101afbe2 fix(stream): refactor the tasks restart mechanism. 2023-08-18 22:36:38 +08:00
Haojun Liao 4b10393c81 fix(stream): fix memory leak and do some internal refactor. 2023-08-18 18:02:08 +08:00
liuyao 87c65f3b68 Merge remote-tracking branch 'origin/3.0' into enh/triggerCheckPoint2 2023-08-18 15:27:02 +08:00
dapan1121 efc5589aa2 Merge remote-tracking branch 'origin/3.0' into feat/TD-24700 2023-08-18 14:11:26 +08:00
dapan1121 daf91648fe fix: invalid read memory issue 2023-08-18 13:57:17 +08:00
dm chen e393a98ee9
Merge branch '3.0' into feat/TD-22970 2023-08-18 13:37:18 +08:00
slzhou 4e2a26e8be Merge branch '3.0' of github.com:taosdata/TDengine into szhou/select-tags-scan 2023-08-18 08:46:17 +08:00
slzhou 85d1dbe00a Merge branch '3.0' of github.com:taosdata/TDengine into szhou/select-tags-scan 2023-08-17 16:27:37 +08:00
dapan1121 1b038d2dcd Merge remote-tracking branch 'origin/3.0' into feat/TD-24700 2023-08-17 16:08:39 +08:00
Benguang Zhao 7735e6f388 Merge branch 3.0 to FEAT/TD-25699-3.0 2023-08-17 16:04:23 +08:00
shenglian zhou 4a9391929c fix: select tags - ctb cursor pause/unlock and lock/resume 2023-08-17 14:59:17 +08:00
dapan1121 0e10e94a40
Merge pull request #22453 from taosdata/feat/TD-25685
feat: support column comment
2023-08-17 14:23:54 +08:00
dapan1121 3045a623e1 Merge remote-tracking branch 'origin/3.0' into feat/TD-24700 2023-08-17 14:16:05 +08:00
dapan1121 e8fa9aa633 fix: join blockId and target issues 2023-08-17 13:50:26 +08:00
wangjiaming0909 16754b5ac1 feat: show create table, desc table with col comments 2023-08-17 11:39:34 +08:00
Haojun Liao 6746339609 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2
# Conflicts:
#	source/libs/stream/src/streamSnapshot.c
2023-08-17 00:08:44 +08:00
Haojun Liao ea6574b3c7 other: merge 3.0 2023-08-17 00:07:55 +08:00
wangmm0220 dbc1b35d44 feat:support varbinary type 2023-08-16 19:57:01 +08:00
dmchen fee4b875d1 error code 2023-08-16 17:49:17 +08:00
yihaoDeng ab7e2b3122 Merge branch 'enh/chkpTransfer' into enh/triggerCheckPoint2 2023-08-16 09:00:30 +00:00
dm chen e020c4e8c5
Merge pull request #22456 from taosdata/3.0
merge 3.0 to feat/TD-22970
2023-08-16 16:49:43 +08:00
Haojun Liao f1359076c1
Merge pull request #22450 from taosdata/fix/3_liaohj
other: merge main.
2023-08-16 16:48:33 +08:00
Haojun Liao d63758a1c5 fix(stream): fix error in execute task on a tranferred node. 2023-08-16 15:24:24 +08:00
dapan1121 143c657571 Merge remote-tracking branch 'origin/3.0' into feat/TD-24700 2023-08-16 14:50:31 +08:00
dapan1121 b113d02476
Merge pull request #22438 from taosdata/feat/TD-23299
feat: add irate distributed execution
2023-08-16 14:44:33 +08:00
dapan1121 91d6734b34 fix: join condition push down issue 2023-08-16 14:28:39 +08:00
dapan1121 a6ecb7253e
Merge pull request #22390 from taosdata/feat/3.0/TD-25365
feat: optimize select agg_func partition by tag slimit
2023-08-16 13:32:58 +08:00
wangjiaming0909 e587cc50e6 feat: optimize select agg_func partition by tag slimit 2023-08-16 11:20:56 +08:00
wangjiaming0909 cb027cc5c5 feat: support alter table add column with comment 2023-08-16 11:07:40 +08:00
dmchen de5aedd8f3 vnode.json 2023-08-16 10:20:48 +08:00
Haojun Liao ad9f3cbc43 other: merge main. 2023-08-16 09:14:10 +08:00
slzhou 4fdaaba3ce Merge branch '3.0' of github.com:taosdata/TDengine into szhou/tag-scan-opt 2023-08-15 17:18:25 +08:00
Benguang Zhao 239a79d405 enh: add some vnode info in SStatusReq 2023-08-15 17:06:33 +08:00
wangjiaming0909 dcbef83dea feat: support column comment 2023-08-15 16:30:02 +08:00
shenglian zhou 84e472ad03 enhance: tag cond col list only once and tag scan derive from scan 2023-08-15 16:10:54 +08:00
Haojun Liao 39079ab64a fix(stream): load term from sync model to decide if the node is restart or not 2023-08-15 15:52:06 +08:00
Ganlin Zhao 01a7dfbc34 feat: add irate distributed execution 2023-08-15 12:59:30 +08:00
Haojun Liao b1d35f43ba enh(stream): using term from sync module to denote the upstream node is restarted/replica-modified/vnode-transferred or not. 2023-08-15 09:25:05 +08:00
Haojun Liao ff17763ed6
Merge pull request #22417 from taosdata/mark/tmq
opti:wal logic
2023-08-15 09:16:29 +08:00
dapan1121 f9f74eaaf4
Merge pull request #22406 from taosdata/fix/TD-24684
fix: remove ins_modules table
2023-08-15 08:42:08 +08:00
slzhou 012248b681 fix: move the only ctb idx flag to logical plan 2023-08-14 19:26:53 +08:00
dapan1121 6a78053b51 feat: add hint supporting 2023-08-14 17:21:15 +08:00
Haojun Liao e8c9a019a4 fix(stream): remove the invalid set of scheduler status. 2023-08-14 11:41:24 +08:00
dapan1121 6ce28e8886 Merge remote-tracking branch 'origin/3.0' into feat/TD-24700 2023-08-14 10:49:56 +08:00
slzhou 646e52ae7f Merge branch '3.0' of github.com:taosdata/TDengine into szhou/tag-scan-opt 2023-08-14 10:19:36 +08:00
wangmm0220 dd0bc0e050 fix:heap use after free 2023-08-14 09:42:55 +08:00
Haojun Liao 0d38f389ab refactor: do some internal refactor. 2023-08-13 16:25:35 +08:00
Haojun Liao afe9b848a5 fix(tsdb): check the 2023-08-12 18:54:39 +08:00
Haojun Liao 09da6c6840 refactor: do some internal refactor. 2023-08-12 18:51:20 +08:00
Haojun Liao 75e6fb0f16 refactor: do some internal refactor. 2023-08-12 18:47:01 +08:00
Haojun Liao 8f9de93cf0 refactor: do some internal refactor. 2023-08-12 18:37:36 +08:00
Haojun Liao ce721a0146 fix(stream): fix error. 2023-08-12 16:32:05 +08:00
Haojun Liao a89ce1a20b fix(stream): transfer state by using data block. 2023-08-12 01:24:07 +08:00
wangmm0220 f1baed79b4 opti:rm useless code 2023-08-11 20:22:51 +08:00
wangmm0220 deda4b9eed opti:wal logic 2023-08-11 19:26:17 +08:00
dapan1121 c9656d3f77 fix: fix memory issues 2023-08-11 17:39:41 +08:00
wangmm0220 7b22d37f12 fix:lost data when consumer db 2023-08-11 17:25:43 +08:00
slzhou 42a4f364c1 Merge branch 'szhou/tag-scan-opt' of github.com:taosdata/TDengine into szhou/tag-scan-opt 2023-08-11 16:48:49 +08:00
yihaoDeng 6e6eb05d5c Merge branch 'enh/triggerCheckPoint2' into enh/chkpTransfer 2023-08-11 08:03:02 +00:00
Haojun Liao e984affe90 fix(stream): disable the stream in the followers nodes. 2023-08-11 15:58:15 +08:00
dapan1121 8987553d9c fix: remove ins_modules 2023-08-11 15:56:38 +08:00
shenglian zhou 1c7f854a71 enhance: add only meta ctb index to tag scan physi node 2023-08-11 14:47:28 +08:00
yihaoDeng 99be2836b2 Merge branch 'enh/triggerCheckPoint2' into enh/chkpTransfer 2023-08-11 02:50:12 +00:00
Haojun Liao 6a9826cf6e enh(stream): update the stream task epset. 2023-08-11 10:37:25 +08:00
yihaoDeng ba4ce9db02 Merge branch 'enh/triggerCheckPoint2' into enh/chkpTransfer 2023-08-11 02:15:07 +00:00
shenglian zhou b2e615d4e7 enhance: tag scan cursor based block 2023-08-10 17:30:01 +08:00
dm chen dd271bca6d
Merge pull request #22394 from taosdata/3.0
merge 3.0 to feat/TD-22970
2023-08-10 14:14:22 +08:00
Haojun Liao f633c7fe2b other: merge 3.0. 2023-08-10 11:56:30 +08:00
Haojun Liao b658608541
Merge pull request #22388 from taosdata/fix/3_liaohj
other: merge main.
2023-08-10 11:43:02 +08:00
yihaoDeng ef247cdb1d support reopen stream state 2023-08-10 01:49:26 +00:00
Haojun Liao 7e3f1d92fc Merge branch 'main' into fix/liaohj 2023-08-09 19:43:24 +08:00
Haojun Liao 1e8579e8c5 fix(stream): fix other cases. 2023-08-09 16:04:48 +08:00
Haojun Liao 4c92997328 fix(stream): use streamId&taskId to identify the stream task in the stream meta. 2023-08-09 15:52:23 +08:00
Haojun Liao 1d649bccb6
Merge pull request #22372 from taosdata/fix/TD-25626
fix taosd cannot quit
2023-08-09 15:46:14 +08:00
Haojun Liao 3cdb16352c fix(stream): avoid launching check downstream when failed to add stream task into stream meta. 2023-08-09 12:03:14 +08:00
dapan1121 1aac643a9b enh: support single vnode join 2023-08-09 10:30:35 +08:00
Haojun Liao f3c5f20ee2 enh(stream): add timer to check the node changing. 2023-08-09 10:25:16 +08:00
yihaoDeng fb7dec00e1 support reopen stream state 2023-08-09 01:50:49 +00:00
yihaoDeng cfb5247e30 change var name 2023-08-09 00:46:18 +00:00
Benguang Zhao e4d16e594c enh: check if disk space sufficient at primary dir with tfs 2023-08-08 17:53:11 +08:00
Haojun Liao af3a87560a refactor: do some refactor. 2023-08-08 09:11:41 +08:00
yihaoDeng b6c991f896 support reopen stream state 2023-08-07 08:59:04 +00:00
yihaoDeng eeb97351e8 support reopen stream state 2023-08-07 08:51:01 +00:00
Haojun Liao 225c0e61dc hen(stream): support the rollback and checkdown stream tasks. 2023-08-07 16:13:39 +08:00
dapan1121 0546bdceb2 Merge remote-tracking branch 'origin/3.0' into feat/TD-24700 2023-08-07 11:23:15 +08:00
Haojun Liao 8a11a0418f other: merge 3.0 2023-08-07 09:19:26 +08:00
yihaoDeng 6dc93a8dec add stream ver 2023-08-04 13:52:20 +08:00
dm chen 5b03ab1705
Merge branch '3.0' into feat/TD-22970 2023-08-03 17:43:51 +08:00
yihaoDeng f9d0874e45 support reopen stream state 2023-08-03 08:24:50 +00:00
Haojun Liao 13543f7daa feature(stream): handle task update in tq module. 2023-08-02 10:33:41 +08:00
Haojun Liao ad4c5916e7 enh(stream): update the stream task. 2023-08-01 18:14:58 +08:00
Haojun Liao 164bfd5408 enh(stream): prepare update trans. 2023-08-01 16:12:35 +08:00
Haojun Liao 6365d5000b
Merge pull request #22271 from taosdata/fix/3_liaohj
fix(stream): dump results to sink node before paused.
2023-08-01 15:50:17 +08:00
Haojun Liao 75b1520be0 enh(stream): create task update info 2023-08-01 14:04:07 +08:00
Haojun Liao f6ae9cf9bb fix(stream): fetch all data before paused and dump to sink node. 2023-08-01 10:16:14 +08:00
Haojun Liao 36ef9a537f
Merge pull request #22256 from taosdata/fix/TD-25457
check update data
2023-07-31 22:56:05 +08:00
Haojun Liao d45596bb33 fix(stream): kill task when pause the stream execution. 2023-07-31 18:07:37 +08:00
liuyao 32b59af4b1 check update data 2023-07-31 17:32:24 +08:00
Haojun Liao 9981cecbed refactor: do some internal refactor. 2023-07-31 15:24:35 +08:00
Haojun Liao e61aa83594 enh(stream): handle the stream hb. 2023-07-31 14:07:18 +08:00
Haojun Liao 8dfef8768a other: merge 3.0 2023-07-29 22:54:16 +08:00
Haojun Liao f6e07d1fdb other: merge 3.0 2023-07-29 01:32:02 +08:00
Haojun Liao 936afeb5ac refactor: do internal refactor to simple the pause/resume in case of fill history exists. 2023-07-28 19:13:03 +08:00
Haojun Liao d5974a8f25 refactor(stream): refactor the pause/resume for fill history execution. 2023-07-28 18:05:32 +08:00
dapan1121 b7126b9cc6 Merge remote-tracking branch 'origin/3.0' into feat/TD-24700 2023-07-28 18:01:11 +08:00
Haojun Liao 9f943213ed enh(stream): update the hb info. 2023-07-28 14:23:53 +08:00
Haojun Liao 74834aea11 enh(stream): prepare hb to mnode from stream meta. 2023-07-28 13:07:16 +08:00
Haojun Liao 2a78cd2d23
Merge pull request #22215 from taosdata/fix/liaohj
other: merge main.
2023-07-28 13:06:17 +08:00
Haojun Liao ccc0f13649
Merge pull request #22214 from taosdata/fix/3_liaohj
fix(stream): scan wal in step2
2023-07-28 00:42:15 +08:00
Haojun Liao 22a5a18fff fix(stream): 1. set correct timewindow after step2. 2. handle the case when the task is failed to be added into the meta store. 2023-07-27 18:57:36 +08:00
Haojun Liao b145771a1b other: merge 3.0 2023-07-27 16:38:57 +08:00
Haojun Liao 3d403dca5a other: merge main. 2023-07-27 16:23:41 +08:00
Haojun Liao 40fe3ef4f6 fix(stream): refactor the step2 wal scan. 2023-07-27 14:49:20 +08:00
Shungang Li 167ecea705 fix: check term for role time
1. time of mnode becomes current role in this term
2. show 0 for offline mnodes
2023-07-27 14:16:54 +08:00
Haojun Liao e89f530db2 fix(stream): scan wal in step2 2023-07-27 10:55:59 +08:00
dapan1121 e83a46b88f enh: cache necessary file for seq mode 2023-07-26 19:17:59 +08:00
dapan1121 4e5fbb52ee Merge remote-tracking branch 'origin/3.0' into feat/TD-24700 2023-07-26 13:56:46 +08:00
dapan1121 6a0061ccfb fix: invalid task status update issue 2023-07-26 13:54:58 +08:00
Haojun Liao 728112ed89 fix(stream): set correct upstream epinfo. 2023-07-26 10:26:59 +08:00
Haojun Liao 1c1bf63e1f other: merge 3.0 2023-07-25 18:17:11 +08:00
Haojun Liao 0bdccd2681 refactor: do some internal refactor. 2023-07-25 17:31:54 +08:00
Haojun Liao a2694b9ce9 fix(stream): fix the invalid check of step2 . 2023-07-24 19:44:28 +08:00
Haojun Liao 1e34f84f78 other: merge 3.0 2023-07-24 15:23:03 +08:00
dapan1121 4f75eb5655 Merge remote-tracking branch 'origin/3.0' into feat/TD-24700 2023-07-24 11:43:15 +08:00
Haojun Liao 1367552f38 fix(stream): refactor the halt status to check more status. 2023-07-24 10:04:15 +08:00
Haojun Liao 4e0f7ffbf8 fix(stream): set the correct flag of pause/resume. 2023-07-23 18:49:56 +08:00
Haojun Liao 1b2636028a fix(stream): fix memory leak. 2023-07-21 23:05:42 +08:00
Haojun Liao 16d7707b90 fix(stream): align the scan real time data for stream task. 2023-07-21 19:33:43 +08:00
dmchen 7d480cf3ac compatible old sync config 2023-07-21 10:31:53 +08:00
Haojun Liao d0da988b7d Merge branch '3.0' into fix/3_liaohj 2023-07-21 09:47:44 +08:00
dapan1121 2ef01728ca
Merge pull request #22089 from wangjiaming0909/fix/3.0/TD-23763
feat: optimize partition by tbname slimit
2023-07-21 09:29:36 +08:00
Haojun Liao db46d31ca5 fix(stream): refactor the halt function. 2023-07-21 01:32:42 +08:00
wangjiaming0909 7d850c1a5e feat: optimize partition by tbname slimit 2023-07-20 15:07:55 +08:00
Haojun Liao 87fa8f0c4c Merge branch '3.0' into fix/3_liaohj 2023-07-20 12:15:23 +08:00
Haojun Liao aed99da6c1 refactor: refactor the stream task starting order. 2023-07-20 12:14:53 +08:00
yihaoDeng 6e5be0d30e fix stream state transfer 2023-07-20 03:49:32 +00:00
Haojun Liao 97c44e7c18 refactor: do some internal refactor. 2023-07-19 18:42:02 +08:00
dapan1121 cbe03ef212
Merge pull request #22069 from taosdata/enh/TS-2288
enh: add scope for show xx variables
2023-07-19 18:01:11 +08:00
dm chen 141004bf77
Merge branch '3.0' into feat/TD-22970 2023-07-19 10:57:40 +08:00
dapan1121 c45359c989 enh: add batch table scan 2023-07-19 10:37:30 +08:00
Haojun Liao a32c650248 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-07-19 10:05:48 +08:00
Haojun Liao 2ae95217bd fix(stream): open inputQ by default for task deployed on snode. 2023-07-19 10:05:35 +08:00
liuyao fd02b9a71e
Merge branch '3.0' into enh/triggerCheckPoint2 2023-07-19 10:02:06 +08:00
wangmm0220 5c344b0159 fix:conflicts from main 2023-07-19 09:05:05 +08:00
dmchen 3711fdd865 feat/TD-22970 2023-07-18 16:09:38 +08:00
Haojun Liao d2c875e774 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-07-18 15:19:09 +08:00
Haojun Liao 901b7d8ecc fix(stream): if a source task is set to be non-normal, no data should be put into inputQ anymore. 2023-07-18 15:18:57 +08:00
dapan1121 294376de0b enh: add batch table scan 2023-07-18 14:44:53 +08:00
Benguang Zhao 24fed51137 enh: tfsRename dir on primary disk at last 2023-07-18 13:58:43 +08:00
yihaoDeng 40d59990d8 fix mem leak 2023-07-18 04:01:20 +00:00
Benguang Zhao 5624ecc8df fix: prepare vnode dir recursively in vnodeCreate 2023-07-18 11:32:23 +08:00
Benguang Zhao 6b6b7d8d8f enh: alloc disk of vnode primary dir in vmAllocPrimaryDisk 2023-07-18 11:32:23 +08:00
wangmm0220 872222eb77 fix:[TD-25222] error in drop topic if topic num is too long 2023-07-17 19:52:07 +08:00
Ganlin Zhao 929db3d647 Merge branch '3.0' into enh/TS-2288 2023-07-17 16:09:07 +08:00
Haojun Liao 08f43b9d00 fix(stream): fix checkpoint block not fetched bug. 2023-07-17 15:31:54 +08:00
Haojun Liao b2a905bd91
Merge branch '3.0' into enh/triggerCheckPoint2 2023-07-17 11:50:12 +08:00
dapan1121 a1e18ac898 fix: fix global cache issue 2023-07-17 09:25:28 +08:00
Haojun Liao a9757637d9 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-07-16 12:47:24 +08:00
Haojun Liao c6a322e0ef refactor(stream): back pressure is active, which is trigger by dispatch rsp. 2023-07-16 12:47:08 +08:00
yihaoDeng e18c9ea672 add checkpoint 2023-07-15 04:26:34 +00:00
dapan1121 188df1d675 fix: fix bugs 2023-07-14 19:36:56 +08:00
yihaoDeng ed931c1100 Merge branch 'fix/newCheckpoint' into enh/triggerCheckPoint2 2023-07-14 10:11:20 +00:00
yihaoDeng 3c4631ef1f add checkpoint 2023-07-14 10:06:24 +00:00
Haojun Liao 2b85ea62aa refactor: do some internal refactor. 2023-07-14 17:48:47 +08:00
Haojun Liao eb7e6152ae refactor(stream): do some internal refactor. 2023-07-14 17:21:20 +08:00
wangmm0220 6762a01d88 Merge branch 'main' of https://github.com/taosdata/TDengine into mark/tmq 2023-07-14 16:44:00 +08:00
wangmm0220 bbdcbcb75b fix:modify commit version to next validate version 2023-07-14 16:43:28 +08:00
wangjiaming0909 b850c1af47 fix: state/session/event window with order by _wstart/_wend has no effect 2023-07-14 16:03:59 +08:00
Ganlin Zhao cdb3453812 add show local variables scope 2023-07-14 14:38:35 +08:00
dapan1121 aca9c5fe19 Merge remote-tracking branch 'origin/3.0' into feat/TD-24700 2023-07-14 13:31:07 +08:00
dapan1121 2312f10372 enh: support concurrent fetch from group cache 2023-07-14 13:30:13 +08:00
Haojun Liao e0ea0f2df4
Merge pull request #22020 from taosdata/fix/liaohj
other: merge main
2023-07-13 17:55:28 +08:00
Haojun Liao 813f4cb363 refactor: do some internal refactor. 2023-07-13 16:32:25 +08:00
Haojun Liao f41bcd73b0 other: merge main. 2023-07-13 11:02:09 +08:00
Haojun Liao 2f90a53548 fix(stream): set checkpoint id when expanding task. 2023-07-13 10:16:57 +08:00
Haojun Liao c388802bda
Merge pull request #22024 from taosdata/fix/3_liaohj
fix(stream): fix concurrent bug in save task meta.
2023-07-12 18:17:27 +08:00
dapan1121 75c250f503 fix: report permission error when all columns are invisiable 2023-07-12 11:49:57 +08:00
Haojun Liao 3ce54423a5 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-07-12 11:38:27 +08:00
Haojun Liao d392bb60ba refactor(stream): set the initial version from the checkpoint. 2023-07-12 11:38:13 +08:00
liuyao 7d4bb1b932 add checkpoint id for recover 2023-07-12 10:48:58 +08:00
Haojun Liao 9484f3da94
Merge branch '3.0' into enh/triggerCheckPoint2 2023-07-12 10:20:18 +08:00
dapan1121 a42bd9e478 Merge remote-tracking branch 'origin/3.0' into feat/TD-24700 2023-07-11 19:34:39 +08:00
dapan1121 185071fae9 enh: add group cache func 2023-07-11 19:34:03 +08:00
Haojun Liao fed3803739 fix(stream): fix memory leak. 2023-07-11 19:29:52 +08:00
liuyao 6298f17c45 delete invalid code 2023-07-11 19:21:27 +08:00
wangjiaming0909 1d7515213b feat: 1. add limit for diskBasedBuf
2. use referenced tuple before actually pushing into pq
3. use limitInfo instead of maxRows in sort pyhsical node
2023-07-11 14:16:20 +08:00
Haojun Liao 09b764494d fix(stream): set correct checkpoint version when starting stream tasks. 2023-07-11 14:03:43 +08:00
Shungang Li 8f91da24e4 fix: type convert failure returns errcode
TSDB_CODE_SCALAR_CONVERT_ERROR:
"Cannot convert to specific type"
2023-07-11 10:20:50 +08:00
Haojun Liao 3ffdbe923d other: merge 3.0 2023-07-11 09:12:57 +08:00
Haojun Liao 87bedef2cd fix(stream): fix error in checkpointing. 2023-07-10 19:20:05 +08:00
Shungang Li 8de31219b4 fix: type convert failure returns errcode
TSDB_CODE_SCALAR_CONVERT_ERROR:
"Cannot convert to specific type"
2023-07-10 09:29:29 +08:00
Haojun Liao 4f534ce6e9 fix(stream): fix error in generating checkpoint. 2023-07-08 10:29:09 +08:00
Haojun Liao a5c19427e7 fix(stream): send correct rsp to mnode. 2023-07-08 09:39:44 +08:00
Haojun Liao 9c30abf95b fix(stream): fix error in generating checkpoint. 2023-07-07 21:38:53 +08:00
dapan1121 5b5b5648ac Merge remote-tracking branch 'origin/3.0' into feat/TD-24700 2023-07-07 19:32:50 +08:00
Haojun Liao 8298f30e56 fix(stream): fix bug in checkpoint. 2023-07-07 17:16:08 +08:00
Haojun Liao 47877898d0 enh(stream): generate the checkpoint framework. 2023-07-07 16:07:52 +08:00
dapan1121 779224f0a6 fix: fix bugs 2023-07-06 19:33:31 +08:00
Haojun Liao d7101f7109 enh(stream): support dispatch checkpoint msg. 2023-07-06 18:26:22 +08:00
liuyao 0e914a19c6 stream operartor checkpoint 2023-07-06 14:28:34 +08:00
Haojun Liao 5a9461a69a other: merge 3.0 2023-07-06 11:52:21 +08:00
Haojun Liao f4a3567935 other: merge 3.0 2023-07-06 11:24:30 +08:00
dapan1121 b371b7e6be fix: compile issue and merge join crash issue 2023-07-06 10:52:28 +08:00
wangjiaming0909 1f71ce9409 feature: get last timestamp before create sma index 2023-07-06 10:33:22 +08:00
dapan1121 4cb849267a Merge remote-tracking branch 'origin/3.0' into feat/TD-24700 2023-07-06 09:55:17 +08:00
dapan1121 0718859c0a enh: support passing params between nodes 2023-07-05 19:24:06 +08:00
Haojun Liao 74f5b3f80e
Merge pull request #21959 from taosdata/refact/fillhistory
refactor: do some internal refactor.
2023-07-05 17:47:00 +08:00
yihaoDeng 79f01ad655 add version check in rpc 2023-07-05 08:16:25 +00:00
Haojun Liao 03dbcbf055 refactor: do some internal refactor. 2023-07-05 15:55:55 +08:00
dapan1121 c85bbef2e9 Merge remote-tracking branch 'origin/3.0' into feat/TD-24700 2023-07-05 11:13:57 +08:00
dapan1121 7b9d73c77a feat: add dynamic query ctrl operator 2023-07-05 11:07:08 +08:00
Haojun Liao 9b3e34d589
Merge pull request #21735 from taosdata/refact/fillhistory
refactor: refactor the fill history operation
2023-07-05 10:48:51 +08:00
Haojun Liao 82342ebdc7
Merge pull request #21934 from taosdata/feature/TD-20678
feat:subscribe only meta info
2023-07-04 11:28:27 +08:00
dapan1121 ac35ae9839 feat: add dynamic query ctrl operator 2023-07-03 19:29:46 +08:00
Haojun Liao 200575647c
Merge branch '3.0' into refact/fillhistory 2023-07-03 15:16:18 +08:00
dapan1121 5971395dcf feat: add group cache operator 2023-07-03 13:42:06 +08:00
yihaoDeng 7d30a6e27a vnode snapshot read 2023-06-30 11:48:46 +00:00
dapan1121 60290b98e4 feat: add group cache operator 2023-06-30 19:20:36 +08:00
wangmm0220 58c7011e0e feat:support only meta in tmq subscriptions 2023-06-30 11:42:40 +08:00
dapan1121 7dddfd0a5a Merge remote-tracking branch 'origin/3.0' into feat/TD-24700 2023-06-29 19:29:27 +08:00
dapan1121 226ee06209 enh: add physical plan processing 2023-06-29 19:28:32 +08:00
dapan1121 3519e9170e Merge remote-tracking branch 'origin/main' into 3.0 2023-06-29 11:13:45 +08:00
dapan1121 9f0da17c49 Merge remote-tracking branch 'origin/3.0' into feat/TD-24700 2023-06-28 19:40:55 +08:00
dapan1121 81a2bf10cf enh: optimize stable join 2023-06-28 19:39:04 +08:00
yihaoDeng 6b6e237079 add checkpoint 2023-06-28 09:57:08 +00:00
liuyao 2fc5eeb810 session win range 2023-06-28 17:20:08 +08:00
Haojun Liao ed900d6ff6
Merge branch '3.0' into refact/fillhistory 2023-06-28 13:48:26 +08:00
Haojun Liao 57fcd553f8 refactor: do some internal refactor. 2023-06-28 13:13:13 +08:00
Haojun Liao a19e63fd23 fix(stream): fix error in handling fill history. 2023-06-27 23:00:14 +08:00
dapan1121 8f39b9d2e4 enh: optimize query plan 2023-06-27 19:36:51 +08:00
Yihao Deng 4de7db06f9
Merge branch '3.0' into enh/triggerCheckPoint2 2023-06-27 17:57:14 +08:00
wangjiaming0909 57ddb3437d feature: optimize order by limit using priority queue 2023-06-27 17:50:50 +08:00
Haojun Liao 3289ad62be other: merge 3.0 2023-06-27 11:33:40 +08:00
Haojun Liao b73444b291 fix(stream): start stream task in case of scan history completing. 2023-06-27 09:44:51 +08:00
dapan1121 4dae9f4eff merge main to 3.0 2023-06-26 18:43:00 +08:00
dapan1121 9e595daafe
Merge pull request #21830 from taosdata/fix/TD-24287
fix: fix userAlias issue when keepColumnName is set to true
2023-06-26 18:12:44 +08:00
dapan1121 ce2635074d enh: add uid/vgid functions 2023-06-26 11:48:47 +08:00
yihaoDeng 04ab8e19d0 Merge branch 'enh/dev30' into enh/triggerCheckPoint2 2023-06-25 19:58:45 +08:00
Haojun Liao 402c091df0 fix(stream): fix sma error. 2023-06-25 19:41:44 +08:00
Ganlin Zhao 77d2737f91 fix: fix userAlias issue when keepColumnName is set to true 2023-06-25 17:51:51 +08:00
liuyao e236bf818c set fill history info 2023-06-25 17:47:10 +08:00
dapan1121 9972aa81d6 Merge remote-tracking branch 'origin/3.0' into feat/TD-24700 2023-06-25 17:31:32 +08:00
yihaoDeng 0330f3b2db add checkpoint 2023-06-25 17:03:01 +08:00
wangmm0220 7a49d67078 Merge branch '3.0' of https://github.com/taosdata/TDengine into feature/TS-3495 2023-06-25 14:54:16 +08:00
yihaoDeng e36de5edf7 add checkpoint 2023-06-25 14:35:20 +08:00
shenglian zhou fd754eaa08 fix: udfd can not connect to taosd since authentification failure 2023-06-25 11:31:33 +08:00
Haojun Liao 6857881742 Merge branch '3.0' into refact/fillhistory 2023-06-25 10:41:32 +08:00
wade zhang 254a20bdf3
Merge pull request #21660 from luckeverda/feat/TD-23739
feat/TD-23739: enhance ttl, deletetime modified by writing-op
2023-06-25 09:06:57 +08:00
Haojun Liao ceb78fdad2
Merge branch '3.0' into refact/fillhistory 2023-06-24 18:53:48 +08:00
dapan1121 2b55a75e82 enh: refact code 2023-06-21 19:33:27 +08:00
yihaoDeng d9e24566c0 add checkpoint 2023-06-20 18:32:56 +08:00
yihaoDeng 548e439aa2 add checkpoint 2023-06-19 20:48:49 +08:00
Shungang Li b93f653d7e feat: enhance ttl, deletetime modified by writing-ops
new config item: ttlChangeOnWrite (default 0)
ttl delete time changes on last write if true
2023-06-19 19:03:35 +08:00
liuyao 41c193945f fill history pause&resume 2023-06-19 17:28:19 +08:00
yihaoDeng 0eeaab9cd3 Merge branch 'refact/fillhistory1' into refact/fillhistory 2023-06-19 13:53:37 +08:00
dapan1121 1ca24fea6b
Merge pull request #21742 from wangjiaming0909/feature/3.0/TD-24656
feature: add input, output ts order for execution plans
2023-06-18 19:24:29 +08:00
yihaoDeng fd85a8495a Merge branch 'dev30' into enh/triggerCheckPoint2 2023-06-17 14:17:21 +08:00
yihaoDeng b6fe5d917b refactor checkpoint 2023-06-17 14:05:49 +08:00
wangmm0220 c5dfe169a6 fix:error 2023-06-16 19:33:03 +08:00
Haojun Liao 64365666b7 fix(stream): update the info, and do some internal refactor. 2023-06-16 16:04:43 +08:00
Benguang Zhao 495ae49752 fix: refreshMeta on invalid schema of tb epSet in doAsyncQuery 2023-06-16 15:41:52 +08:00
wangjiaming0909 fb4f174fbc feature: add input, output ts order for execution plans 2023-06-16 10:26:09 +08:00
yihaoDeng 0ef8afbdaa support fill history 2023-06-16 09:32:38 +08:00
yihaoDeng 9f9171719a support fill history 2023-06-15 21:29:52 +08:00
dapan1121 e6afcbf07f feat: hash join init version 2023-06-15 19:34:15 +08:00
dapan1121 575c48212a
Merge pull request #21721 from taosdata/fix/TD-24707
fix: forbid system table functions
2023-06-15 18:52:33 +08:00
Haojun Liao 74e0138f72 Merge branch '3.0' into refact/fillhistory 2023-06-15 15:25:00 +08:00
wangmm0220 22776e60d5 fix:control memory size if consumer group is too much 2023-06-15 14:51:04 +08:00
liuyao 693942b821 trans state 2023-06-15 14:13:17 +08:00
Haojun Liao 53377c2c1f fix(stream): wait for stream task completed. 2023-06-15 01:14:41 +08:00
Yihao Deng 7ded6fc7a2
Merge branch '3.0' into enh/triggerCheckPoint2 2023-06-14 16:30:38 +08:00
liuyao 9a3708e17b pause&resume fill history 2023-06-14 15:54:07 +08:00