Commit Graph

16660 Commits

Author SHA1 Message Date
Benguang Zhao 811f1bbbea enh: tidy up logging msg in syncNodeOnSnapshotRsp 2023-10-24 15:47:47 +08:00
Haojun Liao f1498f8929 fix(stream): fix the invalid write in sma 2023-10-24 15:24:34 +08:00
Benguang Zhao 1c60e67a83 enh: send the END snap msg at last 2023-10-24 14:16:46 +08:00
Haojun Liao 0f9328330b fix(stream): disable continue check for downstream tasks. 2023-10-24 11:56:36 +08:00
dapan1121 dbbceae061 fix: union all view issue 2023-10-24 11:29:04 +08:00
Benguang Zhao f444cd7a6d enh: log signature of snap sender/receiver while started or stopped 2023-10-24 11:11:11 +08:00
Haojun Liao 7a8b046a35 fix(sma): fix bugs in sma and do some internal refactor. 2023-10-24 09:40:38 +08:00
shenglian zhou 65cfc13703 fix: memory sanitizer error 2023-10-23 19:40:27 +08:00
wangjiaming0909 f299a28109 feat: support to_timestamp/to_char 2023-10-23 19:36:03 +08:00
Benguang Zhao e34da43e38 feat: support pipelining of snap replication 2023-10-23 19:32:44 +08:00
slzhou 0cfbcd7a13 Merge branch '3.0' of github.com:taosdata/TDengine into szhou/continue-coing 2023-10-23 16:34:21 +08:00
shenglian zhou e713b7c22f enhance: insert stb skeleton development 2023-10-23 16:27:00 +08:00
yihaoDeng 09192acf96 fix mem leak 2023-10-23 10:20:57 +08:00
dapan1121 ab98f7623c Merge remote-tracking branch 'origin/3.0' into feat/TD-25204 2023-10-23 08:44:46 +08:00
shenglian zhou 5156c0d00c enhance: get tbname from one row for stb syntax 2023-10-22 15:14:50 +08:00
shenglian zhou 6488672dd6 enhance: parse target column 2023-10-22 11:21:36 +08:00
Haojun Liao 059e94e428 fix(stream): clear flag for checkpoint. 2023-10-22 01:25:00 +08:00
Haojun Liao 4826b34a2b refactor: do some internal refactor. 2023-10-21 16:32:44 +08:00
Haojun Liao 06cd67e26e refactor: do some internal refactor. 2023-10-21 16:20:03 +08:00
shenglian zhou 438a775c78 fix: parse insert stb columns when meta is ready or ready after get meta 2023-10-21 14:02:03 +08:00
Haojun Liao 21e98e358e fix(stream): clear the flag. 2023-10-21 02:41:03 +08:00
Haojun Liao d1095e2c4c Merge remote-tracking branch 'origin/refact/streamsm' into refact/streamsm 2023-10-21 01:42:59 +08:00
Haojun Liao 49014d4b68 fix(stream): update the nodeEp even during checkpoint trans. 2023-10-21 01:42:43 +08:00
yihaoDeng aaf7e070ee Merge branch 'refact/streamsm' of https://github.com/taosdata/TDengine into refact/streamsm 2023-10-20 20:49:17 +08:00
yihaoDeng e95735eea4 fix mem leak 2023-10-20 20:49:01 +08:00
dapan1121 0f4766e38e feat: add view cases 2023-10-20 18:22:30 +08:00
slzhou 3fe5c447e7 enhance: begin parse cols 2023-10-20 17:16:45 +08:00
Haojun Liao c68c0eda79 fix(stream): fix bugs caused by refactor sm. 2023-10-20 16:27:39 +08:00
Haojun Liao 4feebffb05 refactor: add ref in log. 2023-10-20 15:59:43 +08:00
Haojun Liao c4268ca395 fix(stream): fix bugs caused by refactor. 2023-10-20 15:54:30 +08:00
dapan1121 1ff5ccf186
Merge pull request #23222 from taosdata/feat/TS-4072
feat: support interval syntax of quoted duration and default unit
2023-10-20 15:16:07 +08:00
dapan1121 d7a5b529f9
Merge pull request #23312 from taosdata/szhou/fix/td-26778
fix: remove subquery user alias name distinct check
2023-10-20 15:15:01 +08:00
slzhou ce6be3d3e7 fix: refactor checkAuth for target table 2023-10-20 14:51:44 +08:00
Haojun Liao 3b8c85f632 fix(stream): fix bugs caused by refactor sm. 2023-10-20 14:19:57 +08:00
Haojun Liao d75948160d Merge branch 'main' into refact/streamsm 2023-10-20 11:10:19 +08:00
wangjiaming0909 720982374c fix: union all cast func resType check error 2023-10-20 10:36:52 +08:00
Haojun Liao 270a847809 fix(stream): fix bugs caused by refactor sm. 2023-10-20 10:23:48 +08:00
Haojun Liao 9f9fae3b99
Merge pull request #23329 from taosdata/opt/addStatusSend
Opt/add status send
2023-10-20 09:52:12 +08:00
wade zhang 628667f22c
Merge pull request #23231 from taosdata/FEAT/TS-3816-3.0
feat: support restoring vnodes on replaced disks as needed
2023-10-20 09:02:25 +08:00
dapan1121 42f440b0fb Merge remote-tracking branch 'origin/3.0' into feat/TD-25204 2023-10-20 08:46:32 +08:00
dapan1121 969b002936 enh: support view privilege 2023-10-20 08:41:49 +08:00
Haojun Liao 4d5d078fbe fix(stream): fix bugs caused by refactor. 2023-10-19 18:00:54 +08:00
Haojun Liao d5059826a8 fix(stream): fix bugs caused by refactor. 2023-10-19 17:59:04 +08:00
Haojun Liao c1cebae6ba fix(stream): fix error in stream. 2023-10-19 16:20:27 +08:00
slzhou 332268fd4b set super table name for stb syntax and rename setRefreshMate to setRefreshMeta 2023-10-19 15:55:24 +08:00
wangjiaming0909 04c60486e9 feat: support interval syntax of quoted duration and default unit 2023-10-19 15:46:19 +08:00
Haojun Liao 614bdd9fb9
Merge pull request #23220 from taosdata/feat/TD-26644
opt bloom filter
2023-10-19 15:34:43 +08:00
Haojun Liao da8f6a4c2f
Merge pull request #23248 from taosdata/feat/TD-26647
recover session buff state
2023-10-19 15:34:03 +08:00
yihaoDeng 93cac3532e fix invalid debug info 2023-10-19 15:30:04 +08:00
Haojun Liao 402aefd95d refactor(stream): do some internal refactor. 2023-10-19 15:09:47 +08:00
slzhou cb2311fde6 fix minior error 2023-10-19 13:28:48 +08:00
slzhou 334feb199a call processTableSchemaFromMetaData when success 2023-10-19 13:22:28 +08:00
yihaoDeng afac844656 add rpc sync read time 2023-10-19 11:45:59 +08:00
slzhou 24436c8502 fix: tag scan support limit and remove slimit optimization 2023-10-19 11:40:10 +08:00
shenglian zhou 8532227a36 fix: first schema clause top - target is supertable 2023-10-19 11:30:44 +08:00
Benguang Zhao a2e0480839 refact: rename as SYNC_FSM_STATE_COMPLETE 2023-10-19 11:18:57 +08:00
Benguang Zhao c4e9069a66 fix: set nextProcessedVer properly in tqProcessTaskScanHistory 2023-10-19 11:18:57 +08:00
Benguang Zhao 05ba5e1ed0 refact: adjust logging msg in walLogEntriesComplete 2023-10-19 11:18:57 +08:00
Benguang Zhao d671283b8b refact: adjust logging msg for incomplete fsm state 2023-10-19 11:18:57 +08:00
Benguang Zhao 9643799dc5 fixup: compiler error at labels since allowed only at statements 2023-10-19 11:04:39 +08:00
Benguang Zhao 233a3c4034 enh: terminate on incompletenss of fsm state for dbs of single replica 2023-10-19 11:04:39 +08:00
Benguang Zhao 810678ebcb enh: tidy up debugging msgs of snapshot replication 2023-10-19 11:04:39 +08:00
Benguang Zhao c89c69f951 enh: use waitTime to prevent from starting snapshot too frequently 2023-10-19 11:04:39 +08:00
Benguang Zhao be6411ebbe fixup: set lastSendTime with taosGetTimestampMs 2023-10-19 11:04:39 +08:00
Benguang Zhao a53ba24118 fix: set startTime in snapshotReSend 2023-10-19 11:04:39 +08:00
Benguang Zhao e901adfdf3 enh: check snapshot receiver and sender by signature 2023-10-19 11:04:39 +08:00
Benguang Zhao eb4e2aa58f feat: restore incomplete fsm state with maxVerValid via snapshot replication 2023-10-19 11:04:36 +08:00
Benguang Zhao e1c03118ab enh: extract snapshot info for both of snap reader and writer 2023-10-19 10:51:13 +08:00
Benguang Zhao 410ced8320 feat: use TLV format to encode data of snapshot info 2023-10-19 10:51:13 +08:00
Benguang Zhao 517f1f7e40 fixup: fix syncNodeOnSnapshotPrep 2023-10-19 10:37:34 +08:00
Benguang Zhao 083dd148be feat: exchange difference of snapshot info for replication 2023-10-19 10:37:34 +08:00
Haojun Liao f4caeca24a refactor(stream): add state machine to manage the state of stream tasks. 2023-10-19 10:34:20 +08:00
yihaoDeng 365d535e6d add rpc sync read timeout 2023-10-19 10:32:51 +08:00
yihaoDeng 1910540a61 add rpc sync read timeout 2023-10-19 10:15:04 +08:00
dapan1121 afe963a9d1 enh: support view privilege 2023-10-19 08:31:31 +08:00
liuyao 5852a0975e set fill history range 2023-10-18 19:49:05 +08:00
yihaoDeng ef27c87756 opt status send 2023-10-18 16:37:34 +08:00
Haojun Liao 54ec679b58 refactor(stream): do some internal refactor. 2023-10-18 15:34:53 +08:00
slzhou 9c1697bfd1 fix: fix minior error 2023-10-18 13:19:44 +08:00
Haojun Liao c6dd73b68b
Merge pull request #23187 from taosdata/feat/TD-26056
feat:add replay logic
2023-10-18 11:43:43 +08:00
slzhou 98d782cfa5 fix: if not subquery, rewrite project alias 2023-10-18 11:04:34 +08:00
Haojun Liao 2904cfd4d5 Merge branch 'main' into refact/streamsm 2023-10-18 10:29:09 +08:00
slzhou cdc8b757ad fix: remove subquery user alias name distinct check 2023-10-18 10:11:43 +08:00
Haojun Liao 5115a1ac88
Merge pull request #23304 from taosdata/fix/TD-26771
double free
2023-10-18 10:09:17 +08:00
dapan1121 e6755461f5
Merge pull request #23087 from taosdata/szhou/pseudo-column-aliasname
enhance: support select `pseduo_column` from (select pseudo_column ...)
2023-10-18 09:23:01 +08:00
Haojun Liao df07443379
Merge pull request #23288 from taosdata/fix/liaohj
fix(stream):add more check for test cases.
2023-10-18 08:13:15 +08:00
Benguang Zhao 4ca897246c enh: proceed sync log buffer on failure of appending too 2023-10-17 14:56:07 +08:00
liuyao afa44732e2 Merge branch 'main' of https://github.com/taosdata/TDengine into main 2023-10-17 14:49:30 +08:00
liuyao 5e0f9cb908 double free 2023-10-17 14:32:09 +08:00
Haojun Liao 64ed7e49a2 enh(stream): sm for stream tasks. 2023-10-17 13:47:55 +08:00
Haojun Liao 7b7ce10475 refactor(stream): do some internal refactor. 2023-10-17 11:23:04 +08:00
Haojun Liao 14035c763c refactor: do some internal refactor. 2023-10-17 09:57:13 +08:00
dapan1121 5ae3987958
Merge pull request #23283 from taosdata/szhou/3.0/fix/td-26703
fix: tag scan support limit and remove slimit optimization
2023-10-17 08:54:21 +08:00
Haojun Liao fdb6ec1fa3 enh(stream): add parameter to limit the stream sink task. 2023-10-16 22:52:39 +08:00
dapan1121 cdda43cd67 Merge remote-tracking branch 'origin/3.0' into feat/TD-25204 2023-10-16 19:54:21 +08:00
dapan1121 7c8cf28b37 feat: add privileges 2023-10-16 19:53:08 +08:00
liuyao 990d36654d release buff 2023-10-16 19:49:45 +08:00
Haojun Liao a1aa2c9e0c fix(stream):add more check for test cases. 2023-10-16 18:47:01 +08:00
Haojun Liao 582bedd4bb
Merge pull request #23277 from taosdata/fix/TD-26722
set fill history range
2023-10-16 17:38:49 +08:00
slzhou 34246ea001 fix: tag scan support limit and remove slimit optimization 2023-10-16 16:43:15 +08:00
slzhou d30c6f6bcc fix: change tablename.tbname aliasname to tbname 2023-10-16 13:56:15 +08:00
liuyao 4ba45abd01 set fill history range 2023-10-16 13:53:54 +08:00
wangmm0220 473142fab7 fix:conflicts from 3.0 2023-10-16 11:35:56 +08:00
Haojun Liao 67bee17e5e other: merge main. 2023-10-16 09:55:41 +08:00
Haojun Liao f90cf54714 fix(stream): fix error in creating update node trans. 2023-10-15 21:56:49 +08:00
Haojun Liao 6611f216ac enh(stream): add some logs. 2023-10-13 19:45:29 +08:00
dapan1121 aab4cb98dc enh: create & drop view meta processing 2023-10-13 19:16:37 +08:00
dapan1121 a0699d758c Merge remote-tracking branch 'origin/3.0' into feat/TD-25204 2023-10-13 16:51:38 +08:00
dapan1121 c0a4328803 feat: support view meta updating 2023-10-13 16:29:34 +08:00
liuyao 7269dedb39 Merge branch '3.0' of https://github.com/taosdata/TDengine into 3.0 2023-10-13 11:35:01 +08:00
liuyao 429125be93 session state recover 2023-10-13 11:32:35 +08:00
Haojun Liao 33d9f772be other: merge 3.0 2023-10-13 09:06:13 +08:00
Haojun Liao 84c5359d5b other: merge 3.0 2023-10-13 08:58:26 +08:00
shenglian-zhou cbd9749bfe
Merge branch '3.0' into szhou/pseudo-column-aliasname 2023-10-12 19:01:28 -05:00
Alex Duan 35fced8796
Merge pull request #23234 from taosdata/main_3_merge
other: merge main into 3.0
2023-10-12 07:48:20 -05:00
dapan1121 7c67f23469 feat: update view meta 2023-10-12 19:56:17 +08:00
liuyao 2b540021e9 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26644 2023-10-12 17:52:30 +08:00
Haojun Liao 90f866352b
Merge pull request #23221 from taosdata/feat/TD-26052
fix:[TD-26671] judge if pointer is null to avoid core dump
2023-10-12 17:23:41 +08:00
liuyao 731fe67352 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26644 2023-10-12 16:28:10 +08:00
slzhou b78a32eb1a Merge branch '3.0' of github.com:taosdata/TDengine into szhou/pseudo-column-aliasname 2023-10-12 11:01:50 +08:00
Haojun Liao eb4449999f other: merge 3.0 2023-10-12 10:33:48 +08:00
liuyao 5fafdf351b refect 2023-10-11 20:17:47 +08:00
dapan1121 f5768494b4 feat: support describe view command 2023-10-11 18:49:47 +08:00
wangmm0220 05c016b667 fix:[TD-26671] judge if pointer is null to avoid core dump 2023-10-11 13:55:54 +08:00
dapan1121 3ff3fe7477
Merge pull request #23181 from taosdata/enh/TD-26604
enh: support balance group leader on vgroup_id
2023-10-11 13:25:51 +08:00
Hongze Cheng ef94767758
Merge pull request #23213 from taosdata/FIX/TD-26664-3.0
enh: send rpc rsp on error of tmsgPutToQueue
2023-10-10 22:46:24 -05:00
wangmm0220 f7d1e0ea82 fix:[TD-26671] judge if pointer is null to avoid core dump 2023-10-11 11:08:14 +08:00
dapan1121 478de7ae56 feat: add show create view implement 2023-10-11 10:38:22 +08:00
Haojun Liao 6982935df7
Merge pull request #23157 from taosdata/fix/liaohj
refactor(stream): fix bugs and do some internal refactor.
2023-10-11 10:30:16 +08:00
liuyao e9fc079d26 opt bloom filter 2023-10-11 10:14:11 +08:00
dapan1121 17e3b99bed
Merge pull request #23200 from taosdata/szhou/main/revert-create-table-sql
Revert "fix: add create table sql to audit log"
2023-10-11 08:52:53 +08:00
dapan1121 c5ec45ddb4
Merge pull request #23185 from taosdata/feat/TD-26639
feat: remove partition node for agg
2023-10-11 08:36:48 +08:00
Haojun Liao 1d4f0c8599
Merge pull request #23201 from taosdata/enh/TD-26646
Enh/td 26646
2023-10-10 22:59:37 +08:00
Benguang Zhao a9ed36e167 enh: send rpc rsp on error of tmsgPutToQueue 2023-10-10 16:53:15 +08:00
Haojun Liao 05dfadd8f8 fix(stream): set initial version for fill-history task. disable reentry of scan-history task function. 2023-10-10 15:52:48 +08:00
Haojun Liao 5f9b858fc1 other: merge main. 2023-10-10 15:38:46 +08:00
yihaoDeng b36163a197 add session iter 2023-10-10 15:12:21 +08:00
yihaoDeng 825341d90a add sess iter 2023-10-10 14:35:02 +08:00
wangjiaming0909 eea90507d4 feat: remove partition node for agg 2023-10-10 14:29:36 +08:00
Haojun Liao ba1690f0dd Merge remote-tracking branch 'origin/fix/liaohj' into fix/liaohj 2023-10-10 14:00:48 +08:00
Haojun Liao adf6f65d09 fix(stream): set initial version for fill-history task. disable reentry of scan-history task function. 2023-10-10 14:00:30 +08:00
Alex Duan 9da96ebf63
Merge pull request #23017 from taosdata/case/TD-26408-MAIN
fix: add case for lost data after  split vgroup (main)
2023-10-10 00:54:34 -05:00
Alex Duan e566027cef
Merge pull request #23019 from taosdata/case/TD-26408-3.0
fix: add case for lost data after split 3.0
2023-10-10 00:53:56 -05:00
yihaoDeng 6adf7532a8 add sess iter 2023-10-10 11:35:18 +08:00
shenglian zhou 6c30c4faab Revert "fix: add create table sql to audit log"
This reverts commit 658de2a04e.
2023-10-10 11:12:53 +08:00
slzhou bc2cf345fa fix: change error code after replace column and translate 2023-10-10 10:44:13 +08:00
yihaoDeng 7ac4ef5beb add sess iter 2023-10-10 10:41:46 +08:00
liuyao 26c87e5f41 fix mem leak 2023-10-10 10:26:26 +08:00
slzhou da9d39bfe6 fix: cancel future pseudo column translation function processing when rewritten to column 2023-10-10 08:31:23 +08:00
slzhou b8fe279a85 fix: renanme function 2023-10-10 07:44:29 +08:00
yihaoDeng 0fc6ffe6b6 change test case 2023-10-09 20:51:26 +08:00
Haojun Liao a25d94ab6f fix(stream): retry when error occurs during timer. 2023-10-09 20:10:28 +08:00
Haojun Liao 7d39164133 fix(stream): disable retrieving results during checkpoint procedure 2023-10-09 20:10:27 +08:00
Haojun Liao af4618f958 fix(stream): remove invalid clear of rspmsg list. 2023-10-09 20:10:27 +08:00
Haojun Liao 847baa8b71 fix(stream): fix the pause failure bug. 2023-10-09 20:10:27 +08:00
Haojun Liao 21fb502690 enh(stream): add trans to reset task status to avoid being frozen in checkpoint status due to doing checkpoint failure of partial tasks. 2023-10-09 20:10:26 +08:00
Haojun Liao 64bde93f85 fix(stream): not idle for sink task when no tokens are available. 2023-10-09 20:10:25 +08:00
Haojun Liao 9a7167aaba fix(stream): sleep for 10ms 2023-10-09 20:10:24 +08:00
Haojun Liao 9af8ce21ed fix(stream): wait for a while when no available token. 2023-10-09 20:10:23 +08:00
Haojun Liao 4780474877 fix(stream): continue 2023-10-09 20:10:23 +08:00
Haojun Liao da833ccb30 refactor: inc the dump batch. 2023-10-09 20:10:23 +08:00
Haojun Liao 2936ac9b89 fix(stream): add missing refactor. 2023-10-09 20:10:22 +08:00
Haojun Liao af2c0c95e9 refactor: do some internal refactor. 2023-10-09 20:10:22 +08:00
Haojun Liao 940d6a3cb4 fix(stream): check items in queue and qall, stead of only the queue items. 2023-10-09 20:10:21 +08:00
Haojun Liao e95aea84ae fix(stream): fix syntax error. 2023-10-09 20:10:21 +08:00
Haojun Liao 59e284c332 fix(stream): quit from loop when input queue is full. 2023-10-09 20:10:21 +08:00
Haojun Liao 9d5a3b8d78 other: merge stream fix. 2023-10-09 20:10:13 +08:00
Haojun Liao c5997bee5b fix(stream): update the current processing version. 2023-10-09 20:09:23 +08:00
Haojun Liao 28008f8263 enh(stream): add more info for sink task. 2023-10-09 20:09:22 +08:00
Haojun Liao b3b9e89d30 fix(stream): fix the invalid check. 2023-10-09 20:09:22 +08:00
Haojun Liao cf14772dd9 enh(stream): optimize the scan wal perf 2023-10-09 20:09:21 +08:00
Haojun Liao d2160efa05 refactor: wait for 100ms before scan wal again. 2023-10-09 20:09:21 +08:00
Haojun Liao 932d93ab35 refactor: wait for more time for future data 2023-10-09 20:09:21 +08:00
Haojun Liao 7682c033ad fix(stream): add null check. 2023-10-09 20:09:21 +08:00
Haojun Liao 0ab5d4b342 refactor: do some internal refactor. 2023-10-09 20:09:20 +08:00
Haojun Liao c295ec322a refactor: do some internal refactor. 2023-10-09 20:09:20 +08:00
Haojun Liao d5abb21335 fix(stream): fix invalid check. 2023-10-09 20:09:20 +08:00
Haojun Liao 583ac1fc45 refactor: do some internal refactor. 2023-10-09 20:09:20 +08:00
Haojun Liao 83f84d92bc refactor: do some internal refactor (discard the checkpoint source msg during restoring). 2023-10-09 20:09:10 +08:00
Haojun Liao bb4ba54f28 fix(stream): enable new time range for stream task. 2023-10-09 20:09:09 +08:00
Haojun Liao c759d90bf6 enh(stream): optimize the stream status when creating without fill-history option. 2023-10-09 20:09:09 +08:00
Haojun Liao db897fb03a fix(stream): opt perf. 2023-10-09 20:09:09 +08:00
Haojun Liao 0a2b70fd7f fix(stream): fix syntax error. 2023-10-09 20:09:06 +08:00
Haojun Liao 8477271240 fix(stream): fix dead lock. 2023-10-09 20:09:00 +08:00
Haojun Liao 12eabb0c2c log(stream): update logs. 2023-10-09 20:09:00 +08:00
Haojun Liao b716f0d1fd fix(stream): fix dead lock. 2023-10-09 20:08:57 +08:00
Haojun Liao 60a720efbb log: update logs. 2023-10-09 20:08:53 +08:00
Haojun Liao d10b07d23d refactor: do some internal refactor. 2023-10-09 20:08:53 +08:00
Haojun Liao 6d2dbd549b fix(stream): avoid repeatly free obj. 2023-10-09 20:08:53 +08:00
Haojun Liao 6b5770aab7 log(stream): update the log. 2023-10-09 20:08:52 +08:00
Haojun Liao dfe8641c0c refactor: optimize the fill-history task launch policy, and do some other internal refactor. 2023-10-09 20:08:52 +08:00
Haojun Liao 38164435f9 refactor: do some internal refactor. 2023-10-09 20:08:52 +08:00
Haojun Liao f2848de12a fix(stream): reduce the counter when remove stream tasks. 2023-10-09 20:08:52 +08:00
Haojun Liao ecb3b44026 fix(stream): limit sink quota. 2023-10-09 20:08:52 +08:00
Haojun Liao 2c0e54f4f7 fix(stream): update the retry interval. 2023-10-09 20:08:13 +08:00
Haojun Liao 7f8da725bc enh(stream): add quota limitation for sink task. 2023-10-09 20:08:13 +08:00
Haojun Liao a248f3d088 refactor: do some internal refactor. 2023-10-09 20:08:12 +08:00
Haojun Liao 0db357401d fix(stream): add new status for meta. 2023-10-09 20:08:12 +08:00
Haojun Liao 3912d80c02 fix(stream): do some internal refactor. 2023-10-09 20:08:11 +08:00
Haojun Liao feb09c8361 fix(stream): fix error in pause scan-history data. 2023-10-09 20:08:11 +08:00
Haojun Liao 6a98b11bef fix(stream): fix invalid read and memory leak. 2023-10-09 20:08:11 +08:00
Haojun Liao 65f66f0986 fix(stream): transfer state when all downstream rsp already. 2023-10-09 20:08:11 +08:00
Haojun Liao a32b56f381 fix(stream): fix memory leak. 2023-10-09 20:08:10 +08:00
Haojun Liao 4af7812f0b fix(stream): fix the invalid counter for ready tasks in vnode, fix an invalid read. 2023-10-09 20:08:10 +08:00
Haojun Liao 4fe1382cd9 fix(stream): adjust nodeUpdate check interval. 2023-10-09 20:08:09 +08:00
Haojun Liao f4f55fcbce fix(stream): record the tasks started info, and do some internal refactor. 2023-10-09 20:08:09 +08:00
Haojun Liao 68b003c804 fix(stream): fix race condition. 2023-10-09 20:08:09 +08:00
Haojun Liao fc96ec6bae fix(stream): do not wait for the checkpoint finish before stop tasks. 2023-10-09 20:08:09 +08:00
Haojun Liao 7167c3c5de fix(stream): add new timer for each task. 2023-10-09 20:08:08 +08:00
Haojun Liao 7336228c16 refactor: do some internal refactor. 2023-10-09 20:08:08 +08:00
Haojun Liao 477f57aa0e refactor: do some internal refactor. 2023-10-09 20:08:08 +08:00
Haojun Liao 52763ca2a3 refactor: do some internal refactor. 2023-10-09 20:08:07 +08:00
Haojun Liao 3baddbe67a fix(stream): update the checkpoint record start time. 2023-10-09 20:08:07 +08:00
Haojun Liao a6ffb845c8 fix(stream): fix invalid checkpoint start time. 2023-10-09 20:08:07 +08:00
Haojun Liao c05a8de3e8 fix(stream): rsp when checkpoint source failed. 2023-10-09 20:08:06 +08:00
Haojun Liao b4bc4fac98 fix(stream): disable auto rsp for checkpoint source. 2023-10-09 20:08:06 +08:00
Haojun Liao e671e87234 fix(stream): fix invalid assert. 2023-10-09 20:08:06 +08:00
Haojun Liao d1a6b8bd22 refactor: do some internal refactor. 2023-10-09 20:08:06 +08:00
Haojun Liao 46b17aa9f1 fix(stream): fix race condition. 2023-10-09 20:08:06 +08:00
Haojun Liao e49409a11e fix(stream): add some logs. 2023-10-09 20:08:05 +08:00
Haojun Liao 5eee76df65 fix(stream): add msg identifier check. 2023-10-09 20:08:05 +08:00
Haojun Liao 192c47a7c2 fix(stream): add some logs. 2023-10-09 20:08:05 +08:00
Haojun Liao 693254f602 fix(stream): remove invalid free. 2023-10-09 20:08:04 +08:00
Haojun Liao f3bd5c411d fix(stream): remove the blocking flag after successfully retry sending msg. 2023-10-09 20:08:04 +08:00
Haojun Liao ed9e035095 fix(stream): clear the failure vnode id list before send msg. 2023-10-09 20:08:04 +08:00
Haojun Liao 3726aa723e fix(stream): fix invalid read. 2023-10-09 20:08:04 +08:00
Haojun Liao e0d19af000 fix(stream): refactor re-try dispatch msg for stream tasks. 2023-10-09 20:08:03 +08:00
Haojun Liao 2b16976902 refactor(stream): refactor send msg. 2023-10-09 20:08:03 +08:00
Haojun Liao 27e00b1f19 fix(stream): add some logs, and remove invalid assert. 2023-10-09 20:08:02 +08:00
Haojun Liao 12687eb287 fix(stream): add check info detailed information. 2023-10-09 20:08:02 +08:00
Haojun Liao ab7c18f604 refactor: do some internal refactor. 2023-10-09 20:08:01 +08:00
Haojun Liao e5535fa1f5 fix(stream): handle dispatch checkpoint-trigger failure. 2023-10-09 20:08:01 +08:00
Haojun Liao 65cc4040f3 fix(stream): update logs. 2023-10-09 20:08:00 +08:00
Haojun Liao 6d3a134077 fix(stream): ignore the dispatch failure, and set the correct rsp counter. 2023-10-09 20:07:54 +08:00
Haojun Liao 7f4d9b6e41 fix(stream): wait for the task checkpoint before stop. 2023-10-09 20:07:53 +08:00
Haojun Liao ef9efc8a8e refactor: do refactor the sink task. 2023-10-09 20:07:53 +08:00
Haojun Liao e4ac835554 fix(stream): disable token bucket. 2023-10-09 20:07:53 +08:00
Haojun Liao a3d13d6634 fix(stream): remove invalid cached task info in buffer. 2023-10-09 20:07:08 +08:00
Haojun Liao 1f45bd82d2 other: merge stream fix in main. 2023-10-09 20:07:01 +08:00
Haojun Liao d752fb1ed6 fix(stream): exec task in task queuee threads. 2023-10-09 20:06:11 +08:00
Haojun Liao 1ebafe4a1f fix(stream): add more check. 2023-10-09 20:06:11 +08:00
Haojun Liao c403a15f36 fix(stream): check the status before exec stream task when handling the dispatch requests. 2023-10-09 20:06:11 +08:00
Haojun Liao d76e3ac718 fix(stream): add task status check. 2023-10-09 20:06:10 +08:00
Haojun Liao e27111ecd1 enh(stream): add node stage check. 2023-10-09 20:06:09 +08:00
Haojun Liao ce85945583 fix(stream): set correct size for results generated by scan history stream tasks. 2023-10-09 20:06:05 +08:00
Haojun Liao 053643be19 fix(stream): add timestamp. 2023-10-09 20:06:05 +08:00
Haojun Liao b38f9e0288 fix(stream): update logs. 2023-10-09 20:06:05 +08:00
Haojun Liao 5c0b8ea804 enh(stream): log the checkpoint time. 2023-10-09 20:06:04 +08:00
Haojun Liao b95ad74c7f fix(stream): not handle the check msg for follower tasks. 2023-10-09 20:06:04 +08:00
Haojun Liao e6fb9ee46c fix(stream): reset task counter. 2023-10-09 20:06:04 +08:00
Haojun Liao c3a3cf21fb fix(stream): add some logs. 2023-10-09 20:05:39 +08:00
Haojun Liao 08b37dfc13 fix(stream): fix memory leak. 2023-10-09 20:05:38 +08:00
Haojun Liao 734f648891 fix(stream): set the output normal for stream dispatch when encountering the transfer state. 2023-10-09 20:05:38 +08:00
Haojun Liao 636eccc160 fix(stream): add null check 2023-10-09 20:05:37 +08:00
Haojun Liao 57bf1cadc4 fix(stream): fix error in decode stream task. 2023-10-09 20:05:37 +08:00
Haojun Liao 9d6199adf7 fix(stream): fix invalid read. 2023-10-09 20:05:37 +08:00
Haojun Liao 0459a4628c fix(stream): fix stream task id error. 2023-10-09 20:05:36 +08:00
Haojun Liao 7ccc273206 other: merge stream fix in main. 2023-10-09 20:05:29 +08:00
Haojun Liao 98ef566eb4 fix(stream): remove fill-history sink task. 2023-10-09 20:04:17 +08:00
Haojun Liao e84eeee6b8 refactor: do some internal refactor. 2023-10-09 20:04:17 +08:00
Haojun Liao fe7864b976 fix(stream): fix error in drop task. 2023-10-09 20:04:17 +08:00
Haojun Liao c33e521aa1 fix(stream): update some logs. 2023-10-09 20:04:17 +08:00
Haojun Liao 39e0c57323 fix(stream): set the correct guard flag. 2023-10-09 20:04:16 +08:00
Haojun Liao 3d1f29ff21 fix(stream): fix memory leak. 2023-10-09 20:04:16 +08:00
yihaoDeng c6e9134cea add sess iter 2023-10-09 20:02:23 +08:00
Haojun Liao 6fa54789cb fix(stream): disable follower send hb to mnode. and do some internal refactor. 2023-10-09 19:59:31 +08:00
Haojun Liao 1256eafddb other: merge stream fix. 2023-10-09 19:59:24 +08:00
Haojun Liao be09c173ab fix:fix coverity issue and remove unnecessary files. 2023-10-09 19:56:17 +08:00
Haojun Liao 283118bf68 fix(stream):fix missing unlock. 2023-10-09 19:56:17 +08:00
Haojun Liao aaa12ed4f8 refactor: do some internal refactor about the sched status set 2023-10-09 19:56:17 +08:00
Haojun Liao 01d104706e refactor(stream): remove unnecessary streamschedTask function to improve the performance. 2023-10-09 19:56:17 +08:00
Haojun Liao a678e722ce fix(stream): limit the token bucket capacity 2023-10-09 19:56:17 +08:00
dapan1121 d229492616 Merge remote-tracking branch 'origin/3.0' into feat/TD-25204 2023-10-09 18:34:08 +08:00
wangmm0220 33045e63ae feat:[TD-26056] add replay logic 2023-10-09 17:35:40 +08:00
dapan1121 6c8db261f3 feat: support show views command 2023-10-09 17:19:36 +08:00
slzhou 44c3bc99e0 feat: add interp pseudo column conversion to column 2023-10-09 16:56:21 +08:00
Haojun Liao b0ef091430 fix(stream): retry when error occurs during timer. 2023-10-09 16:40:05 +08:00
Haojun Liao be0a2e4573 fix(stream): disable retrieving results during checkpoint procedure 2023-10-09 16:33:28 +08:00
slzhou 56534a7b0d enhance: scan and window pseudo column 2023-10-09 16:22:44 +08:00
dapan1121 7c7cf2b1aa enh: support balance group leader on vgroup_id 2023-10-09 15:46:41 +08:00
wade zhang 7c738cbe0c
Merge pull request #23168 from taosdata/feat/TS-4036-main
feat: alter local/dnode asynclog
2023-10-09 15:44:39 +08:00
Haojun Liao 8266c4ff77 fix(stream): remove invalid clear of rspmsg list. 2023-10-09 15:26:42 +08:00
Haojun Liao d87db2f829 fix(stream): fix the pause failure bug. 2023-10-09 14:48:11 +08:00
yihaoDeng 28b546a4ad fix mem leak 2023-10-09 14:25:57 +08:00
yihaoDeng be42143362 Merge branch '3.0' into case/TD-26408-3.0 2023-10-09 14:24:31 +08:00
yihaoDeng 3f9784f475 fix mem leak 2023-10-09 14:07:22 +08:00
shenglian zhou 1bf116f40c Merge branch 'szhou/continue-coing' of github.com:taosdata/TDengine into szhou/continue-coing 2023-10-09 13:23:23 +08:00
shenglian zhou 6ad518d61d enhance: pseduo column coverted to column when necessary 2023-10-09 13:21:32 +08:00
Haojun Liao 74ff0c5b50 Merge branch 'main' into fix/liaohj 2023-10-09 10:14:53 +08:00
Haojun Liao ee6516f3c4 enh(stream): add trans to reset task status to avoid being frozen in checkpoint status due to doing checkpoint failure of partial tasks. 2023-10-09 10:13:53 +08:00
Haojun Liao 4b8cd3bccd fix(stream): not idle for sink task when no tokens are available. 2023-10-09 10:07:19 +08:00
wangmm0220 5f7b6f19ba feat:[TD-26056] add replay logic 2023-10-08 19:05:59 +08:00
Haojun Liao e9ce38e2b0
Merge pull request #23159 from taosdata/fix/TD-26602
init bloomfilter array
2023-10-08 18:56:05 +08:00
dapan1121 5b639a172d feat: support query from view 2023-10-08 18:36:06 +08:00
liuyao 1d952ca8ea rebuild session window 2023-10-08 18:27:05 +08:00
Shungang Li a7507d26b0 feat: alter local/dnode asynclog 2023-10-08 18:26:25 +08:00
wangmm0220 b04d57fcc3 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26056 2023-10-08 16:15:19 +08:00
wangmm0220 3f2d890560 feat:[TD-26056] add replay logic 2023-10-08 16:06:15 +08:00
wade zhang 8e0179b73e
Merge pull request #23142 from taosdata/FIX/TS-4096-main
enh: reserve half a buffer size at syncLogBufferInit
2023-10-08 16:00:38 +08:00
slzhou 1aad905558 fix: collection functions hash set distinct error 2023-10-08 15:55:01 +08:00
liuyao 1cbb8ef444 init bloomfilter array 2023-10-08 14:43:44 +08:00
yihaoDeng b5994b31e2 fix mem leak 2023-10-08 13:33:02 +08:00
liuyao ed8cad22cb Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26174 2023-10-08 13:31:51 +08:00
yihaoDeng e3f18495e0 fix mem leak 2023-10-08 11:22:26 +08:00
slzhou 94b9d0f10a Merge branch '3.0' of github.com:taosdata/TDengine into szhou/pseudo-column-aliasname 2023-10-08 08:58:34 +08:00
Haojun Liao 23fb26798f fix(stream): sleep for 10ms 2023-10-07 19:47:49 +08:00
Haojun Liao e4e4c5a36e fix(stream): wait for a while when no available token. 2023-10-07 19:41:49 +08:00
Haojun Liao 45bb3f50d7 fix(stream): continue 2023-10-07 19:25:40 +08:00
liuyao 95ffe6fa23 stream recover 2023-10-07 19:24:21 +08:00
Haojun Liao 62cdcbc7e3 refactor: inc the dump batch. 2023-10-07 19:20:48 +08:00
Haojun Liao 4d6f143146 fix(stream): add missing refactor. 2023-10-07 19:18:26 +08:00
Haojun Liao ab17bfdf09 refactor: do some internal refactor. 2023-10-07 19:16:55 +08:00
Haojun Liao 0e8a8aabc1 fix(stream): check items in queue and qall, stead of only the queue items. 2023-10-07 19:16:25 +08:00
liuyao c088ee7f91 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26174 2023-10-07 19:13:07 +08:00
liuyao 1e323c0408 fix issue 2023-10-07 19:11:46 +08:00
liuyao 19bbf10579 fix issue 2023-10-07 17:59:53 +08:00
yihaoDeng 97fdcbc60b fix mem leak 2023-10-07 17:48:24 +08:00
liuyao 1aaf873134 fix issue 2023-10-07 17:43:50 +08:00
Haojun Liao d11c0a113c fix(stream): fix syntax error. 2023-10-07 14:56:09 +08:00
Haojun Liao 7ce3d2c200 fix(stream): quit from loop when input queue is full. 2023-10-07 14:54:11 +08:00
Benguang Zhao be3ba000a1 enh: reserve half a buffer size at syncLogBufferInit 2023-10-07 14:17:46 +08:00
liuyao 460ee86fdf fix issue 2023-10-07 11:55:40 +08:00
dapan1121 deb9a6875b feat: mnode processing view meta request 2023-10-07 10:40:00 +08:00
liuyao 59d47e1e1f fix issuse 2023-10-07 10:34:35 +08:00
Haojun Liao 115a284ac0 enh(stream): update the checkpoint interval 2023-10-07 09:56:03 +08:00
liuyao b7b96b67be use secondary pointer 2023-10-07 09:40:23 +08:00
Haojun Liao 011627d50a fix(stream): update the current processing version. 2023-10-07 09:07:44 +08:00
Haojun Liao c20dd002fb enh(stream): add more info for sink task. 2023-10-07 01:14:00 +08:00
Haojun Liao 98659ad323 fix(stream): fix the invalid check. 2023-10-05 00:09:47 +08:00
Haojun Liao 41ef1a45c1 enh(stream): optimize the scan wal perf 2023-10-04 22:06:46 +08:00
Haojun Liao 45e413f8d5 refactor: wait for 100ms before scan wal again. 2023-10-03 20:57:19 +08:00
Haojun Liao 132fb8e82e refactor: wait for more time for future data 2023-10-03 15:42:00 +08:00
Haojun Liao 38aff641ee fix(stream): add null check. 2023-10-03 02:39:57 +08:00
Haojun Liao 58f410a9df refactor: do some internal refactor. 2023-10-03 02:37:52 +08:00
Haojun Liao a543f4ca97 refactor: do some internal refactor. 2023-10-03 01:52:03 +08:00
Haojun Liao 5564eb215c fix(stream): fix invalid check. 2023-10-03 00:38:24 +08:00
Haojun Liao 5718158fc0 refactor: do some internal refactor. 2023-10-01 22:27:29 +08:00
Haojun Liao 31acbc6fe2 refactor: do some internal refactor (discard the checkpoint source msg during restoring). 2023-09-28 22:44:13 +08:00
Haojun Liao f2d8431619 fix(stream): enable new time range for stream task. 2023-09-28 18:26:52 +08:00
Minglei Jin 2d3652c723 fix(keep0-duration): force keep0 at least thrice of duration 2023-09-28 16:15:35 +08:00
Haojun Liao 0047d1e1a6 Merge branch 'main' into fix/liaohj 2023-09-28 14:35:14 +08:00
wade zhang b75baa5b0e
Merge pull request #23100 from taosdata/fix/m/TD-26525
fix: group by operator may cause client assert fail
2023-09-28 14:16:35 +08:00
dapan1121 0a0f512023 feat: add view meta processing 2023-09-28 11:44:38 +08:00
Haojun Liao 80ec77cbb6 enh(stream): optimize the stream status when creating without fill-history option. 2023-09-28 11:23:03 +08:00
wangjiaming0909 2340a952aa fix: group by operator may cause client assert fail 2023-09-28 10:23:33 +08:00
Haojun Liao 22e485d132 fix(stream): opt perf. 2023-09-28 09:25:23 +08:00
slzhou f659e36d2c fix: internal error when show normal db.tables like pattern 2023-09-28 09:20:12 +08:00
Haojun Liao 9df5217221
Merge pull request #23106 from taosdata/fix/fixTransInvalidReadMain
fix trans invalid read
2023-09-28 09:15:12 +08:00
Haojun Liao cc9b9d1054
Merge pull request #23102 from taosdata/fix/liaohj
fix(stream): fix several bugs and do some internal refactor for stream processing.
2023-09-28 09:12:39 +08:00
dapan1121 913c75e654
Merge pull request #23097 from taosdata/fix/ts-4088
fix: timestamp computation output type is float
2023-09-28 08:42:07 +08:00
Haojun Liao f525778aef fix(stream): fix syntax error. 2023-09-28 00:53:36 +08:00
Haojun Liao 25a3c727e3
Merge pull request #23090 from taosdata/fix/dead_lock
fix(stream): fix dead lock.
2023-09-28 00:42:52 +08:00
yihaoDeng 4581c296d0 fix trans invalid read 2023-09-27 19:54:09 +08:00
Haojun Liao 8c998673ad fix(stream): fix dead lock. 2023-09-27 17:15:49 +08:00
shenglian zhou fc824a3bb9 fix: timestamp add return float when get time range 2023-09-27 16:39:49 +08:00
dapan1121 c8aee79e3f fix: apercentile parameter validation and result error 2023-09-27 16:08:06 +08:00
Haojun Liao 2dade996bb log(stream): update logs. 2023-09-27 15:37:12 +08:00
Haojun Liao 9ab89ef961 fix(stream): fix dead lock. 2023-09-27 15:26:46 +08:00
Haojun Liao 8f2d217834 log: update logs. 2023-09-27 14:48:53 +08:00
Haojun Liao 11641e1115 refactor: do some internal refactor. 2023-09-27 14:18:01 +08:00
Haojun Liao 34d547bfff fix(stream): avoid repeatly free obj. 2023-09-27 14:05:14 +08:00
Haojun Liao ae020fcd2d log(stream): update the log. 2023-09-27 14:03:57 +08:00
Haojun Liao e13efd5b04 refactor: optimize the fill-history task launch policy, and do some other internal refactor. 2023-09-27 14:00:48 +08:00
slzhou dce29b367b fix: retore translater.c 2023-09-27 13:46:14 +08:00
dapan1121 222deba430
Merge pull request #23070 from taosdata/szhou/fix-td4070
fix: set null when creating empty input for count
2023-09-27 13:27:11 +08:00
slzhou dee6006ed9 Merge branch '3.0' of github.com:taosdata/TDengine into szhou/continue-coing 2023-09-27 10:02:49 +08:00
Haojun Liao a7e6933ce7 refactor: do some internal refactor. 2023-09-27 09:46:15 +08:00
Haojun Liao 37bf387453 fix(stream): reduce the counter when remove stream tasks. 2023-09-27 09:36:20 +08:00
Haojun Liao 9ab9de0ad3 fix(stream): limit sink quota. 2023-09-27 00:30:38 +08:00
Haojun Liao 27dcbcb96f fix(stream): update the retry interval. 2023-09-26 23:42:02 +08:00
Haojun Liao aec15ae39f enh(stream): add quota limitation for sink task. 2023-09-26 23:29:54 +08:00
liuyao ebf4283e91 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26174 2023-09-26 17:19:41 +08:00
liuyao c95dc167b7 add ci 2023-09-26 17:19:21 +08:00
dapan1121 17e1da0be7 fix: log typo 2023-09-26 16:53:29 +08:00
shenglian zhou 5a28981d50 fix: set null when creating empty input for count 2023-09-26 16:00:56 +08:00
wade zhang f6134b42d7
Merge pull request #23036 from taosdata/feat/TS-4011-3.0
feat/TS-4011: adjust config 'keep_time_offset' level from dnode to db
2023-09-26 14:25:54 +08:00
Haojun Liao 890d658aea refactor: do some internal refactor. 2023-09-26 14:11:45 +08:00
Haojun Liao 525ee369d3
Merge pull request #23032 from taosdata/fix/liaohj
fix(stream): fix several stability-related bugs in stream framework.
2023-09-26 14:10:58 +08:00
Haojun Liao f3f18b0fa3 fix(stream): add new status for meta. 2023-09-26 12:15:12 +08:00
liuyao ca2325f886 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26174 2023-09-26 10:41:31 +08:00
liuyao 82e18e32b0 add ci 2023-09-26 10:41:12 +08:00
Haojun Liao d214a2f6bd fix(stream): do some internal refactor. 2023-09-26 09:32:57 +08:00
Haojun Liao 6cc3618ed9 fix(stream): fix error in pause scan-history data. 2023-09-26 01:09:55 +08:00
Haojun Liao 5a4a0aa0e3 fix(stream): fix invalid read and memory leak. 2023-09-25 23:10:33 +08:00
yihaoDeng 05ab04b87f disable ip on community 2023-09-25 19:10:50 +08:00
Haojun Liao c9576d7a85 fix(stream): transfer state when all downstream rsp already. 2023-09-25 17:31:38 +08:00
liuyao 83c58a25cb ignore udpate check 2023-09-25 16:58:23 +08:00
Haojun Liao c615c513e8 fix(stream): fix memory leak. 2023-09-25 16:01:17 +08:00
Haojun Liao 966ce4f30e Merge remote-tracking branch 'origin/fix/liaohj' into fix/liaohj 2023-09-25 16:00:02 +08:00
Haojun Liao fcf4cc7169 fix(stream): fix the invalid counter for ready tasks in vnode, fix an invalid read. 2023-09-25 15:58:24 +08:00
Shungang Li 743a5b0640 feat: add db config item keep_time_offset 2023-09-25 15:46:08 +08:00
wade zhang 7a711bc687
Merge pull request #22879 from taosdata/enh/TS-3812-3.0
enh: timeseries calculation
2023-09-25 12:23:16 +08:00
wade zhang 928c28fb68
Merge pull request #23021 from taosdata/szhou/star-tbname
feature: bi tools support star expansion to include tbname
2023-09-25 12:22:36 +08:00
Haojun Liao dbc53069db
Merge branch 'main' into fix/liaohj 2023-09-25 10:41:18 +08:00
Haojun Liao 1af95969b2 fix(stream): adjust nodeUpdate check interval. 2023-09-25 10:40:30 +08:00
Haojun Liao eb4078b7f3 fix(stream): record the tasks started info, and do some internal refactor. 2023-09-25 09:59:05 +08:00
Haojun Liao c987f61300 fix(stream): fix race condition. 2023-09-25 01:37:27 +08:00
Haojun Liao da82a5f19e fix(stream): do not wait for the checkpoint finish before stop tasks. 2023-09-24 22:03:07 +08:00
Haojun Liao a74b462ffb fix(stream): add new timer for each task. 2023-09-24 02:25:53 +08:00
Haojun Liao b7dcd94c64 refactor: do some internal refactor. 2023-09-24 01:56:52 +08:00
Haojun Liao 3a75c21e66 refactor: do some internal refactor. 2023-09-24 01:55:59 +08:00
Haojun Liao 4ea737571d refactor: do some internal refactor. 2023-09-24 01:26:51 +08:00
kailixu bc8ebf1562 Merge branch '3.0' into enh/TS-3812-3.0 2023-09-23 18:19:08 +08:00
Haojun Liao 7f265e181d fix(stream): update the checkpoint record start time. 2023-09-23 18:05:14 +08:00
Haojun Liao 6ef68fdf06 fix(stream): fix invalid checkpoint start time. 2023-09-23 17:57:09 +08:00
Haojun Liao 0436977d63 Merge remote-tracking branch 'origin/fix/liaohj' into fix/liaohj 2023-09-23 14:13:53 +08:00
Haojun Liao acd3321494 fix(stream): rsp when checkpoint source failed. 2023-09-23 14:13:33 +08:00
yihaoDeng 67cd3ecd7f avoid double send 2023-09-23 03:38:00 +00:00
Haojun Liao 7d5f76c6f1 fix(stream): disable auto rsp for checkpoint source. 2023-09-23 11:31:14 +08:00
Haojun Liao 5155519559 fix(stream): fix invalid assert. 2023-09-22 23:06:48 +08:00
Haojun Liao cf6c255f22 refactor: do some internal refactor. 2023-09-22 22:50:21 +08:00
shenglian zhou df19645a90 fix: check table is super table when rewrite star for bi tool 2023-09-22 22:02:30 +08:00
kailixu 8f828e052b enh: timeseries calculation optimization 2023-09-22 20:07:51 +08:00
Haojun Liao fcbd747afc fix(stream): fix race condition. 2023-09-22 19:35:12 +08:00
liuyao 0d983e28ef Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26174 2023-09-22 19:25:41 +08:00
liuyao 5cc1ae1266 fix issue 2023-09-22 19:25:19 +08:00
Haojun Liao 1ca05fb3af fix(stream): add some logs. 2023-09-22 18:56:31 +08:00
Haojun Liao 5b12e276cf fix(stream): add msg identifier check. 2023-09-22 18:13:18 +08:00
Haojun Liao bb1a2322ca fix(stream): add some logs. 2023-09-22 17:27:10 +08:00
Haojun Liao 07ec6f38b8 fix(stream): remove invalid free. 2023-09-22 16:53:22 +08:00
Haojun Liao 5a695f632c fix(stream): remove the blocking flag after successfully retry sending msg. 2023-09-22 16:44:55 +08:00
Haojun Liao 6c357104a5 fix(stream): clear the failure vnode id list before send msg. 2023-09-22 16:19:25 +08:00
dapan1121 f0c1585508
Merge pull request #22957 from taosdata/feat/xsren/TS-4000/fillVarchar3.0
fill data of varchar type
2023-09-22 16:16:13 +08:00
Haojun Liao 0f5f21ba09 fix(stream): fix invalid read. 2023-09-22 16:05:12 +08:00
Haojun Liao 619a9f6d08 fix(stream): refactor re-try dispatch msg for stream tasks. 2023-09-22 15:57:55 +08:00
slzhou fb62588dd3 fix: nodesIsStar and nodesIsTableStar 2023-09-22 15:26:39 +08:00
slzhou 57d5d793f8 fix: comm/enterprise split 2023-09-22 15:06:38 +08:00
liuyao 4f8e6d7795 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26174 2023-09-22 15:00:52 +08:00
liuyao 410a177637 fix issue 2023-09-22 15:00:26 +08:00
Haojun Liao 898aea5cfb refactor(stream): refactor send msg. 2023-09-22 14:52:18 +08:00
slzhou 18f8e0dc8d fix: enterprise/community bi support 2023-09-22 14:31:47 +08:00
slzhou 72307ab877 enhance: move bi to enterprise 2023-09-22 14:27:01 +08:00
Haojun Liao 7e4410f094
Merge pull request #22992 from taosdata/feat/TD-26052
feat:support vnode split in tmq
2023-09-22 13:57:21 +08:00
dapan1121 a61d90f672 enh: remove column list 2023-09-22 11:36:53 +08:00
Haojun Liao 87ea745861 fix(stream): add some logs, and remove invalid assert. 2023-09-22 10:53:03 +08:00
Haojun Liao f7bcff862d fix(stream): add check info detailed information. 2023-09-22 10:23:56 +08:00
slzhou 9bb628650c fix: pass basic test 2023-09-22 10:13:17 +08:00
wangmm0220 5555371fbc fix:memory leak 2023-09-22 10:04:53 +08:00
dapan1121 94ad93febd
Merge pull request #23003 from taosdata/feat-pipelined-agg/TD-25620
feat: pipelined agg when partition by col slimit
2023-09-22 09:48:45 +08:00
liuyao dc2f7872f8 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26174 2023-09-22 09:41:15 +08:00
liuyao 4979fc5283 fix issue 2023-09-22 09:40:08 +08:00
wangmm0220 803b17a2db fix:memory leak 2023-09-22 09:31:58 +08:00
Haojun Liao b1ba716299 refactor: do some internal refactor. 2023-09-22 09:24:36 +08:00
Haojun Liao b075b4438b fix(stream): handle dispatch checkpoint-trigger failure. 2023-09-21 23:15:18 +08:00
dapan1121 a67b0c99fc feat: support create/drop view 2023-09-21 19:28:07 +08:00
Haojun Liao 50d5fb6641 fix(stream): update logs. 2023-09-21 19:14:34 +08:00
wangjiaming0909 f2832b5aa7 feat: pipelined agg when partition by col slimit 2023-09-21 17:45:49 +08:00
Cary Xu 1bbb812557
Merge branch '3.0' into enh/TS-3934-3.0 2023-09-21 17:32:51 +08:00
Haojun Liao 4925b67d4a fix(stream): ignore the dispatch failure, and set the correct rsp counter. 2023-09-21 17:22:09 +08:00
shenglian zhou 80f77251b2 merge with 3.0 and finish coding star expansion 2023-09-21 17:04:12 +08:00
dapan1121 64da3f4ef9
Merge pull request #22978 from taosdata/szhou/show-db-table
enhance: show normal/child tables and show user/system databases
2023-09-21 16:55:26 +08:00
Haojun Liao 2efd155adf fix(stream): wait for the task checkpoint before stop. 2023-09-21 15:53:21 +08:00
kailixu 677e938851 enh: remove obsolete code 2023-09-21 14:18:46 +08:00
kailixu b0d1f651ab enh: remove obsolete code 2023-09-21 14:15:29 +08:00
kailixu eb6b6ec882 enh: remove user cache when user dropped 2023-09-21 14:09:50 +08:00
Haojun Liao 17586af0ce refactor: do refactor the sink task. 2023-09-21 13:32:57 +08:00
kailixu 2ff0748022 enh: remove user cache in catalog when user dropped 2023-09-21 11:29:34 +08:00
liuyao b1d9cd1c4a release state 2023-09-21 10:12:43 +08:00
liuyao 3b3c5d7cb8 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26174 2023-09-21 10:11:36 +08:00
slzhou de411ebad1 fix: review comments 2023-09-21 09:55:13 +08:00
yihaoDeng 77ef632233 refactor code 2023-09-21 01:36:12 +00:00
Haojun Liao 9f9b712332 fix(stream): disable token bucket. 2023-09-21 01:19:58 +08:00
dapan1121 cc08a5ee87 fix: add query sql 2023-09-20 19:30:40 +08:00
Haojun Liao 92f18989df fix(stream): remove invalid cached task info in buffer. 2023-09-20 19:19:04 +08:00
Haojun Liao 6633fb971b fix(stream): update logs. 2023-09-20 18:18:31 +08:00
liuyao b4be5fe895 fix mem leak 2023-09-20 17:35:11 +08:00
Haojun Liao 8d5ea720e4
Merge pull request #22962 from taosdata/feat/TD-26052
feat:vnode tranform support in tmq
2023-09-20 17:32:04 +08:00
Haojun Liao 619b377dd9 fix(stream): exec task in task queuee threads. 2023-09-20 17:30:41 +08:00
Haojun Liao 49165f8c3c fix(stream): add more check. 2023-09-20 16:49:55 +08:00
Haojun Liao 8329ec79f2 fix(stream): check the status before exec stream task when handling the dispatch requests. 2023-09-20 16:32:27 +08:00
dmchen 8ad0f4182a revert dependency 2023-09-20 15:54:38 +08:00
Haojun Liao 2a781c509f fix(stream): add task status check. 2023-09-20 15:32:15 +08:00
liuyao 1cebda368a session&state operator buff 2023-09-20 15:06:08 +08:00
slzhou 6496bb3d31 Merge branch 'szhou/show-db-table' into szhou/continue-coing 2023-09-20 14:19:40 +08:00
slzhou 0c6338dc15 fix: fix address sanitizer error 2023-09-20 13:25:26 +08:00
slzhou 1f1657a160 fix: fix address sanitizer error 2023-09-20 11:50:32 +08:00
dm chen 4497a01168
Merge branch 'main' into feat/TD-26127-audit-sql 2023-09-20 11:13:34 +08:00
slzhou 1c27c2123f enhance: select `tbname` from (select tbname from d.st) 2023-09-20 11:06:59 +08:00
Haojun Liao b4419bda65 enh(stream): add node stage check. 2023-09-20 10:35:01 +08:00
Haojun Liao 779c0c5f19
Merge pull request #22970 from taosdata/fix/liaohj
fix(stream): keep the status entry in hash table, instead entry index.
2023-09-20 10:33:05 +08:00
kailixu a9d30f25d2 enh: rsma support delete raw data 2023-09-20 10:11:03 +08:00
slzhou 951786669d fix: modify show_kind enum value from none to all 2023-09-20 08:39:57 +08:00
Haojun Liao 1decaaee1e fix(stream): set correct size for results generated by scan history stream tasks. 2023-09-19 16:49:04 +08:00
slzhou bd2669b4f1 fix: show normal tables core 2023-09-19 16:40:23 +08:00
slzhou f208eefdf2 fix: fix sanitizer error 2023-09-19 16:21:44 +08:00
slzhou f4dbd5d9c9 enhance: show normal/child tables and show user/system databases 2023-09-19 16:14:17 +08:00
wangjiaming0909 1e53e6cfeb optimize count()/last() + partition by tbname/tag 2023-09-19 14:56:02 +08:00
dm chen ee913cbfbc
Merge branch 'main' into feat/TD-26127-audit-sql 2023-09-19 14:39:20 +08:00
Haojun Liao 309630eb11 fix(stream): add timestamp. 2023-09-19 14:22:05 +08:00
dapan1121 b9d554275c Merge remote-tracking branch 'origin/3.0' into feat/TD-25204 2023-09-19 14:21:00 +08:00
dapan1121 14e8db289d feat: support view 2023-09-19 14:19:54 +08:00
dapan1121 aabd7a51f7
Merge pull request #22934 from taosdata/fix/xsren/TD-26274/mergeSort_main
merge stable sort intead of qsort as insert unordered data
2023-09-19 14:17:47 +08:00
shenglian zhou 2773f1e9ac fix: continue coding 2023-09-19 14:03:06 +08:00
dmchen e36ff1282c revert dependency 2023-09-19 13:42:02 +08:00
Haojun Liao 38b3a7c1bd fix(stream): update logs. 2023-09-19 11:05:49 +08:00
slzhou cabe04fccd fix: add more sql trace 2023-09-19 10:47:12 +08:00
slzhou 7b2eea0b4b fix: fix address sanitizer error 2023-09-19 10:08:01 +08:00
Haojun Liao b7efedf4aa enh(stream): log the checkpoint time. 2023-09-19 09:53:33 +08:00
Haojun Liao e76bab7122 fix(stream): not handle the check msg for follower tasks. 2023-09-19 09:43:14 +08:00
slzhou 05ef6e291c fix: fix address sanitizer error 2023-09-19 09:15:12 +08:00