Commit Graph

16320 Commits

Author SHA1 Message Date
Haojun Liao f682ad0479 refactor: do some internal refactor. 2023-10-27 09:55:06 +08:00
Haojun Liao efede8669f refactor: do some internal refactor. 2023-10-27 09:55:06 +08:00
Haojun Liao 9ebf806789 fix(stream): clear the flag. 2023-10-27 09:55:05 +08:00
Haojun Liao 48ff521968 fix(stream): update the nodeEp even during checkpoint trans. 2023-10-27 09:55:02 +08:00
Haojun Liao 0d4892f25b fix(stream): fix bugs caused by refactor sm. 2023-10-27 09:55:00 +08:00
Haojun Liao a31613ae95 refactor: add ref in log. 2023-10-27 09:54:59 +08:00
Haojun Liao 226b6596d6 fix(stream): fix bugs caused by refactor. 2023-10-27 09:54:58 +08:00
Haojun Liao 091238e7be fix(stream): fix bugs caused by refactor sm. 2023-10-27 09:54:58 +08:00
Haojun Liao e1f6043eed fix(stream): fix bugs caused by refactor sm. 2023-10-27 09:54:57 +08:00
Haojun Liao e359da7b19 fix(stream): fix bugs caused by refactor. 2023-10-27 09:54:57 +08:00
Haojun Liao 8729bdac1e fix(stream): fix bugs caused by refactor. 2023-10-27 09:54:57 +08:00
Haojun Liao 1eac7f44c0 fix(stream): fix error in stream. 2023-10-27 09:54:56 +08:00
Haojun Liao 579dd8e6b2 refactor(stream): do some internal refactor. 2023-10-27 09:54:56 +08:00
Haojun Liao 6f3c0d17cc refactor(stream): add state machine to manage the state of stream tasks. 2023-10-27 09:54:49 +08:00
Haojun Liao 596eb073b7 refactor(stream): do some internal refactor. 2023-10-27 09:54:48 +08:00
Haojun Liao 91e3fd66e6 enh(stream): sm for stream tasks. 2023-10-27 09:54:44 +08:00
Haojun Liao 2409a17517 refactor(stream): do some internal refactor. 2023-10-27 09:54:44 +08:00
wangjiaming0909 70850697a4 feat: support to_timestamp/to_char fix comments 2023-10-27 09:54:16 +08:00
Haojun Liao c9bdb56d79 refactor: do some internal refactor. 2023-10-27 09:54:09 +08:00
Haojun Liao 164159f293 enh(stream): add parameter to limit the stream sink task. 2023-10-27 09:54:07 +08:00
Haojun Liao 62c58ecd8b fix(stream):add more check for test cases. 2023-10-27 09:54:06 +08:00
Haojun Liao a4f6042966 fix(stream): fix error in creating update node trans. 2023-10-27 09:52:14 +08:00
Haojun Liao ffa798c4fa enh(stream): add some logs. 2023-10-27 09:52:14 +08:00
Hongze Cheng dc03d8cd1a disable tfs unit test 2023-10-26 20:07:38 +08:00
slzhou 779c37b425 enhance: change to invalid operation for stmt error 2023-10-26 14:23:21 +08:00
kailixu 4097b53bfa enh: only float/double allowed for sum/avg of rsma 2023-10-26 11:21:56 +08:00
kailixu a83b3053f4 enh: check interval and keep for retentions 2023-10-25 22:52:03 +08:00
kailixu 64765579e9 enh: check interval and keep for retentions 2023-10-25 22:42:01 +08:00
Benguang Zhao fe553352b8 enh: cache snap blocks sent in snapshotSend for resending 2023-10-25 20:26:11 +08:00
Hongze Cheng 25aade1333 feat: alloc disk acorrding to avail disk space 2023-10-25 19:44:21 +08:00
slzhou 5ca39f961c fix: add error test case and fix address sanitizer 2023-10-25 16:30:13 +08:00
Benguang Zhao ec5b1f2ec1 enh: logging buf info for snapshot reader and sender 2023-10-25 15:04:14 +08:00
Benguang Zhao 7d9d1c6877 enh: terminate snap replication on timeout 2023-10-25 14:50:53 +08:00
shenglian zhou 6edf954cd3 Merge branch '3.0' of github.com:taosdata/TDengine into szhou/bi-mode-tag-scan 2023-10-25 13:54:58 +08:00
shenglian zhou 8b2d57504c enhance: bi mode default tag scan 2023-10-25 13:54:45 +08:00
slzhou efe480ae14 Merge branch 'szhou/continue-coing' into szhou/insert-stb-tbname 2023-10-25 13:30:49 +08:00
slzhou 04a9f5945f Merge branch '3.0' of github.com:taosdata/TDengine into szhou/insert-stb-tbname 2023-10-25 13:30:38 +08:00
slzhou 29db21a3ad fix: reinit ctb meta and col vals before each stb row 2023-10-25 11:22:15 +08:00
slzhou c17300557d fix: memory sanitizer error of simple insert stb 2023-10-25 10:56:28 +08:00
dapan1121 6dcc555bbc fix: view privilege issue 2023-10-25 10:47:01 +08:00
slzhou f0a44b31fc fix: insert into super table syntax is not supported for stmt 2023-10-25 09:56:21 +08:00
shenglian zhou 3de5b841a5 fix: large file by batches 2023-10-25 09:35:37 +08:00
shenglian zhou c9d1553633 enhance: refactor stb rows data context 2023-10-25 09:06:45 +08:00
shenglian zhou a28b3a6e3f fix: refactor 2023-10-25 08:50:08 +08:00
shenglian zhou 0c33a3e60e fix: child table meta optimization 2023-10-25 08:27:02 +08:00
Benguang Zhao 4e3a8b893d enh: restore wal log from snapshot after finish 2023-10-24 20:03:48 +08:00
Benguang Zhao 374217ceff fixup: adjust a logging msg in syncNodeStartSnapshot 2023-10-24 19:29:09 +08:00
Benguang Zhao 95188ab8c3 enh: adjust some logging msgs for sync log replication mgr 2023-10-24 19:11:27 +08:00
Benguang Zhao 4d61e87c0f enh: add signature info in logging msgs of snap replication 2023-10-24 17:28:46 +08:00
shenglian zhou 27302f995b fix: add memory free 2023-10-24 16:23:03 +08:00
dapan1121 9bf8be1ab4
Merge pull request #23354 from taosdata/fix/3.0/TD-26779
fix: union all cast func resType check error
2023-10-24 16:11:50 +08:00
shenglian zhou ae1bac251a enhance: finished skeleton 2023-10-24 16:08:08 +08:00
Benguang Zhao 811f1bbbea enh: tidy up logging msg in syncNodeOnSnapshotRsp 2023-10-24 15:47:47 +08:00
Benguang Zhao 1c60e67a83 enh: send the END snap msg at last 2023-10-24 14:16:46 +08:00
dapan1121 dbbceae061 fix: union all view issue 2023-10-24 11:29:04 +08:00
Benguang Zhao f444cd7a6d enh: log signature of snap sender/receiver while started or stopped 2023-10-24 11:11:11 +08:00
shenglian zhou 65cfc13703 fix: memory sanitizer error 2023-10-23 19:40:27 +08:00
wangjiaming0909 f299a28109 feat: support to_timestamp/to_char 2023-10-23 19:36:03 +08:00
Benguang Zhao e34da43e38 feat: support pipelining of snap replication 2023-10-23 19:32:44 +08:00
slzhou 0cfbcd7a13 Merge branch '3.0' of github.com:taosdata/TDengine into szhou/continue-coing 2023-10-23 16:34:21 +08:00
shenglian zhou e713b7c22f enhance: insert stb skeleton development 2023-10-23 16:27:00 +08:00
dapan1121 ab98f7623c Merge remote-tracking branch 'origin/3.0' into feat/TD-25204 2023-10-23 08:44:46 +08:00
shenglian zhou 5156c0d00c enhance: get tbname from one row for stb syntax 2023-10-22 15:14:50 +08:00
shenglian zhou 6488672dd6 enhance: parse target column 2023-10-22 11:21:36 +08:00
shenglian zhou 438a775c78 fix: parse insert stb columns when meta is ready or ready after get meta 2023-10-21 14:02:03 +08:00
dapan1121 0f4766e38e feat: add view cases 2023-10-20 18:22:30 +08:00
slzhou 3fe5c447e7 enhance: begin parse cols 2023-10-20 17:16:45 +08:00
dapan1121 1ff5ccf186
Merge pull request #23222 from taosdata/feat/TS-4072
feat: support interval syntax of quoted duration and default unit
2023-10-20 15:16:07 +08:00
dapan1121 d7a5b529f9
Merge pull request #23312 from taosdata/szhou/fix/td-26778
fix: remove subquery user alias name distinct check
2023-10-20 15:15:01 +08:00
slzhou ce6be3d3e7 fix: refactor checkAuth for target table 2023-10-20 14:51:44 +08:00
wangjiaming0909 720982374c fix: union all cast func resType check error 2023-10-20 10:36:52 +08:00
Haojun Liao 9f9fae3b99
Merge pull request #23329 from taosdata/opt/addStatusSend
Opt/add status send
2023-10-20 09:52:12 +08:00
wade zhang 628667f22c
Merge pull request #23231 from taosdata/FEAT/TS-3816-3.0
feat: support restoring vnodes on replaced disks as needed
2023-10-20 09:02:25 +08:00
dapan1121 42f440b0fb Merge remote-tracking branch 'origin/3.0' into feat/TD-25204 2023-10-20 08:46:32 +08:00
dapan1121 969b002936 enh: support view privilege 2023-10-20 08:41:49 +08:00
slzhou 332268fd4b set super table name for stb syntax and rename setRefreshMate to setRefreshMeta 2023-10-19 15:55:24 +08:00
wangjiaming0909 04c60486e9 feat: support interval syntax of quoted duration and default unit 2023-10-19 15:46:19 +08:00
Haojun Liao 614bdd9fb9
Merge pull request #23220 from taosdata/feat/TD-26644
opt bloom filter
2023-10-19 15:34:43 +08:00
Haojun Liao da8f6a4c2f
Merge pull request #23248 from taosdata/feat/TD-26647
recover session buff state
2023-10-19 15:34:03 +08:00
yihaoDeng 93cac3532e fix invalid debug info 2023-10-19 15:30:04 +08:00
slzhou cb2311fde6 fix minior error 2023-10-19 13:28:48 +08:00
slzhou 334feb199a call processTableSchemaFromMetaData when success 2023-10-19 13:22:28 +08:00
yihaoDeng afac844656 add rpc sync read time 2023-10-19 11:45:59 +08:00
shenglian zhou 8532227a36 fix: first schema clause top - target is supertable 2023-10-19 11:30:44 +08:00
Benguang Zhao a2e0480839 refact: rename as SYNC_FSM_STATE_COMPLETE 2023-10-19 11:18:57 +08:00
Benguang Zhao c4e9069a66 fix: set nextProcessedVer properly in tqProcessTaskScanHistory 2023-10-19 11:18:57 +08:00
Benguang Zhao 05ba5e1ed0 refact: adjust logging msg in walLogEntriesComplete 2023-10-19 11:18:57 +08:00
Benguang Zhao d671283b8b refact: adjust logging msg for incomplete fsm state 2023-10-19 11:18:57 +08:00
Benguang Zhao 9643799dc5 fixup: compiler error at labels since allowed only at statements 2023-10-19 11:04:39 +08:00
Benguang Zhao 233a3c4034 enh: terminate on incompletenss of fsm state for dbs of single replica 2023-10-19 11:04:39 +08:00
Benguang Zhao 810678ebcb enh: tidy up debugging msgs of snapshot replication 2023-10-19 11:04:39 +08:00
Benguang Zhao c89c69f951 enh: use waitTime to prevent from starting snapshot too frequently 2023-10-19 11:04:39 +08:00
Benguang Zhao be6411ebbe fixup: set lastSendTime with taosGetTimestampMs 2023-10-19 11:04:39 +08:00
Benguang Zhao a53ba24118 fix: set startTime in snapshotReSend 2023-10-19 11:04:39 +08:00
Benguang Zhao e901adfdf3 enh: check snapshot receiver and sender by signature 2023-10-19 11:04:39 +08:00
Benguang Zhao eb4e2aa58f feat: restore incomplete fsm state with maxVerValid via snapshot replication 2023-10-19 11:04:36 +08:00
Benguang Zhao e1c03118ab enh: extract snapshot info for both of snap reader and writer 2023-10-19 10:51:13 +08:00
Benguang Zhao 410ced8320 feat: use TLV format to encode data of snapshot info 2023-10-19 10:51:13 +08:00
Benguang Zhao 517f1f7e40 fixup: fix syncNodeOnSnapshotPrep 2023-10-19 10:37:34 +08:00
Benguang Zhao 083dd148be feat: exchange difference of snapshot info for replication 2023-10-19 10:37:34 +08:00
yihaoDeng 365d535e6d add rpc sync read timeout 2023-10-19 10:32:51 +08:00
yihaoDeng 1910540a61 add rpc sync read timeout 2023-10-19 10:15:04 +08:00
dapan1121 afe963a9d1 enh: support view privilege 2023-10-19 08:31:31 +08:00
liuyao 5852a0975e set fill history range 2023-10-18 19:49:05 +08:00
yihaoDeng ef27c87756 opt status send 2023-10-18 16:37:34 +08:00
slzhou 9c1697bfd1 fix: fix minior error 2023-10-18 13:19:44 +08:00
Haojun Liao c6dd73b68b
Merge pull request #23187 from taosdata/feat/TD-26056
feat:add replay logic
2023-10-18 11:43:43 +08:00
slzhou 98d782cfa5 fix: if not subquery, rewrite project alias 2023-10-18 11:04:34 +08:00
slzhou cdc8b757ad fix: remove subquery user alias name distinct check 2023-10-18 10:11:43 +08:00
dapan1121 e6755461f5
Merge pull request #23087 from taosdata/szhou/pseudo-column-aliasname
enhance: support select `pseduo_column` from (select pseudo_column ...)
2023-10-18 09:23:01 +08:00
Benguang Zhao 4ca897246c enh: proceed sync log buffer on failure of appending too 2023-10-17 14:56:07 +08:00
dapan1121 5ae3987958
Merge pull request #23283 from taosdata/szhou/3.0/fix/td-26703
fix: tag scan support limit and remove slimit optimization
2023-10-17 08:54:21 +08:00
dapan1121 cdda43cd67 Merge remote-tracking branch 'origin/3.0' into feat/TD-25204 2023-10-16 19:54:21 +08:00
dapan1121 7c8cf28b37 feat: add privileges 2023-10-16 19:53:08 +08:00
slzhou 34246ea001 fix: tag scan support limit and remove slimit optimization 2023-10-16 16:43:15 +08:00
slzhou d30c6f6bcc fix: change tablename.tbname aliasname to tbname 2023-10-16 13:56:15 +08:00
wangmm0220 473142fab7 fix:conflicts from 3.0 2023-10-16 11:35:56 +08:00
dapan1121 aab4cb98dc enh: create & drop view meta processing 2023-10-13 19:16:37 +08:00
dapan1121 a0699d758c Merge remote-tracking branch 'origin/3.0' into feat/TD-25204 2023-10-13 16:51:38 +08:00
dapan1121 c0a4328803 feat: support view meta updating 2023-10-13 16:29:34 +08:00
liuyao 7269dedb39 Merge branch '3.0' of https://github.com/taosdata/TDengine into 3.0 2023-10-13 11:35:01 +08:00
liuyao 429125be93 session state recover 2023-10-13 11:32:35 +08:00
Haojun Liao 33d9f772be other: merge 3.0 2023-10-13 09:06:13 +08:00
Haojun Liao 84c5359d5b other: merge 3.0 2023-10-13 08:58:26 +08:00
shenglian-zhou cbd9749bfe
Merge branch '3.0' into szhou/pseudo-column-aliasname 2023-10-12 19:01:28 -05:00
Alex Duan 35fced8796
Merge pull request #23234 from taosdata/main_3_merge
other: merge main into 3.0
2023-10-12 07:48:20 -05:00
dapan1121 7c67f23469 feat: update view meta 2023-10-12 19:56:17 +08:00
liuyao 2b540021e9 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26644 2023-10-12 17:52:30 +08:00
Haojun Liao 90f866352b
Merge pull request #23221 from taosdata/feat/TD-26052
fix:[TD-26671] judge if pointer is null to avoid core dump
2023-10-12 17:23:41 +08:00
liuyao 731fe67352 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26644 2023-10-12 16:28:10 +08:00
slzhou b78a32eb1a Merge branch '3.0' of github.com:taosdata/TDengine into szhou/pseudo-column-aliasname 2023-10-12 11:01:50 +08:00
Haojun Liao eb4449999f other: merge 3.0 2023-10-12 10:33:48 +08:00
liuyao 5fafdf351b refect 2023-10-11 20:17:47 +08:00
dapan1121 f5768494b4 feat: support describe view command 2023-10-11 18:49:47 +08:00
wangmm0220 05c016b667 fix:[TD-26671] judge if pointer is null to avoid core dump 2023-10-11 13:55:54 +08:00
dapan1121 3ff3fe7477
Merge pull request #23181 from taosdata/enh/TD-26604
enh: support balance group leader on vgroup_id
2023-10-11 13:25:51 +08:00
Hongze Cheng ef94767758
Merge pull request #23213 from taosdata/FIX/TD-26664-3.0
enh: send rpc rsp on error of tmsgPutToQueue
2023-10-10 22:46:24 -05:00
wangmm0220 f7d1e0ea82 fix:[TD-26671] judge if pointer is null to avoid core dump 2023-10-11 11:08:14 +08:00
dapan1121 478de7ae56 feat: add show create view implement 2023-10-11 10:38:22 +08:00
Haojun Liao 6982935df7
Merge pull request #23157 from taosdata/fix/liaohj
refactor(stream): fix bugs and do some internal refactor.
2023-10-11 10:30:16 +08:00
liuyao e9fc079d26 opt bloom filter 2023-10-11 10:14:11 +08:00
dapan1121 17e3b99bed
Merge pull request #23200 from taosdata/szhou/main/revert-create-table-sql
Revert "fix: add create table sql to audit log"
2023-10-11 08:52:53 +08:00
dapan1121 c5ec45ddb4
Merge pull request #23185 from taosdata/feat/TD-26639
feat: remove partition node for agg
2023-10-11 08:36:48 +08:00
Haojun Liao 1d4f0c8599
Merge pull request #23201 from taosdata/enh/TD-26646
Enh/td 26646
2023-10-10 22:59:37 +08:00
Benguang Zhao a9ed36e167 enh: send rpc rsp on error of tmsgPutToQueue 2023-10-10 16:53:15 +08:00
Haojun Liao 05dfadd8f8 fix(stream): set initial version for fill-history task. disable reentry of scan-history task function. 2023-10-10 15:52:48 +08:00
Haojun Liao 5f9b858fc1 other: merge main. 2023-10-10 15:38:46 +08:00
yihaoDeng b36163a197 add session iter 2023-10-10 15:12:21 +08:00
yihaoDeng 825341d90a add sess iter 2023-10-10 14:35:02 +08:00
wangjiaming0909 eea90507d4 feat: remove partition node for agg 2023-10-10 14:29:36 +08:00