Commit Graph

16660 Commits

Author SHA1 Message Date
slzhou 041ef1ef83 enhance: colvals of table data cxt is not used in insert stb syntax 2023-10-31 17:05:37 +08:00
Haojun Liao a1aa2380ae other: merge 3.0 2023-10-31 16:42:51 +08:00
Haojun Liao 0b18192b23 fix(stream): fix error in finishing event handling. 2023-10-31 16:40:16 +08:00
Haojun Liao 762cfef498 fix(stream): adjust the stop condition for stream tasks. 2023-10-31 16:40:16 +08:00
Haojun Liao 4c0242a58d fix(stream): fix error in finishing event handling. 2023-10-31 16:39:14 +08:00
kailixu 012d86d9a8 Merge branch '3.0' into enh/TD-23769-3.0x 2023-10-31 16:15:51 +08:00
dapan1121 c4e1faae36
Merge pull request #23432 from taosdata/szhou/bi-mode-tag-scan
enhance: bi mode tag scan
2023-10-31 15:44:53 +08:00
liuyao 696294c208 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898 2023-10-31 15:41:04 +08:00
liuyao b9e05ab1ec update data 2023-10-31 15:40:42 +08:00
wade zhang 76c9b9afc5
Merge pull request #23377 from taosdata/FIX/TD-26596-3.0
feat: support pipelining of snap replication
2023-10-31 15:19:07 +08:00
slzhou c8767f7614 enhance: tbname token optimization 2023-10-31 14:44:06 +08:00
slzhou 1686c70a60 fix: not use ctb meta from hash of stmt node 2023-10-31 13:14:21 +08:00
Haojun Liao 0ca85a4c03
Merge pull request #23424 from taosdata/refact/streamsm
refactor: do some internal refactor.
2023-10-31 12:48:22 +08:00
Haojun Liao e01c7f3cfd fix(stream): adjust the stop condition for stream tasks. 2023-10-31 11:51:47 +08:00
dapan1121 aabd2bd739 fix: create view table meta issue 2023-10-31 11:23:33 +08:00
Hongze Cheng 16bccef75a
Merge pull request #23407 from taosdata/feat/TS-4180
feat: alloc disk acorrding to avail disk space
2023-10-30 22:15:39 -05:00
shenglian zhou 45ae3727a7 fix: performace improvement 2023-10-31 10:48:10 +08:00
Haojun Liao 88469568b8 fix(stream): handle failure during checkpoint 2023-10-31 10:45:14 +08:00
Haojun Liao 635243f01a refactor: do some internal refactor. 2023-10-31 10:45:12 +08:00
Haojun Liao 0c982093cd fix(stream): enable the set of fill-history task to be un-init. 2023-10-31 10:45:12 +08:00
Haojun Liao 86dfc52a6e fix(stream): add event check when handling the end of event. 2023-10-31 10:45:12 +08:00
Haojun Liao 72f3e4446d fix(stream): handle failure during checkpoint 2023-10-31 10:38:17 +08:00
dapan1121 7d5708f224 fix: case issue and authentication issue 2023-10-31 09:15:40 +08:00
slzhou e800c993dd fix: set scan tags when bi mode 2023-10-31 07:37:56 +08:00
dapan1121 b2fea84a3a fix: case issue and bugs 2023-10-30 19:14:31 +08:00
dapan1121 658ea7c429
Merge pull request #23426 from taosdata/fix/TD-26930/xsren/superTime
fix: interval more than 1000 years
2023-10-30 17:55:53 +08:00
liuyao 5b74bf87b1 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898 2023-10-30 17:55:14 +08:00
kailixu da4fac4204 test: update test case for retentions 2023-10-30 17:04:09 +08:00
dapan1121 1517fe0ff0 fix: ut case issue 2023-10-30 16:44:10 +08:00
slzhou e9a7f6e322 fix: invalid schema error 2023-10-30 15:54:10 +08:00
Haojun Liao fdf3f210ac refactor: do some internal refactor. 2023-10-30 14:39:24 +08:00
kailixu 5e99b69512 Merge branch '3.0' into enh/TD-26638-3.0 2023-10-30 14:09:41 +08:00
dapan1121 0a97f18d72
Merge pull request #23344 from taosdata/feat/3.0/TS-4052
feat: support to_timestamp/to_char
2023-10-30 14:04:33 +08:00
kailixu c77153cb81 enh: use placeholder '-' for interval of 1st retention level 2023-10-30 14:02:31 +08:00
Haojun Liao b0700d6095 Merge branch '3.0' into fix/3_liaohj 2023-10-30 11:57:54 +08:00
Haojun Liao 93232a0e14 fix(stream): enable the set of fill-history task to be un-init. 2023-10-30 11:48:51 +08:00
liuyao 1a37f19c82 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898 2023-10-30 11:43:23 +08:00
dapan1121 6f0b634f95 Merge remote-tracking branch 'origin/3.0' into feat/TD-25204 2023-10-30 10:24:16 +08:00
Haojun Liao 19c5882cbe fix(stream): add event check when handling the end of event. 2023-10-30 10:22:24 +08:00
Benguang Zhao 70e261f662 enh: terminate snap replication on timeout 2023-10-30 10:14:26 +08:00
slzhou 4b6f927e6a fix: add test case for bi tag scan 2023-10-30 10:11:57 +08:00
dapan1121 1b7a6bccdf
Merge pull request #23430 from taosdata/enh/TD-26641-3.0
enh: only float/double allowed for sum/avg of rsma
2023-10-30 10:08:55 +08:00
dapan1121 8650c5d4b0
Merge pull request #23392 from taosdata/feat/3.0/TS-4044
feat: support all utf8 characters as alias
2023-10-30 10:04:37 +08:00
facetosea 55f6d2b7a9 use TSDB_MAX_KEEP 2023-10-30 09:42:06 +08:00
Haojun Liao 980f6fc46e fix(stream): pause the task when they are still in uninit status. 2023-10-30 09:32:40 +08:00
Haojun Liao 1bbad532a7 fix(stream): add more check. 2023-10-30 09:32:40 +08:00
Haojun Liao 076b533ba3 fix(stream): fix race condition when state transferring. 2023-10-30 09:32:40 +08:00
Haojun Liao 85befa10b9 fix(stream): avoid clear the restart flag . 2023-10-30 09:32:39 +08:00
Haojun Liao f708ddb792 fix(stream): pause the task when they are still in uninit status. 2023-10-30 09:09:21 +08:00
dapan1121 972e10a238 Merge remote-tracking branch 'origin/3.0' into feat/TD-25204 2023-10-30 08:45:29 +08:00
Haojun Liao 790d869494 fix(stream): add more check. 2023-10-29 22:57:33 +08:00
Haojun Liao 3c07c3ec2f fix(stream): fix race condition when state transferring. 2023-10-29 02:27:27 +08:00
Haojun Liao c7285c0ede fix(stream): add expired epset node list for stream tasks in hb to mnode. 2023-10-27 23:41:57 +08:00
Haojun Liao 4c267b538f fix(stream): add expired epset node list for stream tasks in hb to mnode. 2023-10-27 23:05:41 +08:00
dapan1121 9801d5d7b7 fix: desciribe view and memory issues 2023-10-27 19:28:22 +08:00
kailixu eae1b4eb03 chore: relationship between interval/keep 2023-10-27 19:15:23 +08:00
Benguang Zhao c3f9cae36b refact: improve code of syncNodeOnSnapshot 2023-10-27 18:55:30 +08:00
Benguang Zhao 4163a3be7c feat: resend snap replication of data on timeout 2023-10-27 17:58:26 +08:00
liuyao ad6d38439b refect 2023-10-27 17:47:25 +08:00
wangjiaming0909 cf158ab428 feat: support all utf8 characters as alias 2023-10-27 15:23:26 +08:00
slzhou 15aedb8d8c fix: fix bugs of pWhere is null 2023-10-27 15:16:40 +08:00
xsren b422c29d4e fix interval limit on us/ns db 2023-10-27 15:16:03 +08:00
kailixu ac72466429 chore: naming optimization 2023-10-27 15:11:35 +08:00
Haojun Liao 62cc33715c fix(stream): fix deadlock. 2023-10-27 15:05:36 +08:00
Haojun Liao 0c2079a963 fix(stream): fix deadlock. 2023-10-27 15:03:21 +08:00
shenglian zhou 1bda5a7223 enhance: use tbname cond to set vgroup list of table node 2023-10-27 14:47:56 +08:00
kailixu 4ea44c429d chore: code optimization 2023-10-27 14:41:17 +08:00
yihaoDeng ebdf6d1cc6 fix mem leak 2023-10-27 14:18:56 +08:00
Haojun Liao afe7fdf672 fix(stream): avoid clear the restart flag . 2023-10-27 14:12:06 +08:00
kailixu 2ad3b98344 chore: test case for rollup 2023-10-27 13:49:39 +08:00
Haojun Liao dcca6b0868 other: merge 3.0. 2023-10-27 11:41:28 +08:00
dapan1121 099f72e84a fix: memory issues 2023-10-27 11:36:17 +08:00
xsren 4186028083 fix: interval more than 1000 years 2023-10-27 11:09:18 +08:00
Haojun Liao 29b3a7a5e9 refactor: do some internal refactor. 2023-10-27 09:59:53 +08:00
Haojun Liao 9c9d02b181 fix(stream): disable follower nodes exec reset. 2023-10-27 09:59:52 +08:00
Haojun Liao 52d8e05c0c fix(stream): resolve the nodeUpdate msg compatible issue. 2023-10-27 09:59:52 +08:00
Haojun Liao 454624516c fix(stream): handle the repeatly issued nodeUpdate msg from dnode. 2023-10-27 09:59:51 +08:00
Haojun Liao 9c9cd08e2e fix(stream): not clear role flag. 2023-10-27 09:59:44 +08:00
Haojun Liao 33dc51cc86 fix(stream): add some logs. 2023-10-27 09:59:44 +08:00
Haojun Liao 1ccbb77981 fix(stream): fix dead lock when shutdown all tasks. 2023-10-27 09:59:37 +08:00
Haojun Liao 9a1a8feec2 fix(stream): do send check info if downstream is not leader. 2023-10-27 09:58:53 +08:00
Haojun Liao 2493c21ed3 fix(stream): fix the invalid write in sma 2023-10-27 09:58:52 +08:00
Haojun Liao e8520997b0 fix(stream): disable continue check for downstream tasks. 2023-10-27 09:58:52 +08:00
Haojun Liao 3bcffcf1da other: merge stream refactor from main. 2023-10-27 09:56:02 +08:00
Haojun Liao b0ef072556 fix(stream): clear flag for checkpoint. 2023-10-27 09:55:07 +08:00
Haojun Liao f682ad0479 refactor: do some internal refactor. 2023-10-27 09:55:06 +08:00
Haojun Liao efede8669f refactor: do some internal refactor. 2023-10-27 09:55:06 +08:00
Haojun Liao 9ebf806789 fix(stream): clear the flag. 2023-10-27 09:55:05 +08:00
Haojun Liao 48ff521968 fix(stream): update the nodeEp even during checkpoint trans. 2023-10-27 09:55:02 +08:00
Haojun Liao 0d4892f25b fix(stream): fix bugs caused by refactor sm. 2023-10-27 09:55:00 +08:00
Haojun Liao a31613ae95 refactor: add ref in log. 2023-10-27 09:54:59 +08:00
Haojun Liao 226b6596d6 fix(stream): fix bugs caused by refactor. 2023-10-27 09:54:58 +08:00
Haojun Liao 091238e7be fix(stream): fix bugs caused by refactor sm. 2023-10-27 09:54:58 +08:00
Haojun Liao e1f6043eed fix(stream): fix bugs caused by refactor sm. 2023-10-27 09:54:57 +08:00
Haojun Liao e359da7b19 fix(stream): fix bugs caused by refactor. 2023-10-27 09:54:57 +08:00
Haojun Liao 8729bdac1e fix(stream): fix bugs caused by refactor. 2023-10-27 09:54:57 +08:00
Haojun Liao 1eac7f44c0 fix(stream): fix error in stream. 2023-10-27 09:54:56 +08:00
Haojun Liao 579dd8e6b2 refactor(stream): do some internal refactor. 2023-10-27 09:54:56 +08:00
Haojun Liao 6f3c0d17cc refactor(stream): add state machine to manage the state of stream tasks. 2023-10-27 09:54:49 +08:00
Haojun Liao 596eb073b7 refactor(stream): do some internal refactor. 2023-10-27 09:54:48 +08:00
Haojun Liao 91e3fd66e6 enh(stream): sm for stream tasks. 2023-10-27 09:54:44 +08:00
Haojun Liao 2409a17517 refactor(stream): do some internal refactor. 2023-10-27 09:54:44 +08:00
wangjiaming0909 70850697a4 feat: support to_timestamp/to_char fix comments 2023-10-27 09:54:16 +08:00
Haojun Liao c9bdb56d79 refactor: do some internal refactor. 2023-10-27 09:54:09 +08:00
Haojun Liao 164159f293 enh(stream): add parameter to limit the stream sink task. 2023-10-27 09:54:07 +08:00
Haojun Liao 62c58ecd8b fix(stream):add more check for test cases. 2023-10-27 09:54:06 +08:00
Haojun Liao a4f6042966 fix(stream): fix error in creating update node trans. 2023-10-27 09:52:14 +08:00
Haojun Liao ffa798c4fa enh(stream): add some logs. 2023-10-27 09:52:14 +08:00
Haojun Liao f549ce3578 refactor: do some internal refactor. 2023-10-27 09:49:16 +08:00
Hongze Cheng dc03d8cd1a disable tfs unit test 2023-10-26 20:07:38 +08:00
slzhou 779c37b425 enhance: change to invalid operation for stmt error 2023-10-26 14:23:21 +08:00
kailixu 4097b53bfa enh: only float/double allowed for sum/avg of rsma 2023-10-26 11:21:56 +08:00
kailixu a83b3053f4 enh: check interval and keep for retentions 2023-10-25 22:52:03 +08:00
kailixu 64765579e9 enh: check interval and keep for retentions 2023-10-25 22:42:01 +08:00
Haojun Liao b974561a79
Merge pull request #23343 from taosdata/refact/streamsm
refactor(stream):  add fsm for managing task status.
2023-10-25 22:31:56 +08:00
liuyao d0e4a5d0f7 opt max delay 2023-10-25 20:29:25 +08:00
Benguang Zhao fe553352b8 enh: cache snap blocks sent in snapshotSend for resending 2023-10-25 20:26:11 +08:00
Hongze Cheng 25aade1333 feat: alloc disk acorrding to avail disk space 2023-10-25 19:44:21 +08:00
liuyao f51c985914 stream event window 2023-10-25 17:50:16 +08:00
slzhou 5ca39f961c fix: add error test case and fix address sanitizer 2023-10-25 16:30:13 +08:00
Benguang Zhao ec5b1f2ec1 enh: logging buf info for snapshot reader and sender 2023-10-25 15:04:14 +08:00
Benguang Zhao 7d9d1c6877 enh: terminate snap replication on timeout 2023-10-25 14:50:53 +08:00
Haojun Liao f36b24ed24 fix(stream): disable follower nodes exec reset. 2023-10-25 14:16:36 +08:00
shenglian zhou 6edf954cd3 Merge branch '3.0' of github.com:taosdata/TDengine into szhou/bi-mode-tag-scan 2023-10-25 13:54:58 +08:00
shenglian zhou 8b2d57504c enhance: bi mode default tag scan 2023-10-25 13:54:45 +08:00
slzhou efe480ae14 Merge branch 'szhou/continue-coing' into szhou/insert-stb-tbname 2023-10-25 13:30:49 +08:00
slzhou 04a9f5945f Merge branch '3.0' of github.com:taosdata/TDengine into szhou/insert-stb-tbname 2023-10-25 13:30:38 +08:00
slzhou 29db21a3ad fix: reinit ctb meta and col vals before each stb row 2023-10-25 11:22:15 +08:00
slzhou c17300557d fix: memory sanitizer error of simple insert stb 2023-10-25 10:56:28 +08:00
yihaoDeng 92017fe149 http handle empty packet 2023-10-25 10:52:08 +08:00
dapan1121 6dcc555bbc fix: view privilege issue 2023-10-25 10:47:01 +08:00
Haojun Liao 985371e841 fix(stream): resolve the nodeUpdate msg compatible issue. 2023-10-25 10:01:20 +08:00
slzhou f0a44b31fc fix: insert into super table syntax is not supported for stmt 2023-10-25 09:56:21 +08:00
Haojun Liao 03165d5327 fix(stream): handle the repeatly issued nodeUpdate msg from dnode. 2023-10-25 09:55:02 +08:00
shenglian zhou 3de5b841a5 fix: large file by batches 2023-10-25 09:35:37 +08:00
shenglian zhou c9d1553633 enhance: refactor stb rows data context 2023-10-25 09:06:45 +08:00
shenglian zhou a28b3a6e3f fix: refactor 2023-10-25 08:50:08 +08:00
shenglian zhou 0c33a3e60e fix: child table meta optimization 2023-10-25 08:27:02 +08:00
Haojun Liao 26aaa4a83c other: merge main. 2023-10-25 00:39:14 +08:00
Haojun Liao 5b42204dba fix(stream): not clear role flag. 2023-10-25 00:32:46 +08:00
Haojun Liao 13d979a2ee fix(stream): add some logs. 2023-10-25 00:03:46 +08:00
Benguang Zhao 4e3a8b893d enh: restore wal log from snapshot after finish 2023-10-24 20:03:48 +08:00
Benguang Zhao 374217ceff fixup: adjust a logging msg in syncNodeStartSnapshot 2023-10-24 19:29:09 +08:00
Benguang Zhao 95188ab8c3 enh: adjust some logging msgs for sync log replication mgr 2023-10-24 19:11:27 +08:00
Haojun Liao 8cde39eebd fix(stream): fix dead lock when shutdown all tasks. 2023-10-24 19:11:24 +08:00
Benguang Zhao 4d61e87c0f enh: add signature info in logging msgs of snap replication 2023-10-24 17:28:46 +08:00
shenglian zhou 27302f995b fix: add memory free 2023-10-24 16:23:03 +08:00
dapan1121 9bf8be1ab4
Merge pull request #23354 from taosdata/fix/3.0/TD-26779
fix: union all cast func resType check error
2023-10-24 16:11:50 +08:00
shenglian zhou ae1bac251a enhance: finished skeleton 2023-10-24 16:08:08 +08:00
Haojun Liao 6ffb5ee476 fix(stream): do send check info if downstream is not leader. 2023-10-24 15:49:50 +08:00
Benguang Zhao 811f1bbbea enh: tidy up logging msg in syncNodeOnSnapshotRsp 2023-10-24 15:47:47 +08:00
Haojun Liao f1498f8929 fix(stream): fix the invalid write in sma 2023-10-24 15:24:34 +08:00
Benguang Zhao 1c60e67a83 enh: send the END snap msg at last 2023-10-24 14:16:46 +08:00
Haojun Liao 0f9328330b fix(stream): disable continue check for downstream tasks. 2023-10-24 11:56:36 +08:00
dapan1121 dbbceae061 fix: union all view issue 2023-10-24 11:29:04 +08:00
Benguang Zhao f444cd7a6d enh: log signature of snap sender/receiver while started or stopped 2023-10-24 11:11:11 +08:00
Haojun Liao 7a8b046a35 fix(sma): fix bugs in sma and do some internal refactor. 2023-10-24 09:40:38 +08:00
shenglian zhou 65cfc13703 fix: memory sanitizer error 2023-10-23 19:40:27 +08:00
wangjiaming0909 f299a28109 feat: support to_timestamp/to_char 2023-10-23 19:36:03 +08:00
Benguang Zhao e34da43e38 feat: support pipelining of snap replication 2023-10-23 19:32:44 +08:00
slzhou 0cfbcd7a13 Merge branch '3.0' of github.com:taosdata/TDengine into szhou/continue-coing 2023-10-23 16:34:21 +08:00
shenglian zhou e713b7c22f enhance: insert stb skeleton development 2023-10-23 16:27:00 +08:00
yihaoDeng 09192acf96 fix mem leak 2023-10-23 10:20:57 +08:00
dapan1121 ab98f7623c Merge remote-tracking branch 'origin/3.0' into feat/TD-25204 2023-10-23 08:44:46 +08:00
shenglian zhou 5156c0d00c enhance: get tbname from one row for stb syntax 2023-10-22 15:14:50 +08:00
shenglian zhou 6488672dd6 enhance: parse target column 2023-10-22 11:21:36 +08:00
Haojun Liao 059e94e428 fix(stream): clear flag for checkpoint. 2023-10-22 01:25:00 +08:00
Haojun Liao 4826b34a2b refactor: do some internal refactor. 2023-10-21 16:32:44 +08:00
Haojun Liao 06cd67e26e refactor: do some internal refactor. 2023-10-21 16:20:03 +08:00
shenglian zhou 438a775c78 fix: parse insert stb columns when meta is ready or ready after get meta 2023-10-21 14:02:03 +08:00
Haojun Liao 21e98e358e fix(stream): clear the flag. 2023-10-21 02:41:03 +08:00
Haojun Liao d1095e2c4c Merge remote-tracking branch 'origin/refact/streamsm' into refact/streamsm 2023-10-21 01:42:59 +08:00
Haojun Liao 49014d4b68 fix(stream): update the nodeEp even during checkpoint trans. 2023-10-21 01:42:43 +08:00
yihaoDeng aaf7e070ee Merge branch 'refact/streamsm' of https://github.com/taosdata/TDengine into refact/streamsm 2023-10-20 20:49:17 +08:00
yihaoDeng e95735eea4 fix mem leak 2023-10-20 20:49:01 +08:00
dapan1121 0f4766e38e feat: add view cases 2023-10-20 18:22:30 +08:00
slzhou 3fe5c447e7 enhance: begin parse cols 2023-10-20 17:16:45 +08:00
Haojun Liao c68c0eda79 fix(stream): fix bugs caused by refactor sm. 2023-10-20 16:27:39 +08:00
Haojun Liao 4feebffb05 refactor: add ref in log. 2023-10-20 15:59:43 +08:00
Haojun Liao c4268ca395 fix(stream): fix bugs caused by refactor. 2023-10-20 15:54:30 +08:00
dapan1121 1ff5ccf186
Merge pull request #23222 from taosdata/feat/TS-4072
feat: support interval syntax of quoted duration and default unit
2023-10-20 15:16:07 +08:00
dapan1121 d7a5b529f9
Merge pull request #23312 from taosdata/szhou/fix/td-26778
fix: remove subquery user alias name distinct check
2023-10-20 15:15:01 +08:00
slzhou ce6be3d3e7 fix: refactor checkAuth for target table 2023-10-20 14:51:44 +08:00
Haojun Liao 3b8c85f632 fix(stream): fix bugs caused by refactor sm. 2023-10-20 14:19:57 +08:00
Haojun Liao d75948160d Merge branch 'main' into refact/streamsm 2023-10-20 11:10:19 +08:00
wangjiaming0909 720982374c fix: union all cast func resType check error 2023-10-20 10:36:52 +08:00
Haojun Liao 270a847809 fix(stream): fix bugs caused by refactor sm. 2023-10-20 10:23:48 +08:00
Haojun Liao 9f9fae3b99
Merge pull request #23329 from taosdata/opt/addStatusSend
Opt/add status send
2023-10-20 09:52:12 +08:00
wade zhang 628667f22c
Merge pull request #23231 from taosdata/FEAT/TS-3816-3.0
feat: support restoring vnodes on replaced disks as needed
2023-10-20 09:02:25 +08:00
dapan1121 42f440b0fb Merge remote-tracking branch 'origin/3.0' into feat/TD-25204 2023-10-20 08:46:32 +08:00
dapan1121 969b002936 enh: support view privilege 2023-10-20 08:41:49 +08:00
Haojun Liao 4d5d078fbe fix(stream): fix bugs caused by refactor. 2023-10-19 18:00:54 +08:00
Haojun Liao d5059826a8 fix(stream): fix bugs caused by refactor. 2023-10-19 17:59:04 +08:00
Haojun Liao c1cebae6ba fix(stream): fix error in stream. 2023-10-19 16:20:27 +08:00
slzhou 332268fd4b set super table name for stb syntax and rename setRefreshMate to setRefreshMeta 2023-10-19 15:55:24 +08:00
wangjiaming0909 04c60486e9 feat: support interval syntax of quoted duration and default unit 2023-10-19 15:46:19 +08:00
Haojun Liao 614bdd9fb9
Merge pull request #23220 from taosdata/feat/TD-26644
opt bloom filter
2023-10-19 15:34:43 +08:00
Haojun Liao da8f6a4c2f
Merge pull request #23248 from taosdata/feat/TD-26647
recover session buff state
2023-10-19 15:34:03 +08:00
yihaoDeng 93cac3532e fix invalid debug info 2023-10-19 15:30:04 +08:00
Haojun Liao 402aefd95d refactor(stream): do some internal refactor. 2023-10-19 15:09:47 +08:00
slzhou cb2311fde6 fix minior error 2023-10-19 13:28:48 +08:00
slzhou 334feb199a call processTableSchemaFromMetaData when success 2023-10-19 13:22:28 +08:00
yihaoDeng afac844656 add rpc sync read time 2023-10-19 11:45:59 +08:00
slzhou 24436c8502 fix: tag scan support limit and remove slimit optimization 2023-10-19 11:40:10 +08:00
shenglian zhou 8532227a36 fix: first schema clause top - target is supertable 2023-10-19 11:30:44 +08:00
Benguang Zhao a2e0480839 refact: rename as SYNC_FSM_STATE_COMPLETE 2023-10-19 11:18:57 +08:00
Benguang Zhao c4e9069a66 fix: set nextProcessedVer properly in tqProcessTaskScanHistory 2023-10-19 11:18:57 +08:00
Benguang Zhao 05ba5e1ed0 refact: adjust logging msg in walLogEntriesComplete 2023-10-19 11:18:57 +08:00
Benguang Zhao d671283b8b refact: adjust logging msg for incomplete fsm state 2023-10-19 11:18:57 +08:00
Benguang Zhao 9643799dc5 fixup: compiler error at labels since allowed only at statements 2023-10-19 11:04:39 +08:00
Benguang Zhao 233a3c4034 enh: terminate on incompletenss of fsm state for dbs of single replica 2023-10-19 11:04:39 +08:00
Benguang Zhao 810678ebcb enh: tidy up debugging msgs of snapshot replication 2023-10-19 11:04:39 +08:00
Benguang Zhao c89c69f951 enh: use waitTime to prevent from starting snapshot too frequently 2023-10-19 11:04:39 +08:00
Benguang Zhao be6411ebbe fixup: set lastSendTime with taosGetTimestampMs 2023-10-19 11:04:39 +08:00
Benguang Zhao a53ba24118 fix: set startTime in snapshotReSend 2023-10-19 11:04:39 +08:00
Benguang Zhao e901adfdf3 enh: check snapshot receiver and sender by signature 2023-10-19 11:04:39 +08:00
Benguang Zhao eb4e2aa58f feat: restore incomplete fsm state with maxVerValid via snapshot replication 2023-10-19 11:04:36 +08:00
Benguang Zhao e1c03118ab enh: extract snapshot info for both of snap reader and writer 2023-10-19 10:51:13 +08:00
Benguang Zhao 410ced8320 feat: use TLV format to encode data of snapshot info 2023-10-19 10:51:13 +08:00
Benguang Zhao 517f1f7e40 fixup: fix syncNodeOnSnapshotPrep 2023-10-19 10:37:34 +08:00
Benguang Zhao 083dd148be feat: exchange difference of snapshot info for replication 2023-10-19 10:37:34 +08:00
Haojun Liao f4caeca24a refactor(stream): add state machine to manage the state of stream tasks. 2023-10-19 10:34:20 +08:00
yihaoDeng 365d535e6d add rpc sync read timeout 2023-10-19 10:32:51 +08:00
yihaoDeng 1910540a61 add rpc sync read timeout 2023-10-19 10:15:04 +08:00
dapan1121 afe963a9d1 enh: support view privilege 2023-10-19 08:31:31 +08:00
liuyao 5852a0975e set fill history range 2023-10-18 19:49:05 +08:00
yihaoDeng ef27c87756 opt status send 2023-10-18 16:37:34 +08:00
Haojun Liao 54ec679b58 refactor(stream): do some internal refactor. 2023-10-18 15:34:53 +08:00
slzhou 9c1697bfd1 fix: fix minior error 2023-10-18 13:19:44 +08:00
Haojun Liao c6dd73b68b
Merge pull request #23187 from taosdata/feat/TD-26056
feat:add replay logic
2023-10-18 11:43:43 +08:00
slzhou 98d782cfa5 fix: if not subquery, rewrite project alias 2023-10-18 11:04:34 +08:00
Haojun Liao 2904cfd4d5 Merge branch 'main' into refact/streamsm 2023-10-18 10:29:09 +08:00
slzhou cdc8b757ad fix: remove subquery user alias name distinct check 2023-10-18 10:11:43 +08:00
Haojun Liao 5115a1ac88
Merge pull request #23304 from taosdata/fix/TD-26771
double free
2023-10-18 10:09:17 +08:00
dapan1121 e6755461f5
Merge pull request #23087 from taosdata/szhou/pseudo-column-aliasname
enhance: support select `pseduo_column` from (select pseudo_column ...)
2023-10-18 09:23:01 +08:00
Haojun Liao df07443379
Merge pull request #23288 from taosdata/fix/liaohj
fix(stream):add more check for test cases.
2023-10-18 08:13:15 +08:00
Benguang Zhao 4ca897246c enh: proceed sync log buffer on failure of appending too 2023-10-17 14:56:07 +08:00
liuyao afa44732e2 Merge branch 'main' of https://github.com/taosdata/TDengine into main 2023-10-17 14:49:30 +08:00
liuyao 5e0f9cb908 double free 2023-10-17 14:32:09 +08:00
Haojun Liao 64ed7e49a2 enh(stream): sm for stream tasks. 2023-10-17 13:47:55 +08:00
Haojun Liao 7b7ce10475 refactor(stream): do some internal refactor. 2023-10-17 11:23:04 +08:00
Haojun Liao 14035c763c refactor: do some internal refactor. 2023-10-17 09:57:13 +08:00
dapan1121 5ae3987958
Merge pull request #23283 from taosdata/szhou/3.0/fix/td-26703
fix: tag scan support limit and remove slimit optimization
2023-10-17 08:54:21 +08:00
Haojun Liao fdb6ec1fa3 enh(stream): add parameter to limit the stream sink task. 2023-10-16 22:52:39 +08:00
dapan1121 cdda43cd67 Merge remote-tracking branch 'origin/3.0' into feat/TD-25204 2023-10-16 19:54:21 +08:00
dapan1121 7c8cf28b37 feat: add privileges 2023-10-16 19:53:08 +08:00
liuyao 990d36654d release buff 2023-10-16 19:49:45 +08:00
Haojun Liao a1aa2c9e0c fix(stream):add more check for test cases. 2023-10-16 18:47:01 +08:00
Haojun Liao 582bedd4bb
Merge pull request #23277 from taosdata/fix/TD-26722
set fill history range
2023-10-16 17:38:49 +08:00
slzhou 34246ea001 fix: tag scan support limit and remove slimit optimization 2023-10-16 16:43:15 +08:00
slzhou d30c6f6bcc fix: change tablename.tbname aliasname to tbname 2023-10-16 13:56:15 +08:00
liuyao 4ba45abd01 set fill history range 2023-10-16 13:53:54 +08:00
wangmm0220 473142fab7 fix:conflicts from 3.0 2023-10-16 11:35:56 +08:00
Haojun Liao 67bee17e5e other: merge main. 2023-10-16 09:55:41 +08:00
Haojun Liao f90cf54714 fix(stream): fix error in creating update node trans. 2023-10-15 21:56:49 +08:00
Haojun Liao 6611f216ac enh(stream): add some logs. 2023-10-13 19:45:29 +08:00
dapan1121 aab4cb98dc enh: create & drop view meta processing 2023-10-13 19:16:37 +08:00
dapan1121 a0699d758c Merge remote-tracking branch 'origin/3.0' into feat/TD-25204 2023-10-13 16:51:38 +08:00
dapan1121 c0a4328803 feat: support view meta updating 2023-10-13 16:29:34 +08:00
liuyao 7269dedb39 Merge branch '3.0' of https://github.com/taosdata/TDengine into 3.0 2023-10-13 11:35:01 +08:00
liuyao 429125be93 session state recover 2023-10-13 11:32:35 +08:00
Haojun Liao 33d9f772be other: merge 3.0 2023-10-13 09:06:13 +08:00
Haojun Liao 84c5359d5b other: merge 3.0 2023-10-13 08:58:26 +08:00
shenglian-zhou cbd9749bfe
Merge branch '3.0' into szhou/pseudo-column-aliasname 2023-10-12 19:01:28 -05:00
Alex Duan 35fced8796
Merge pull request #23234 from taosdata/main_3_merge
other: merge main into 3.0
2023-10-12 07:48:20 -05:00
dapan1121 7c67f23469 feat: update view meta 2023-10-12 19:56:17 +08:00
liuyao 2b540021e9 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26644 2023-10-12 17:52:30 +08:00
Haojun Liao 90f866352b
Merge pull request #23221 from taosdata/feat/TD-26052
fix:[TD-26671] judge if pointer is null to avoid core dump
2023-10-12 17:23:41 +08:00
liuyao 731fe67352 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26644 2023-10-12 16:28:10 +08:00
slzhou b78a32eb1a Merge branch '3.0' of github.com:taosdata/TDengine into szhou/pseudo-column-aliasname 2023-10-12 11:01:50 +08:00
Haojun Liao eb4449999f other: merge 3.0 2023-10-12 10:33:48 +08:00
liuyao 5fafdf351b refect 2023-10-11 20:17:47 +08:00
dapan1121 f5768494b4 feat: support describe view command 2023-10-11 18:49:47 +08:00
wangmm0220 05c016b667 fix:[TD-26671] judge if pointer is null to avoid core dump 2023-10-11 13:55:54 +08:00
dapan1121 3ff3fe7477
Merge pull request #23181 from taosdata/enh/TD-26604
enh: support balance group leader on vgroup_id
2023-10-11 13:25:51 +08:00
Hongze Cheng ef94767758
Merge pull request #23213 from taosdata/FIX/TD-26664-3.0
enh: send rpc rsp on error of tmsgPutToQueue
2023-10-10 22:46:24 -05:00
wangmm0220 f7d1e0ea82 fix:[TD-26671] judge if pointer is null to avoid core dump 2023-10-11 11:08:14 +08:00
dapan1121 478de7ae56 feat: add show create view implement 2023-10-11 10:38:22 +08:00
Haojun Liao 6982935df7
Merge pull request #23157 from taosdata/fix/liaohj
refactor(stream): fix bugs and do some internal refactor.
2023-10-11 10:30:16 +08:00
liuyao e9fc079d26 opt bloom filter 2023-10-11 10:14:11 +08:00
dapan1121 17e3b99bed
Merge pull request #23200 from taosdata/szhou/main/revert-create-table-sql
Revert "fix: add create table sql to audit log"
2023-10-11 08:52:53 +08:00
dapan1121 c5ec45ddb4
Merge pull request #23185 from taosdata/feat/TD-26639
feat: remove partition node for agg
2023-10-11 08:36:48 +08:00
Haojun Liao 1d4f0c8599
Merge pull request #23201 from taosdata/enh/TD-26646
Enh/td 26646
2023-10-10 22:59:37 +08:00
Benguang Zhao a9ed36e167 enh: send rpc rsp on error of tmsgPutToQueue 2023-10-10 16:53:15 +08:00
Haojun Liao 05dfadd8f8 fix(stream): set initial version for fill-history task. disable reentry of scan-history task function. 2023-10-10 15:52:48 +08:00
Haojun Liao 5f9b858fc1 other: merge main. 2023-10-10 15:38:46 +08:00
yihaoDeng b36163a197 add session iter 2023-10-10 15:12:21 +08:00
yihaoDeng 825341d90a add sess iter 2023-10-10 14:35:02 +08:00
wangjiaming0909 eea90507d4 feat: remove partition node for agg 2023-10-10 14:29:36 +08:00
Haojun Liao ba1690f0dd Merge remote-tracking branch 'origin/fix/liaohj' into fix/liaohj 2023-10-10 14:00:48 +08:00
Haojun Liao adf6f65d09 fix(stream): set initial version for fill-history task. disable reentry of scan-history task function. 2023-10-10 14:00:30 +08:00
Alex Duan 9da96ebf63
Merge pull request #23017 from taosdata/case/TD-26408-MAIN
fix: add case for lost data after  split vgroup (main)
2023-10-10 00:54:34 -05:00
Alex Duan e566027cef
Merge pull request #23019 from taosdata/case/TD-26408-3.0
fix: add case for lost data after split 3.0
2023-10-10 00:53:56 -05:00
yihaoDeng 6adf7532a8 add sess iter 2023-10-10 11:35:18 +08:00
shenglian zhou 6c30c4faab Revert "fix: add create table sql to audit log"
This reverts commit 658de2a04e.
2023-10-10 11:12:53 +08:00
slzhou bc2cf345fa fix: change error code after replace column and translate 2023-10-10 10:44:13 +08:00
yihaoDeng 7ac4ef5beb add sess iter 2023-10-10 10:41:46 +08:00
liuyao 26c87e5f41 fix mem leak 2023-10-10 10:26:26 +08:00
slzhou da9d39bfe6 fix: cancel future pseudo column translation function processing when rewritten to column 2023-10-10 08:31:23 +08:00
slzhou b8fe279a85 fix: renanme function 2023-10-10 07:44:29 +08:00
yihaoDeng 0fc6ffe6b6 change test case 2023-10-09 20:51:26 +08:00
Haojun Liao a25d94ab6f fix(stream): retry when error occurs during timer. 2023-10-09 20:10:28 +08:00
Haojun Liao 7d39164133 fix(stream): disable retrieving results during checkpoint procedure 2023-10-09 20:10:27 +08:00
Haojun Liao af4618f958 fix(stream): remove invalid clear of rspmsg list. 2023-10-09 20:10:27 +08:00
Haojun Liao 847baa8b71 fix(stream): fix the pause failure bug. 2023-10-09 20:10:27 +08:00
Haojun Liao 21fb502690 enh(stream): add trans to reset task status to avoid being frozen in checkpoint status due to doing checkpoint failure of partial tasks. 2023-10-09 20:10:26 +08:00
Haojun Liao 64bde93f85 fix(stream): not idle for sink task when no tokens are available. 2023-10-09 20:10:25 +08:00
Haojun Liao 9a7167aaba fix(stream): sleep for 10ms 2023-10-09 20:10:24 +08:00
Haojun Liao 9af8ce21ed fix(stream): wait for a while when no available token. 2023-10-09 20:10:23 +08:00
Haojun Liao 4780474877 fix(stream): continue 2023-10-09 20:10:23 +08:00
Haojun Liao da833ccb30 refactor: inc the dump batch. 2023-10-09 20:10:23 +08:00
Haojun Liao 2936ac9b89 fix(stream): add missing refactor. 2023-10-09 20:10:22 +08:00
Haojun Liao af2c0c95e9 refactor: do some internal refactor. 2023-10-09 20:10:22 +08:00
Haojun Liao 940d6a3cb4 fix(stream): check items in queue and qall, stead of only the queue items. 2023-10-09 20:10:21 +08:00
Haojun Liao e95aea84ae fix(stream): fix syntax error. 2023-10-09 20:10:21 +08:00
Haojun Liao 59e284c332 fix(stream): quit from loop when input queue is full. 2023-10-09 20:10:21 +08:00
Haojun Liao 9d5a3b8d78 other: merge stream fix. 2023-10-09 20:10:13 +08:00
Haojun Liao c5997bee5b fix(stream): update the current processing version. 2023-10-09 20:09:23 +08:00
Haojun Liao 28008f8263 enh(stream): add more info for sink task. 2023-10-09 20:09:22 +08:00
Haojun Liao b3b9e89d30 fix(stream): fix the invalid check. 2023-10-09 20:09:22 +08:00
Haojun Liao cf14772dd9 enh(stream): optimize the scan wal perf 2023-10-09 20:09:21 +08:00
Haojun Liao d2160efa05 refactor: wait for 100ms before scan wal again. 2023-10-09 20:09:21 +08:00
Haojun Liao 932d93ab35 refactor: wait for more time for future data 2023-10-09 20:09:21 +08:00
Haojun Liao 7682c033ad fix(stream): add null check. 2023-10-09 20:09:21 +08:00
Haojun Liao 0ab5d4b342 refactor: do some internal refactor. 2023-10-09 20:09:20 +08:00
Haojun Liao c295ec322a refactor: do some internal refactor. 2023-10-09 20:09:20 +08:00
Haojun Liao d5abb21335 fix(stream): fix invalid check. 2023-10-09 20:09:20 +08:00
Haojun Liao 583ac1fc45 refactor: do some internal refactor. 2023-10-09 20:09:20 +08:00
Haojun Liao 83f84d92bc refactor: do some internal refactor (discard the checkpoint source msg during restoring). 2023-10-09 20:09:10 +08:00
Haojun Liao bb4ba54f28 fix(stream): enable new time range for stream task. 2023-10-09 20:09:09 +08:00
Haojun Liao c759d90bf6 enh(stream): optimize the stream status when creating without fill-history option. 2023-10-09 20:09:09 +08:00
Haojun Liao db897fb03a fix(stream): opt perf. 2023-10-09 20:09:09 +08:00
Haojun Liao 0a2b70fd7f fix(stream): fix syntax error. 2023-10-09 20:09:06 +08:00
Haojun Liao 8477271240 fix(stream): fix dead lock. 2023-10-09 20:09:00 +08:00
Haojun Liao 12eabb0c2c log(stream): update logs. 2023-10-09 20:09:00 +08:00
Haojun Liao b716f0d1fd fix(stream): fix dead lock. 2023-10-09 20:08:57 +08:00
Haojun Liao 60a720efbb log: update logs. 2023-10-09 20:08:53 +08:00
Haojun Liao d10b07d23d refactor: do some internal refactor. 2023-10-09 20:08:53 +08:00
Haojun Liao 6d2dbd549b fix(stream): avoid repeatly free obj. 2023-10-09 20:08:53 +08:00
Haojun Liao 6b5770aab7 log(stream): update the log. 2023-10-09 20:08:52 +08:00
Haojun Liao dfe8641c0c refactor: optimize the fill-history task launch policy, and do some other internal refactor. 2023-10-09 20:08:52 +08:00
Haojun Liao 38164435f9 refactor: do some internal refactor. 2023-10-09 20:08:52 +08:00
Haojun Liao f2848de12a fix(stream): reduce the counter when remove stream tasks. 2023-10-09 20:08:52 +08:00
Haojun Liao ecb3b44026 fix(stream): limit sink quota. 2023-10-09 20:08:52 +08:00
Haojun Liao 2c0e54f4f7 fix(stream): update the retry interval. 2023-10-09 20:08:13 +08:00
Haojun Liao 7f8da725bc enh(stream): add quota limitation for sink task. 2023-10-09 20:08:13 +08:00
Haojun Liao a248f3d088 refactor: do some internal refactor. 2023-10-09 20:08:12 +08:00
Haojun Liao 0db357401d fix(stream): add new status for meta. 2023-10-09 20:08:12 +08:00
Haojun Liao 3912d80c02 fix(stream): do some internal refactor. 2023-10-09 20:08:11 +08:00
Haojun Liao feb09c8361 fix(stream): fix error in pause scan-history data. 2023-10-09 20:08:11 +08:00