Commit Graph

19476 Commits

Author SHA1 Message Date
wangjiaming0909 64f3d11783 add tests for month/year tsma interval 2024-07-09 17:39:44 +08:00
Yihao Deng ddd3c23ff0 refactor code 2024-07-09 09:12:02 +00:00
Yihao Deng 41f8553d53 refactor code 2024-07-09 08:35:04 +00:00
Yihao Deng ee09e26f47 refactor code 2024-07-09 08:24:30 +00:00
Haojun Liao 773f70a907 fix(stream): fix syntax error. 2024-07-09 15:55:56 +08:00
Haojun Liao c71413c2aa fix(stream): discard the repeat send consensus-checkpointId msg. 2024-07-09 14:52:15 +08:00
factosea 163b31a4ee fix: type overflow 2024-07-09 14:48:21 +08:00
Haojun Liao acde36a25b Merge branch '3.0' into fix/3_liaohj 2024-07-09 14:43:35 +08:00
Haojun Liao 75d2e96b9a
Merge pull request #26446 from taosdata/fix/cov
refactor(stream): delay checkpointInterval to generate the checkpoint
2024-07-09 09:00:43 +08:00
factosea 20f4eda56d fix: tinyint 2024-07-09 07:05:40 +08:00
Haojun Liao 9f4f4f7f9f fix(stream): set the null column when extracting data from submit data. 2024-07-09 00:01:54 +08:00
factosea 3e320ebdf1 build failed 2024-07-08 23:22:41 +08:00
factosea 28dc3c85ea type overflow 2024-07-08 20:38:23 +08:00
wangjiaming0909 cdca567ad3 fix query tsma with month/year interval 2024-07-08 19:12:15 +08:00
wangjiaming0909 73d4fa48f9 support month/year tsma interval 2024-07-08 18:22:33 +08:00
Haojun Liao bdced636b3 fix(stream): free task state when stopping stream tasks. 2024-07-08 18:20:35 +08:00
Yihao Deng fe9aebc4fe fix invalid read 2024-07-08 09:27:42 +00:00
Haojun Liao de7e25f259 fix(stream): fix race condition in handling the hbMsg rsp. 2024-07-08 16:57:13 +08:00
Hongze Cheng 1c774f021f
Merge pull request #26443 from taosdata/fix/TD-30807
fix UAF
2024-07-08 16:14:56 +08:00
Haojun Liao 7cfdf0c14d fix(stream): not check the total number of sub tasks with different status. 2024-07-08 15:43:29 +08:00
Yihao Deng ef46c0c545 Merge remote-tracking branch 'origin/3.0' into enh/TD-30880 2024-07-08 07:34:39 +00:00
Yihao Deng 982fed581d fix invalid read 2024-07-08 07:34:06 +00:00
Haojun Liao 6e15c16cf7 fix(stream): check the set consensus-checkpointId ts. 2024-07-08 14:33:28 +08:00
Yihao Deng e02caa9757 add http interface 2024-07-08 05:41:38 +00:00
Yihao Deng c3caa8475a add http interface 2024-07-08 03:25:41 +00:00
Yihao Deng 392e65c2ac add http interface 2024-07-08 03:22:26 +00:00
Yihao Deng 0e1677d397 add http interface 2024-07-08 02:51:47 +00:00
Yihao Deng 92281bb4a3 add http interface 2024-07-08 02:44:52 +00:00
Yihao Deng 3148463ab3 add http interface 2024-07-08 02:43:58 +00:00
Yihao Deng 1c4f354adf add http interface 2024-07-08 02:32:55 +00:00
Hongze Cheng c8aa963417
Merge pull request #26434 from xinjiempolde/enh/TD-21826-3.0
enh/td-21826-3.0 error handling for stmt
2024-07-08 10:21:14 +08:00
Yihao Deng df12b72549 fix invalid read 2024-07-08 01:37:47 +00:00
Haojun Liao ce4153b6fc fix(stream): use hb to send the consens-checkpointid req. 2024-07-08 09:05:33 +08:00
Yihao Deng 8cbe534f93 fix invalid read 2024-07-07 06:04:59 +00:00
wangjiaming0909 dbc2e9ec75 support bigger tsma interval 2024-07-05 18:21:48 +08:00
Yihao Deng 0e9205c314 fix UAF 2024-07-05 09:13:30 +00:00
Haojun Liao 8e6bb176c2 fix(stream): use trans to set the consensus-checkpoint id 2024-07-05 16:17:20 +08:00
Yihao Deng 3202776f0a Merge remote-tracking branch 'origin/3.0' into enh/TD-30442 2024-07-05 07:31:57 +00:00
Yihao Deng 4ac897be44 refactor backend 2024-07-05 06:51:13 +00:00
dmchen 3a4412b282 fix/TD-30876 2024-07-05 06:24:53 +00:00
xjzhou b8012df909 handle fixed table name int sql 2024-07-05 14:18:51 +08:00
Yihao Deng 52a8082622 refactor backend 2024-07-05 03:40:19 +00:00
Yihao Deng 7730413924 Merge remote-tracking branch 'origin/3.0' into enh/TD-30442 2024-07-05 03:22:35 +00:00
Yihao Deng f9679feaa7 fix compile error 2024-07-05 02:42:22 +00:00
Yihao Deng f8c7908611 fix compile error 2024-07-05 02:29:55 +00:00
dapan1121 2dbedaf88b
Merge pull request #26415 from taosdata/feat/3.0/TS-5131
feat:[TS-5131] Support parse alias table name with backquote.
2024-07-05 09:01:32 +08:00
Haojun Liao db4a00c74e fix(stream): not restart for reset task status. 2024-07-05 08:55:40 +08:00
Yihao Deng 94a480292f Merge remote-tracking branch 'origin/3.0' into enh/TD-30442 2024-07-05 00:48:41 +00:00
factosea 99f9c28e77 fix: return code 2024-07-05 08:07:00 +08:00
Yihao Deng 0cdfae3a2c refactor backend 2024-07-04 12:13:17 +00:00
Haojun Liao 799f61c2db other: fix coverity issue. 2024-07-04 19:20:07 +08:00
Yihao Deng 92ab689c46 refactor backend 2024-07-04 10:26:58 +00:00
Yihao Deng 8428a5be37 refactor backend 2024-07-04 10:25:37 +00:00
Haojun Liao 998421e5ad fix(stream): update some logs. 2024-07-04 17:49:59 +08:00
Haojun Liao e6defda0d0 fix(stream): check for checkpoint interrpution in sendReady monitor. 2024-07-04 17:48:58 +08:00
Haojun Liao c35c634977 fix(stream): add flag to disable the concurrently started consensus-checkpointId procedure. 2024-07-04 17:08:32 +08:00
xjzhou 3151d0663c update 2024-07-04 16:45:10 +08:00
Yihao Deng 7171b6dd6d fix comment 2024-07-04 08:34:42 +00:00
Yihao Deng 5b1dddf4d5 fix comment 2024-07-04 08:14:50 +00:00
sima 7526f8315a feat:[TS-5131] Support parse alias table name with backquote. 2024-07-04 16:10:19 +08:00
Yihao Deng eb1a5e3cc6 fix comment 2024-07-04 08:05:51 +00:00
factosea 593d8adc42 test case 2024-07-04 15:56:12 +08:00
Haojun Liao 47b0a0464e fix(stream): send checkpoint-source-rsp to mnode before reset task status. 2024-07-04 15:21:16 +08:00
Yihao Deng ea01f1eb85 fix comment 2024-07-04 06:38:14 +00:00
Yihao Deng 0bd51f2133 fix comment 2024-07-04 06:36:36 +00:00
Haojun Liao 653f7a1a43 fix(stream): refactor the checkpoint consensus policy. 2024-07-04 13:55:50 +08:00
factosea 5f0ac46029 diff 2024-07-04 11:04:59 +08:00
dapan1121 a8a725936e
Merge pull request #26342 from taosdata/fix/TD-30725
fix:[TD-30725]modify error code & fix potential memory leaks
2024-07-04 11:00:49 +08:00
xjzhou 19cbd47bef Merge remote-tracking branch 'origin/3.0' into enh/TD-21826-3.0 2024-07-03 17:08:07 +08:00
Yihao Deng 95469124f8 fix stream restart crash 2024-07-03 06:47:52 +00:00
Hongze Cheng 71af880554
Merge pull request #26376 from xinjiempolde/fix/TD-30864-3.0
fix(TD-30864): taos crashed at parInsertSql.c
2024-07-03 09:35:53 +08:00
dapan1121 56689cf97a
Merge pull request #26360 from taosdata/fix/3.0/TD-30305
fix coverity issues
2024-07-03 08:50:11 +08:00
Hongze Cheng e679c8d95a
Merge pull request #26374 from taosdata/fix/TD-30856-3.0
fix: buildTagIndexForBindTags errcode
2024-07-02 18:55:40 +08:00
xjzhou c851049d7c fix(TD-30864): taos crashed at parInsertSql.c 2024-07-02 16:28:30 +08:00
Yihao Deng 471580ec5e Merge remote-tracking branch 'origin/3.0' into enh/TD-30442 2024-07-02 08:26:10 +00:00
Yihao Deng ca1562a990 add self check 2024-07-02 08:23:56 +00:00
Shungang Li 21d653f10f fix: buildTagIndexForBindTags errcode 2024-07-02 16:22:59 +08:00
Haojun Liao 279bfb4de0
Merge pull request #26364 from taosdata/fix/3_liaohj
fix(stream): fix error in pause/resume procedure.
2024-07-02 15:32:43 +08:00
Haojun Liao 4e56b6f9eb fix(stream): fix error in pause/resume procedure. 2024-07-02 13:33:31 +08:00
xjzhou 88aa15e944 enh: Enhance error handling for stmt 2024-07-02 11:05:54 +08:00
xjzhou d69c5b1840 isStmtBind 2024-07-02 10:56:55 +08:00
dapan1121 2f970dbc03
Merge pull request #26351 from taosdata/fix/TS-5105-1
fix(query):adj second param for last_row
2024-07-02 10:50:36 +08:00
wangjiaming0909 024422bfd7 fix coverity issues 2024-07-02 09:27:14 +08:00
Haojun Liao 420b59fea5
Merge pull request #26344 from taosdata/fix/3_liaohj
fix(stream): validate the stream hb msg, and discard the invalid hb msg.
2024-07-02 09:07:31 +08:00
dapan1121 6d0b8eeed4
Merge pull request #26302 from taosdata/TD-26483
feat(query):add thread pool
2024-07-01 19:04:52 +08:00
54liuyao 24308a4acb adj pool name 2024-07-01 18:52:36 +08:00
Haojun Liao 2c86e3940f fix(stream): fix memory leak. 2024-07-01 17:43:10 +08:00
54liuyao ff32797e05 adj second param for last_row 2024-07-01 16:58:39 +08:00
54liuyao b723e05535 adj second param for last_row 2024-07-01 16:57:46 +08:00
Haojun Liao c166c8de70 fix(stream): fix memory leak. 2024-07-01 16:53:43 +08:00
dapan1121 b16bf11280
Merge pull request #26333 from taosdata/fix/3.0/TS-5103
fix fill wrong timestamp value
2024-07-01 16:42:21 +08:00
54liuyao be2c16723d adj second param for last_row 2024-07-01 16:38:47 +08:00
Haojun Liao 6d64d0e081 fix(stream): fix memory leak. 2024-07-01 15:34:04 +08:00
Haojun Liao 3ae8916384 fix(stream): add more check for checkpoint info update for leader. 2024-07-01 14:59:55 +08:00
Haojun Liao f09be802ea other: merge 3.0 2024-07-01 13:32:30 +08:00
Haojun Liao b07d2b4adc
Merge pull request #26340 from taosdata/fix/check_end_pos
fix(stream): reset the status before re-send data.
2024-07-01 11:13:36 +08:00
54liuyao c3deebf5b6 adj name 2024-07-01 11:08:40 +08:00
wangjiaming0909 6c6f322a83 change vnode/qnode query threads min value 2024-07-01 11:08:40 +08:00
wangjiaming0909 5040ff5bd9 mnode/qnode support QueryAutoQWorkerPool 2024-07-01 11:08:40 +08:00
54liuyao 26adfdd48d adj name 2024-07-01 11:08:40 +08:00
54liuyao 55341586b5 drop limit 2024-07-01 11:08:40 +08:00
wangjiaming0909 a25571313f remove test code 2024-07-01 11:08:39 +08:00
54liuyao 02a7d29841 adj log 2024-07-01 11:08:39 +08:00
54liuyao 8fdd64e92e limit the size of query queue 2024-07-01 11:08:39 +08:00
54liuyao 0383257900 limit the size of query queue 2024-07-01 11:08:39 +08:00
54liuyao 03a7b43af6 client use new thread pool 2024-07-01 11:08:39 +08:00
wangjiaming0909 11a98ffab2 QueryAutoQWorker 2024-07-01 11:08:39 +08:00
wangmm0220 304460f452 fix:[TD-30725] fix potential memory leaks 2024-07-01 10:49:24 +08:00
Hongze Cheng ce4ecb0371
Merge pull request #26324 from xinjiempolde/enh/TD-23926-3.0
enh/td-23926-3.0 insert into db.?
2024-07-01 09:29:50 +08:00
Hongze Cheng e4826e63f4
Merge pull request #26328 from taosdata/feat/TS-4917-3.0
fix: parseOneStbRow fill tag name
2024-07-01 09:15:53 +08:00
Haojun Liao 5c002e4bbe fix(stream):set the srcTaskId for checkpoint-trigger block 2024-07-01 08:55:38 +08:00
Haojun Liao 398a1b08ac fix(stream): set the correct rsp msg start position. 2024-07-01 08:55:04 +08:00
Yihao Deng 7290920c6f add self check 2024-06-29 04:35:54 +00:00
Yihao Deng f023e7780c add self check 2024-06-29 04:33:14 +00:00
Haojun Liao 1f8991ec91 fix(stream): set the correct rsp msg position. 2024-06-29 00:40:57 +08:00
Haojun Liao e74b8473f1 fix(stream): clear the active checkpoint info after report to mnode. 2024-06-28 23:40:05 +08:00
Haojun Liao 5585a141d5 fix(stream): set the failed id before clear the checkpoint info. 2024-06-28 23:16:03 +08:00
wangjiaming0909 d03a14506e fix fill wrong timestamp value 2024-06-28 17:31:49 +08:00
Haojun Liao 1ffec769b8 fix(stream): clear the msgId if send success, and handle the race condition problem. 2024-06-28 17:03:14 +08:00
Haojun Liao 2345f6cf7f Merge branch '3.0' into fix/check_end_pos 2024-06-28 16:30:36 +08:00
Haojun Liao 79be59d20c fix(stream): reset the status before re-send data. 2024-06-28 16:27:31 +08:00
Haojun Liao 67f483430e fix(stream): reset the status before re-send data. 2024-06-28 16:25:59 +08:00
Yihao Deng bf656ec80f fix merge conflict 2024-06-28 08:23:09 +00:00
Yihao Deng 2e59284388 add self check 2024-06-28 08:14:34 +00:00
Yihao Deng 2ae54486b5 add self check 2024-06-28 07:01:45 +00:00
Yihao Deng 8fe57c1669 add self check 2024-06-28 03:08:02 +00:00
Yihao Deng 51e4abe256 add self check 2024-06-28 02:58:30 +00:00
Shungang Li fa6e3c9c6f fix: parseOneStbRow fill tag name 2024-06-28 10:50:13 +08:00
sima 6282ebef22 fix:[TD-30755] fix heap-buffer-overflow when no qualified data in pk's data block. 2024-06-28 09:20:42 +08:00
Haojun Liao 025437df0c fix(stream): fix error in checkpoint consensus. 2024-06-27 19:25:18 +08:00
Haojun Liao 48bf5eb4d8 other: merge 3.0 2024-06-27 19:23:06 +08:00
Hongze Cheng dfe260fbde
Merge pull request #26316 from taosdata/feat/TS-4917-3.0
fix for create table from csv
2024-06-27 18:03:42 +08:00
Yihao Deng de77ce6480 add self check 2024-06-27 09:51:49 +00:00
xjzhou 12c64a1c45 Merge remote-tracking branch 'origin/3.0' into enh/TD-23926-3.0 2024-06-27 17:02:54 +08:00
Shungang Li e61c5a4083 fix: parseOneStbRow break if token parse err 2024-06-27 14:17:32 +08:00
Hongze Cheng 5e235b50fa
Merge pull request #26295 from taosdata/fix/TD-30720
fix(streamMeta): commit tdb after load tasks
2024-06-27 14:04:02 +08:00
Hongze Cheng 10237869d9
Merge pull request #26292 from taosdata/fix/TD-30620
Add index filtering based on column value type
2024-06-27 13:41:42 +08:00
Yihao Deng 1004ac6924 add self check 2024-06-27 05:28:17 +00:00
Yihao Deng 7c328f0cfa add self check 2024-06-27 05:28:06 +00:00
Shungang Li 85e4f09239 fix: parseCsvFile reset pTag to NULL 2024-06-27 10:30:58 +08:00
Yihao Deng f2fc09cd02 add self check 2024-06-27 01:48:59 +00:00
Yihao Deng 0a35d7ef6b add self check 2024-06-27 01:33:25 +00:00
sima 96e3222726 fix:[TD-30730] fix mergejoin operator's timetruncate caculation on timezone. 2024-06-27 08:42:59 +08:00
sima 4601583361 fix:[TD-30730] Modify precision rules for input parameters of function timetruncate and add test. 2024-06-27 08:42:59 +08:00
sima 5685346d78 fix:[TD-30730] Modify precision rules for input parameters of function to_iso8601 and add test. 2024-06-27 08:42:59 +08:00
Yihao Deng a5441cdcde Add index filtering based on column value type 2024-06-26 08:49:38 +00:00
Yihao Deng 58b3dd7b99 Add index filtering based on column value type 2024-06-26 08:45:14 +00:00
xjzhou 42361fcd45 fix: failed to identify dbName when only ? exists 2024-06-26 16:38:21 +08:00
Haojun Liao a44e17d5ea fix(stream): enable to re-send hbmsg if mnode failed to recv this hbmsg. 2024-06-26 15:21:14 +08:00
xjzhou 1a32279f7f Merge remote-tracking branch 'origin/3.0' into enh/TS-23926-3.0 2024-06-26 14:21:15 +08:00
Minglei Jin 3014c66965 fix(streamMeta): commit tdb after load tasks 2024-06-26 11:21:31 +08:00
Yihao Deng 512671df85 Add index filtering based on column value type 2024-06-26 02:56:49 +00:00
xjzhou 1c8110e7a4 Merge remote-tracking branch 'origin/3.0' into enh/TS-23926 2024-06-26 10:34:36 +08:00
Hongze Cheng b761bd2e38 enh: port main change to 3.0 2024-06-26 10:32:15 +08:00
Haojun Liao b6948dcc4e refactor: do some internal refactor. 2024-06-26 10:19:45 +08:00
Haojun Liao 1818edcb2b fix(stream): consensus the start checkpoint id, and extract the streamhb related functions into a new file. 2024-06-26 10:18:32 +08:00
Yihao Deng ac351c5b58 add self check info 2024-06-26 01:26:39 +00:00
Yihao Deng 061648071e add self check info 2024-06-25 12:35:25 +00:00
Yihao Deng 49ba8132c0 add self check info 2024-06-25 12:04:10 +00:00
Hongze Cheng 59c8656e61
Merge pull request #26275 from taosdata/feat/TS-4917-3.0
feat: 'create table' from csv file
2024-06-25 17:56:23 +08:00
54liuyao 25b150af10 fix(stream):fill result immediately after delete data 2024-06-25 17:24:59 +08:00
dapan1121 ccda3a7f0d
Merge pull request #26263 from taosdata/fix/TS-4921
feat:[TS-4921] add slow log logic
2024-06-25 17:07:35 +08:00
Haojun Liao c2ad0a6ec5
Revert "fix(stream):fill result immediately after delete data" 2024-06-25 16:53:32 +08:00
Haojun Liao 156e3ce109
Merge pull request #26267 from taosdata/fix/TD-30585
fix(stream):fill result immediately after delete data
2024-06-25 16:46:52 +08:00
xjzhou 3fb5f2b1d3 Merge remote-tracking branch 'origin/3.0' into enh/TS-23926 2024-06-25 16:16:56 +08:00
xjzhou b444e18d90 enh: stmt supports 'insert into db.?' 2024-06-25 16:16:32 +08:00
Haojun Liao e6f376f5cb
Merge pull request #26278 from taosdata/fix/3_liaohj
fix(stream): update the remote checkpoint directory in snode.
2024-06-25 15:52:01 +08:00
Yihao Deng 33aef6ddc5 add self check info 2024-06-25 07:12:09 +00:00
54liuyao 4235045d72 adj delete range 2024-06-25 14:36:21 +08:00
Shungang Li b55337ec42 feat: 'create table' ignore lines start with '#' 2024-06-25 14:34:59 +08:00
Shungang Li 586f8094c2 fix: handle mac/win compile warn 2024-06-25 14:10:34 +08:00
Haojun Liao 195469f1dd fix(stream): disable the checkpoint-info-update for tasks in non-checkpoint status 2024-06-25 12:57:50 +08:00
Shungang Li 41021285a1 fix: more ret check 2024-06-25 11:36:55 +08:00
Shungang Li 2292829e47 fix: add check for memory alloc 2024-06-25 10:56:24 +08:00
Shungang Li eaa45470a5 feat: 'create table' add keyword file 2024-06-25 10:55:36 +08:00
Shungang Li 17e84e1fca Merge branch '3.0' into feat/TS-4917-3.0 2024-06-25 10:33:12 +08:00
Haojun Liao 42beba30a8
Merge pull request #26274 from taosdata/fix/3_liaohj
fix(stream): do update the checkpoint info if not in checkpoint status.
2024-06-24 23:05:26 +08:00
Shungang Li b3368f6472 feat: 'create table' from csv file 2024-06-24 22:13:03 +08:00
Yihao Deng 7cab27110a add self check info 2024-06-24 12:26:10 +00:00
54liuyao a4211efacf calc end key 2024-06-24 19:19:15 +08:00
Haojun Liao 6b0b65527f fix(stream): do update the checkpoint info if not in checkpoint status. 2024-06-24 19:18:31 +08:00
54liuyao 41a85e80a3 calc end key 2024-06-24 17:19:38 +08:00
54liuyao 4f8dfe7522 fix(stream):fill dresultim mediately after delete data 2024-06-24 15:52:27 +08:00
dapan1121 3decadf764
Merge pull request #26213 from taosdata/fix/3.0/first_last_fill_order_fault
fix first last fill with ts order fault
2024-06-24 15:44:24 +08:00
Haojun Liao de1a9702bf
Merge pull request #26268 from taosdata/fix/3_liaohj
fix(stream): pause not stop the start procedure of stream tasks.
2024-06-24 14:36:47 +08:00
Haojun Liao bd8c7d8c93 fix(stream): pause not stop the start procedure of stream tasks. 2024-06-24 13:25:48 +08:00
wangmm0220 ed16b1e8db fix:conflict from 3.0 2024-06-24 12:03:10 +08:00
54liuyao 2d7d144ca2 fix(stream):fill dresultimmediately after delete data 2024-06-24 10:56:26 +08:00
wangmm0220 a29d1b0c59 fix:test case error 2024-06-24 10:18:09 +08:00
Haojun Liao ffef405c3a
Merge pull request #26242 from taosdata/fix/3_liaohj
fix(stream): disable pause if task is un-init.
2024-06-23 10:01:49 +08:00
Hongze Cheng 2ba22e34f5
Merge pull request #26216 from xinjiempolde/fix/TS-5024-3.0
fix: stmt bind crashed when colIdx exceeds column nums
2024-06-23 09:53:46 +08:00
Haojun Liao 393369fcd8 fix(stream):clear checkpoint-ready msg. 2024-06-23 00:40:12 +08:00
wangmm0220 65fac20367 fix:[TS-4921] merge from 3.0 2024-06-22 15:02:34 +08:00
Haojun Liao 21e1763ff4 fix(stream): set correct flag for checkpoint. 2024-06-22 11:16:20 +08:00
Haojun Liao 095510ba41 fix(stream): fix deadlock 2024-06-21 23:43:25 +08:00
Haojun Liao 94f3c6ec2d fix(stream): fix deadlock 2024-06-21 23:40:03 +08:00
Haojun Liao 82febd30a0 fix(stream): check the task status checkpoint-ready msg send timer. 2024-06-21 18:48:34 +08:00
Haojun Liao 5a9500055d fix(stream): check the task status checkpoint-ready msg send timer. 2024-06-21 18:44:54 +08:00
Haojun Liao 5966b4f83f fix(stream): fix error in assert. 2024-06-21 17:17:39 +08:00
Haojun Liao 4c4bb0a2e4 other: merge 3.0. 2024-06-21 16:11:50 +08:00