Commit Graph

1026 Commits

Author SHA1 Message Date
yihaoDeng b24b91886a Merge branch 'dev3' into enh/rocksRevert 2023-04-11 10:59:00 +00:00
Xiaoyu Wang 4c04b155d5 merge main 2023-04-11 15:56:28 +08:00
liuyao 95d81604c7 feat:encode&&decode stream scan op 2023-04-11 14:34:31 +08:00
Ganlin Zhao ea6c96df32 fix memory leak 2023-04-11 11:13:23 +08:00
liuyao 74da3c05bc feat:set check point id 2023-04-11 10:33:10 +08:00
Haojun Liao a4ba5401f9 enh(stream): set the start version of all operators. 2023-04-11 10:01:36 +08:00
xinsheng Ren 965af6cc82
fix: handle leak (#20836)
* fix: handle leak

* fix: del unused code

---------

Co-authored-by: facetosea <25808407@qq.com>
2023-04-11 09:46:06 +08:00
liuyao f236457904 feat:add data version 2023-04-10 17:35:16 +08:00
liuyao 955f8f9f07 feat:optimize get patitionby name 2023-04-07 18:45:09 +08:00
liuyao 0716a4aee8 feat:add check point 2023-04-06 16:45:22 +08:00
Haojun Liao 7e734e3088 Merge remote-tracking branch 'origin/feature/3_liaohj' into feature/3_liaohj 2023-04-06 15:09:06 +08:00
Haojun Liao 665ba407cf fix: fix syntax error. 2023-04-06 15:08:35 +08:00
Haojun Liao 2b2059ef18
Merge pull request #20534 from taosdata/fix/TD-22671
fix:error in TD-23218 & remove useless logic
2023-04-06 11:47:24 +08:00
54liuyao 1892b806b5 feat:add stream state buff 2023-04-04 17:09:35 +08:00
54liuyao 429b5cd646 feat:add stream file state 2023-04-04 17:09:35 +08:00
Xiaoyu Wang e9d7a099cc merge main 2023-04-04 14:50:58 +08:00
wangmm0220 1d7581f660 fix:conflicts from main 2023-04-03 19:59:33 +08:00
wangmm0220 d651ba02ae fix:lose consume data because of exec close if consume while insert data 2023-04-03 19:54:52 +08:00
Haojun Liao 3ef7d43dae refactor: do some internal refactor. 2023-04-03 17:47:48 +08:00
Haojun Liao 08bd021a6f refactor: do some internal refactor. 2023-04-03 14:49:14 +08:00
Haojun Liao 91ae07b6c7 fix(tmq): set the table list correctly. 2023-04-03 11:57:17 +08:00
Haojun Liao 167a56f8d0 fix(query): set the correct group table list. 2023-04-02 21:25:54 +08:00
Haojun Liao addabf3ba7 refactor: push down the tableListinfo to scanner. 2023-04-02 15:25:31 +08:00
wangmm0220 97b5c7abee fix:merge from main 2023-03-31 16:20:21 +08:00
dapan1121 15578cf980
Merge branch 'main' into fix/cencVer 2023-03-30 15:36:30 +08:00
Haojun Liao 56c98d7768 refactor: do some internal refactor. 2023-03-29 19:35:04 +08:00
Haojun Liao 152fc5daab fix(stream):fix the race condition when creating new tsables. 2023-03-29 16:36:35 +08:00
dapan1121 a87d35be08 fix: optimize performance 2023-03-28 17:40:46 +08:00
wangmm0220 f1d67b6059 fix:conflict 2023-03-25 19:03:23 +08:00
Haojun Liao 27c848453e
Merge pull request #20625 from taosdata/fix/TD-23220
fix: modify stream fill linear
2023-03-25 15:01:06 +08:00
yihaoDeng 8e409f81ae add backend 2023-03-25 06:43:17 +00:00
54liuyao f18cfc25d6 fix:reset parameter ignoreExpried for fill history 2023-03-24 11:06:05 +08:00
wangmm0220 dd4cf0597b fix:error in optimize consume logic 2023-03-22 17:04:02 +08:00
dapan1121 5b02af6a91 fix: merge main to 3.0 2023-03-22 16:08:16 +08:00
dapan1121 7258ea9244
Merge pull request #20576 from taosdata/fix/TS-2933
enh: optimize table merge scan performance
2023-03-22 13:45:00 +08:00
54liuyao a614ef777f fix: modify pull linear 2023-03-21 18:19:45 +08:00
dapan1121 ddab83a2ba enh: optimize table merge scan performance 2023-03-21 11:42:46 +08:00
wangmm0220 f7b7320f5f fix:set offset if read wal none 2023-03-20 16:57:45 +08:00
Haojun Liao 7e712a14b6 fix(tmq): adjust log. 2023-03-19 19:06:28 +08:00
Haojun Liao ae5155edcf fix(tmq): do some internal refactor. 2023-03-19 10:49:30 +08:00
wangmm0220 ccba1d07c6 fix:error in TD-23218 & remove useless logic 2023-03-18 18:42:49 +08:00
wangmm0220 7616a283e3 fix:error in TD-23218 & remove useless logic 2023-03-18 18:23:38 +08:00
Shengliang Guan 041f03e918
Merge pull request #20414 from taosdata/feat/TD-23058
feat: correct slimit&limit clause
2023-03-12 20:48:16 +08:00
dapan1121 f74c488c42 fix: keep group for interval query 2023-03-12 11:03:41 +08:00
54liuyao 87ba6cb019 fix:fill history check update 2023-03-08 19:19:09 +08:00
54liuyao d8fb591435 fix:incorrectly judged that the stream was killed 2023-03-06 09:46:12 +08:00
Ganlin Zhao cad32b12a5 add inherit from upstream order option for exchange 2023-02-28 18:30:51 +08:00
Haojun Liao b46098793d refactor: do some internal refactor and add some logs for tmq. 2023-02-26 12:16:45 +08:00
Xiaoyu Wang c597de099f merge main 2023-02-20 13:41:27 +08:00
Haojun Liao 0d9d2ea293 fix(query): do some internal refactor, and fix the bug when calender time duration exists in sliding and offset. 2023-02-17 18:31:32 +08:00
54liuyao 05c9d46fac fix:wrong tag value 2023-02-16 10:22:31 +08:00
Haojun Liao f6ced36c87 fix(query): fix memory leak. 2023-02-15 01:28:50 +08:00
Haojun Liao 4e9146f061 fix(query): fix memory leak. 2023-02-14 22:46:31 +08:00
Haojun Liao a7fdc4bae3 other: merge 3.0 2023-02-10 19:20:24 +08:00
Xiaoyu Wang 3382a24a69 merge main 2023-02-10 18:03:11 +08:00
54liuyao e89362fb36 feat:stream ignore check update data 2023-02-07 15:29:05 +08:00
Haojun Liao 3822225231 other: merge main. 2023-02-06 16:24:15 +08:00
Xiaoyu Wang 5d499e52f9 merge main 2023-02-03 17:13:11 +08:00
Haojun Liao 0030c4b5ee refactor(query): opt perf by remove some functions. 2023-02-03 14:24:00 +08:00
Haojun Liao ab8c977417 other: merge main. 2023-02-02 14:00:36 +08:00
54liuyao fa43fc455a refactor stream interval build result data 2023-02-01 17:27:03 +08:00
Haojun Liao fae4f2c4ed refactor: do some internal refactor. 2023-01-20 18:08:34 +08:00
Xiaoyu Wang f8082bc752
Merge pull request #19623 from taosdata/enh/3.0_planner_optimize
enh: optimize execute plan when 'tail' function is used with 'partition by' clause
2023-01-18 17:25:16 +08:00
Haojun Liao c9a1b3ba01 fix(query): handle the multi-group limit/offset in table group merge scan/ multiway-merge executor. 2023-01-18 16:24:29 +08:00
Xiaoyu Wang dd0ea40768 Merge remote-tracking branch 'origin/fix/liaohj' into enh/3.0_planner_optimize 2023-01-18 10:56:03 +08:00
Xiaoyu Wang 0b1bb7a1fb merge 3.0 2023-01-16 17:55:35 +08:00
Haojun Liao e9fc109edf enh(query): opt query perf. 2023-01-11 18:47:45 +08:00
Haojun Liao 67a291955e fix(query): initialize output buffer for each output. 2023-01-11 17:36:01 +08:00
54liuyao d5ade95b31 feat(stream):user define tag 2023-01-10 10:13:56 +08:00
Xiaoyu Wang fdde287ca9 merge main 2023-01-04 11:43:20 +08:00
Haojun Liao 53c3cbd661 enh(query): support event window. 2023-01-03 17:41:10 +08:00
dapan1121 47e885da07 fix: evac page failed issue cause of disk full 2023-01-03 15:40:40 +08:00
Alex Duan 2439c345d9 enh: clear assert remove tbuffer.h 2022-12-30 18:04:54 +08:00
54liuyao 4c6702ab73 fix:modify parameter type 2022-12-30 13:29:29 +08:00
Shengliang Guan 25e9d94f5b
Merge pull request #19244 from taosdata/feature/stream_main
enh: put func state into tdb
2022-12-29 17:17:29 +08:00
Liu Jicong 7721353b6b enh: put func state into tdb 2022-12-29 12:39:07 +08:00
Shengliang Guan d342ebcd77
Merge pull request #18720 from taosdata/refact/submit_req
Refact/submit req
2022-12-28 10:29:00 +08:00
Liu Jicong 39eb62d80d enh: set scan limit 2022-12-27 14:52:41 +08:00
Haojun Liao 723efba79b
Merge branch '3.0' into refact/submit_req 2022-12-26 13:25:25 +08:00
Liu Jicong cc81892db1
Merge branch '3.0' into feature/stream_3.0 2022-12-26 13:22:24 +08:00
Shengliang Guan 028cc52846
Merge pull request #19116 from taosdata/feature/3_liaohj
refactor: do some internal refactor.
2022-12-26 09:12:35 +08:00
Haojun Liao a4213aedf0 refactor: do some internal refactor. 2022-12-23 17:23:31 +08:00
Liu Jicong b1bd24d15a enh: scan exec set limit 2022-12-23 16:35:40 +08:00
54liuyao 7c84ddd46d fix:timestampe is out of order 2022-12-22 16:48:33 +08:00
Liu Jicong 74a253eac4 refactor 2022-12-08 13:34:42 +08:00
Shengliang Guan 6d94afe48f
Revert "refact: adjust some assert cases" 2022-12-07 21:51:17 +08:00
Shengliang Guan d5126d469a refact: replcase ASSERT with tAssert 2022-12-07 18:42:48 +08:00
Liu Jicong 9e7bbf622a refactor: support submitreq2 2022-12-07 17:54:09 +08:00
Liu Jicong b133a56219 refactor: support submitreq2 2022-12-07 15:19:34 +08:00
Hongze Cheng 899d7b0bcc Merge branch '3.0' of https://github.com/taosdata/TDengine into refact/submit_req 2022-12-06 14:37:22 +08:00
Liu Jicong 619bbdfd82 refactor: support submitreq2 2022-12-06 05:58:28 +08:00
dapan1121 f9f60a8f39
Merge pull request #18646 from taosdata/fix/TD-20684-3.0
feat(api): add new api int64_t taos_affected_rows64
2022-12-04 16:47:51 +08:00
Haojun Liao 5e77b3eca3 refactor: add function for extract the required buffer during query. 2022-12-02 23:10:03 +08:00
dapan1121 84eb77e124
Merge pull request #18590 from taosdata/szhou/table-count-scan
enhancement: table count scan
2022-12-02 21:07:28 +08:00
Alex Duan 9fb4fa0a7f feat(api): add int64 affected rows modify tmsg.h struct 2022-12-02 20:48:39 +08:00
Xiaoyu Wang 85ea8bbbb3 Merge remote-tracking branch 'origin/3.0' into enh/3.0_planner_optimize 2022-12-02 14:04:50 +08:00
dapan1121 dff4c36092
Merge branch '3.0' into fix/TD-20802 2022-12-02 10:11:39 +08:00
slzhou ee5d0a384f fix: refactor table scan count 2022-12-01 19:05:33 +08:00
54liuyao bccb31aced fix:stream crash && add debug log 2022-12-01 14:15:50 +08:00
dapan1121 b430f653b9 Merge remote-tracking branch 'origin/3.0' into fix/TD-20802 2022-12-01 09:22:31 +08:00
slzhou 903718940d Merge branch '3.0' of github.com:taosdata/TDengine into szhou/table-count-scan 2022-12-01 09:14:10 +08:00
Shengliang Guan 5c2ac1a625
Merge pull request #18591 from taosdata/fix/liao_cov
refactor: do some internal refactor.
2022-11-30 22:12:56 +08:00
Haojun Liao 2c8b962b5a refactor: do some internal refactor. 2022-11-30 21:04:58 +08:00
slzhou 323e52b8c5 Merge branch 'enh/3.0_planner_optimize' into szhou/table-count-scan 2022-11-30 15:43:41 +08:00
slzhou 6d86fb5b51 Merge branch 'enh/3.0_planner_optimize' into szhou/table-count-scan 2022-11-29 22:19:36 +08:00
Ganlin Zhao 2956eec51f fix partition/group by tag count should not have output 2022-11-29 19:01:09 +08:00
dapan1121 8ee170bef1 enh: add retry for vnode closed case 2022-11-29 16:17:05 +08:00
Haojun Liao d8da10f2bb refactor: do some internal refactor. 2022-11-28 00:51:18 +08:00
Haojun Liao b0ee829db2 refactor: do some internal refactor. 2022-11-28 00:27:49 +08:00
slzhou b5b6fff68b feature: save work 2022-11-27 13:50:36 +08:00
slzhou c2a7404b42 save work in case it losts 2022-11-25 23:00:14 +08:00
Haojun Liao e5e817ae55 other: merge 3.0 2022-11-24 17:24:24 +08:00
Haojun Liao 8dd780b486 other: merge 3.0 2022-11-24 17:17:53 +08:00
Haojun Liao f745dec5ec other: merge 3.0 2022-11-24 17:17:22 +08:00
Haojun Liao 9a208b2d09 other: merge 3.0 2022-11-24 17:08:15 +08:00
shenglian zhou 7f6ff39648 feat: table merge scan save work 2022-11-23 19:47:24 +08:00
Shengliang Guan fda726df0c
Merge pull request #18371 from taosdata/fix/liao_cov
refactor: do some internal refactor.
2022-11-23 09:25:13 +08:00
Haojun Liao 0d60f24db5 refactor: do some internal refactor. 2022-11-22 22:42:44 +08:00
dapan1121 e1ea03fbda
Merge pull request #18345 from taosdata/fix/TD-20591
fix:  crash caused by elect null and issues found in asan
2022-11-22 18:49:19 +08:00
54liuyao 2020ea0a76 fix:stream fill crash 2022-11-22 16:28:55 +08:00
dapan1121 e42f895fea fix: fix select null crash issue and asan issues 2022-11-22 16:07:04 +08:00
Haojun Liao 1bd0cc4a5a refactor: do some internal refactor, and update the logs. 2022-11-21 15:09:18 +08:00
dapan1121 d3a75048c2
Merge pull request #17972 from taosdata/fix/TD-20246
refactor: optimize interp linear interpolation ignore NULL values during calculation
2022-11-21 10:15:37 +08:00
Haojun Liao e09ea90b97 other: merge 3.0 2022-11-18 22:19:32 +08:00
Shengliang Guan a12cf7f91d
Merge pull request #18266 from taosdata/feature/stream
enh(stream): put user defined tb name into stream state
2022-11-18 19:56:56 +08:00
Haojun Liao 54e7335477 fix(query): set the scan flag. 2022-11-18 17:27:05 +08:00
Liu Jicong 9a603e5663 enh(stream): put user defined tb name into stream state 2022-11-18 17:21:50 +08:00
Haojun Liao 8b1e13af5e refactor: do some internal refactor. 2022-11-18 13:40:03 +08:00
Haojun Liao 875989aa30 refactor: do some internal refactor. 2022-11-18 11:24:56 +08:00
dapan1121 48d5e13ae3
Merge pull request #18233 from taosdata/fix/TS-2069-3.0
fix(query): createOneDataBlock rowsize must reset to zero
2022-11-18 11:11:48 +08:00
Haojun Liao 2055879deb refactor: do some internal refactor. 2022-11-18 09:47:26 +08:00
Ganlin Zhao c8f069c647 change interp linear behavior 2022-11-18 09:43:40 +08:00
Ganlin Zhao 8a19e84fe4 Merge branch '3.0' into fix/TD-20246 2022-11-17 11:20:33 +08:00
Alex Duan 8b82fdf0e8 fix(query): correct calc sort page size 2022-11-16 16:00:37 +08:00
Liu Jicong ab57d069d4 enh(stream): add tbname map cache 2022-11-16 15:18:31 +08:00
Haojun Liao 7b53b8142e refactor: do some internal refactor. 2022-11-12 16:03:47 +08:00
Haojun Liao ab52d28cb0 refactor: do some internal refactor. 2022-11-11 22:18:06 +08:00
dapan1121 56b33e9200 Merge remote-tracking branch 'origin/3.0' into fix/TD-20300 2022-11-11 18:57:12 +08:00
dapan1121 f60441e2dd fix: fix query thread quitting issue 2022-11-11 18:44:59 +08:00
dapan1121 89c13efba8 fix: fix query thread quit issue 2022-11-11 17:13:55 +08:00
54liuyao 1ca9839170 fix(operator):Operator double free 2022-11-10 15:47:07 +08:00
Haojun Liao 2402fd1d48 refactor: do some internal refactor. 2022-11-09 19:14:27 +08:00
Haojun Liao b48752686e refactor: do some internal refactor. 2022-11-09 13:45:46 +08:00
Haojun Liao d238f387ce other: merge 3.0 2022-11-09 00:00:14 +08:00
Ganlin Zhao 6aca4b8a5c enh: interp fill linear ignore null values during calculation 2022-11-08 14:51:32 +08:00
Ganlin Zhao a7d21c9ee7 enh: interp fill linear ignore null values during calculation 2022-11-08 14:50:03 +08:00
Liu Jicong bc469f7f7b fix(stream): delete tb should be checked in write thread 2022-11-08 11:30:29 +08:00
Haojun Liao 9863879951 refactor: do some internal refactor. 2022-11-08 09:21:43 +08:00
Haojun Liao 9932fa6bf0 refactor: refactor to avoid spin operator in exchange operator. 2022-11-07 17:48:27 +08:00
Haojun Liao fea40da5dc other: merge 3.0 2022-11-07 14:31:01 +08:00
Haojun Liao cd29972a4d enh(query): add cache for table meta. 2022-11-07 11:53:23 +08:00
Haojun Liao be5b72b25d enh(query): add cache for table meta entry in table scan. 2022-11-07 10:17:42 +08:00
Haojun Liao 270404318c other: merge 3.0 2022-11-07 09:28:22 +08:00
Haojun Liao 341112923b fix(query): init filter in group operator. 2022-11-06 23:42:04 +08:00
Haojun Liao 8c4be7dc21 refactor: do some internal refactor. 2022-11-04 22:13:40 +08:00
Haojun Liao 03f4918b3b refactor: do some internal refactor. 2022-11-04 18:46:48 +08:00
Shengliang Guan 18f7d658d9
Merge pull request #17804 from taosdata/feature/3_liaohj
refactor: add some logs.
2022-11-01 16:46:24 +08:00
Shengliang Guan 68f1641991
Merge pull request #17800 from taosdata/feature/stream
refactor(stream): fill history
2022-11-01 16:15:07 +08:00
Haojun Liao cff5d9295e refactor: add some logs. 2022-11-01 15:00:02 +08:00
Liu Jicong 8ca5f0bd9c Merge branch '3.0' into feature/stream 2022-11-01 13:20:20 +08:00
Liu Jicong 5e253cc8ea refactor(stream): fill history 2022-11-01 11:56:14 +08:00
Haojun Liao c17a921a03 fix(query): set the correct buffer to accommodate the tag values. 2022-10-31 23:19:40 +08:00
Haojun Liao f790d91b45 fix(query): check null before free resource, and some internal refactor. 2022-10-31 10:41:25 +08:00
Haojun Liao 864e2c60a7 fix(query): invoke the different api for extract queried table list. 2022-10-31 09:48:23 +08:00
Haojun Liao 46a6d9ab99 refactor: do some internal refactor. 2022-10-30 22:23:27 +08:00
Haojun Liao f990ceab6e refactor: do some internal refactor. 2022-10-30 22:13:49 +08:00
Haojun Liao e4de732285 fix(query): always build hash map from uid to keyinfo 2022-10-29 18:15:00 +08:00
Haojun Liao 9b99c69785 fix(query): support partition by + limit push down. 2022-10-28 19:56:32 +08:00
Haojun Liao 4b2fa43dae
Revert "fix(query): handle partition by in table scan operator" 2022-10-28 18:05:19 +08:00
Haojun Liao d0a7a43e6f other:merge 3.0 2022-10-28 18:02:50 +08:00
Haojun Liao 407a3453ca fix(query): set fetch block info. 2022-10-28 14:45:35 +08:00
Haojun Liao 2c896012df fix(query): check status before add table uid in hash map. and do some other refactor. 2022-10-28 10:43:25 +08:00
Haojun Liao 4774baa635 fix(query): handle the case of the single block in last files. 2022-10-27 22:43:42 +08:00
yihaoDeng 6a978be730 opt mem 2022-10-27 20:38:57 +08:00
Haojun Liao a7ca29c627 other: merge 3.0 2022-10-27 18:04:28 +08:00
Haojun Liao 5a971dd03a fix(query): handle partition by in table scan operator with limit/offset value. 2022-10-27 16:58:32 +08:00
Haojun Liao c5c5b5aa9f
Merge pull request #17662 from taosdata/feature/3_liaohj
enh(query): enable the limit clause to be push down
2022-10-27 10:46:21 +08:00
Haojun Liao 376e7ea5b9 fix(query): support limit/offset in merge sort operator. 2022-10-26 19:23:05 +08:00
Haojun Liao 81d795c293 fix(query): enable limit in grouped scan. 2022-10-26 17:11:56 +08:00
Haojun Liao 8cf3339b25 enh(query): enable the limit clause to be push down to the table scan operator. 2022-10-26 11:31:31 +08:00
Liu Jicong 52b4b510a8 merge 3.0 2022-10-26 09:18:29 +08:00
Liu Jicong 75e5e490fd refactor(stream): recover and fill history 2022-10-26 00:31:00 +08:00
Haojun Liao e654f3f92c refactor: do some internal refactor. 2022-10-24 16:44:44 +08:00
Haojun Liao b06870f70f Merge branch '3.0' into fix/liao_cov 2022-10-24 14:07:59 +08:00
Haojun Liao 2f5ed16cb8 fix(query): remove redundant ts cols in cache scan. 2022-10-24 13:26:54 +08:00
Shengliang Guan 9903bbc527
Merge pull request #17577 from taosdata/fix/liao_cov
fix(query): fix coverity issues.
2022-10-23 23:12:36 +08:00
Haojun Liao 6ebf6b29bd fix(query): fix coverity issues. 2022-10-23 15:20:29 +08:00
Shengliang Guan e86cdc8cde
Merge pull request #17381 from taosdata/feature/addIdxToSysTable
Feature/addIdxToSysTable
2022-10-23 14:38:37 +08:00
yihaoDeng 79ac1153ce avoid invalid read/write 2022-10-22 16:02:09 +08:00
Liu Jicong 5571ebee0f
Merge pull request #17542 from taosdata/feature/stream
enh(stream): internal optimize
2022-10-21 14:31:42 +08:00
Liu Jicong 035e6b13c8 enh(stream): internal optimize 2022-10-21 10:29:05 +08:00
Haojun Liao bcb3dcc7dc refactor: remove some comments. 2022-10-20 18:12:27 +08:00
Haojun Liao 6e15719ccb other: merge 3.0 2022-10-20 18:10:44 +08:00
Haojun Liao 14fe065528 fix(query): fix no-fill expression calculation bug. 2022-10-20 18:07:38 +08:00
Haojun Liao c41713cf21
Merge pull request #17495 from taosdata/fix/liao_cov
refactor: remove redundant codes and do some internal refactor.
2022-10-20 13:16:02 +08:00
Haojun Liao 70adc0ea33 fix(query): fix coverity issues. 2022-10-20 11:27:33 +08:00
Liu Jicong 8357c7342b fix(stream): stream state and session support partition tbname 2022-10-19 11:43:01 +08:00
54liuyao 8efd7e8763 feat(stream):replace disk buff 2022-10-18 18:13:47 +08:00
dapan1121 0df311a78f
Merge pull request #17264 from taosdata/refact/query_opt
refactor:do some internal refactor to optimize the query performance.
2022-10-14 19:51:46 +08:00
Liu Jicong 6f8d4d6955 fix(tmq): push msg 2022-10-14 13:31:05 +08:00