Commit Graph

575 Commits

Author SHA1 Message Date
Ganlin Zhao 709b59a3a6 fix: fix assert crash in tsort.c 2023-05-19 17:27:15 +08:00
dapan1121 8fe63e1e24
Merge pull request #21180 from taosdata/szhou/fix-ts3326
fix: clear null bitmap bit when set value
2023-05-06 15:58:57 +08:00
slzhou 25170e1a75 fix: restore the removal of show datablock to console 2023-05-06 13:32:58 +08:00
slzhou 6b0580eedf fix: clear null bitmap bit when set value 2023-05-06 13:30:49 +08:00
Haojun Liao 09a04052ec refactor: do some internal refactor. 2023-05-04 16:15:14 +08:00
Haojun Liao db1d75bb48 refactor: do some internal refactor. 2023-04-27 09:28:20 +08:00
Haojun Liao 02ec67ad9e
Merge pull request #20882 from taosdata/fix/TS-3081
fix:open test cases for tmq & add log if rebalance error
2023-04-14 17:56:58 +08:00
wangmm0220 e985f15cf0 fix:memset nullBitmap of SSDataBlock to 0 in udf 2023-04-14 09:36:36 +08:00
wangmm0220 7648e03e31 fix:doBitmapMerge error if remaind bytes is not 0 2023-04-13 10:03:30 +08:00
Xiaoyu Wang 4c04b155d5 merge main 2023-04-11 15:56:28 +08:00
Ganlin Zhao 2d0dad7a37 fix: fix nullbitmap shift error when trimming data blocks. 2023-04-07 19:35:46 +08:00
Ganlin Zhao 1c6bf2d1d3 fix: fix nullbitmap shift error when trimming data blocks. 2023-04-07 18:08:49 +08:00
Xiaoyu Wang c134432c45 merge main 2023-04-06 09:31:45 +08:00
Ganlin Zhao 23ec9287c9 fix: fix tsim crash on windows due to invalid input to strftime 2023-04-04 10:33:41 +08:00
Ganlin Zhao 6c64b760a0 fix: fix tsim crash on windows due to invalid input to strftime 2023-04-03 17:58:43 +08:00
Haojun Liao addabf3ba7 refactor: push down the tableListinfo to scanner. 2023-04-02 15:25:31 +08:00
dapan1121 9952be43f6 Merge remote-tracking branch 'origin/main' into fix/cencVer 2023-03-29 15:50:14 +08:00
dapan1121 0327a8eaa3 fix: block rows number type 2023-03-29 10:46:56 +08:00
dapan1121 22ad3129b9 fix: query schema is old issue 2023-03-28 15:21:47 +08:00
dapan1121 61571d9296 enh: optimize count performance 2023-03-27 19:40:29 +08:00
54liuyao 87ba6cb019 fix:fill history check update 2023-03-08 19:19:09 +08:00
54liuyao 8a23f0ce3b fix:set timestamp precision 2023-03-01 18:59:27 +08:00
Xiaoyu Wang 58fc265b80 merge main 2023-02-24 13:26:45 +08:00
Haojun Liao 97024f1468 fix(query): fix coverity issue. 2023-02-24 09:48:34 +08:00
Xiaoyu Wang 1ab144609e merge main 2023-02-23 14:58:22 +08:00
dapan1121 6aa05c4370
Merge pull request #20067 from taosdata/fix/TS-2687
fix: add merge join operator result limitation
2023-02-23 10:40:23 +08:00
dapan1121 968c538be5 fix: add merge join operator result limitation 2023-02-21 08:54:05 +08:00
Xiaoyu Wang c597de099f merge main 2023-02-20 13:41:27 +08:00
Haojun Liao 0a9f8347cc fix(query):suppress the syntax error in internal. 2023-02-20 10:51:04 +08:00
Haojun Liao 751c1cb5d2 refactor:do some internal refactor. 2023-02-20 10:12:27 +08:00
Haojun Liao 8d187efc18 refactor:do some internal refactor. 2023-02-20 10:04:08 +08:00
Haojun Liao c597a1e4ce refactor: do some internal refactor. 2023-02-13 15:46:47 +08:00
Haojun Liao 72287a3b5f fix(query): set correct tag value during tag filter and do some internal refactor. 2023-02-10 16:03:11 +08:00
Haojun Liao 3822225231 other: merge main. 2023-02-06 16:24:15 +08:00
wangmm0220 762f6466f3 fix:conflicts from 3.0 2023-02-06 09:23:29 +08:00
Xiaoyu Wang 5d499e52f9 merge main 2023-02-03 17:13:11 +08:00
wangmm0220 c8d49b603d fix:roll back htol length for block raw data 2023-02-02 17:23:01 +08:00
wangmm0220 936b15629f fix:remove htonl length in block encode 2023-01-31 15:26:58 +08:00
wangmm0220 2ad5869659 fix:add log for block encode 2023-01-31 14:25:39 +08:00
Haojun Liao 7803104b7e fix(query): do some internal refactor, and identify a bug. 2023-01-20 22:50:35 +08:00
Haojun Liao 07cf336fa0 refactor: add an array list api. 2023-01-17 09:43:33 +08:00
Xiaoyu Wang 9a0c2805f4 merge main 2023-01-13 13:54:04 +08:00
Haojun Liao e0dbe22199 fix(query): fix uninitialized memory buffer accessed. 2023-01-11 10:27:23 +08:00
Haojun Liao 75f4e64326 enh(query): adjust the memset rule when creating new datablock. 2023-01-10 23:45:49 +08:00
Haojun Liao 3eadb9b921 enh(query): disable the memset when allocate the memory for dataBlock. 2023-01-10 23:08:25 +08:00
54liuyao d5ade95b31 feat(stream):user define tag 2023-01-10 10:13:56 +08:00
Shengliang Guan b9f95b6a12
Merge pull request #19390 from taosdata/merge/mainto3.0_0105
merge from main to 3.0
2023-01-06 08:59:32 +08:00
Shengliang Guan 3016f35e9f Merge branch '3.0' into merge/mainto3.0_0105 2023-01-05 16:08:23 +08:00
Ganlin Zhao a2cc08145a fix: fix coverity issues 2023-01-05 14:11:05 +08:00
dapan1121 8a773d6b7f
Merge pull request #19325 from taosdata/enh/TD-21206
fix: fix ASSERTs
2023-01-04 16:10:12 +08:00
Ganlin Zhao 795fcab242 fix error 2023-01-04 14:01:04 +08:00
Ganlin Zhao 0f877eea43 fix error 2023-01-04 11:29:35 +08:00
Ganlin Zhao 4b81962269 fix asserts 2023-01-04 09:16:00 +08:00
Haojun Liao 00c2d382b1 fix(query): opt filter perf. 2023-01-03 22:45:02 +08:00
kailixu d34dc4bf5f chore: print format 2023-01-03 10:29:24 +08:00
kailixu 88b4a904ac chore: print format 2023-01-03 10:27:58 +08:00
kailixu 8905a4839e fix: tsma result submit for row/column update 2023-01-02 15:57:36 +08:00
Liu Jicong 834495d62a refact: adapt to new sml api 2022-12-26 10:14:59 +08:00
dapan1121 f6123395c0 Merge branch 'refact/submit_req' of github.com:taosdata/TDengine into refact/submit_req 2022-12-20 18:05:03 +08:00
dapan1121 32e8202a25 enh: refact insert into select processing 2022-12-20 16:55:11 +08:00
kailixu adc23925bf refact: optimization of method buildSubmitReqFromDataBlock 2022-12-20 12:07:56 +08:00
Haojun Liao fdade6d6a3
Merge branch '3.0' into refact/submit_req 2022-12-19 11:24:00 +08:00
Shengliang Guan 04750d9078
Merge pull request #18905 from taosdata/feature/3_liaohj
refactor: do multiple refactor and improve some query perf.
2022-12-14 08:01:42 +08:00
Haojun Liao e4ad989070 fix(query): disable assert. 2022-12-13 00:17:11 +08:00
Haojun Liao e3e42cdfbd fix(query): set update ts flag for stream. 2022-12-13 00:16:40 +08:00
Haojun Liao 48f7fc5c3d
Merge branch '3.0' into refact/submit_req 2022-12-12 18:11:17 +08:00
kailixu fcb99d4586 Merge branch 'refact/submit_req' of github.com:taosdata/TDengine into refact/submit_req 2022-12-12 16:56:00 +08:00
Haojun Liao ba50a7c30d refactor(query): add additional attribute to denote if current block has already loaded data. 2022-12-12 14:25:26 +08:00
54liuyao 8caca97568 feat:add delete mark for sma 2022-12-09 11:34:58 +08:00
WANG MINGMING 35b5f185a2
Merge pull request #18833 from taosdata/refact/submit_req_marks
opti:performance of schemaless
2022-12-09 05:04:48 +08:00
kailixu 5dbbaa3b77 refact: add more check for rsma 2022-12-08 15:06:18 +08:00
kailixu a2092892f7 refact: tsma/rsma code optimization 2022-12-08 14:43:48 +08:00
kailixu 6f377e3234 refact: tsma/rsma data format 2022-12-08 14:39:59 +08:00
wangmm0220 443aa2ee3f fix:modify influxdb parse logic for sml 2022-12-07 11:05:33 +08:00
Hongze Cheng 899d7b0bcc Merge branch '3.0' of https://github.com/taosdata/TDengine into refact/submit_req 2022-12-06 14:37:22 +08:00
Haojun Liao 392fe988a0 fix(query): remove invalid assert for mac&win. 2022-12-03 20:16:56 +08:00
kailixu e360094f8a chore: code format 2022-12-03 20:15:31 +08:00
kailixu 42b17760a2 refact: tsma result adaption 2022-12-03 20:06:55 +08:00
kailixu 11684ceb82 refact: resource mgmt when build block for rsma 2022-12-03 15:00:40 +08:00
kailixu e918982a5a refact: rsma adaption for new SSubmitReq 2022-12-03 14:23:58 +08:00
kailixu d3a88ea517 refactor: row and submit msg of rsma/tsdb 2022-12-03 13:33:30 +08:00
Haojun Liao fa43f86fe1 refactor: add an assert. 2022-12-03 12:43:03 +08:00
Haojun Liao b6199d8d99 enh(query): update the aligned bits for colInfodata 2022-12-03 12:37:42 +08:00
Shengliang Guan 6d70f48802
Merge pull request #18592 from taosdata/feature/3_liaohj
enh(query): optimize query perf.
2022-12-02 21:00:35 +08:00
Haojun Liao 83782fb27b fix(query): fix invalid tag fill and clear nullbitmp 2022-12-02 10:07:48 +08:00
Haojun Liao f8a2ab8338 refactor: do some internal refactor. 2022-12-01 17:24:26 +08:00
Haojun Liao cefe4be1ab refactor: do some internal refactor. 2022-12-01 00:34:06 +08:00
Haojun Liao ae81633144 enh(query): optimize query perf. 2022-11-30 14:55:27 +08:00
Haojun Liao 445c4f28f0 enh(query): optimize the perf. 2022-11-29 23:34:22 +08:00
Shengliang Guan d65e55558f
Merge pull request #18540 from taosdata/main
merge from main to 3.0 branch
2022-11-29 14:43:36 +08:00
MysticBoy 4b668a4153
修改可能导致读取额外内容 2022-11-28 17:47:37 +08:00
Haojun Liao 6e81e8cc73 refactor: do some internal refactor. 2022-11-28 12:32:40 +08:00
Haojun Liao 203ea1f9c8 fix(query): fix error 2022-11-27 14:57:44 +08:00
Haojun Liao 7fe4cf7bbe
Merge branch '3.0' into feature/3_liaohj 2022-11-25 22:24:59 +08:00
Ganlin Zhao 0ea961b659 fix: [ASAN] fix nullpointer issue in tdatablock.c 2022-11-24 21:24:11 +08:00
Haojun Liao 9a208b2d09 other: merge 3.0 2022-11-24 17:08:15 +08:00
Shengliang Guan 335a572d86
Revert "Revert "enh: row optimize2"" 2022-11-24 10:12:25 +08:00
Hongze Cheng ffbb04d40a
Revert "enh: row optimize2" 2022-11-24 09:21:26 +08:00
Shengliang Guan d31be656e3
Merge pull request #18401 from taosdata/fix/TD-20605
fix: [ASAN] fix null pointer in tdatablock.c
2022-11-24 08:04:01 +08:00
Haojun Liao 611ab8b394 refactor: make sure the memory is aligned to 32 bytes. 2022-11-23 21:52:51 +08:00
kailixu 4e739b45fb fix: flen/offset adaption for trow 2022-11-23 21:29:16 +08:00
Ganlin Zhao 516cb116c0 fix: [ASAN] fix null pointer in tdatablock.c 2022-11-23 18:32:22 +08:00
Shengliang Guan fda726df0c
Merge pull request #18371 from taosdata/fix/liao_cov
refactor: do some internal refactor.
2022-11-23 09:25:13 +08:00
Haojun Liao 0d60f24db5 refactor: do some internal refactor. 2022-11-22 22:42:44 +08:00
dapan1121 e1ea03fbda
Merge pull request #18345 from taosdata/fix/TD-20591
fix:  crash caused by elect null and issues found in asan
2022-11-22 18:49:19 +08:00
54liuyao 2020ea0a76 fix:stream fill crash 2022-11-22 16:28:55 +08:00
dapan1121 e42f895fea fix: fix select null crash issue and asan issues 2022-11-22 16:07:04 +08:00
Alex Duan 031ceda752 createOneDataBlock rowsize must reset to zero 2022-11-17 14:58:53 +08:00
Cary Xu 1d795f5c62 fix: null pointer when merge col data of varchar 2022-11-14 16:27:02 +08:00
Haojun Liao 7b53b8142e refactor: do some internal refactor. 2022-11-12 16:03:47 +08:00
Shengliang Guan 29db4d67f8 fix: null pointer passed as argument , which is declared to never be null 2022-11-12 15:39:19 +08:00
Haojun Liao b48752686e refactor: do some internal refactor. 2022-11-09 13:45:46 +08:00
Haojun Liao a1a2bae25c fix(query): allocate memory for null value columns. 2022-11-07 10:29:58 +08:00
Haojun Liao cc9532c76a fix(query): set correct helper buffer. 2022-11-06 18:39:57 +08:00
Haojun Liao f44dd569cc fix(query): remove the invalid capacity changing. 2022-11-06 16:09:19 +08:00
Haojun Liao 10cd3c0f29 fix(query): remove the invalid capacity changing. 2022-11-06 15:18:33 +08:00
Haojun Liao 9d1998d7d2 fix(query): temporarily disable assert. 2022-11-06 11:53:07 +08:00
Haojun Liao d200fe5145 refactor: do some internal refactor. 2022-11-06 01:34:04 +08:00
Haojun Liao 03f4918b3b refactor: do some internal refactor. 2022-11-04 18:46:48 +08:00
Haojun Liao 9c33d10ad9 refactor: remove the unnecessary function. 2022-11-04 09:15:14 +08:00
Haojun Liao e7d58625b9 fix(query): add memset after malloc memory. 2022-11-04 09:09:37 +08:00
Haojun Liao abfa8c1d87 fix(query): add api to memset buffer for filtering data. 2022-11-03 22:05:08 +08:00
Haojun Liao 53e1c19acb enh(query): remove the memset. 2022-11-03 10:28:52 +08:00
dapan1121 079704599c
Merge pull request #17840 from taosdata/feature/TD-19844
fix(function):if data is null, apercentile function should return null
2022-11-02 17:57:09 +08:00
54liuyao 43918a27f9 fix(function):if data is null, apercentile function should return null 2022-11-02 16:37:23 +08:00
Shengliang Guan b5f0041af1 refact: adjust error code in vnode 2022-11-02 15:28:32 +08:00
Shengliang Guan 68f1641991
Merge pull request #17800 from taosdata/feature/stream
refactor(stream): fill history
2022-11-01 16:15:07 +08:00
Haojun Liao 83495ed5d3 fix(query): set the correct buffer to accommodate the tag values. 2022-11-01 13:49:02 +08:00
Haojun Liao c17a921a03 fix(query): set the correct buffer to accommodate the tag values. 2022-10-31 23:19:40 +08:00
Liu Jicong 2e640c38a2 refactor: stream and tmq message 2022-10-31 18:37:28 +08:00
slzhou bc0f120fb0 fix: set values before add it to array 2022-10-25 14:16:31 +08:00
slzhou 211ab7f367 fix: set var meta length to data length when decode data block 2022-10-25 13:34:51 +08:00
Cary Xu 4f5a38b786 fix: null column value when build rsma result 2022-10-22 18:01:43 +08:00
Cary Xu 951d110b3b fix: coverity scan for trow 2022-10-20 09:31:17 +08:00
Benguang Zhao 00a066443f Merge branch '3.0' into FIX/TD-19593-3.0 2022-10-19 09:38:36 +08:00
Benguang Zhao 3b0968d7f9 enh: enable the -Wformat=2 compiler option 2022-10-19 09:24:15 +08:00
54liuyao 8efd7e8763 feat(stream):replace disk buff 2022-10-18 18:13:47 +08:00
Liu Jicong fbfae317b3 refactor 2022-10-11 02:09:15 +08:00
Liu Jicong 57d1406096 add tbname column into stream special block 2022-10-09 22:49:37 +08:00
Liu Jicong 2f9aeeb5fc feat(stream): support define table name 2022-10-09 16:54:27 +08:00
54liuyao 3a21da6e46 fix(stream): data block capacity and function byte 2022-09-22 15:54:44 +08:00
Haojun Liao 01adee2f53 fix(query): add an assert 2022-09-19 14:36:55 +08:00
Haojun Liao 597ea1c2bf fix(query): add value check. 2022-09-04 11:58:02 +08:00
Liu Jicong d653da7971 feat(stream): support delete data 2022-09-02 15:46:41 +08:00
wade zhang 2ad31384f6
Merge pull request #15818 from taosdata/feature/TD-14761
feat: get meta and data from tmq using snapshot
2022-08-29 09:49:35 +08:00
slzhou f3890f7421 feat: support udf merge in udfd 2022-08-26 14:27:15 +08:00
wangmm0220 44ce4f1cf3 Merge branch '3.0' of https://github.com/taosdata/TDengine into feature/TD-14761 2022-08-18 10:45:45 +08:00
wangmm0220 78c9f245b1 fix:conflicts from 3.0 2022-08-16 15:18:11 +08:00
wangmm0220 61a19b80d7 Merge branch '3.0' into feature/3.0_query_optimize 2022-08-12 14:41:08 +08:00
wangmm0220 eec58b8ef0 opti:use suid+uid->tags index to optimize time cost 2022-08-12 13:53:24 +08:00
Cary Xu d9c10a2f0f other: rsma submit 2022-08-11 19:59:47 +08:00
Cary Xu d71e238d48 fix: code optimization 2022-08-11 15:25:31 +08:00
Cary Xu 113b29ed12 fix: taos array get pointer 2022-08-11 15:03:10 +08:00
Cary Xu 6cd2e52d1a enh: code optimization 2022-08-11 14:43:17 +08:00
Cary Xu 15544a2207 enh: rsma fetch 2022-08-11 11:14:31 +08:00
wangmm0220 e039334792 opti: logic in get table list 2022-08-10 20:18:54 +08:00
Haojun Liao 41d2c92231 fix(query): copy null value. 2022-08-09 16:54:05 +08:00
Xiaoyu Wang 07ef00e89f merge 3.0 2022-08-09 11:36:08 +08:00
Haojun Liao 4d8842c21f other:merge 3.0 2022-08-08 16:37:37 +08:00
Haojun Liao 200a669542 refactor: do some internal refactor. 2022-08-08 16:34:11 +08:00
Cary Xu 0aac37a45c enh: rsma fetch logic optimization 2022-08-08 11:25:32 +08:00
wangmm0220 9f9788c205 Merge branch '3.0' into feature/TD-14761 2022-08-08 10:04:03 +08:00
wangmm0220 1309c489e2 fix:error in tmq for snapshot 2022-08-06 19:31:53 +08:00
54liuyao 214d3609b2 fix(stream):set num of stream session child 2022-08-06 15:14:11 +08:00
Haojun Liao 0e4748771a enh(query): support combine multi datablock to pass to upstream operators 2022-08-05 14:10:45 +08:00
Haojun Liao 3a5fcefc8d other: merge 3.0 2022-08-04 17:24:51 +08:00
Cary Xu f1790b2776 enh: adjust numOfRows in SubmitBlk from int16_t to int32_t 2022-08-03 21:03:27 +08:00
Haojun Liao 4cd7af0ecf other: merge 3.0 2022-08-03 19:02:43 +08:00
Cary Xu a3166507a5 enh: don't read bitmap when all col is normal 2022-08-03 15:58:28 +08:00
Cary Xu 99cb9bb60e
Merge pull request #15687 from taosdata/feature/TD-11274-3.0
fix: handle rsma resource leak
2022-08-02 20:42:38 +08:00
Shengliang Guan 590266067b
Merge pull request #15680 from taosdata/fix/dnode
refactor: adjust logs
2022-08-02 19:37:07 +08:00
Cary Xu cecec01b75 fix: handle rsma resource leak 2022-08-02 19:21:27 +08:00
Shengliang Guan 56f2e49764 refactor: adjust logs 2022-08-02 17:12:07 +08:00
Cary Xu 602d2aa377 other: rsma snapshot and misc update 2022-08-02 16:13:36 +08:00
Haojun Liao bb869800f6
Merge pull request #15661 from taosdata/feature/3_liaohj
refactor: optimize the build block perf.
2022-08-02 13:04:00 +08:00
54liuyao fdcf9f1aa6 feat(stream):add log 2022-08-02 10:56:02 +08:00
54liuyao fbf83d06a8 feat(stream): add log 2022-08-02 09:52:54 +08:00
Haojun Liao bbcba1855d Merge branch '3.0' into feature/3_liaohj 2022-08-01 20:09:42 +08:00
Haojun Liao fe6772f940 refactor: do some internal refactor. 2022-08-01 20:09:10 +08:00
54liuyao b3d104349f feat(stream):optimize stream update scan 2022-08-01 17:09:46 +08:00
Haojun Liao 24218752ab refactor: optimize tablescan perf. 2022-08-01 16:41:14 +08:00
Haojun Liao a2a2dbd68a refactor: optimize the build block perf. 2022-08-01 13:11:32 +08:00
Haojun Liao 4b4cc03fc6
Merge pull request #15581 from taosdata/feature/3_liaohj
fix(query): fix memory leak.
2022-07-30 14:00:15 +08:00
Haojun Liao ed57347579 fix(query): fix memory leak. 2022-07-30 11:30:31 +08:00
Cary Xu 466e7965ed feat: rsma1/rsma2 support replication 2022-07-30 00:38:11 +08:00
Cary Xu 0dcb3a5da1 fix: assign uid for rsma by physical plan 2022-07-28 17:07:47 +08:00
54liuyao 35ddd56691 feat(stream): refector some log 2022-07-26 09:55:21 +08:00
Cary Xu 135d2673d6 fix: add data len for multiple rows 2022-07-25 14:50:13 +08:00
Haojun Liao 72574b69de test: update the block merge. 2022-07-23 14:09:26 +08:00
Haojun Liao b9b53f04c1 fix(query):ignore null type. 2022-07-23 13:18:36 +08:00
Haojun Liao 72bbc27e8c fix(query): remove the invalid update ops. 2022-07-22 10:50:54 +08:00
Haojun Liao 0c326410fd fix(query): set value for varchar type in fill and check for null ptr before cleanup. 2022-07-21 16:54:07 +08:00
Haojun Liao 8e42bf85e8 fix(query): fix border check. 2022-07-21 15:47:22 +08:00
Ganlin Zhao e5aadc9323 Merge branch '3.0' into fix/TD-17381 2022-07-18 17:34:28 +08:00
Ganlin Zhao 1ab22f9d9e fix(query): fix taosd crashed when using first(col+null)
TD-17381
2022-07-18 17:29:40 +08:00
afwerar fa96e64ee0 os: win format negative timestamp error 2022-07-18 16:53:20 +08:00
Haojun Liao ad058e8c97 Merge branch '3.0' into feature/3_liaohj 2022-07-17 11:06:49 +08:00
Haojun Liao f0d1f393fd fix(query): add limit/offset implementation in exchange operator. 2022-07-16 23:24:59 +08:00
54liuyao 069778c676 feat(stream): add log 2022-07-16 17:32:40 +08:00
54liuyao 352db0febb feat(stream): optimize interval plan 2022-07-16 09:28:15 +08:00