Commit Graph

2285 Commits

Author SHA1 Message Date
Liu Jicong 5ee7e7aed9 fix: init tsdb read snap 2023-01-04 17:55:00 +08:00
Minglei Jin 625bf9992f
Merge branch '3.0' into fix/long_query 2023-01-04 15:15:51 +08:00
Xiaoyu Wang 9df6f69371 merge 3.0 2023-01-04 15:02:31 +08:00
Shengliang Guan e2056ba8fb Merge branch 'main' into FIX/TD-21043-main 2023-01-04 11:48:35 +08:00
Xiaoyu Wang fdde287ca9 merge main 2023-01-04 11:43:20 +08:00
Hongze Cheng 0a085da032 enh: use diff atomic op 2023-01-04 09:35:48 +08:00
Shengliang Guan 34260cd397 Merge branch 'main' into FIX/TD-21043-main 2023-01-04 09:29:07 +08:00
Minglei Jin b020383046 fix(tsdb): comment qlist out to please CI 2023-01-03 18:30:50 +08:00
Hongze Cheng c6a71a4b66 more code 2023-01-03 18:29:30 +08:00
Hongze Cheng 5e579398e8 more code 2023-01-03 18:16:52 +08:00
Minglei Jin 07f16b1660 Merge branch 'v3.0' into fix/long_query 2023-01-03 17:21:10 +08:00
Hongze Cheng 1567fe2f67 fix: skiplist concurrent access 2023-01-03 17:19:19 +08:00
Alex Duan b68e440cc2 feat: support total vgroups count for table 2023-01-03 14:13:51 +08:00
Hongze Cheng 9fd2ac0b4c add log 2023-01-03 11:57:25 +08:00
Minglei Jin e4e72dd9e9 fix(tsdb/read): new tsdbReleaseDataBlock api from release reader's lock 2023-01-03 09:43:29 +08:00
Hongze Cheng 4936eb5b2c more code 2022-12-30 16:55:49 +08:00
Minglei Jin d3c97947f3 fix(tsdb/read): use int32_t instead of size_t for taosHashGetSize 2022-12-30 16:04:18 +08:00
Hongze Cheng 835c42e5c7 more code 2022-12-30 15:40:13 +08:00
Hongze Cheng 47d493e851 more code 2022-12-30 14:49:55 +08:00
Hongze Cheng 38b4c5c14a more code 2022-12-30 14:20:55 +08:00
Hongze Cheng 112a6b833a more code 2022-12-29 17:57:23 +08:00
Minglei Jin 2ed9c19da4 Merge branch 'v3.0' into fix/long_query 2022-12-29 17:43:51 +08:00
Hongze Cheng 6f947af8cc more code 2022-12-29 17:40:55 +08:00
Hongze Cheng 3aa1f8ca90 more code 2022-12-29 16:34:41 +08:00
Hongze Cheng 01f6823bc1 more code 2022-12-29 15:46:17 +08:00
Benguang Zhao d307413c36 Merge branch 'main' into FIX/TD-21043-main 2022-12-29 10:03:17 +08:00
Hongze Cheng de6be90cb5 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/vnode_compact 2022-12-29 10:00:47 +08:00
Hongze Cheng de82f3a806 more code 2022-12-29 09:59:28 +08:00
Hongze Cheng 6f30871fd6 more code 2022-12-29 09:10:57 +08:00
Shengliang Guan 78c14a2c88 Merge remote-tracking branch 'origin/3.0' into merge/mainto3.0_1228 2022-12-28 14:59:02 +08:00
Hongze Cheng e0e7cc4f87 more code 2022-12-28 14:21:06 +08:00
Hongze Cheng a0fa31954c Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/vnode_compact 2022-12-28 13:53:59 +08:00
Hongze Cheng a21fbd05e4 more code 2022-12-28 13:37:22 +08:00
Hongze Cheng a09b5b8b5e more code 2022-12-27 17:58:37 +08:00
Hongze Cheng 1427f9218c more code 2022-12-27 16:59:52 +08:00
Shengliang Guan c844922aef
Merge pull request #19172 from taosdata/feature/3_liaohj
refactor: do some internal refactor.
2022-12-27 16:07:23 +08:00
Hongze Cheng 3b3b8d4f9a more code 2022-12-27 15:19:35 +08:00
Benguang Zhao 137e7d009d fix: update nextRowIterGet of tsdbCache 2022-12-26 20:52:42 +08:00
Hongze Cheng 5abaf4409d mroe code 2022-12-26 17:12:08 +08:00
Hongze Cheng 53226eae7c more code 2022-12-26 16:23:33 +08:00
Haojun Liao 8a4fb244fb fix(query): fix coverity issues. 2022-12-26 14:20:05 +08:00
Haojun Liao f54f6201be fix(query): fix coverity issues. 2022-12-26 14:07:22 +08:00
Haojun Liao 9107c3149b fix(query): fix syntax error. 2022-12-26 13:49:16 +08:00
Haojun Liao 1a07451bc3 refactor: do some internal refactor. 2022-12-26 13:45:25 +08:00
Hongze Cheng d15453eb4e more code 2022-12-26 13:28:23 +08:00
Haojun Liao 723efba79b
Merge branch '3.0' into refact/submit_req 2022-12-26 13:25:25 +08:00
Hongze Cheng b000fb09ba Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/vnode_compact 2022-12-26 13:17:30 +08:00
Haojun Liao a5165ab5e7 refactor: do some internal refactor. 2022-12-26 10:58:17 +08:00
Haojun Liao fbc9e77004
Merge branch '3.0' into refact/submit_req 2022-12-26 10:26:17 +08:00
Hongze Cheng 8135efb541 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/vnode_compact 2022-12-26 09:28:00 +08:00
Shengliang Guan 028cc52846
Merge pull request #19116 from taosdata/feature/3_liaohj
refactor: do some internal refactor.
2022-12-26 09:12:35 +08:00
kailixu 9c9c263ace chore: rsma query debug log 2022-12-26 01:22:43 +08:00
kailixu ed3a0c1dc1 chore: vgId format uniform 2022-12-24 23:44:01 +08:00
kailixu 4f25c0f7d3 Merge branch '3.0' into feature/TD-19148-D 2022-12-24 00:59:35 +08:00
Haojun Liao 1edf1e1799 refactor: do some internal refactor. 2022-12-23 23:02:40 +08:00
Xiaoyu Wang 0c269c317b merge 3.0 2022-12-23 17:50:05 +08:00
Haojun Liao 224f5a72c2 refactor: do some internal refactor. 2022-12-23 17:45:12 +08:00
dapan1121 d39e34ce7c
Merge pull request #19071 from taosdata/fix/TS-2276-main
Fix(tsdb): table block distributed totalSize is zero
2022-12-23 11:54:13 +08:00
Shengliang Guan 0ea1d145d5
Merge pull request #19101 from taosdata/feature/3_liaohj
fix(query): set start row index for desc scan.
2022-12-23 11:02:42 +08:00
Haojun Liao ff01a0d2b5 fix(query): remove todo 2022-12-23 09:42:55 +08:00
Haojun Liao 884f9dfee1 fix(query): set start row index for desc scan. 2022-12-23 00:56:03 +08:00
Haojun Liao c2f6d4ab77 fix(query): add some logs. 2022-12-23 00:16:15 +08:00
Shengliang Guan 2668def457
Merge pull request #19076 from taosdata/feature/3_liaohj
fix(query): add lock for cache.
2022-12-22 20:12:50 +08:00
wangmm0220 fd76fdb9e0 opti:taosx for write_raw_block 2022-12-22 16:50:21 +08:00
Haojun Liao 8210c49a85 fix(query): fix memory leak. 2022-12-22 15:47:02 +08:00
Hongze Cheng ecca2fc0b0 more code 2022-12-22 15:18:41 +08:00
Hongze Cheng 3278c11491 more code 2022-12-22 15:02:39 +08:00
Shengliang Guan 2454cf0c5d
Merge pull request #19058 from taosdata/release/ver-3.0.2.1
release: build 3.0.2.1
2022-12-21 21:00:33 +08:00
Alex Duan 950529d148 fix(query): show distributed table modify average calc ++ 2022-12-21 19:03:48 +08:00
Shengliang Guan 46df0e8dd1
Merge pull request #19067 from taosdata/feature/3_liaohj
fix(query): update the blockInfo
2022-12-21 17:57:52 +08:00
Alex Duan 8dfbcc5a83 fix(query): getFileBlockDistInfo totalSize set use index 0 2022-12-21 17:19:00 +08:00
Alex Duan ebf35651f3 fix(query): getFileBlockDistInfo totalSize set 2022-12-21 17:01:59 +08:00
Haojun Liao d5a770c98a fix(query): add comment. 2022-12-21 16:25:18 +08:00
Haojun Liao d1b85f893e fix(query): update the blockInfo 2022-12-21 16:24:37 +08:00
Hongze Cheng 5ab1cba45e Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/vnode_compact 2022-12-21 14:36:36 +08:00
Hongze Cheng a8eb32da9f more code 2022-12-21 14:36:12 +08:00
yihaoDeng a68b8fc43e set mergeTree sst trigger to Max 2022-12-20 17:11:22 +08:00
Shengliang Guan 41dcd32b8e refact: adjust some logs 2022-12-20 15:01:03 +08:00
Hongze Cheng 1edb6d5b4d more code 2022-12-19 15:23:12 +08:00
Haojun Liao fdade6d6a3
Merge branch '3.0' into refact/submit_req 2022-12-19 11:24:00 +08:00
Hongze Cheng 4772f2a296 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/vnode_compact 2022-12-19 10:11:23 +08:00
Shengliang Guan 2e2e227dbe fix: remove invalid assert 2022-12-18 19:59:17 +08:00
Shengliang Guan cb8cd5f733 Merge branch 'main' into fix/td-21029 2022-12-15 19:24:16 +08:00
Hongze Cheng a481e8fa5e more code 2022-12-15 16:03:56 +08:00
Hongze Cheng 66aefc392f more code 2022-12-15 09:50:02 +08:00
Haojun Liao b5f611328a fix(query): add check for blockdata. 2022-12-14 20:31:21 +08:00
Hongze Cheng c0b2ff9c62 more code 2022-12-14 15:23:01 +08:00
Shengliang Guan 04750d9078
Merge pull request #18905 from taosdata/feature/3_liaohj
refactor: do multiple refactor and improve some query perf.
2022-12-14 08:01:42 +08:00
kailixu 2a1f5df28e Merge branch '3.0' into feature/TD-19148-D 2022-12-12 19:12:12 +08:00
Haojun Liao 48f7fc5c3d
Merge branch '3.0' into refact/submit_req 2022-12-12 18:11:17 +08:00
Haojun Liao ba50a7c30d refactor(query): add additional attribute to denote if current block has already loaded data. 2022-12-12 14:25:26 +08:00
Shengliang Guan 9e8f4f5e71
Merge pull request #18862 from taosdata/feature/3_liaohj
fix(query): return with error code if the table does not exist
2022-12-10 15:56:30 +08:00
Haojun Liao eeefd1a4b5 fix(query): does not return error code if queried table does not exists. 2022-12-10 14:35:56 +08:00
Haojun Liao 44dc2564eb fix(query): return with error code if the table does not exist during creating tsdbReader 2022-12-09 21:07:03 +08:00
Hongze Cheng 7b20c09f34 more code 2022-12-09 16:19:49 +08:00
Minglei Jin c22fa53bc4 fix: release lock and memory in exceptional cases 2022-12-09 10:22:43 +08:00
Haojun Liao 27ebafdbaa other: merge 3.0 2022-12-09 10:19:05 +08:00
Hongze Cheng 24ee499670 fix: coredump 2022-12-08 21:38:08 +08:00
Hongze Cheng 1b433cac0c fix tsdb snapshot problem 2022-12-08 17:44:47 +08:00
dapan1121 311365ea6f
Merge pull request #18762 from taosdata/fix/TD-20929
fix:read the deleted data
2022-12-08 17:21:41 +08:00
kailixu fb265ff9ba Merge branch '3.0' into feature/TD-19148-D 2022-12-08 16:28:04 +08:00
54liuyao 6c9d6e2aa8 fix:read the deleted data 2022-12-08 15:42:37 +08:00
Shengliang Guan fc0412b69a
Merge pull request #18791 from taosdata/fix/TD-20964-3.0
fix: update diskId when migrate DFileSet
2022-12-08 13:58:29 +08:00
kailixu 399dace80f chore: code format optimization 2022-12-08 12:00:04 +08:00
kailixu 5ca21df5d0 Merge branch '3.0' into fix/TD-20964-3.0 2022-12-08 11:59:21 +08:00
Minglei Jin 04948080bc tsdb/cache-read: release lru handle in case table's empty 2022-12-08 11:06:16 +08:00
Minglei Jin 1a066d19f7 fix: dismiss coverity issues 2022-12-08 10:55:08 +08:00
Hongze Cheng 058ea5871c fix: memory bug 2022-12-08 10:50:52 +08:00
kailixu 35e67b3fb4 Merge branch '3.0' into feature/TD-19148-D 2022-12-08 09:14:25 +08:00
dapan1121 5b21a2394c
Merge pull request #18779 from taosdata/fix/TD-20958-3.0
fix(query): ensure the SMA  SArray*  capacity is enough big to save all the columns for scanning
2022-12-08 09:13:04 +08:00
kailixu 2d75447bb2 fix: update diskId when migrate DFileSet 2022-12-08 02:11:39 +08:00
Shengliang Guan 6d94afe48f
Revert "refact: adjust some assert cases" 2022-12-07 21:51:17 +08:00
kailixu 04f785315e Merge branch '3.0' into feature/TD-19148-D 2022-12-07 21:16:36 +08:00
Haojun Liao d3aa0be66e fix(query): add duplicated row merge for column format data in memory. 2022-12-07 20:36:42 +08:00
Shengliang Guan 4172acf95d git lo 2022-12-07 19:39:53 +08:00
Shengliang Guan d5126d469a refact: replcase ASSERT with tAssert 2022-12-07 18:42:48 +08:00
Haojun Liao 35d13a91c2 fix(query): enable merge duplicated rows. 2022-12-07 18:40:18 +08:00
Shengliang Guan f69a188f7e refact: replcase ASSERT with tAssert 2022-12-07 18:37:40 +08:00
Alex Duan cc285d4900 fix(query): SMA ensure support info pColAgg capacity over column numfor this table 2022-12-07 18:00:32 +08:00
Alex Duan 15b8b28972 fix(query): SMA ensure support info pColAgg capacity over column numfor this table 2022-12-07 17:52:49 +08:00
Hongze Cheng a4549b00de fix: retention 2022-12-07 15:11:37 +08:00
Minglei Jin 1e23f80597 tsdb/cache: use empty array as negative entry to empty table's last/lr 2022-12-07 14:34:38 +08:00
Hongze Cheng c0494b6453 fix another memory problem 2022-12-07 10:21:01 +08:00
Hongze Cheng 046174656c fix: an insert error 2022-12-07 09:25:00 +08:00
Hongze Cheng 2d85c7c451 Merge branch '3.0' of https://github.com/taosdata/TDengine into refact/submit_req 2022-12-07 09:04:00 +08:00
kailixu 6b30410339 Merge branch '3.0' into feature/TD-19148-D 2022-12-06 19:26:00 +08:00
Hongze Cheng ca84805cfc fix interpolation corner case 2022-12-06 17:22:58 +08:00
Haojun Liao 78aea791df fix(query): remove invalid free. 2022-12-06 16:38:31 +08:00
Hongze Cheng 259b7e8a8a fix compile issue 2022-12-06 14:53:02 +08:00
Hongze Cheng 899d7b0bcc Merge branch '3.0' of https://github.com/taosdata/TDengine into refact/submit_req 2022-12-06 14:37:22 +08:00
Haojun Liao 68273aef52 Merge branch '3.0' into feature/3_liaohj 2022-12-06 10:36:32 +08:00
Liu Jicong 619bbdfd82 refactor: support submitreq2 2022-12-06 05:58:28 +08:00
Haojun Liao 114943ddb0 fix(query): set the correct flag when no neighbors exist. 2022-12-05 22:28:26 +08:00
Haojun Liao d5b493677b fix(query): set column sma into the correct position. 2022-12-05 20:39:37 +08:00
Haojun Liao 9e04f42635 fix(query): check for neighbor block when merging data block. 2022-12-05 20:20:48 +08:00
Haojun Liao 136937d69a fix(query): insert null column sma firstly. 2022-12-05 17:05:07 +08:00
kailixu 64e907b993 Merge branch '3.0' into feature/TD-19148-D 2022-12-05 12:12:02 +08:00
dapan1121 da74ede563
Merge pull request #18679 from taosdata/fix/TD-20904-3.0
fix: tsdb do retention fix
2022-12-05 09:50:25 +08:00
kailixu cf4ef434ee Merge branch '3.0' into feature/TD-19148-D 2022-12-05 06:56:27 +08:00
kailixu 8bc95dcb10 Merge branch '3.0' into feature/TD-19148-D 2022-12-04 17:54:17 +08:00
kailixu 9b9ebea6f5 fix: tsdb do retention fix 2022-12-04 17:49:37 +08:00
Hongze Cheng 2a20347210 add more code 2022-12-04 15:14:04 +08:00
Hongze Cheng df6eb27b75 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/async_commit 2022-12-04 14:51:05 +08:00
Hongze Cheng f78efdac7e fix asan error 2022-12-04 14:50:58 +08:00
Shengliang Guan af3bd5bc9a
Merge pull request #18670 from taosdata/fix/liao_cov
enh(query): avoid repeatly load del file.
2022-12-04 13:20:14 +08:00
Haojun Liao 0d687a533e fix(query): check for null ptr. 2022-12-04 11:35:54 +08:00
Hongze Cheng d977929c99 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/async_commit 2022-12-04 09:37:29 +08:00
Haojun Liao fca20668f5 fix(query): check for 0 tables in tsdbreader 2022-12-03 23:52:38 +08:00
Haojun Liao 803762c4e0 enh(query): avoid repeatly load del file. 2022-12-03 22:57:00 +08:00
kailixu 11684ceb82 refact: resource mgmt when build block for rsma 2022-12-03 15:00:40 +08:00
kailixu 184f0cf0f2 Merge branch 'refact/submit_req' into refact/TD-20895-3.0 2022-12-03 13:41:36 +08:00
kailixu d3a88ea517 refactor: row and submit msg of rsma/tsdb 2022-12-03 13:33:30 +08:00
Shengliang Guan d9c261cd13 refact: remove some error codes 2022-12-03 10:17:02 +08:00
Shengliang Guan 6d70f48802
Merge pull request #18592 from taosdata/feature/3_liaohj
enh(query): optimize query perf.
2022-12-02 21:00:35 +08:00
Haojun Liao 8152541998 fix(query): set correct tsrow index. 2022-12-02 18:16:12 +08:00
Minglei Jin 55fb892e70 fix(tsdb/cache): use lru erase to invalidate cache entries 2022-12-02 17:53:16 +08:00
Haojun Liao 27ed740eb5 refactor: do some internal refactor. 2022-12-02 17:52:49 +08:00
Haojun Liao 42a512c39f refactor: do some internal refactor. 2022-12-02 15:52:32 +08:00
Hongze Cheng 129c692f3e more async commit 2022-12-02 15:44:24 +08:00
Hongze Cheng 2cfdf7bf62 finish more code 2022-12-02 14:24:23 +08:00
Hongze Cheng 5b83fcc1fc optimize by interpolation search 2022-12-02 14:04:24 +08:00
Haojun Liao 5bb0c8f9c0 Merge branch 'refact/submit_req' of github.com:taosdata/tdengine into refact/submit_req 2022-12-02 11:41:01 +08:00
Haojun Liao 6d9e229a72 refactor: fix the in-memory row merge. 2022-12-02 11:40:03 +08:00
Hongze Cheng 4828a19e10 more code 2022-12-02 10:42:34 +08:00
kailixu da8a337c94 Merge branch '3.0' into feature/TD-19148-D 2022-12-01 21:44:00 +08:00
kailixu 9b4c881106 chore: rsma logic optimization 2022-12-01 21:43:42 +08:00
Haojun Liao 24614d03bd fix(query): set correct sma retrieve procedure. 2022-12-01 21:35:01 +08:00
Hongze Cheng f8b18c4f18 fix some code 2022-12-01 20:48:55 +08:00
Haojun Liao efcc3b06bb fix(query): fix memory leak. 2022-12-01 20:01:09 +08:00
Haojun Liao 8c62d5f9fa fix(query): fix bug in tsdbread. 2022-12-01 18:34:26 +08:00
Haojun Liao f8a2ab8338 refactor: do some internal refactor. 2022-12-01 17:24:26 +08:00
Hongze Cheng 6dcdafa486 more code 2022-12-01 17:00:33 +08:00
Hongze Cheng bd56fd2e09 Merge branch '3.0' of https://github.com/taosdata/TDengine into refact/submit_req 2022-12-01 16:52:12 +08:00
Hongze Cheng 69617030fa more code 2022-12-01 16:51:36 +08:00
Hongze Cheng 78beb8f4f1 more code 2022-12-01 16:36:25 +08:00
Hongze Cheng 3700f0dc8e more code 2022-12-01 16:19:21 +08:00
Hongze Cheng 0525b4fa0d more code 2022-12-01 15:36:10 +08:00
Hongze Cheng 73f8dc6a5b more code 2022-12-01 14:24:10 +08:00
Hongze Cheng 915e9a8ae2 adjust more code 2022-12-01 13:39:59 +08:00
Hongze Cheng 7765f542d3 more code 2022-12-01 11:53:29 +08:00
Hongze Cheng fc50d94156 more coe 2022-12-01 11:45:26 +08:00
Hongze Cheng 5347eb4dec more code 2022-12-01 10:31:44 +08:00
Haojun Liao cefe4be1ab refactor: do some internal refactor. 2022-12-01 00:34:06 +08:00
Benguang Zhao 55bae49d56 Merge branch 3.0 to FIX/TD-19334-3.0 2022-11-30 23:47:30 +08:00
Hongze Cheng 86b0dc98c3 Merge branch '3.0' of https://github.com/taosdata/TDengine into refact/submit_req 2022-11-30 21:17:51 +08:00
Hongze Cheng f67b516241 more code 2022-11-30 21:17:34 +08:00
Hongze Cheng 6b636ae1ad fix and more dev 2022-11-30 20:14:16 +08:00
Hongze Cheng 4b5671a631 Merge branch '3.0' of https://github.com/taosdata/TDengine into refact/submit_req 2022-11-30 19:28:52 +08:00
Haojun Liao 124fb5fc50 refactor: do some internal refactor. 2022-11-30 17:52:12 +08:00
Haojun Liao 3f0c93a623 enh(query): optimize query perf. 2022-11-30 14:53:25 +08:00
Haojun Liao e45023f3e9 fix(query): add an null ptr checking before copying memory. 2022-11-30 12:23:08 +08:00
Hongze Cheng f5270f6a0c adjust api 2022-11-30 10:30:03 +08:00
Haojun Liao 445c4f28f0 enh(query): optimize the perf. 2022-11-29 23:34:22 +08:00
Benguang Zhao 470441c541 Merge branch 3.0 to FIX/TD-19334-3.0 2022-11-29 18:24:01 +08:00
Hongze Cheng 25ec924c91 more code 2022-11-29 17:29:49 +08:00
Hongze Cheng 49e7c002bb refact more code 2022-11-29 16:37:48 +08:00
Hongze Cheng 882d421215 adjust more code 2022-11-29 16:02:33 +08:00
Hongze Cheng 4f8031821b make it pass compile 2022-11-28 16:45:15 +08:00
Hongze Cheng 086b2d58c2 refact more code 2022-11-28 16:41:35 +08:00
Hongze Cheng f812957d3a Merge branch '3.0' of https://github.com/taosdata/TDengine into refact/submit_req 2022-11-28 16:35:28 +08:00
Hongze Cheng 37239ffaea more code 2022-11-28 15:37:47 +08:00
Benguang Zhao dc2dcea3de Merge branch 3.0 to FIX/TD-19334-3.0 2022-11-28 14:27:10 +08:00
Benguang Zhao 8475aaaaf1 enh: add ASSERT info msg in tsdbStartCommit 2022-11-28 13:48:57 +08:00
Hongze Cheng 0f8016995c more code 2022-11-28 13:41:06 +08:00
Haojun Liao 6e81e8cc73 refactor: do some internal refactor. 2022-11-28 12:32:40 +08:00
Haojun Liao 0948216ca9 fix(query): fix dead lock. 2022-11-26 21:13:34 +08:00
Benguang Zhao 68f8ebac9d Merge branch 3.0 to FIX/TD-19334-3.0 2022-11-25 13:10:06 +08:00
Haojun Liao 9a208b2d09 other: merge 3.0 2022-11-24 17:08:15 +08:00
Shengliang Guan 335a572d86
Revert "Revert "enh: row optimize2"" 2022-11-24 10:12:25 +08:00
Hongze Cheng ffbb04d40a
Revert "enh: row optimize2" 2022-11-24 09:21:26 +08:00
Shengliang Guan 7f4a14fbb7
Merge pull request #18369 from taosdata/szhou/fixbugs
fix: build data from mem/imem first when large nchar column incur …eBlockShouldLoad since SDataBlockToLoadInfo.moreThanCapacity
2022-11-24 08:24:41 +08:00
Hongze Cheng df5bcae11b more code 2022-11-23 15:45:19 +08:00
slzhou 9a85050ff3 fix: direct return file block only rows <= capacity 2022-11-23 15:43:57 +08:00
slzhou c1ba62b26f fix: build from buf first when buf data is in block gap and only capacity caused load 2022-11-23 14:52:07 +08:00
Hongze Cheng 6e23c8cdb3 more code 2022-11-23 10:45:58 +08:00
Hongze Cheng 2313ebc648 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/row_optimize 2022-11-23 09:36:31 +08:00
slzhou 0161374a8b Merge branch '3.0' of github.com:taosdata/TDengine into szhou/fixbugs 2022-11-22 22:59:06 +08:00
slzhou 272a161a61 fix: build data from mem/imem first when large nchar column incur fileBlockShouldLoad since SDataBlockToLoadInfo.moreThanCapacity 2022-11-22 22:06:39 +08:00
Shengliang Guan d588cd37f8
Merge pull request #18357 from taosdata/fix/liao_cov
fix(query): fix memory leak.
2022-11-22 20:49:33 +08:00
Haojun Liao 7c7b2f1cef fix(query): fix memory leak. 2022-11-22 18:06:01 +08:00
Haojun Liao b70a616a2d refactor: do some internal refactor. 2022-11-22 15:27:33 +08:00
Haojun Liao 4d206fd3b2 refactor: do some internal refactor. 2022-11-22 14:59:17 +08:00
Haojun Liao 93ad9e9d3d refactor: do some internal refactor. 2022-11-22 14:29:30 +08:00
Hongze Cheng cede9e14da Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/row_optimize 2022-11-22 13:54:40 +08:00
dapan1121 44462ef869
Merge pull request #18321 from taosdata/szhou/fixbugs
fix: fix error for select count(c2),count(ts) from table caused by null ts column aggregation
2022-11-22 13:17:11 +08:00
Haojun Liao 0af77e6ae2 refactor: do some internal refactor. 2022-11-22 12:43:00 +08:00
Hongze Cheng 390709e3c8 add interface 2022-11-22 12:37:47 +08:00
Haojun Liao fbb0a1e921 fix(query): set correct tsdbreader during the creation of tableblockscan info 2022-11-22 11:08:55 +08:00
Haojun Liao 56edf57c12 refactor: do some internal refactor. 2022-11-22 09:52:53 +08:00
slzhou bb51d3cac7 fix: fix error for select count(c2),count(ts) from table caused by invalid ts column aggregation 2022-11-21 23:11:00 +08:00
Haojun Liao 8fee089aaf refactor: do some internal refactor. 2022-11-21 22:48:25 +08:00
Haojun Liao 6d5a256774 fix(query): fix some memory leaks. 2022-11-21 22:40:20 +08:00
Benguang Zhao b90ee79623 fix: use syncLogBufferCommit in syncNodeOnLocalCmd 2022-11-21 13:51:01 +08:00
Hongze Cheng 593f694fdc Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/row_optimize 2022-11-21 09:27:25 +08:00
Hongze Cheng 23f7b67b8a fix: binary NONE + NULL commit coredump 2022-11-20 15:51:40 +08:00
Hongze Cheng a0dc7859ec Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/row_optimize 2022-11-20 10:12:38 +08:00
Minglei Jin 35b9dc6b6c meta: use meta cache to get uid's version instead of fetching from tdb 2022-11-18 17:07:19 +08:00
Hongze Cheng 93089916e4 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/row_optimize 2022-11-18 13:25:57 +08:00
Benguang Zhao 051b73c1ed Merge branch 3.0 to FIX/TD-19334-3.0 2022-11-17 17:28:11 +08:00
kailixu 6515c9c7c5 fix: real path optimization in case of invalid read 2022-11-17 10:56:24 +08:00
Haojun Liao a464053692 fix(query): set correct size of array list. 2022-11-17 00:46:06 +08:00
Haojun Liao 9c459a24e2 fix(query): fix memory leak. 2022-11-17 00:38:35 +08:00
Haojun Liao a54275a7b5 fix(query): support null columns sma optimization. 2022-11-16 23:46:59 +08:00
Hongze Cheng a5725b506c more code 2022-11-16 17:22:09 +08:00
Hongze Cheng 56db6e6630 fix: omit sma for all NONE/NULL column 2022-11-16 15:47:40 +08:00
Hongze Cheng aaef32ca69 refact code for further code change 2022-11-16 10:27:05 +08:00
Shengliang Guan 1312b9c785
Merge pull request #18125 from taosdata/fix/liao_cov
fix(query): fix errors found by asan.
2022-11-14 20:55:25 +08:00
Hongze Cheng 6aefbbf3b2 more optimize 2022-11-14 17:32:09 +08:00
Hongze Cheng 10921cc09a more opt 2022-11-14 17:13:22 +08:00
Haojun Liao cf56c38e7a fix(query): fix errors found by asan. 2022-11-14 17:10:25 +08:00
Hongze Cheng 5b51f97a48 more optimize 2022-11-14 16:52:39 +08:00
Cary Xu 08aaf97657 chore: code optimization 2022-11-11 19:11:06 +08:00
Cary Xu 0dcbe92006 fix: adjust the the varData offset of tp row 2022-11-11 19:04:54 +08:00
Cary Xu 97e83a905b fix: iter next column for kv row 2022-11-11 17:07:16 +08:00
Cary Xu 41a2b0e8ea chore: append kv row to block data 2022-11-11 16:01:41 +08:00
Hongze Cheng 74223b3467 more optimize 2022-11-11 15:22:13 +08:00
Hongze Cheng 5f97ea3ce1 perf: more optimize 2022-11-11 13:11:48 +08:00
Hongze Cheng f55292dd6d perf: optimize write 2022-11-11 10:00:40 +08:00
Cary Xu 65d9d2cd1e chore: code refactor for tsMaxKey definition 2022-11-10 15:58:16 +08:00
Cary Xu 69c1465142 Merge branch '3.0' into feat/TS-2007 2022-11-10 15:49:15 +08:00
Haojun Liao 9f5cf450de refactor: do some internal refactor. 2022-11-10 15:37:18 +08:00
Shengliang Guan 1a1ce767e2
Merge pull request #18011 from taosdata/fix/TS-2029
fix: skip empty data in delete file
2022-11-10 09:44:29 +08:00
stephenkgu 8d6f129154 fix: skip empty data in delete file 2022-11-10 08:14:21 +08:00
Shengliang Guan b067079d7a
Merge pull request #18007 from taosdata/feature/3_liaohj
refactor: do some internal refactor.
2022-11-10 08:12:36 +08:00
Cary Xu 25148268e6 enh: support wider range for future timestamp 2022-11-09 18:10:30 +08:00
Hongze Cheng 86ed5e5674 more optimize 2022-11-09 16:02:04 +08:00
Haojun Liao 411371ba48 refactor: do some internal refactor. 2022-11-09 14:16:21 +08:00
Haojun Liao 0c427b5f5b refactor: do some internal refactor. 2022-11-09 10:39:32 +08:00
Haojun Liao 68f2f92116 fix(query): fix the syntax errors. 2022-11-09 09:07:21 +08:00
Haojun Liao d238f387ce other: merge 3.0 2022-11-09 00:00:14 +08:00
Haojun Liao 663138ba1e enh(query): optimize the query perf. 2022-11-08 18:33:57 +08:00
dapan1121 d5874419ec
Merge pull request #17935 from taosdata/fix/TD-20246
fix: fix tsdbRead crash caused by reuse after free
2022-11-08 17:48:25 +08:00
Haojun Liao cc3e97da36 fix(query): fix an typo. 2022-11-08 17:41:29 +08:00
Haojun Liao 6e1a2b1e54 enh(query): improve the perf. 2022-11-08 17:38:09 +08:00
Haojun Liao f85d66f5ee enh(query): opt query perf. 2022-11-08 16:59:00 +08:00
Haojun Liao b0a54d3fab enh(query): improve the perf. 2022-11-08 14:54:42 +08:00
Hongze Cheng 7bba9996cf perf: optimize insert 2022-11-08 14:36:18 +08:00
Shengliang Guan 7a5be43d14
Merge pull request #17954 from taosdata/feature/stream
fix(stream): delete tb should be checked in write thread
2022-11-08 13:50:15 +08:00
Liu Jicong bc469f7f7b fix(stream): delete tb should be checked in write thread 2022-11-08 11:30:29 +08:00
Shengliang Guan dfbb958128
Merge pull request #17929 from taosdata/perf/sma_optimize
perf: optimize sma calculation
2022-11-08 10:03:12 +08:00
Ganlin Zhao d590a38d62 fix: fix tsdbRead crash caused by reuse after free
TD-20246
2022-11-07 17:36:58 +08:00
Hongze Cheng d52b8966fc perf: optimize block data operation 2022-11-07 16:56:35 +08:00
Hongze Cheng 70f7e3e379 perf: optimize sma calculation 2022-11-07 15:42:53 +08:00
Benguang Zhao 5878c9a31a fix: impl ring log buffer 2022-11-07 14:27:22 +08:00
Haojun Liao e3d0bc6bf7 other: merge 3.0. 2022-11-06 11:37:21 +08:00
Haojun Liao d200fe5145 refactor: do some internal refactor. 2022-11-06 01:34:04 +08:00
Shengliang Guan 8ce2e12423
Merge pull request #17886 from taosdata/feature/3_liaohj
fix(query): set the last key of each tablescan info
2022-11-04 18:46:17 +08:00
Shengliang Guan 8886785be1
Merge pull request #17853 from taosdata/fix/liao_cov
refactor(query): do some internal  refactor.
2022-11-04 15:58:11 +08:00
Haojun Liao 0315414623 other: merge 3.0 2022-11-03 19:03:09 +08:00
Haojun Liao 4959529127 fix(query): set the last key of each tablescan info 2022-11-03 19:00:13 +08:00
Minglei Jin 93190003a3 fix: reset last load info when close dataf reader for stt last files 2022-11-03 15:19:21 +08:00
Shengliang Guan e61829856a
Merge pull request #17852 from taosdata/fix/TD-20125
fix: set fs and last dataf reader to null when resetting
2022-11-03 11:31:34 +08:00
Haojun Liao 7a14bc05ea fix(query): fix some issues about the initialization of SColumnInfoData. 2022-11-03 10:57:05 +08:00
dapan1121 2bf5b0405d
Merge pull request #17851 from taosdata/enh/TD-19956
enh: optimize submit response message
2022-11-03 10:19:39 +08:00
Haojun Liao 9f5a0f01ea Merge branch '3.0' into fix/liao_cov 2022-11-03 10:02:23 +08:00
Haojun Liao 11c4878ca1 refactor(query): do some internal refactor. 2022-11-03 10:01:11 +08:00
Shengliang Guan 9de4bfb230
Merge pull request #17834 from taosdata/fix/liao_cov
fix(query): update the lastkey for each table during table scanning.
2022-11-03 09:29:55 +08:00
Minglei Jin 0bbe049e58 fix: set fs and last dataf reader to null when resetting 2022-11-03 09:14:51 +08:00
Haojun Liao fc20be8699 fix(query): get if the correct rows in last block exists, and set the correct flag to denote if the last blocks index have been loaded or not. 2022-11-02 22:27:23 +08:00
Ganlin Zhao 215257f7f1 fix: fix reverse table scan when checking if block from file overlap
with skyline deletion result error
2022-11-02 16:58:36 +08:00
dapan1121 ecfcf7054c enh: optimize submit response msg 2022-11-02 15:18:32 +08:00
Haojun Liao ecad94c419 fix(query): add one more check. 2022-11-02 14:59:34 +08:00
Haojun Liao f83b863cf9 fix(query): update the lastkey for each table during table scanning. 2022-11-02 14:36:00 +08:00
Haojun Liao c3ece576f2 Merge branch '3.0' into feature/3_liaohj 2022-11-02 09:13:13 +08:00
Haojun Liao 698ae90e5b fix(query): set correct value in hash map reset. 2022-11-01 23:37:51 +08:00
Haojun Liao b610b23981 fix(query): check for null value. 2022-11-01 21:47:12 +08:00
Haojun Liao 026b82145e Merge branch '3.0' into feature/3_liaohj 2022-11-01 18:49:51 +08:00
Haojun Liao 68db9b1cc9 fix(query): optimize the performance of tsdbread. 2022-11-01 18:48:57 +08:00
Minglei Jin 5ae5df1a17 Merge branch 'v3.0' into fix/long_query 2022-11-01 18:06:39 +08:00
Minglei Jin a5052eb2d5 fix: remove last stt load info resetting from fs iterator 2022-11-01 17:29:18 +08:00
Shengliang Guan d53ab62f00
Merge pull request #17797 from taosdata/fix/td_19618
fix: invalid read problem of tsdb path
2022-11-01 16:46:58 +08:00
Shengliang Guan 18f7d658d9
Merge pull request #17804 from taosdata/feature/3_liaohj
refactor: add some logs.
2022-11-01 16:46:24 +08:00
Minglei Jin ef606d3fd9 tsdb/read: first round long query for non-cache reading 2022-11-01 16:38:35 +08:00
Cary Xu 872085bef4 fix: add TD_PATH_MAX to support multi-platform 2022-11-01 15:18:26 +08:00
Haojun Liao cff5d9295e refactor: add some logs. 2022-11-01 15:00:02 +08:00
Cary Xu 65943b3712 chore: revert the code change 2022-11-01 14:51:37 +08:00
Haojun Liao b78249c548 other: merge 3.0 2022-11-01 13:52:08 +08:00
Haojun Liao 83495ed5d3 fix(query): set the correct buffer to accommodate the tag values. 2022-11-01 13:49:02 +08:00
Cary Xu 0b6d117121 fix: add TD_PATH_MAX to support multi-platform 2022-11-01 11:44:17 +08:00
Cary Xu 9f14c599f2 fix: add TD_PATH_MAX to support multi-platform 2022-11-01 10:49:27 +08:00
Cary Xu 64f07523e2 Merge branch '3.0' into fix/td_19618 2022-11-01 10:02:45 +08:00
Cary Xu 8a5f94d35c fix: set search key according to order 2022-10-31 20:03:21 +08:00
Haojun Liao f29127a15e ehn(query): do some internal refactor. 2022-10-31 18:04:58 +08:00
Haojun Liao 1fa5eafa8a ehn(query): keep the time window for each block to avoid repeatly parsing the compressed data block meta info. 2022-10-31 17:49:50 +08:00
Haojun Liao fac516a196 refactor: do some internal refactor. 2022-10-31 17:20:27 +08:00
Haojun Liao 9703ab510b enh(query): avoid parse the mapdata to improve the performance by keep the offset of each block. 2022-10-31 17:19:15 +08:00
Haojun Liao ba37a58192 enh(query): reduce the number of malloc. 2022-10-31 15:39:16 +08:00
Haojun Liao f38e9664f9 other:merge 3.0 2022-10-31 15:32:48 +08:00
Haojun Liao adf085ab46 refactor: do some internal refactor. 2022-10-31 14:17:57 +08:00
Haojun Liao f790d91b45 fix(query): check null before free resource, and some internal refactor. 2022-10-31 10:41:25 +08:00
Haojun Liao ab2c7c575b Merge branch '3.0' into feature/3_liaohj 2022-10-30 11:18:36 +08:00
Haojun Liao afdb1467b7 refactor: do some internal refactor. 2022-10-29 18:27:22 +08:00
Haojun Liao d583f1fab6 other: merge 3.0 2022-10-29 13:05:35 +08:00
Haojun Liao bae6d824c2 fix(query): init blockscanInfo correctly. 2022-10-29 12:54:39 +08:00
Haojun Liao 9b99c69785 fix(query): support partition by + limit push down. 2022-10-28 19:56:32 +08:00
Haojun Liao 4b2fa43dae
Revert "fix(query): handle partition by in table scan operator" 2022-10-28 18:05:19 +08:00
Haojun Liao d0a7a43e6f other:merge 3.0 2022-10-28 18:02:50 +08:00
Haojun Liao d103581eb8 Merge remote-tracking branch 'origin/fix/liao_cov' into fix/liao_cov 2022-10-28 17:59:20 +08:00
Haojun Liao 6c19e886df fix(query): move the init function for different reader. 2022-10-28 17:58:59 +08:00
Shengliang Guan 8a8aa3efea
Merge pull request #17723 from taosdata/enh/optQueryMem
enh: opt query mem
2022-10-28 17:09:17 +08:00
Haojun Liao 2c896012df fix(query): check status before add table uid in hash map. and do some other refactor. 2022-10-28 10:43:25 +08:00
Haojun Liao f25387018d
Merge pull request #17724 from taosdata/fix/liao_cov
fix(query): handle the case of the single block in last files.
2022-10-28 10:25:38 +08:00
Haojun Liao 70c3825ee5 fix(query): remove invalid check. 2022-10-28 09:12:40 +08:00
Haojun Liao 4774baa635 fix(query): handle the case of the single block in last files. 2022-10-27 22:43:42 +08:00
Haojun Liao e7b59ae56d fix(query): handle the case of the single block in last files. 2022-10-27 21:51:54 +08:00
yihaoDeng 9de0afc8ea opt mem 2022-10-27 21:22:36 +08:00
yihaoDeng 6a978be730 opt mem 2022-10-27 20:38:57 +08:00
Haojun Liao d8102fc8d8 fix(query): fix invalid number of tables check. 2022-10-27 18:58:10 +08:00
Haojun Liao a7ca29c627 other: merge 3.0 2022-10-27 18:04:28 +08:00
Haojun Liao 5a971dd03a fix(query): handle partition by in table scan operator with limit/offset value. 2022-10-27 16:58:32 +08:00