Commit Graph

833 Commits

Author SHA1 Message Date
Haojun Liao f85d66f5ee enh(query): opt query perf. 2022-11-08 16:59:00 +08:00
Haojun Liao b0a54d3fab enh(query): improve the perf. 2022-11-08 14:54:42 +08:00
Ganlin Zhao d590a38d62 fix: fix tsdbRead crash caused by reuse after free
TD-20246
2022-11-07 17:36:58 +08:00
Hongze Cheng d52b8966fc perf: optimize block data operation 2022-11-07 16:56:35 +08:00
Haojun Liao d200fe5145 refactor: do some internal refactor. 2022-11-06 01:34:04 +08:00
Haojun Liao 4959529127 fix(query): set the last key of each tablescan info 2022-11-03 19:00:13 +08:00
Haojun Liao 7a14bc05ea fix(query): fix some issues about the initialization of SColumnInfoData. 2022-11-03 10:57:05 +08:00
Shengliang Guan 9de4bfb230
Merge pull request #17834 from taosdata/fix/liao_cov
fix(query): update the lastkey for each table during table scanning.
2022-11-03 09:29:55 +08:00
Haojun Liao fc20be8699 fix(query): get if the correct rows in last block exists, and set the correct flag to denote if the last blocks index have been loaded or not. 2022-11-02 22:27:23 +08:00
Ganlin Zhao 215257f7f1 fix: fix reverse table scan when checking if block from file overlap
with skyline deletion result error
2022-11-02 16:58:36 +08:00
Haojun Liao ecad94c419 fix(query): add one more check. 2022-11-02 14:59:34 +08:00
Haojun Liao f83b863cf9 fix(query): update the lastkey for each table during table scanning. 2022-11-02 14:36:00 +08:00
Haojun Liao 698ae90e5b fix(query): set correct value in hash map reset. 2022-11-01 23:37:51 +08:00
Haojun Liao b610b23981 fix(query): check for null value. 2022-11-01 21:47:12 +08:00
Haojun Liao 026b82145e Merge branch '3.0' into feature/3_liaohj 2022-11-01 18:49:51 +08:00
Haojun Liao 68db9b1cc9 fix(query): optimize the performance of tsdbread. 2022-11-01 18:48:57 +08:00
Minglei Jin 5ae5df1a17 Merge branch 'v3.0' into fix/long_query 2022-11-01 18:06:39 +08:00
Shengliang Guan 18f7d658d9
Merge pull request #17804 from taosdata/feature/3_liaohj
refactor: add some logs.
2022-11-01 16:46:24 +08:00
Minglei Jin ef606d3fd9 tsdb/read: first round long query for non-cache reading 2022-11-01 16:38:35 +08:00
Haojun Liao cff5d9295e refactor: add some logs. 2022-11-01 15:00:02 +08:00
Haojun Liao b78249c548 other: merge 3.0 2022-11-01 13:52:08 +08:00
Haojun Liao 83495ed5d3 fix(query): set the correct buffer to accommodate the tag values. 2022-11-01 13:49:02 +08:00
Cary Xu 8a5f94d35c fix: set search key according to order 2022-10-31 20:03:21 +08:00
Haojun Liao f29127a15e ehn(query): do some internal refactor. 2022-10-31 18:04:58 +08:00
Haojun Liao 1fa5eafa8a ehn(query): keep the time window for each block to avoid repeatly parsing the compressed data block meta info. 2022-10-31 17:49:50 +08:00
Haojun Liao fac516a196 refactor: do some internal refactor. 2022-10-31 17:20:27 +08:00
Haojun Liao 9703ab510b enh(query): avoid parse the mapdata to improve the performance by keep the offset of each block. 2022-10-31 17:19:15 +08:00
Haojun Liao ba37a58192 enh(query): reduce the number of malloc. 2022-10-31 15:39:16 +08:00
Haojun Liao f38e9664f9 other:merge 3.0 2022-10-31 15:32:48 +08:00
Haojun Liao adf085ab46 refactor: do some internal refactor. 2022-10-31 14:17:57 +08:00
Haojun Liao f790d91b45 fix(query): check null before free resource, and some internal refactor. 2022-10-31 10:41:25 +08:00
Haojun Liao ab2c7c575b Merge branch '3.0' into feature/3_liaohj 2022-10-30 11:18:36 +08:00
Haojun Liao afdb1467b7 refactor: do some internal refactor. 2022-10-29 18:27:22 +08:00
Haojun Liao d583f1fab6 other: merge 3.0 2022-10-29 13:05:35 +08:00
Haojun Liao bae6d824c2 fix(query): init blockscanInfo correctly. 2022-10-29 12:54:39 +08:00
Haojun Liao 9b99c69785 fix(query): support partition by + limit push down. 2022-10-28 19:56:32 +08:00
Haojun Liao 4b2fa43dae
Revert "fix(query): handle partition by in table scan operator" 2022-10-28 18:05:19 +08:00
Haojun Liao d0a7a43e6f other:merge 3.0 2022-10-28 18:02:50 +08:00
Haojun Liao 6c19e886df fix(query): move the init function for different reader. 2022-10-28 17:58:59 +08:00
Haojun Liao 2c896012df fix(query): check status before add table uid in hash map. and do some other refactor. 2022-10-28 10:43:25 +08:00
Haojun Liao 4774baa635 fix(query): handle the case of the single block in last files. 2022-10-27 22:43:42 +08:00
yihaoDeng 9de0afc8ea opt mem 2022-10-27 21:22:36 +08:00
yihaoDeng 6a978be730 opt mem 2022-10-27 20:38:57 +08:00
Haojun Liao d8102fc8d8 fix(query): fix invalid number of tables check. 2022-10-27 18:58:10 +08:00
Haojun Liao a7ca29c627 other: merge 3.0 2022-10-27 18:04:28 +08:00
Haojun Liao 5a971dd03a fix(query): handle partition by in table scan operator with limit/offset value. 2022-10-27 16:58:32 +08:00
Minglei Jin eac3847532 fix: new reseek callback to separate tsdb & cache readers 2022-10-27 16:48:33 +08:00
Minglei Jin 545607ccd2 tsdb: resolve conflicts to make table creating & writing works 2022-10-27 15:17:59 +08:00
54liuyao 012dd30baa fix(stream): read preversion data with delete many times 2022-10-27 14:18:48 +08:00
54liuyao 442f89783f fix(stream): read preversion data for delete 2022-10-27 10:55:32 +08:00
Minglei Jin 7800b7731d Merge branch 'v3.0' into fix/long_query 2022-10-27 10:39:50 +08:00
Haojun Liao d06bcb2219 refactor: fix typo and do some internal refactor. 2022-10-26 09:47:11 +08:00
Haojun Liao 6acdfdd9ab refactor: do some internal refactor. 2022-10-25 16:20:51 +08:00
Haojun Liao a87f915ebf fix(query):set correct column match info size. 2022-10-25 15:30:41 +08:00
Haojun Liao 319cd8af85 fix(query): refactor and fix some coverity issues. 2022-10-24 15:02:17 +08:00
Haojun Liao 6ebf6b29bd fix(query): fix coverity issues. 2022-10-23 15:20:29 +08:00
Haojun Liao b53cc7f3dd fix(query): fix coverity issues. 2022-10-21 14:00:46 +08:00
Haojun Liao c41713cf21
Merge pull request #17495 from taosdata/fix/liao_cov
refactor: remove redundant codes and do some internal refactor.
2022-10-20 13:16:02 +08:00
Haojun Liao 12e81869bc fix(query): remove invalid free. 2022-10-20 11:52:30 +08:00
Haojun Liao 70adc0ea33 fix(query): fix coverity issues. 2022-10-20 11:27:33 +08:00
Shengliang Guan 228640af3b fix: compile error 2022-10-19 20:51:25 +08:00
Shengliang Guan 097a047b61 Merge remote-tracking branch 'origin/3.0' into FIX/TD-19593-3.0 2022-10-19 20:08:49 +08:00
Haojun Liao 74305814f0 fix(query): fix coverity issues. 2022-10-19 13:38:01 +08:00
Benguang Zhao 3b0968d7f9 enh: enable the -Wformat=2 compiler option 2022-10-19 09:24:15 +08:00
Haojun Liao 95dd30be57 fix(query): fix coverity issues. 2022-10-18 11:43:58 +08:00
Haojun Liao 4639051e68 fix(query): fix coverity issues. 2022-10-17 16:03:45 +08:00
Haojun Liao ed9ec795eb fix(query): fix coverity issues. 2022-10-17 14:05:40 +08:00
Haojun Liao 87516ea332 fix(query): fix bug in group by tag. 2022-10-17 13:00:31 +08:00
Haojun Liao bcb3d41d08 fix(query): fix coverity issues. 2022-10-16 13:46:21 +08:00
Haojun Liao f5f0a7026f other: merge 3.0 2022-10-13 14:20:51 +08:00
Hongze Cheng 5f010843a6 more code format 2022-10-13 16:58:43 +08:00
Haojun Liao 3d9e284913 other:merge 3.0 2022-10-13 12:01:47 +08:00
Haojun Liao fbd3aac007 fix(query):set the correct active block index and add some logs. 2022-10-13 11:59:14 +08:00
Haojun Liao cee7185450 fix(query): update the copy function. 2022-10-11 18:02:46 +08:00
Haojun Liao 7c3ddc4920 other:merge 3.0 2022-10-10 15:35:38 +08:00
Minglei Jin 997dfb41d9 fix(meta): use rwlock to favor writers 2022-10-10 11:00:55 +08:00
Haojun Liao fac464792d other:merge 3.0 2022-09-30 17:54:03 +08:00
Haojun Liao 6faf1af5f5 fix(query): handle the block read case. 2022-09-30 14:44:42 +08:00
Haojun Liao f8a84a1d19 other:merge 3.0 2022-09-30 13:47:21 +08:00
dapan1121 45fb658cec fix: fix rows missed in query result issue 2022-09-28 19:06:43 +08:00
Haojun Liao 14412f2811 refactor(query): do some internal refactor. 2022-09-28 11:16:52 +08:00
Haojun Liao 04f087793e refactor(query): do some internal refactor. 2022-09-28 10:54:54 +08:00
Haojun Liao 59b7435170 fix(query): fix memory copy 2022-09-27 19:17:35 +08:00
Haojun Liao 7818bed189 Merge branch 'feature/3_liaohj' into refact/query_opt 2022-09-27 18:51:42 +08:00
Haojun Liao c565c4cb63 fix(query): remove the primary timestamp column in the required column list. 2022-09-27 18:50:51 +08:00
Haojun Liao e2fa878136 other:merge 3.0 2022-09-27 18:39:03 +08:00
Haojun Liao 398c23edec enh(query): only load the required columns. 2022-09-27 18:37:02 +08:00
Haojun Liao bd6cf3137f other:merge 3.0 2022-09-27 18:12:54 +08:00
Haojun Liao 144a0c573b fix(query): set schema info for inner reader. 2022-09-27 16:17:03 +08:00
Haojun Liao cbe91fd4c3 fix(query): initialize the blockdata before load last block. 2022-09-27 13:48:53 +08:00
Hongze Cheng 4bfdfe89a5 adjust api 2022-09-27 11:02:04 +08:00
Haojun Liao 54712ae302 other:merge 3.0 2022-09-26 14:50:51 +08:00
Haojun Liao 5c1f55f6ca other:merge 3.0 2022-09-26 11:35:19 +08:00
Haojun Liao 4ebee6b232 refactor(query): do some internal refactor. 2022-09-26 11:22:26 +08:00
Hongze Cheng f0fea204f2 enh: col value optimize 2022-09-23 18:55:27 +08:00
Haojun Liao 74ca7abf95
Merge pull request #17027 from taosdata/feature/3_liaohj
fix(query): update remove check condition.
2022-09-23 15:11:55 +08:00
Haojun Liao be3459d882 fix(query): update remove check condition. 2022-09-23 14:34:40 +08:00
Haojun Liao 4935b8f391 fix(query): update check. 2022-09-23 14:33:52 +08:00
Cary Xu 9ddbe54d0d Merge branch '3.0' into feature/3.0_interval_hash_optimize 2022-09-22 17:25:13 +08:00
Haojun Liao c9bc7c3972 fix(query): update check condition. 2022-09-22 16:16:33 +08:00
Haojun Liao 092805b41f fix(query): update check condition. 2022-09-22 15:41:58 +08:00
Haojun Liao 6bd5cbbfc3 fix(query): set correct page id list. 2022-09-22 15:24:33 +08:00
Haojun Liao 976b36631e fix(query): keep last key for interp query. 2022-09-22 10:31:17 +08:00
Haojun Liao 50ee0dabbf refactor(query): do some internal refactor. 2022-09-20 10:02:20 +08:00
Haojun Liao 78f03e993d other:merge 3.0 2022-09-19 10:30:55 +08:00
Cary Xu 2f5e197dbe Merge branch '3.0' into feature/3.0_interval_hash_optimize 2022-09-16 17:45:12 +08:00
Haojun Liao 15f656e683 refactor(query): add some logs. 2022-09-16 13:06:57 +08:00
Hongze Cheng f845a01480 more code 2022-09-15 18:04:39 +08:00
Haojun Liao 188c3a9881 Merge remote-tracking branch 'origin/feature/3_liaohj' into feature/3_liaohj 2022-09-15 17:44:57 +08:00
Haojun Liao 0c71d95773 fix(query):set correct block load condition. 2022-09-15 17:44:28 +08:00
Hongze Cheng 3a4273406e more code 2022-09-15 17:32:39 +08:00
Cary Xu 4be9d4c704 chore: merge 3.0 2022-09-15 16:56:46 +08:00
Haojun Liao 22afbb5035
Merge branch '3.0' into feature/3_liaohj 2022-09-15 16:56:39 +08:00
Hongze Cheng d2141ea5ca more code 2022-09-15 16:44:33 +08:00
Haojun Liao 5ba41111b4 refactor: add some logs. 2022-09-15 16:17:39 +08:00
Hongze Cheng 87b59d2148 Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/long_query 2022-09-15 15:47:46 +08:00
Hongze Cheng 151fd39d1a more code 2022-09-15 14:51:40 +08:00
Haojun Liao dec379586b
Merge pull request #16851 from taosdata/feature/3_liaohj
refactor(query): do some internal refactor.
2022-09-15 11:43:24 +08:00
Haojun Liao 18924f9a7d refactor(query): do some internal refactor. 2022-09-15 10:26:45 +08:00
Hongze Cheng 26f740f26b fix more 2022-09-15 09:56:56 +08:00
Haojun Liao 4d44b56ec6 refactor(query):check for none table. 2022-09-14 14:53:52 +08:00
Haojun Liao dfc028a5c7 other:merge 3.0 2022-09-14 13:48:40 +08:00
Cary Xu 860a7bdcac enh: add queryRsmaTolerance conf for rsma query 2022-09-13 14:51:04 +08:00
Cary Xu 834c9edad8 chore: revert the code change 2022-09-11 19:46:30 +08:00
Cary Xu b8b91eb124 chore: revert the code change 2022-09-11 19:39:54 +08:00
Cary Xu 4cc44ee791 enh: sma optimization for query and reboot 2022-09-11 19:34:10 +08:00
Haojun Liao c328552b09
Merge pull request #16769 from taosdata/feature/3_liaohj
refactor(query): opt tsdb read perf.
2022-09-10 18:30:28 +08:00
Haojun Liao 06926edadd fix(query): handle empty time window case. 2022-09-10 15:43:46 +08:00
Haojun Liao 7b8f96851f fix(query): copy all columns to dest buffer. 2022-09-09 23:18:19 +08:00
Haojun Liao 1f645ab1d9 refactor(query): opt tsdb read perf. 2022-09-09 18:41:12 +08:00
Haojun Liao 44544ef228 fix(query): remove invalid assert 2022-09-09 16:17:51 +08:00
Haojun Liao 2c3c441b78 refactor(query): opt perf. 2022-09-09 16:13:36 +08:00
Haojun Liao e7987cd9e3 fix(query): set correct finish flag. 2022-09-09 10:21:31 +08:00
Haojun Liao 22c32f76fc refactor: opt perf in tsdbread. 2022-09-09 09:50:49 +08:00
Haojun Liao a0520d2a06 refactor: do some internal refactor. 2022-09-08 15:36:53 +08:00
Hongze Cheng bb0b1fda91 Merge branch '3.0' of https://github.com/taosdata/TDengine into refact/tsdb_new_snapshot 2022-09-08 15:16:22 +08:00
Haojun Liao 57d6c27171 refactor:do some internal refactor. 2022-09-08 14:11:34 +08:00
Haojun Liao e6ab7e5c86 refactor: do some internal refactor. 2022-09-08 14:08:07 +08:00
Haojun Liao 96dedb04f8 refactor: add some logs. 2022-09-08 10:26:30 +08:00
Haojun Liao 0b6070e518 refactor(query): add some logs. 2022-09-08 09:45:11 +08:00
Hongze Cheng 79f71be7e0 Merge branch '3.0' of https://github.com/taosdata/TDengine into refact/tsdb_new_snapshot 2022-09-07 21:37:36 +08:00
Haojun Liao 3c952a337e fix(query): fix invalid read. 2022-09-07 18:54:58 +08:00
Haojun Liao a0a6c9e9b9 fix(query): fix bug caused by refactor. 2022-09-07 17:51:04 +08:00
Hongze Cheng 0e4b0459bd more code 2022-09-07 17:06:42 +08:00
Haojun Liao e7149cce3a fix(query): opt perf in query last file blocks. 2022-09-07 13:18:34 +08:00
Haojun Liao cf46b22267 fix(query): fix error in tsdbread. 2022-09-06 19:27:49 +08:00
Haojun Liao a5933fc682 fix(query): optimize last block read performance. 2022-09-06 15:25:54 +08:00
Haojun Liao 8f92ffcd3b fix(query): set correct time window. 2022-09-06 02:36:04 +08:00
Haojun Liao a6d9c76681 fix(query): reset the time range. 2022-09-06 01:56:31 +08:00
Haojun Liao 581cb0ffe1 other:merge 3.0 2022-09-06 01:30:15 +08:00
Haojun Liao e179c10c88 fix(query): set correct last block reader range. 2022-09-06 00:26:38 +08:00
Haojun Liao 3719da865c other:merge 3.0 2022-09-05 19:02:04 +08:00
Haojun Liao a6cece10df fix(query): fix the invalid the check of last file blocks. 2022-09-05 18:57:46 +08:00
Hongze Cheng e70db79d10 refact: change sst to stt 2022-09-05 17:31:41 +08:00
Shengliang Guan 1a764d64ce
Merge pull request #16620 from taosdata/feature/TD-14761
fix:<TD-18803> taosX core dump if schema is null
2022-09-04 18:19:05 +08:00
Shengliang Guan c09e6f6236 Merge branch '3.0' into feature/TD-14761 2022-09-04 09:01:43 +08:00
Shengliang Guan 97b802ad77 fix: compile error 2022-09-04 09:01:26 +08:00
Shengliang Guan 0528fff7e0 Merge branch '3.0' into refact/tsdb_optimize 2022-09-04 08:56:58 +08:00
Haojun Liao 280bb37270 fix(query): reset fileIter when reset tsdb reader. 2022-09-03 23:06:39 +08:00
Haojun Liao 04c360dfcf fix(query): check the ts before merge file block. 2022-09-03 20:30:53 +08:00
Haojun Liao 86348e7439 fix(query): initialize the last block reader successfully. 2022-09-02 17:27:47 +08:00
wangmm0220 796342dabb fix:<TD-18803> taosX core dump if schema is null 2022-09-02 16:05:22 +08:00
Haojun Liao a170796f66 fix(query): fix invalid read/write. 2022-09-02 14:34:30 +08:00
Haojun Liao cac1fd36b7 Merge remote-tracking branch 'origin/refact/tsdb_optimize' into refact/tsdb_optimize
# Conflicts:
#	source/dnode/vnode/src/inc/tsdb.h
#	source/dnode/vnode/src/tsdb/tsdbMergeTree.c
#	source/dnode/vnode/src/tsdb/tsdbRead.c
2022-09-02 11:23:01 +08:00
Haojun Liao 720f3b2482 refactor: do some internal refactor. 2022-09-02 11:20:12 +08:00
Hongze Cheng 0eb29455ae refact code 2022-09-02 11:19:34 +08:00
Hongze Cheng aec4297eb4 refact code 2022-09-02 11:16:23 +08:00
Hongze Cheng ff4fda8442 refact code 2022-09-02 10:43:49 +08:00
Hongze Cheng 1132a7f719 refact code 2022-09-02 10:17:40 +08:00
Haojun Liao 52c5992c87 other:merge 3.0 2022-09-02 09:58:16 +08:00
Haojun Liao d1b7d07790 refactor:do some internal refactor. 2022-09-02 09:54:22 +08:00
Haojun Liao fed9efa840 fix(query): check memory malloc failure. 2022-09-01 18:46:50 +08:00
Haojun Liao b2cf2818eb refactor(query): do some internal refactor. 2022-09-01 18:23:44 +08:00
Haojun Liao a3011a0194 refactor(query): do some internal refactor. 2022-09-01 17:51:26 +08:00
Haojun Liao 72e0f09dd2 refactor(query): do some internal refactor. 2022-09-01 15:50:41 +08:00
Haojun Liao e65927bc5b fix(query): fix bug in merge multiple last files. 2022-09-01 15:11:40 +08:00
Haojun Liao 1cfd3e74f9 enh(query): support merge multiple last files. 2022-09-01 11:56:56 +08:00
Haojun Liao fdea9db9d3 fix(query): fix macro definition error. 2022-08-30 09:58:30 +08:00
Hongze Cheng 90d7ba0f4f Merge branch '3.0' of https://github.com/taosdata/TDengine into refact/tsdb_optimize 2022-08-29 11:02:53 +08:00
wade zhang 2ad31384f6
Merge pull request #15818 from taosdata/feature/TD-14761
feat: get meta and data from tmq using snapshot
2022-08-29 09:49:35 +08:00
Haojun Liao 655dbb47c1 refactor(query): do some internal refactor. 2022-08-26 19:19:48 +08:00
Haojun Liao 60d9acb7b4 feature(query): support last function cache and retrieve data. 2022-08-26 15:27:19 +08:00
Hongze Cheng c677d5494b make it compile 2022-08-26 13:03:12 +08:00
Hongze Cheng b833c3ef89 Merge branch '3.0' of https://github.com/taosdata/TDengine into refact/tsdb_optimize 2022-08-26 13:01:15 +08:00
Hongze Cheng 4a1447b666 make it compile 2022-08-26 10:12:36 +08:00
Hongze Cheng 5bbfc54504 Merge branch '3.0' of https://github.com/taosdata/TDengine into refact/tsdb_optimize 2022-08-26 10:08:12 +08:00
Haojun Liao 5ea4c0a7c8 fix(query): update the uid list when tablemap is changed. 2022-08-25 23:04:07 +08:00
Hongze Cheng eb2fb724b1 more code 2022-08-25 18:15:20 +08:00
Haojun Liao 755176d28f fix(query): add the null ptr check. 2022-08-25 17:32:27 +08:00
wangmm0220 6b61d3c23b fix:conflicts from 3.0 2022-08-25 16:57:19 +08:00
Haojun Liao 0ec1c52a19 fix(query): set ascending order of check last block. 2022-08-25 16:34:00 +08:00
Haojun Liao 739457ad28 refactor: do some internal refactor. 2022-08-25 16:22:22 +08:00
Haojun Liao 0d14fa9aad fix(query): reset the table accesss index. 2022-08-25 16:06:54 +08:00
Haojun Liao b09ee742d5 refactor(query): check table in uid order when handling the last block, and some internal refactor. 2022-08-25 15:31:48 +08:00
Haojun Liao a23f5f59ea refactor(query): do some internal refactor. 2022-08-24 17:09:33 +08:00
wangmm0220 2afc23a120 fix:conflicts from 3.0 2022-08-24 13:59:51 +08:00
Hongze Cheng a4d4b10404 make it compile 2022-08-24 11:58:10 +08:00
Hongze Cheng 0920cb911a Merge branch '3.0' of https://github.com/taosdata/TDengine into refact/tsdb_optimize 2022-08-24 11:52:40 +08:00
Haojun Liao 370b5136c2 fix(query): fix the last block check condition. 2022-08-24 10:38:26 +08:00
Haojun Liao 20b06a7ec7 refactor(query): do some internal refactor. 2022-08-23 19:44:59 +08:00
Haojun Liao 2889b8d913 refactor(query): do some internal refactor. 2022-08-23 17:28:08 +08:00
Hongze Cheng 478d5ebb64 more code 2022-08-23 13:49:10 +08:00
wangmm0220 1134319570 Merge branch '3.0' of https://github.com/taosdata/TDengine into feature/TD-14761 2022-08-23 10:45:51 +08:00
Haojun Liao 821a12a048 fix(query): add check before retrieve data. 2022-08-22 18:17:47 +08:00
Haojun Liao 9cdf2bb3a5 fix(query): init the blockdata before load data. 2022-08-22 17:43:55 +08:00
wangmm0220 43862ccd74 Merge branch '3.0' of https://github.com/taosdata/TDengine into feature/TD-14761 2022-08-22 16:53:53 +08:00
Haojun Liao 4322f59a22 fix(query): fix bug in descending order scan in lastblock. 2022-08-22 14:28:13 +08:00
Haojun Liao e61ee31de6 refactor(query): do some internal refactor. 2022-08-22 13:26:09 +08:00
Haojun Liao 530c775d97 refactor(query): do some internal refactor. 2022-08-22 11:57:10 +08:00
Haojun Liao e4881423b8 fix(query): add one more condition check when merge file block and last block. 2022-08-22 11:09:12 +08:00
Haojun Liao f029df4876 fix(query): reset index when moving to next file. 2022-08-21 22:17:12 +08:00
Haojun Liao a7ba94939a fix(query): set init value for current last block index. 2022-08-21 22:02:01 +08:00
Haojun Liao 4879ae3d68 refactor(query): optimize load last block. 2022-08-21 21:36:15 +08:00
Haojun Liao 29a1245be4 fix(query): use the separate last block delete index. 2022-08-21 20:15:53 +08:00
Haojun Liao 7904686915 fix(query): support delete in last 2022-08-21 18:59:21 +08:00
Haojun Liao d305e975c4 fix(query): remove printf. 2022-08-21 15:56:46 +08:00
Haojun Liao fe918b3f69 fix(query): set correct column data. 2022-08-21 15:56:06 +08:00
Haojun Liao 5a1ba3d016 fix(query): increase the output buffer size. 2022-08-20 23:26:58 +08:00
Haojun Liao 6d8a70ebf6 fix(query): remove invalid free. 2022-08-20 20:22:39 +08:00
Haojun Liao df0d6f1823 fix(query): fix memory leak. 2022-08-20 19:05:55 +08:00
Haojun Liao 0dfd032068 fix(query): reset block data when no blocks are available. 2022-08-20 16:57:44 +08:00
Haojun Liao 09ffcd2e13 fix(query): fix bug in tsdbread 2022-08-20 12:41:58 +08:00
Haojun Liao 515e8d36b0 fix(query): fix bug in merge buffer data and last block. 2022-08-20 11:14:00 +08:00
Haojun Liao 5eae03fcab fix(query): handle the reverse case. 2022-08-18 22:57:26 +08:00
Haojun Liao eaef3dffaf fix(query): fix error in query last block. 2022-08-18 22:42:16 +08:00
Haojun Liao e75c400045 fix(query): fix bug in query last block. 2022-08-18 18:48:50 +08:00
Hongze Cheng e9bb654a4a Merge branch '3.0' of https://github.com/taosdata/TDengine into refact/tsdb_last 2022-08-18 17:14:51 +08:00
Haojun Liao 8eb86676d0 fix(query): support query last file. 2022-08-18 17:09:44 +08:00
wangmm0220 fbc69a10c4 Merge branch '3.0' into feature/TD-14761 2022-08-18 16:45:06 +08:00
Haojun Liao 9dc5b4cb0c fix(query): support read from last file. 2022-08-18 00:08:09 +08:00
Haojun Liao 5b396276ea Merge branch 'refact/tsdb_last' of github.com:taosdata/tdengine into refact/tsdb_last 2022-08-17 07:54:31 +08:00
Haojun Liao 559286db71 refactor(query): support read data from last files. 2022-08-17 07:51:09 +08:00
wangmm0220 78c9f245b1 fix:conflicts from 3.0 2022-08-16 15:18:11 +08:00
Hongze Cheng 3359b8e620 more optimize 2022-08-15 10:16:07 +00:00
Hongze Cheng e1b638aeb5 Merge branch '3.0' of https://github.com/taosdata/TDengine into refact/tsdb_last 2022-08-15 03:02:54 +00:00
Cary Xu ae7550eb86 enh: rsma exec in async mode 2022-08-12 21:00:48 +08:00
Minglei Jin 6058b8dff5
Merge pull request #16003 from taosdata/fix/TD-18321
fix: use mem schema if pReader->pSchema is null
2022-08-11 19:18:30 +08:00
Haojun Liao 02300b30fa
Merge pull request #15995 from taosdata/feature/3_liaohj
fix(query): add check when invoking sma filter.
2022-08-11 18:52:51 +08:00
Minglei Jin 203a8073ca fix: use mem schema if pReader->pSchema is null 2022-08-11 18:19:44 +08:00
Haojun Liao 3a6285c478 fix(query): add check when invoking sma filter. 2022-08-11 17:40:55 +08:00
Cary Xu 1d6d0aa2db enh: row iter and fetch optimization 2022-08-10 17:26:44 +08:00
Haojun Liao 6250c1b157
Merge pull request #15851 from taosdata/feature/3.0_query_optimize
ehn(query): optimize the query performance.
2022-08-10 16:51:46 +08:00
Ganlin Zhao 249e2b12f6 fix(query): fix interp + fill interpolation after last datablock 2022-08-10 14:21:31 +08:00
Haojun Liao 41d2c92231 fix(query): copy null value. 2022-08-09 16:54:05 +08:00
Haojun Liao 29c84833d3 fix(query):fix invalid free. 2022-08-09 10:34:01 +08:00
Haojun Liao 30a64bdcd9 fix(query): set correct schema. 2022-08-09 10:16:00 +08:00
Hongze Cheng 4f06c4bbdd make it compile 2022-08-08 07:32:02 +00:00
Hongze Cheng 8ae2ab1c6e more work 2022-08-08 05:34:01 +00:00
Hongze Cheng 33c3f34f34 more work 2022-08-08 03:22:24 +00:00
Hongze Cheng 71691eb7da make code compile 2022-08-07 13:14:43 +00:00
Hongze Cheng 7c32e099d0 more work 2022-08-06 14:20:30 +00:00
Hongze Cheng 04804e384a more 2022-08-06 12:24:46 +00:00
Hongze Cheng 3436d52316 more refact 2022-08-06 12:23:29 +00:00
Hongze Cheng 3324f4e5b7 more work 2022-08-06 12:04:42 +00:00
wangmm0220 f28155714e fix:confilcts from 3.0 2022-08-06 12:31:15 +08:00
wangmm0220 45e7597df3 feat:get data from snapshot for taosx 2022-08-05 21:12:18 +08:00
Hongze Cheng 51538a1710 more work 2022-08-05 09:47:26 +00:00
Haojun Liao 52173e14e1 fix(query): add check for null ptr. 2022-08-05 16:10:45 +08:00
Haojun Liao 0e4748771a enh(query): support combine multi datablock to pass to upstream operators 2022-08-05 14:10:45 +08:00
Haojun Liao 271528f4e2 refactor: opt tsdb performance. 2022-08-04 18:12:44 +08:00
Haojun Liao 4cd7af0ecf other: merge 3.0 2022-08-03 19:02:43 +08:00
Cary Xu 71419d330d other: adjust rsma debug logs 2022-08-03 14:58:54 +08:00
Cary Xu 335da8fc65 other: add tsma debug log 2022-08-03 14:33:29 +08:00
Haojun Liao bc600a4942 refactor: do some internal refactor optimize the building block performance. 2022-08-03 14:08:03 +08:00
Haojun Liao 64db9afeb7 refactor: do some internal refactor. 2022-08-03 10:52:06 +08:00
Shengliang Guan efb0127fbf refactor: adjust logs 2022-08-02 16:48:49 +08:00
Shengliang Guan d5aea7dac2 refactor: adjust sync log 2022-08-02 16:39:12 +08:00
Minglei Jin 711c75652c
Merge pull request #15671 from taosdata/fix/TD-18074
fix: new pSchema if reader's schema is null
2022-08-02 14:12:30 +08:00
Haojun Liao bb869800f6
Merge pull request #15661 from taosdata/feature/3_liaohj
refactor: optimize the build block perf.
2022-08-02 13:04:00 +08:00
Minglei Jin 5cf4dac071 fix: new pSchema if reader's schema is null 2022-08-02 12:56:33 +08:00
Shengliang Guan bd31c9da5a
Merge pull request #15657 from taosdata/fix/dnode
fix: write snapshot after apply queue is empty
2022-08-01 20:13:08 +08:00
Haojun Liao bbcba1855d Merge branch '3.0' into feature/3_liaohj 2022-08-01 20:09:42 +08:00
Shengliang Guan 99f29f6455 refactor: adjust log 2022-08-01 17:23:52 +08:00
54liuyao b3d104349f feat(stream):optimize stream update scan 2022-08-01 17:09:46 +08:00
Haojun Liao 7db6497d28 refactor: update some logs. 2022-08-01 11:19:06 +08:00
Minglei Jin c2faef7377
Merge pull request #15555 from taosdata/fix/TD-17968
fix: update schema to newest version to parsing rows
2022-07-30 16:04:04 +08:00
Minglei Jin e57f12d581 fix: use colId to merge rows 2022-07-30 15:23:28 +08:00
Minglei Jin 56d2697308 fix: new tRowMergerInit2 for ts row merging 2022-07-30 12:46:40 +08:00
Haojun Liao 2261d689e4 fix(query): opt read data from file block. 2022-07-29 21:09:33 +08:00
Haojun Liao 0c1e30dc56 fix(query): step forward index 2022-07-29 19:34:13 +08:00
Minglei Jin 0c111cd2bf fix: update schema to newest version to parsing rows 2022-07-29 18:15:44 +08:00
Haojun Liao 60c5b2beac fix(query): optimize the row merge procedure for files. 2022-07-29 17:53:30 +08:00
Haojun Liao aeed234b2e fix(query):fix memory leak. 2022-07-26 20:40:39 +08:00
Haojun Liao bd8fa53371 fix(query): set current SBlock before move to next block. 2022-07-26 15:52:47 +08:00
Haojun Liao 6600540fd9 refactor: optimize the memory consumption during tsdbread 2022-07-26 11:43:45 +08:00
Haojun Liao 231f439979 refactor: opt memory consumption for tsdbread. 2022-07-26 10:19:12 +08:00
Haojun Liao 6d86ef0c33 other: merge 3.0 2022-07-25 11:22:09 +08:00
Haojun Liao 9bddf99d7d refactor(query): do some internal refactor. 2022-07-25 11:17:45 +08:00
Cary Xu 00a9598ac8 enh: rsma level 2/3 submitReq msg use wal version 2022-07-22 20:39:13 +08:00
Hongze Cheng 8cdef36879 fix: sam cases 2022-07-22 04:56:15 +00:00
Hongze Cheng cd762afe76 Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/hzcheng_3.0 2022-07-22 04:50:24 +00:00
Hongze Cheng b27272d784 fix memory leak 2022-07-22 01:40:02 +00:00
Haojun Liao 7522c2edf3 refactor: do some internal refactor. 2022-07-21 20:44:36 +08:00
Hongze Cheng bce29321c6 Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/hzcheng_3.0 2022-07-21 12:40:03 +00:00
Hongze Cheng 6a7a3da3db fix some crash 2022-07-21 11:56:18 +00:00
Hongze Cheng 684dd82358 fix read concurrency 2022-07-21 11:42:42 +00:00
Haojun Liao 8e42bf85e8 fix(query): fix border check. 2022-07-21 15:47:22 +08:00
Hongze Cheng f195decac9 more fix 2022-07-21 06:27:32 +00:00
Haojun Liao 2a437ee38a fix(query): close del handle when successing in read del file content. 2022-07-21 11:35:31 +08:00
Haojun Liao c2d588a118 other:merge 3.0 2022-07-21 11:29:34 +08:00