Commit Graph

833 Commits

Author SHA1 Message Date
Haojun Liao 092805b41f fix(query): update check condition. 2022-09-22 15:41:58 +08:00
Haojun Liao 6bd5cbbfc3 fix(query): set correct page id list. 2022-09-22 15:24:33 +08:00
Haojun Liao 976b36631e fix(query): keep last key for interp query. 2022-09-22 10:31:17 +08:00
Haojun Liao 50ee0dabbf refactor(query): do some internal refactor. 2022-09-20 10:02:20 +08:00
Haojun Liao 78f03e993d other:merge 3.0 2022-09-19 10:30:55 +08:00
Cary Xu 2f5e197dbe Merge branch '3.0' into feature/3.0_interval_hash_optimize 2022-09-16 17:45:12 +08:00
Haojun Liao 15f656e683 refactor(query): add some logs. 2022-09-16 13:06:57 +08:00
Hongze Cheng f845a01480 more code 2022-09-15 18:04:39 +08:00
Haojun Liao 188c3a9881 Merge remote-tracking branch 'origin/feature/3_liaohj' into feature/3_liaohj 2022-09-15 17:44:57 +08:00
Haojun Liao 0c71d95773 fix(query):set correct block load condition. 2022-09-15 17:44:28 +08:00
Hongze Cheng 3a4273406e more code 2022-09-15 17:32:39 +08:00
Cary Xu 4be9d4c704 chore: merge 3.0 2022-09-15 16:56:46 +08:00
Haojun Liao 22afbb5035
Merge branch '3.0' into feature/3_liaohj 2022-09-15 16:56:39 +08:00
Hongze Cheng d2141ea5ca more code 2022-09-15 16:44:33 +08:00
Haojun Liao 5ba41111b4 refactor: add some logs. 2022-09-15 16:17:39 +08:00
Hongze Cheng 87b59d2148 Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/long_query 2022-09-15 15:47:46 +08:00
Hongze Cheng 151fd39d1a more code 2022-09-15 14:51:40 +08:00
Haojun Liao dec379586b
Merge pull request #16851 from taosdata/feature/3_liaohj
refactor(query): do some internal refactor.
2022-09-15 11:43:24 +08:00
Haojun Liao 18924f9a7d refactor(query): do some internal refactor. 2022-09-15 10:26:45 +08:00
Hongze Cheng 26f740f26b fix more 2022-09-15 09:56:56 +08:00
Haojun Liao 4d44b56ec6 refactor(query):check for none table. 2022-09-14 14:53:52 +08:00
Haojun Liao dfc028a5c7 other:merge 3.0 2022-09-14 13:48:40 +08:00
Cary Xu 860a7bdcac enh: add queryRsmaTolerance conf for rsma query 2022-09-13 14:51:04 +08:00
Cary Xu 834c9edad8 chore: revert the code change 2022-09-11 19:46:30 +08:00
Cary Xu b8b91eb124 chore: revert the code change 2022-09-11 19:39:54 +08:00
Cary Xu 4cc44ee791 enh: sma optimization for query and reboot 2022-09-11 19:34:10 +08:00
Haojun Liao c328552b09
Merge pull request #16769 from taosdata/feature/3_liaohj
refactor(query): opt tsdb read perf.
2022-09-10 18:30:28 +08:00
Haojun Liao 06926edadd fix(query): handle empty time window case. 2022-09-10 15:43:46 +08:00
Haojun Liao 7b8f96851f fix(query): copy all columns to dest buffer. 2022-09-09 23:18:19 +08:00
Haojun Liao 1f645ab1d9 refactor(query): opt tsdb read perf. 2022-09-09 18:41:12 +08:00
Haojun Liao 44544ef228 fix(query): remove invalid assert 2022-09-09 16:17:51 +08:00
Haojun Liao 2c3c441b78 refactor(query): opt perf. 2022-09-09 16:13:36 +08:00
Haojun Liao e7987cd9e3 fix(query): set correct finish flag. 2022-09-09 10:21:31 +08:00
Haojun Liao 22c32f76fc refactor: opt perf in tsdbread. 2022-09-09 09:50:49 +08:00
Haojun Liao a0520d2a06 refactor: do some internal refactor. 2022-09-08 15:36:53 +08:00
Hongze Cheng bb0b1fda91 Merge branch '3.0' of https://github.com/taosdata/TDengine into refact/tsdb_new_snapshot 2022-09-08 15:16:22 +08:00
Haojun Liao 57d6c27171 refactor:do some internal refactor. 2022-09-08 14:11:34 +08:00
Haojun Liao e6ab7e5c86 refactor: do some internal refactor. 2022-09-08 14:08:07 +08:00
Haojun Liao 96dedb04f8 refactor: add some logs. 2022-09-08 10:26:30 +08:00
Haojun Liao 0b6070e518 refactor(query): add some logs. 2022-09-08 09:45:11 +08:00
Hongze Cheng 79f71be7e0 Merge branch '3.0' of https://github.com/taosdata/TDengine into refact/tsdb_new_snapshot 2022-09-07 21:37:36 +08:00
Haojun Liao 3c952a337e fix(query): fix invalid read. 2022-09-07 18:54:58 +08:00
Haojun Liao a0a6c9e9b9 fix(query): fix bug caused by refactor. 2022-09-07 17:51:04 +08:00
Hongze Cheng 0e4b0459bd more code 2022-09-07 17:06:42 +08:00
Haojun Liao e7149cce3a fix(query): opt perf in query last file blocks. 2022-09-07 13:18:34 +08:00
Haojun Liao cf46b22267 fix(query): fix error in tsdbread. 2022-09-06 19:27:49 +08:00
Haojun Liao a5933fc682 fix(query): optimize last block read performance. 2022-09-06 15:25:54 +08:00
Haojun Liao 8f92ffcd3b fix(query): set correct time window. 2022-09-06 02:36:04 +08:00
Haojun Liao a6d9c76681 fix(query): reset the time range. 2022-09-06 01:56:31 +08:00
Haojun Liao 581cb0ffe1 other:merge 3.0 2022-09-06 01:30:15 +08:00
Haojun Liao e179c10c88 fix(query): set correct last block reader range. 2022-09-06 00:26:38 +08:00
Haojun Liao 3719da865c other:merge 3.0 2022-09-05 19:02:04 +08:00
Haojun Liao a6cece10df fix(query): fix the invalid the check of last file blocks. 2022-09-05 18:57:46 +08:00
Hongze Cheng e70db79d10 refact: change sst to stt 2022-09-05 17:31:41 +08:00
Shengliang Guan 1a764d64ce
Merge pull request #16620 from taosdata/feature/TD-14761
fix:<TD-18803> taosX core dump if schema is null
2022-09-04 18:19:05 +08:00
Shengliang Guan c09e6f6236 Merge branch '3.0' into feature/TD-14761 2022-09-04 09:01:43 +08:00
Shengliang Guan 97b802ad77 fix: compile error 2022-09-04 09:01:26 +08:00
Shengliang Guan 0528fff7e0 Merge branch '3.0' into refact/tsdb_optimize 2022-09-04 08:56:58 +08:00
Haojun Liao 280bb37270 fix(query): reset fileIter when reset tsdb reader. 2022-09-03 23:06:39 +08:00
Haojun Liao 04c360dfcf fix(query): check the ts before merge file block. 2022-09-03 20:30:53 +08:00
Haojun Liao 86348e7439 fix(query): initialize the last block reader successfully. 2022-09-02 17:27:47 +08:00
wangmm0220 796342dabb fix:<TD-18803> taosX core dump if schema is null 2022-09-02 16:05:22 +08:00
Haojun Liao a170796f66 fix(query): fix invalid read/write. 2022-09-02 14:34:30 +08:00
Haojun Liao cac1fd36b7 Merge remote-tracking branch 'origin/refact/tsdb_optimize' into refact/tsdb_optimize
# Conflicts:
#	source/dnode/vnode/src/inc/tsdb.h
#	source/dnode/vnode/src/tsdb/tsdbMergeTree.c
#	source/dnode/vnode/src/tsdb/tsdbRead.c
2022-09-02 11:23:01 +08:00
Haojun Liao 720f3b2482 refactor: do some internal refactor. 2022-09-02 11:20:12 +08:00
Hongze Cheng 0eb29455ae refact code 2022-09-02 11:19:34 +08:00
Hongze Cheng aec4297eb4 refact code 2022-09-02 11:16:23 +08:00
Hongze Cheng ff4fda8442 refact code 2022-09-02 10:43:49 +08:00
Hongze Cheng 1132a7f719 refact code 2022-09-02 10:17:40 +08:00
Haojun Liao 52c5992c87 other:merge 3.0 2022-09-02 09:58:16 +08:00
Haojun Liao d1b7d07790 refactor:do some internal refactor. 2022-09-02 09:54:22 +08:00
Haojun Liao fed9efa840 fix(query): check memory malloc failure. 2022-09-01 18:46:50 +08:00
Haojun Liao b2cf2818eb refactor(query): do some internal refactor. 2022-09-01 18:23:44 +08:00
Haojun Liao a3011a0194 refactor(query): do some internal refactor. 2022-09-01 17:51:26 +08:00
Haojun Liao 72e0f09dd2 refactor(query): do some internal refactor. 2022-09-01 15:50:41 +08:00
Haojun Liao e65927bc5b fix(query): fix bug in merge multiple last files. 2022-09-01 15:11:40 +08:00
Haojun Liao 1cfd3e74f9 enh(query): support merge multiple last files. 2022-09-01 11:56:56 +08:00
Haojun Liao fdea9db9d3 fix(query): fix macro definition error. 2022-08-30 09:58:30 +08:00
Hongze Cheng 90d7ba0f4f Merge branch '3.0' of https://github.com/taosdata/TDengine into refact/tsdb_optimize 2022-08-29 11:02:53 +08:00
wade zhang 2ad31384f6
Merge pull request #15818 from taosdata/feature/TD-14761
feat: get meta and data from tmq using snapshot
2022-08-29 09:49:35 +08:00
Haojun Liao 655dbb47c1 refactor(query): do some internal refactor. 2022-08-26 19:19:48 +08:00
Haojun Liao 60d9acb7b4 feature(query): support last function cache and retrieve data. 2022-08-26 15:27:19 +08:00
Hongze Cheng c677d5494b make it compile 2022-08-26 13:03:12 +08:00
Hongze Cheng b833c3ef89 Merge branch '3.0' of https://github.com/taosdata/TDengine into refact/tsdb_optimize 2022-08-26 13:01:15 +08:00
Hongze Cheng 4a1447b666 make it compile 2022-08-26 10:12:36 +08:00
Hongze Cheng 5bbfc54504 Merge branch '3.0' of https://github.com/taosdata/TDengine into refact/tsdb_optimize 2022-08-26 10:08:12 +08:00
Haojun Liao 5ea4c0a7c8 fix(query): update the uid list when tablemap is changed. 2022-08-25 23:04:07 +08:00
Hongze Cheng eb2fb724b1 more code 2022-08-25 18:15:20 +08:00
Haojun Liao 755176d28f fix(query): add the null ptr check. 2022-08-25 17:32:27 +08:00
wangmm0220 6b61d3c23b fix:conflicts from 3.0 2022-08-25 16:57:19 +08:00
Haojun Liao 0ec1c52a19 fix(query): set ascending order of check last block. 2022-08-25 16:34:00 +08:00
Haojun Liao 739457ad28 refactor: do some internal refactor. 2022-08-25 16:22:22 +08:00
Haojun Liao 0d14fa9aad fix(query): reset the table accesss index. 2022-08-25 16:06:54 +08:00
Haojun Liao b09ee742d5 refactor(query): check table in uid order when handling the last block, and some internal refactor. 2022-08-25 15:31:48 +08:00
Haojun Liao a23f5f59ea refactor(query): do some internal refactor. 2022-08-24 17:09:33 +08:00
wangmm0220 2afc23a120 fix:conflicts from 3.0 2022-08-24 13:59:51 +08:00
Hongze Cheng a4d4b10404 make it compile 2022-08-24 11:58:10 +08:00
Hongze Cheng 0920cb911a Merge branch '3.0' of https://github.com/taosdata/TDengine into refact/tsdb_optimize 2022-08-24 11:52:40 +08:00
Haojun Liao 370b5136c2 fix(query): fix the last block check condition. 2022-08-24 10:38:26 +08:00
Haojun Liao 20b06a7ec7 refactor(query): do some internal refactor. 2022-08-23 19:44:59 +08:00
Haojun Liao 2889b8d913 refactor(query): do some internal refactor. 2022-08-23 17:28:08 +08:00
Hongze Cheng 478d5ebb64 more code 2022-08-23 13:49:10 +08:00
wangmm0220 1134319570 Merge branch '3.0' of https://github.com/taosdata/TDengine into feature/TD-14761 2022-08-23 10:45:51 +08:00
Haojun Liao 821a12a048 fix(query): add check before retrieve data. 2022-08-22 18:17:47 +08:00
Haojun Liao 9cdf2bb3a5 fix(query): init the blockdata before load data. 2022-08-22 17:43:55 +08:00
wangmm0220 43862ccd74 Merge branch '3.0' of https://github.com/taosdata/TDengine into feature/TD-14761 2022-08-22 16:53:53 +08:00
Haojun Liao 4322f59a22 fix(query): fix bug in descending order scan in lastblock. 2022-08-22 14:28:13 +08:00
Haojun Liao e61ee31de6 refactor(query): do some internal refactor. 2022-08-22 13:26:09 +08:00
Haojun Liao 530c775d97 refactor(query): do some internal refactor. 2022-08-22 11:57:10 +08:00
Haojun Liao e4881423b8 fix(query): add one more condition check when merge file block and last block. 2022-08-22 11:09:12 +08:00
Haojun Liao f029df4876 fix(query): reset index when moving to next file. 2022-08-21 22:17:12 +08:00
Haojun Liao a7ba94939a fix(query): set init value for current last block index. 2022-08-21 22:02:01 +08:00
Haojun Liao 4879ae3d68 refactor(query): optimize load last block. 2022-08-21 21:36:15 +08:00
Haojun Liao 29a1245be4 fix(query): use the separate last block delete index. 2022-08-21 20:15:53 +08:00
Haojun Liao 7904686915 fix(query): support delete in last 2022-08-21 18:59:21 +08:00
Haojun Liao d305e975c4 fix(query): remove printf. 2022-08-21 15:56:46 +08:00
Haojun Liao fe918b3f69 fix(query): set correct column data. 2022-08-21 15:56:06 +08:00
Haojun Liao 5a1ba3d016 fix(query): increase the output buffer size. 2022-08-20 23:26:58 +08:00
Haojun Liao 6d8a70ebf6 fix(query): remove invalid free. 2022-08-20 20:22:39 +08:00
Haojun Liao df0d6f1823 fix(query): fix memory leak. 2022-08-20 19:05:55 +08:00
Haojun Liao 0dfd032068 fix(query): reset block data when no blocks are available. 2022-08-20 16:57:44 +08:00
Haojun Liao 09ffcd2e13 fix(query): fix bug in tsdbread 2022-08-20 12:41:58 +08:00
Haojun Liao 515e8d36b0 fix(query): fix bug in merge buffer data and last block. 2022-08-20 11:14:00 +08:00
Haojun Liao 5eae03fcab fix(query): handle the reverse case. 2022-08-18 22:57:26 +08:00
Haojun Liao eaef3dffaf fix(query): fix error in query last block. 2022-08-18 22:42:16 +08:00
Haojun Liao e75c400045 fix(query): fix bug in query last block. 2022-08-18 18:48:50 +08:00
Hongze Cheng e9bb654a4a Merge branch '3.0' of https://github.com/taosdata/TDengine into refact/tsdb_last 2022-08-18 17:14:51 +08:00
Haojun Liao 8eb86676d0 fix(query): support query last file. 2022-08-18 17:09:44 +08:00
wangmm0220 fbc69a10c4 Merge branch '3.0' into feature/TD-14761 2022-08-18 16:45:06 +08:00
Haojun Liao 9dc5b4cb0c fix(query): support read from last file. 2022-08-18 00:08:09 +08:00
Haojun Liao 5b396276ea Merge branch 'refact/tsdb_last' of github.com:taosdata/tdengine into refact/tsdb_last 2022-08-17 07:54:31 +08:00
Haojun Liao 559286db71 refactor(query): support read data from last files. 2022-08-17 07:51:09 +08:00
wangmm0220 78c9f245b1 fix:conflicts from 3.0 2022-08-16 15:18:11 +08:00
Hongze Cheng 3359b8e620 more optimize 2022-08-15 10:16:07 +00:00
Hongze Cheng e1b638aeb5 Merge branch '3.0' of https://github.com/taosdata/TDengine into refact/tsdb_last 2022-08-15 03:02:54 +00:00
Cary Xu ae7550eb86 enh: rsma exec in async mode 2022-08-12 21:00:48 +08:00
Minglei Jin 6058b8dff5
Merge pull request #16003 from taosdata/fix/TD-18321
fix: use mem schema if pReader->pSchema is null
2022-08-11 19:18:30 +08:00
Haojun Liao 02300b30fa
Merge pull request #15995 from taosdata/feature/3_liaohj
fix(query): add check when invoking sma filter.
2022-08-11 18:52:51 +08:00
Minglei Jin 203a8073ca fix: use mem schema if pReader->pSchema is null 2022-08-11 18:19:44 +08:00
Haojun Liao 3a6285c478 fix(query): add check when invoking sma filter. 2022-08-11 17:40:55 +08:00
Cary Xu 1d6d0aa2db enh: row iter and fetch optimization 2022-08-10 17:26:44 +08:00
Haojun Liao 6250c1b157
Merge pull request #15851 from taosdata/feature/3.0_query_optimize
ehn(query): optimize the query performance.
2022-08-10 16:51:46 +08:00
Ganlin Zhao 249e2b12f6 fix(query): fix interp + fill interpolation after last datablock 2022-08-10 14:21:31 +08:00
Haojun Liao 41d2c92231 fix(query): copy null value. 2022-08-09 16:54:05 +08:00
Haojun Liao 29c84833d3 fix(query):fix invalid free. 2022-08-09 10:34:01 +08:00
Haojun Liao 30a64bdcd9 fix(query): set correct schema. 2022-08-09 10:16:00 +08:00
Hongze Cheng 4f06c4bbdd make it compile 2022-08-08 07:32:02 +00:00
Hongze Cheng 8ae2ab1c6e more work 2022-08-08 05:34:01 +00:00
Hongze Cheng 33c3f34f34 more work 2022-08-08 03:22:24 +00:00
Hongze Cheng 71691eb7da make code compile 2022-08-07 13:14:43 +00:00
Hongze Cheng 7c32e099d0 more work 2022-08-06 14:20:30 +00:00
Hongze Cheng 04804e384a more 2022-08-06 12:24:46 +00:00
Hongze Cheng 3436d52316 more refact 2022-08-06 12:23:29 +00:00
Hongze Cheng 3324f4e5b7 more work 2022-08-06 12:04:42 +00:00
wangmm0220 f28155714e fix:confilcts from 3.0 2022-08-06 12:31:15 +08:00
wangmm0220 45e7597df3 feat:get data from snapshot for taosx 2022-08-05 21:12:18 +08:00
Hongze Cheng 51538a1710 more work 2022-08-05 09:47:26 +00:00
Haojun Liao 52173e14e1 fix(query): add check for null ptr. 2022-08-05 16:10:45 +08:00
Haojun Liao 0e4748771a enh(query): support combine multi datablock to pass to upstream operators 2022-08-05 14:10:45 +08:00
Haojun Liao 271528f4e2 refactor: opt tsdb performance. 2022-08-04 18:12:44 +08:00
Haojun Liao 4cd7af0ecf other: merge 3.0 2022-08-03 19:02:43 +08:00
Cary Xu 71419d330d other: adjust rsma debug logs 2022-08-03 14:58:54 +08:00
Cary Xu 335da8fc65 other: add tsma debug log 2022-08-03 14:33:29 +08:00
Haojun Liao bc600a4942 refactor: do some internal refactor optimize the building block performance. 2022-08-03 14:08:03 +08:00
Haojun Liao 64db9afeb7 refactor: do some internal refactor. 2022-08-03 10:52:06 +08:00
Shengliang Guan efb0127fbf refactor: adjust logs 2022-08-02 16:48:49 +08:00
Shengliang Guan d5aea7dac2 refactor: adjust sync log 2022-08-02 16:39:12 +08:00
Minglei Jin 711c75652c
Merge pull request #15671 from taosdata/fix/TD-18074
fix: new pSchema if reader's schema is null
2022-08-02 14:12:30 +08:00
Haojun Liao bb869800f6
Merge pull request #15661 from taosdata/feature/3_liaohj
refactor: optimize the build block perf.
2022-08-02 13:04:00 +08:00
Minglei Jin 5cf4dac071 fix: new pSchema if reader's schema is null 2022-08-02 12:56:33 +08:00
Shengliang Guan bd31c9da5a
Merge pull request #15657 from taosdata/fix/dnode
fix: write snapshot after apply queue is empty
2022-08-01 20:13:08 +08:00
Haojun Liao bbcba1855d Merge branch '3.0' into feature/3_liaohj 2022-08-01 20:09:42 +08:00
Shengliang Guan 99f29f6455 refactor: adjust log 2022-08-01 17:23:52 +08:00
54liuyao b3d104349f feat(stream):optimize stream update scan 2022-08-01 17:09:46 +08:00
Haojun Liao 7db6497d28 refactor: update some logs. 2022-08-01 11:19:06 +08:00
Minglei Jin c2faef7377
Merge pull request #15555 from taosdata/fix/TD-17968
fix: update schema to newest version to parsing rows
2022-07-30 16:04:04 +08:00
Minglei Jin e57f12d581 fix: use colId to merge rows 2022-07-30 15:23:28 +08:00
Minglei Jin 56d2697308 fix: new tRowMergerInit2 for ts row merging 2022-07-30 12:46:40 +08:00
Haojun Liao 2261d689e4 fix(query): opt read data from file block. 2022-07-29 21:09:33 +08:00
Haojun Liao 0c1e30dc56 fix(query): step forward index 2022-07-29 19:34:13 +08:00
Minglei Jin 0c111cd2bf fix: update schema to newest version to parsing rows 2022-07-29 18:15:44 +08:00
Haojun Liao 60c5b2beac fix(query): optimize the row merge procedure for files. 2022-07-29 17:53:30 +08:00
Haojun Liao aeed234b2e fix(query):fix memory leak. 2022-07-26 20:40:39 +08:00
Haojun Liao bd8fa53371 fix(query): set current SBlock before move to next block. 2022-07-26 15:52:47 +08:00
Haojun Liao 6600540fd9 refactor: optimize the memory consumption during tsdbread 2022-07-26 11:43:45 +08:00
Haojun Liao 231f439979 refactor: opt memory consumption for tsdbread. 2022-07-26 10:19:12 +08:00
Haojun Liao 6d86ef0c33 other: merge 3.0 2022-07-25 11:22:09 +08:00
Haojun Liao 9bddf99d7d refactor(query): do some internal refactor. 2022-07-25 11:17:45 +08:00
Cary Xu 00a9598ac8 enh: rsma level 2/3 submitReq msg use wal version 2022-07-22 20:39:13 +08:00
Hongze Cheng 8cdef36879 fix: sam cases 2022-07-22 04:56:15 +00:00
Hongze Cheng cd762afe76 Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/hzcheng_3.0 2022-07-22 04:50:24 +00:00
Hongze Cheng b27272d784 fix memory leak 2022-07-22 01:40:02 +00:00
Haojun Liao 7522c2edf3 refactor: do some internal refactor. 2022-07-21 20:44:36 +08:00
Hongze Cheng bce29321c6 Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/hzcheng_3.0 2022-07-21 12:40:03 +00:00
Hongze Cheng 6a7a3da3db fix some crash 2022-07-21 11:56:18 +00:00
Hongze Cheng 684dd82358 fix read concurrency 2022-07-21 11:42:42 +00:00
Haojun Liao 8e42bf85e8 fix(query): fix border check. 2022-07-21 15:47:22 +08:00
Hongze Cheng f195decac9 more fix 2022-07-21 06:27:32 +00:00
Haojun Liao 2a437ee38a fix(query): close del handle when successing in read del file content. 2022-07-21 11:35:31 +08:00
Haojun Liao c2d588a118 other:merge 3.0 2022-07-21 11:29:34 +08:00
Haojun Liao ef0d705c5f fix(query): close del file read handle. 2022-07-21 11:27:20 +08:00
Minglei Jin 37bb5caf29
Merge pull request #15205 from taosdata/fix/TD-17582
fix: use suid from pReader
2022-07-20 19:44:40 +08:00
Minglei Jin 5cc829e45f fix: use suid from pReader 2022-07-20 18:47:46 +08:00
Minglei Jin 982b11f6eb
Merge pull request #15184 from taosdata/fix/TD-17582
fix: use Ex version of metaGetTbTSchema to retrieve schema
2022-07-20 16:51:10 +08:00
Minglei Jin 527aa3584d fix: get suid from uid to be used to retrieve schema 2022-07-20 15:26:47 +08:00
Minglei Jin eefad2bd9d fix: use Ex version of metaGetTbTSchema to retrieve schema 2022-07-20 14:28:13 +08:00
WANG MINGMING 258f4fb20a
Merge branch '3.0' into feature/TD-14761 2022-07-20 11:20:42 +08:00
Minglei Jin e422d7dbf5 fix: remove assert if schema is null 2022-07-20 10:29:21 +08:00
wangmm0220 bc0e8e3061 fix:invalidate in telnet schemaless 2022-07-20 09:48:57 +08:00
Haojun Liao a0428f5685 fix(query): add null ptr check. 2022-07-19 18:05:26 +08:00
Hongze Cheng 024f2221b7 Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/hzcheng_3.0 2022-07-19 08:31:16 +00:00
Hongze Cheng 657c2dcaa4 more r/w concurrency 2022-07-19 07:21:15 +00:00
Hongze Cheng 58135a1aeb tsdb r/w concurrency 2022-07-19 06:19:01 +00:00
Haojun Liao 5e754a7662 fix(query): add check for deleting record 2022-07-19 14:00:45 +08:00
dapan1121 077fbd6787
Merge pull request #15010 from taosdata/fix/TD-17460
fix: fix taosd mem leak
2022-07-18 09:18:43 +08:00
dapan1121 9ec14ece62 fix: fix taosd mem leak 2022-07-16 18:58:29 +08:00
Hongze Cheng 989159f0ba vnod snapshot done 2022-07-15 13:02:24 +00:00
Haojun Liao fd2dec280b fix(query): fix memory leak. 2022-07-15 11:18:26 +08:00
Haojun Liao 707f0a837a fix(query): set correct fill output object. 2022-07-14 20:11:29 +08:00
Haojun Liao 75aca0b031 fix(query): set correct fill output column index, fix some memory leak, and do some internal refactor, 2022-07-14 13:53:23 +08:00
Haojun Liao 083de75afc fix(query):fix memory leak. 2022-07-13 23:15:58 +08:00
Haojun Liao 2c1efc3963 other: merge 3.0 2022-07-12 21:10:10 +08:00
Liu Jicong a34d344225
Merge pull request #14808 from taosdata/feature/stream
refactor(tmq): prepare only needed
2022-07-12 18:09:31 +08:00
Haojun Liao 85ddb63e53 fix(query): free resources in tsdbread 2022-07-12 17:44:10 +08:00
Liu Jicong 8e3f5135a6 fix(tsdb): close fd 2022-07-12 17:28:14 +08:00
Cary Xu 6c5e8bae55 fix: use correct keep2 when set least ts for query 2022-07-12 14:14:42 +08:00
Haojun Liao 4527447b60 fix(query): handle the indefinit function output with partition by 2022-07-11 11:13:49 +08:00
Haojun Liao 7dc7f478de refactor: do some internal refactor and fix some memory leak. 2022-07-10 17:34:21 +08:00
Haojun Liao 40380ef9c1 refactor: do internal refactor. 2022-07-10 10:15:27 +08:00
Haojun Liao fceee02622
Merge branch '3.0' into feature/3_liaohj 2022-07-09 11:11:11 +08:00
Haojun Liao 3e81daf578 fix(query): fix memory leak. 2022-07-08 17:28:37 +08:00
dapan1121 50a6ef7f39
Merge pull request #14635 from taosdata/feature/insertselect
feat: support insert from query res
2022-07-08 16:59:21 +08:00
Haojun Liao 1711d646c1
Merge pull request #14671 from taosdata/feature/3_liaohj
enh(query): add block sma for int type column data.
2022-07-08 16:23:13 +08:00
Shengliang Guan 09c095a91c fix: asan error 2022-07-08 11:51:35 +08:00
Haojun Liao c339800611 fix(query): handle delete duration generating data block. 2022-07-08 11:02:12 +08:00
dapan1121 0925064d24 Merge branch 'feature/3.0_debug_wxy' into feature/insertselect 2022-07-08 10:28:53 +08:00
Haojun Liao 5c2e98544d fix(query): check if the data block overlaps with the delete skyline 2022-07-07 22:40:20 +08:00
Haojun Liao 211985f03e refactor: do some internal refactor. 2022-07-07 17:23:54 +08:00
Haojun Liao 557873c1bc other: merge 3.0 2022-07-07 16:50:00 +08:00
Haojun Liao 41be3e4d04 refactor: do some internal refactor. 2022-07-07 15:56:43 +08:00
Haojun Liao 57bf509dee refactor: do some internal refactor. 2022-07-07 15:40:04 +08:00
Haojun Liao d9e5172357 fix(query): set the correct sma data 2022-07-07 15:32:56 +08:00
Haojun Liao 4d2bc796e7 enh(query): add block sma for int type column data. 2022-07-07 11:26:58 +08:00
dapan1121 d4696ef31f Merge branch '3.0' into feature/insertselect 2022-07-07 09:02:09 +08:00
yihaoDeng 1e5ddcb92f merge 3.0 2022-07-06 18:29:11 +08:00
dapan1121 0d4fb5bb80 feat: support insert from query 2022-07-06 16:29:51 +08:00
Haojun Liao ddb71ed095 refactor: do some internal refactor. 2022-07-06 13:33:21 +08:00
Cary Xu 442a781781 Merge branch 'feat/tsdb_refact' of github.com:taosdata/TDengine into feat/tsdb_refact 2022-07-05 19:31:19 +08:00
Cary Xu eedaeda846 enh: rsma level 1/2 utilize separated version 2022-07-05 19:30:37 +08:00
Hongze Cheng 004a6571b0 Merge branch 'feat/tsdb_refact' of https://github.com/taosdata/TDengine into feat/tsdb_refact 2022-07-05 09:31:54 +00:00
Hongze Cheng 08a7d9d38f fix ci coredump 2022-07-05 09:31:51 +00:00
Haojun Liao c9ffc42ddb fix(query): set initial value for neighbor block check. 2022-07-05 17:02:21 +08:00
Haojun Liao 5b20f00383 refactor: do some internal refactor. 2022-07-05 14:38:45 +08:00
Haojun Liao 3bae30412c refactor: do some internal refactor. 2022-07-05 13:57:07 +08:00
Haojun Liao c7559a81ca refactor: do some internal refactor. 2022-07-04 23:28:27 +08:00
Minglei Jin 8d00f1139a tsdbRead: fix None display to NULL instead of 0 2022-07-04 14:46:00 +08:00
Haojun Liao 16d18b8046 refactor: do some internal refactor. 2022-07-04 14:10:29 +08:00
Hongze Cheng 38ca993452 make merge compile 2022-07-04 05:21:02 +00:00
Hongze Cheng ddb198de23 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/tsdb_refact 2022-07-04 03:42:50 +00:00
Haojun Liao a7cbb93a38 refactor: do some internal refactor. 2022-07-03 23:00:12 +08:00
Haojun Liao ba8ab92632 refactor: do some internal refactor. 2022-07-02 23:37:31 +08:00
Haojun Liao 42d635a73d refactor: do some internal refactor. 2022-07-02 20:39:23 +08:00
Haojun Liao a0e38fc703 refactor: do some internal refactor. 2022-07-02 15:22:49 +08:00
Haojun Liao 42d0af5cf7 refactor: do some internal refactor. 2022-07-02 14:17:27 +08:00
Haojun Liao 99fb3c678c refactor: do some internal refactor. 2022-07-02 12:05:03 +08:00
Hongze Cheng 7d50bfcb0d more code 2022-07-01 15:10:46 +00:00
Haojun Liao 34e4980a51 refactor(query): do some internal refactor. 2022-07-01 15:19:02 +08:00
Haojun Liao 0db8d77a70 refactor: do some internal refactor. 2022-06-30 23:38:18 +08:00
Liu Jicong 8dece648e3 feat(tmq): enable withTbName config for snapshot 2022-06-30 15:38:27 +08:00
Haojun Liao d377a89afd refactor: do some internal rafactor. 2022-06-30 15:17:04 +08:00
Haojun Liao 0758751b0c refactor: do some internal refactor. 2022-06-30 14:50:59 +08:00
Liu Jicong 4695dc2dae feat(tmq): add snapshot test 2022-06-30 14:41:50 +08:00
Hongze Cheng 319e745dd5 more work 2022-06-30 06:02:47 +00:00
Haojun Liao c5951374d4 refactor: do internal refactor. 2022-06-29 20:25:03 +08:00
Hongze Cheng aefc151c03 fix some code 2022-06-29 10:37:35 +00:00
Haojun Liao 3a566d5e5e refactor(query): do some internal refactor. 2022-06-29 17:14:00 +08:00
Haojun Liao 6464a3d272 refactor(query): do some internal refactor. 2022-06-29 14:18:03 +08:00
Haojun Liao f2b83dfb4a fix(query):check null ptr. 2022-06-29 10:35:07 +08:00
Haojun Liao b8bc052aa4 refactor(query): do some internal refactor. 2022-06-29 09:40:31 +08:00
Haojun Liao 4a59e1300b other: merge 3.0. 2022-06-28 15:22:32 +08:00
Haojun Liao 6a32f81265 fix(query): retrieve in-memory buffer data. 2022-06-28 11:37:26 +08:00
Haojun Liao c638c33a76 enh(query): retrieve in-memory data. 2022-06-28 10:32:42 +08:00
Cary Xu e6dd04f573 refactor: rsma restore 2022-06-27 14:47:14 +08:00
Haojun Liao dbd8c300fa refactor: do tsdbread refactor. 2022-06-27 10:46:20 +08:00
Cary Xu 0597f3b9cd refactor: rsma resource release 2022-06-26 18:44:49 +08:00
slzhou a9f094613a fix: restore table merge scan operator 2022-06-25 13:52:52 +08:00
wangmm0220 a95f98f7e7 feat:merge from 3.0 2022-06-23 20:50:48 +08:00
wangmm0220 3799db4366 feat:sort table group if needed 2022-06-23 20:46:11 +08:00
wangmm0220 26cceaf172 feat:sort table group if needed 2022-06-23 19:58:12 +08:00
Haojun Liao bf0caa2038 Merge branch '3.0' into feature/3_liaohj 2022-06-22 20:32:02 +08:00
shenglian zhou c1f5f825b7 feat: prepare for multiple group tsdb reads 2022-06-22 18:51:16 +08:00
Haojun Liao 5c1e7f3114 Merge branch '3.0' into feature/3_liaohj 2022-06-22 17:23:57 +08:00
Haojun Liao 14ddf539e0 refactor(query): do some internal refactor. 2022-06-22 17:21:04 +08:00
afwerar 9dff7b93c6 test: fix sim test error 2022-06-21 20:04:55 +08:00
Haojun Liao 659e429b87 feature(query): support show table block distribution. 2022-06-20 12:54:46 +08:00
Hongze Cheng 21ea4e3a0b more work 2022-06-20 02:38:08 +00:00
Hongze Cheng 64554461f6 more work 2022-06-17 12:22:45 +00:00
Hongze Cheng 095ca03f0d more work 2022-06-17 06:29:06 +00:00
Hongze Cheng 75816b7e7a more work 2022-06-16 12:53:25 +00:00
Hongze Cheng 813005eb7b query start 2022-06-16 11:32:05 +00:00
Hongze Cheng 760905f632 refact 2022-06-16 11:14:56 +00:00
Hongze Cheng 5bd3732adf refact more code 2022-06-16 09:53:07 +00:00
Hongze Cheng 5485c7fc9f refact tsdb read 2022-06-16 09:18:30 +00:00
Hongze Cheng d59b0254d3 more work 2022-06-16 08:58:00 +00:00
Hongze Cheng 07792850cb refact code 2022-06-16 06:29:28 +00:00
Hongze Cheng b0b30215af more work 2022-06-16 04:00:15 +00:00
Hongze Cheng 47b11afe10 more work 2022-06-16 01:32:48 +00:00
Hongze Cheng 0ef7eec754 more work 2022-06-13 12:12:54 +00:00
Hongze Cheng c94ac9a1e4 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/tsdb_refact 2022-06-13 09:11:11 +00:00
shenglian zhou dc56c636ea Merge branch '3.0' of github.com:taosdata/TDengine into szhou/feature/multiwaymerge 2022-06-13 15:08:26 +08:00
shenglian zhou 140e15bc8d fix: merge interval operator optimization and explain analyze multimerge operator 2022-06-13 15:07:54 +08:00
Hongze Cheng 2c63430804 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/tsdb_refact 2022-06-13 06:10:51 +00:00
Haojun Liao 0b8dd61f41 fix(query): fix some memory leaks. 2022-06-13 09:33:08 +08:00
Hongze Cheng 2f87d80d1c Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/tsdb_refact 2022-06-10 09:49:13 +00:00
Liu Jicong 2be81daf2e
Merge pull request #13681 from taosdata/feature/stream
refactor(tsdb): tsdb reader open
2022-06-10 15:53:03 +08:00
Liu Jicong 6fcee0e244 refactor(tsdb): tsdb reader open 2022-06-10 15:20:57 +08:00
Hongze Cheng 17efc22b03 refact: 1 2022-06-10 06:48:21 +00:00
Haojun Liao c55aae2c0c enh(query): block distribution query is supported. 2022-06-10 09:51:57 +08:00
Hongze Cheng 53d66c41ac fix ci test 2022-06-07 08:10:21 +00:00
Hongze Cheng 892021b089 fix tsdb save 2022-06-07 05:24:25 +00:00
Hongze Cheng 92f68d83f1 fix query problem 2022-06-06 12:57:35 +00:00
Hongze Cheng 5852936a8d fix query problem 2022-06-06 12:46:21 +00:00
Hongze Cheng c28aac66dc more 2022-06-06 12:22:21 +00:00
Hongze Cheng 487530636d feat: tsdb multi-version 1 2022-06-06 10:00:48 +00:00
Hongze Cheng 461cd037bf Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/row_refact 2022-06-06 01:24:46 +00:00
Hongze Cheng f81d102747 refact 2022-06-06 01:24:14 +00:00
Yihao Deng 6c57bb2b07
Merge pull request #13480 from taosdata/enh/json_index
Enh/json index
2022-06-05 22:34:30 +08:00
Hongze Cheng 9ea8640b24 refact 2022-06-05 13:50:10 +00:00
yihaoDeng 0ca6a5ae27 refactor json index 2022-06-05 21:46:07 +08:00
Cary Xu fbdffd87ad
Merge pull request #13481 from taosdata/feature/TD-14481-3.0
enh: check max/sum/avg func for rsma
2022-06-05 20:30:05 +08:00
Cary Xu 1c46958cb4 enh: check max/sum/avg func for rsma 2022-06-05 19:55:06 +08:00
Hongze Cheng 32ee762924 add version on some structures 2022-06-04 14:27:34 +00:00
Shengliang Guan 0bade86534
Merge pull request #13410 from taosdata/fix/mnode
enh: adjust vnode replica and some logs
2022-06-02 17:06:10 +08:00
Shengliang Guan 27c1687a05 refactor: adjust some logs 2022-06-02 14:30:26 +08:00
Liu Jicong f2048b00cb fix(tmq): subscribe stb 2022-06-02 11:01:05 +08:00
Cary Xu 15b25eeec5 feat: tsma/rsma refactor 2022-06-01 15:06:12 +08:00
slzhou@taodata.com 32135e442f fix: tsdb can mixed block even output capacity is greater than block rows 2022-05-30 21:39:55 +08:00
Yihao Deng 7710766583
Merge branch '3.0' into enh/tagFlt 2022-05-28 18:40:54 +08:00
yihaoDeng 6acbe7e777 enh: support tag filter 2022-05-28 16:15:24 +08:00
Haojun Liao 49ba25d507 fix(query): get correct table schema version. 2022-05-28 14:30:39 +08:00
slzhou 7a459a26a8 enhance:modify table scan operator that can accept several scan ranges 2022-05-27 17:59:27 +08:00
wangmm0220 051020f932 fix: remove table group code in 2.x 2022-05-26 16:05:27 +08:00
wangmm0220 29db3bad79 feat: add tag condition 2022-05-25 22:42:44 +08:00
wangmm0220 4825d48019 feat: add tag condition 2022-05-25 22:34:34 +08:00
wangmm0220 71ec636c3c feat: add tag condition 2022-05-25 22:29:24 +08:00
wangmm0220 eea32f5f0a feat: add tag condition 2022-05-25 22:21:04 +08:00
Cary Xu f63552c213 fix: use bound index instead of colid in case of alter schema 2022-05-23 15:25:01 +08:00
Cary Xu 3570705ebd enh: add merge case to ci and code optimization 2022-05-22 22:12:10 +08:00
Cary Xu f4aaf791fb fix: check commit and merge and add cases 2022-05-22 19:37:32 +08:00
Haojun Liao 23801197fc fix(query): set the correct schema version for rows in buffer. 2022-05-21 14:46:44 +08:00
Cary Xu e9607a9e25 feat: add cases to merge dup data in file and mem 2022-05-20 17:24:10 +08:00
Cary Xu d2e9f408b0 Merge branch '3.0' into feature/TD-13066-3.0 2022-05-20 15:30:18 +08:00
Haojun Liao 5809c980e2 fix(query): fix syntax error on windows platform. 2022-05-20 11:11:01 +08:00
Cary Xu 3ab9b88dd7 Merge branch '3.0' into feature/TD-13066-3.0 2022-05-19 23:54:56 +08:00
Cary Xu 9a022bca60 feat: add case for update without multi-version 2022-05-19 23:54:44 +08:00
Haojun Liao cded09bf79 enh(query): limit the rsp ssdatablock size. 2022-05-19 23:47:27 +08:00
Haojun Liao f636806c2a other: merge 3.0 2022-05-19 17:07:01 +08:00
Cary Xu 156b0cfebf feat: tsma logic optimization 2022-05-17 23:33:59 +08:00
Haojun Liao 004c1e5157
Merge pull request #12578 from taosdata/feature/3.0_liaohj
enh(query): reverse scan table to generated interval results.
2022-05-17 12:36:16 +08:00
Haojun Liao eb6f95c7dd enh(query): reverse scan table to generated interval results. 2022-05-17 12:16:44 +08:00
Cary Xu e054b3b4d8 feat: sma refactor and add cases 2022-05-16 23:55:17 +08:00
Haojun Liao 3ebebcb841
Merge pull request #12536 from taosdata/feature/3.0_liaohj
fix(query): return error code when connecting to database failed.
2022-05-16 15:04:26 +08:00
Haojun Liao c1b332f34d refactor: do some internal refactor. 2022-05-16 14:38:56 +08:00
Haojun Liao 4c1e835db3
Merge pull request #12528 from taosdata/feature/3.0_liaohj
fix(query): merge updated data from cache.
2022-05-16 14:06:00 +08:00
Haojun Liao 619eae3c49 fix(query): merge updated data from cache. 2022-05-16 13:51:21 +08:00
Hongze Cheng da75e3d19f Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/alter_table 2022-05-14 14:40:18 +00:00
Hongze Cheng 65edd3296e feat: alter super table 2022-05-14 14:29:04 +00:00
Haojun Liao b6677e1a5d fix(query): remove expired moving data operation during extract data from in-memory buffer. 2022-05-14 22:13:27 +08:00
Cary Xu d66bb65171 feat(tsdb): unit of days and keep support minute 2022-05-12 18:32:32 +08:00
Hongze Cheng ae509e874e fix: concurrent r/w meta 2022-05-11 14:20:14 +00:00
Cary Xu 7e093163dc fix: commit table in mem and file 2022-05-11 07:43:14 +08:00
Cary Xu 1df5468f79
Merge pull request #12292 from taosdata/feature/TD-14481-3.0
feat: code refactor for rollup
2022-05-10 13:28:26 +08:00
Cary Xu 20ce1b7936 feat: code refactor for rollup 2022-05-10 00:03:44 +08:00
dapan af2ba729b0 Merge remote-tracking branch 'origin/3.0' into feature/qnode 2022-05-09 20:04:00 +08:00
Cary Xu 35c2f9e484 fix: code optimization 2022-05-09 12:00:07 +08:00
Cary Xu 4b6cae113f enh: code optimization 2022-05-09 11:51:18 +08:00
Cary Xu 50235b71dd merge 3.0 2022-05-09 11:49:10 +08:00
Cary Xu 2c4b44b590 fix: merge data of mem and file 2022-05-09 11:46:00 +08:00
Cary Xu ddb2e95c10 fix: merge mix data of mem and file 2022-05-09 08:55:33 +08:00
dapan 71dbed3ede Merge remote-tracking branch 'origin/3.0' into feature/qnode 2022-05-09 08:16:02 +08:00
Cary Xu 215613f4cd feat: set tsdb cfg for rollup sma 2022-05-07 22:33:19 +08:00
dapan1121 6f49a2ca73 stmt insert 2022-05-07 21:10:52 +08:00
Cary Xu f942f144e9 feat: bitmap operation optimization 2022-05-07 11:12:46 +08:00
Cary Xu b1a429f7df feat: code optimization for update 2022-05-07 00:56:07 +08:00
Cary Xu bcdf9c19b2 feat: update refactor 2022-05-06 19:31:20 +08:00
Cary Xu 6588dfe4f2 Merge branch '3.0' into feature/TD-13066-3.0 2022-05-05 23:43:35 +08:00
Haojun Liao 02c7fcc228 Merge branch '3.0' into feature/3.0_liaohj 2022-05-05 19:00:07 +08:00
Haojun Liao c1659805b6 fix(query): do perform arithmetic operator before apply the sort procedure. 2022-05-05 18:54:19 +08:00
Cary Xu 319d2785ab feat: update support merge in mem 2022-05-05 18:33:31 +08:00
Cary Xu 7a8f8e11a5 feat: support update in mem/file 2022-05-05 16:00:35 +08:00
Haojun Liao d20d78729e
Merge pull request #12097 from taosdata/feature/3.0_liaohj
fix(query): set the correct primary timestamp column for state window operator.
2022-05-03 22:14:28 +08:00
Haojun Liao 0799a5eaf7 refactor: do some internal refactor. 2022-05-03 14:43:53 +08:00
Cary Xu cca06e2b71 feat: rollup data query 2022-05-02 18:18:47 +08:00
Cary Xu 4ca81bec89 feat: rollup data query 2022-05-02 18:16:43 +08:00
Cary Xu 5a0ae19cbc feat: submit req msg iter refactor 2022-05-01 10:50:23 +08:00
Cary Xu 50bba1397c feat: bsma logic optimization 2022-04-29 21:32:54 +08:00
Haojun Liao ca786a9251
Merge pull request #12065 from taosdata/feature/3.0_liaohj
enh(query): enable check sma status for each column in query.
2022-04-29 20:49:46 +08:00
Haojun Liao c71c88a719 enh(query): enable check sma status for each column in query. 2022-04-29 20:07:33 +08:00
Haojun Liao 210e9cdbd8
Merge pull request #12059 from taosdata/feature/3.0_liaohj
fix(query): avoid to build dummy value column in group by constant value.
2022-04-29 18:48:19 +08:00
Hongze Cheng ab0e435d81 Merge branch '3.0' of https://github.com/taosdata/TDengine into feature/vnode_refact1 2022-04-29 10:02:58 +00:00