Commit Graph

495 Commits

Author SHA1 Message Date
Hongze Cheng d596f3be4a Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-03-23 16:29:03 +08:00
dapan1121 5b02af6a91 fix: merge main to 3.0 2023-03-22 16:08:16 +08:00
Hongze Cheng 4f0833e1a0 more code 2023-03-22 14:41:16 +08:00
Minglei Jin 0b31aac2c5 enh(tsdb/cache): skip data block with merge tree 2023-03-22 10:19:58 +08:00
Xiaoyu Wang ca39dfcf2d feat: show vgroup display num of cache tables 2023-03-13 17:21:32 +08:00
Xiaoyu Wang 62377619ba enh: optimizing stt file reading in last query 2023-03-13 15:05:24 +08:00
Xiaoyu Wang 47417e003e enh: optimize last/last_row cost when the cache was first loaded 2023-03-09 18:54:15 +08:00
Xiaoyu Wang 7deee1c4c7 fix: last cache read problem after schema change 2023-03-02 18:22:42 +08:00
Xiaoyu Wang c597de099f merge main 2023-02-20 13:41:27 +08:00
Xiaoyu Wang 9bc225ffda merge 3.0 2023-02-09 09:44:29 +08:00
Hongze Cheng 8d6e6d2fe0 more code 2023-02-08 17:46:11 +08:00
Xiaoyu Wang 09925437e3 merge main 2023-02-08 09:51:52 +08:00
Haojun Liao 3822225231 other: merge main. 2023-02-06 16:24:15 +08:00
Hongze Cheng 09628401f8 refact code 2023-02-06 14:49:50 +08:00
Minglei Jin 023b8377fb enh(tsdb/cache): new block index cache for querying 2023-02-06 14:12:57 +08:00
Haojun Liao e29ca4f5d8 refactor(query): use real number of stt instead of default value. 2023-02-03 10:04:15 +08:00
Haojun Liao ab8c977417 other: merge main. 2023-02-02 14:00:36 +08:00
Hongze Cheng 11bc53bbd7 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/vnode_compact 2023-01-31 14:07:58 +08:00
Hongze Cheng 5e7b6602c5 Merge branch 'main' of https://github.com/taosdata/TDengine into fix/3.0_merge_main 2023-01-29 14:05:15 +08:00
Hongze Cheng d6028bdde1 some code 2023-01-18 14:59:02 +08:00
Minglei Jin e48bdbfd0f tsdb/log-query: new proactive flag for mem table unref 2023-01-10 11:52:40 +08:00
Hongze Cheng bff8c216cc more code 2023-01-10 11:36:40 +08:00
Hongze Cheng ad9e8a9aa3 more code 2023-01-09 19:03:09 +08:00
Hongze Cheng 2e443c395e more code 2023-01-09 15:51:30 +08:00
Haojun Liao f90fa07ea9 refactor: add avx support zigzag decode. 2023-01-08 12:34:18 +08:00
Hongze Cheng a046dbb02b Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/vnode_compact 2023-01-05 13:57:55 +08:00
Minglei Jin 625bf9992f
Merge branch '3.0' into fix/long_query 2023-01-04 15:15:51 +08:00
Xiaoyu Wang 9df6f69371 merge 3.0 2023-01-04 15:02:31 +08:00
Xiaoyu Wang fdde287ca9 merge main 2023-01-04 11:43:20 +08:00
Hongze Cheng 5e579398e8 more code 2023-01-03 18:16:52 +08:00
Hongze Cheng 1567fe2f67 fix: skiplist concurrent access 2023-01-03 17:19:19 +08:00
Hongze Cheng 4936eb5b2c more code 2022-12-30 16:55:49 +08:00
Hongze Cheng 47d493e851 more code 2022-12-30 14:49:55 +08:00
Minglei Jin 2ed9c19da4 Merge branch 'v3.0' into fix/long_query 2022-12-29 17:43:51 +08:00
Hongze Cheng 6f30871fd6 more code 2022-12-29 09:10:57 +08:00
Hongze Cheng a0fa31954c Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/vnode_compact 2022-12-28 13:53:59 +08:00
Haojun Liao 723efba79b
Merge branch '3.0' into refact/submit_req 2022-12-26 13:25:25 +08:00
Hongze Cheng b000fb09ba Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/vnode_compact 2022-12-26 13:17:30 +08:00
Haojun Liao 224f5a72c2 refactor: do some internal refactor. 2022-12-23 17:45:12 +08:00
Hongze Cheng 3278c11491 more code 2022-12-22 15:02:39 +08:00
Hongze Cheng f4f08b24d2 fix: wrong row sversion 2022-12-06 19:56:43 +08:00
Hongze Cheng 2cfdf7bf62 finish more code 2022-12-02 14:24:23 +08:00
Hongze Cheng 4828a19e10 more code 2022-12-02 10:42:34 +08:00
Hongze Cheng 6dcdafa486 more code 2022-12-01 17:00:33 +08:00
Hongze Cheng 69617030fa more code 2022-12-01 16:51:36 +08:00
Hongze Cheng 0525b4fa0d more code 2022-12-01 15:36:10 +08:00
Hongze Cheng 73f8dc6a5b more code 2022-12-01 14:24:10 +08:00
Hongze Cheng fc50d94156 more coe 2022-12-01 11:45:26 +08:00
Hongze Cheng f5270f6a0c adjust api 2022-11-30 10:30:03 +08:00
Hongze Cheng 0f8016995c more code 2022-11-28 13:41:06 +08:00
Haojun Liao 9a208b2d09 other: merge 3.0 2022-11-24 17:08:15 +08:00
Shengliang Guan 335a572d86
Revert "Revert "enh: row optimize2"" 2022-11-24 10:12:25 +08:00
Hongze Cheng ffbb04d40a
Revert "enh: row optimize2" 2022-11-24 09:21:26 +08:00
Hongze Cheng 49c78ed5ed Merge branch 'feat/mapdata_to_array' of https://github.com/taosdata/TDengine into refact/submit_req 2022-11-23 21:15:35 +08:00
Hongze Cheng 390709e3c8 add interface 2022-11-22 12:37:47 +08:00
Hongze Cheng 7976d88402 add interface 2022-11-22 10:10:23 +08:00
Hongze Cheng a5725b506c more code 2022-11-16 17:22:09 +08:00
Hongze Cheng aaef32ca69 refact code for further code change 2022-11-16 10:27:05 +08:00
Hongze Cheng 5b51f97a48 more optimize 2022-11-14 16:52:39 +08:00
Hongze Cheng 86ed5e5674 more optimize 2022-11-09 16:02:04 +08:00
Shengliang Guan dfbb958128
Merge pull request #17929 from taosdata/perf/sma_optimize
perf: optimize sma calculation
2022-11-08 10:03:12 +08:00
Hongze Cheng d52b8966fc perf: optimize block data operation 2022-11-07 16:56:35 +08:00
Hongze Cheng 70f7e3e379 perf: optimize sma calculation 2022-11-07 15:42:53 +08:00
Haojun Liao 03f4918b3b refactor: do some internal refactor. 2022-11-04 18:46:48 +08:00
Haojun Liao fc20be8699 fix(query): get if the correct rows in last block exists, and set the correct flag to denote if the last blocks index have been loaded or not. 2022-11-02 22:27:23 +08:00
Minglei Jin 5ae5df1a17 Merge branch 'v3.0' into fix/long_query 2022-11-01 18:06:39 +08:00
Minglei Jin ef606d3fd9 tsdb/read: first round long query for non-cache reading 2022-11-01 16:38:35 +08:00
Haojun Liao 9b99c69785 fix(query): support partition by + limit push down. 2022-10-28 19:56:32 +08:00
Haojun Liao 4b2fa43dae
Revert "fix(query): handle partition by in table scan operator" 2022-10-28 18:05:19 +08:00
Haojun Liao 5a971dd03a fix(query): handle partition by in table scan operator with limit/offset value. 2022-10-27 16:58:32 +08:00
Minglei Jin eac3847532 fix: new reseek callback to separate tsdb & cache readers 2022-10-27 16:48:33 +08:00
Minglei Jin 7800b7731d Merge branch 'v3.0' into fix/long_query 2022-10-27 10:39:50 +08:00
Minglei Jin b52ad0f740 tsdb/cache: new separate dataf reader for last file reading 2022-10-26 08:58:38 +08:00
Minglei Jin 89f7ad2920 fix: optimize tsdb cache loading speed 2022-10-25 10:36:30 +08:00
Haojun Liao abff4fb1f2
Merge pull request #17336 from taosdata/feature/3_liaohj
other:merge 3.0, and support last query cache
2022-10-20 18:15:38 +08:00
Hongze Cheng 0706f2dea2 more code 2022-10-18 16:54:53 +08:00
Hongze Cheng 1779c17375 more code 2022-10-18 16:22:06 +08:00
Hongze Cheng b7342525c7 more code 2022-10-18 13:38:26 +08:00
Haojun Liao da9df99461 fix(query): opt last query. 2022-10-17 17:59:43 +08:00
Hongze Cheng 12371d344b Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/stream_compression 2022-09-28 17:49:16 +08:00
Shengliang Guan 53bfdf7bbb
Merge pull request #17117 from taosdata/revert-17106-feature/TD-18581-D
Revert "enh(tsdb): data migrate should not block data r/w and commit"
2022-09-28 17:43:21 +08:00
Haojun Liao 71e3993185
Merge pull request #17114 from taosdata/feature/3_liaohj
refactor(query): do some internal refactor.
2022-09-28 17:36:01 +08:00
Cary Xu 1fe66cb846
Revert "enh(tsdb): data migrate should not block data r/w and commit" 2022-09-28 15:50:29 +08:00
Haojun Liao 14412f2811 refactor(query): do some internal refactor. 2022-09-28 11:16:52 +08:00
Cary Xu 0841442db6 feat: logic optimization for data migration 2022-09-28 07:41:38 +08:00
Cary Xu 11d6db5ab2 Merge branch '3.0' into feature/TD-18581-D 2022-09-27 19:29:59 +08:00
Hongze Cheng 8bd8ff1523 more code 2022-09-27 18:59:29 +08:00
Hongze Cheng a53575a152 more code 2022-09-27 17:57:57 +08:00
Hongze Cheng a4d16f1c00 more code 2022-09-27 17:36:02 +08:00
Hongze Cheng e17c65fd82 Merge branch 'enh/load_by_column' of https://github.com/taosdata/TDengine into feat/stream_compression 2022-09-27 16:22:42 +08:00
Hongze Cheng 3bd6808335 fix coredump 2022-09-27 15:37:00 +08:00
Cary Xu 43c954b6e7 chore: data migration support specify max speed 2022-09-27 14:27:18 +08:00
Haojun Liao cbe91fd4c3 fix(query): initialize the blockdata before load last block. 2022-09-27 13:48:53 +08:00
Hongze Cheng 4bfdfe89a5 adjust api 2022-09-27 11:02:04 +08:00
Cary Xu 6c682daf42 Merge branch '3.0' into feature/TD-18581-D 2022-09-27 10:33:51 +08:00
Hongze Cheng bba042124f Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/stream_compression 2022-09-27 09:27:02 +08:00
Hongze Cheng 19529d6606 fix: wrong file corrupt report 2022-09-26 18:57:14 +08:00
Cary Xu ed2b3678a6 feat(tsdb): migrate support speed limit 2022-09-23 18:57:13 +08:00
Cary Xu 797b9376e7 chore: code optimization for fs destroy 2022-09-23 17:27:48 +08:00
Hongze Cheng 8ff1eb41d1 more code 2022-09-23 17:13:14 +08:00
Hongze Cheng da2150a15b more code 1 2022-09-23 16:45:38 +08:00
Cary Xu b8ea469aff enh(tsdb): data migrate should not block data r/w and commit 2022-09-23 16:42:36 +08:00
Hongze Cheng a3cedbf1bc more code 2022-09-22 13:49:34 +08:00
Hongze Cheng 9f7771cde4 refact more code 2022-09-22 11:52:47 +08:00
Hongze Cheng a8b919918f more code 2022-09-21 17:58:44 +08:00
Hongze Cheng fb45b8d577 refact code 2022-09-20 13:39:32 +08:00
Hongze Cheng f845a01480 more code 2022-09-15 18:04:39 +08:00
Hongze Cheng 9b29931f78 more code 2022-09-15 17:45:47 +08:00
Hongze Cheng 3a4273406e more code 2022-09-15 17:32:39 +08:00
Haojun Liao 22afbb5035
Merge branch '3.0' into feature/3_liaohj 2022-09-15 16:56:39 +08:00
Hongze Cheng d2141ea5ca more code 2022-09-15 16:44:33 +08:00
Haojun Liao 5ba41111b4 refactor: add some logs. 2022-09-15 16:17:39 +08:00
Hongze Cheng 87b59d2148 Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/long_query 2022-09-15 15:47:46 +08:00
Hongze Cheng 151fd39d1a more code 2022-09-15 14:51:40 +08:00
Hongze Cheng ce9fb84221 refact 2022-09-13 14:21:43 +08:00
Hongze Cheng b44eb59f5d tsdb retention fix done 2022-09-09 15:42:20 +08:00
Hongze Cheng e5e42524c7 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_page_size 2022-09-08 21:40:15 +08:00
Hongze Cheng f0a5820d01 add tsdb config support 2022-09-08 18:36:08 +08:00
Hongze Cheng eae7947c68 more refact 2022-09-08 17:58:33 +08:00
Hongze Cheng 2e8b43d01c more code 2022-09-08 16:56:29 +08:00
Hongze Cheng bb0b1fda91 Merge branch '3.0' of https://github.com/taosdata/TDengine into refact/tsdb_new_snapshot 2022-09-08 15:16:22 +08:00
Hongze Cheng 255f42e07f more tsdb snapshot 2022-09-08 15:13:58 +08:00
Haojun Liao 0b6070e518 refactor(query): add some logs. 2022-09-08 09:45:11 +08:00
Hongze Cheng 0e4b0459bd more code 2022-09-07 17:06:42 +08:00
Hongze Cheng 2d789f5ae0 more code 2022-09-07 15:37:51 +08:00
Hongze Cheng efb429ebd3 Merge branch '3.0' of https://github.com/taosdata/TDengine into refact/tsdb_new_snapshot 2022-09-07 09:45:52 +08:00
Hongze Cheng 56985c5217 snapshot read code 2022-09-06 17:41:06 +08:00
Haojun Liao 6f252d8d7a fix(query): opt perf on last block query. 2022-09-06 16:36:56 +08:00
Haojun Liao a5933fc682 fix(query): optimize last block read performance. 2022-09-06 15:25:54 +08:00
Haojun Liao 3719da865c other:merge 3.0 2022-09-05 19:02:04 +08:00
Haojun Liao a6cece10df fix(query): fix the invalid the check of last file blocks. 2022-09-05 18:57:46 +08:00
Hongze Cheng e70db79d10 refact: change sst to stt 2022-09-05 17:31:41 +08:00
Hongze Cheng c71455216c more code 2022-09-04 22:29:59 +08:00
Hongze Cheng 7e1306a976 more code 2022-09-04 20:28:12 +08:00
Hongze Cheng b85bde9a43 more code 2022-09-04 19:59:21 +08:00
Hongze Cheng 28b56baa98 more code 2022-09-04 18:23:19 +08:00
Hongze Cheng 3607b18368 more code 2022-09-04 18:20:12 +08:00
Hongze Cheng 8ec79c9d5c more code 2022-09-04 17:31:20 +08:00
Hongze Cheng fe20dea410 more code 2022-09-04 16:12:29 +08:00
Hongze Cheng 3e55e72ab5 more code 2022-09-04 14:31:32 +08:00
Hongze Cheng 173a8366e3 fix: compile warning 2022-09-02 17:20:50 +08:00
Hongze Cheng 696df47f05 more 2022-09-02 17:17:46 +08:00
Hongze Cheng 8329284a45 refact for further dev 2022-09-02 17:15:45 +08:00
Hongze Cheng 687dd81c44 refact more code 2022-09-02 14:26:57 +08:00
Hongze Cheng ecbca97ca4 more code 2022-09-02 13:55:05 +08:00
Haojun Liao cac1fd36b7 Merge remote-tracking branch 'origin/refact/tsdb_optimize' into refact/tsdb_optimize
# Conflicts:
#	source/dnode/vnode/src/inc/tsdb.h
#	source/dnode/vnode/src/tsdb/tsdbMergeTree.c
#	source/dnode/vnode/src/tsdb/tsdbRead.c
2022-09-02 11:23:01 +08:00
Haojun Liao 720f3b2482 refactor: do some internal refactor. 2022-09-02 11:20:12 +08:00
Hongze Cheng 0eb29455ae refact code 2022-09-02 11:19:34 +08:00
Hongze Cheng aec4297eb4 refact code 2022-09-02 11:16:23 +08:00
Hongze Cheng ff4fda8442 refact code 2022-09-02 10:43:49 +08:00