Commit Graph

529 Commits

Author SHA1 Message Date
Hongze Cheng 89eafa18cb Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-05-23 09:58:53 +08:00
Minglei Jin 75ccd024a2 cache/writebatch: separate read & write batches 2023-05-22 18:06:58 +08:00
Hongze Cheng 66ea10755e Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-05-19 10:58:12 +08:00
Minglei Jin b892b1fdfe cache/flag: fix cache flag compiling issue 2023-05-17 15:26:10 +08:00
Minglei Jin 756fefaa29 cache/batchread: load columns in one trip 2023-05-16 18:56:05 +08:00
Hongze Cheng c31b1034cd Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-05-15 14:26:40 +08:00
Haojun Liao 7ef16e1922 other: merge main. 2023-05-12 11:49:53 +08:00
Hongze Cheng 2a754394bf more code 2023-05-11 18:16:55 +08:00
Hongze Cheng faadf5d3a2 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-05-09 13:32:16 +08:00
Minglei Jin 2eec395720 cache/commit: flush cache when tsdb commits data 2023-05-08 11:14:59 +08:00
Minglei Jin 90be20a662 cache/lstring: use ltype with cache/get 2023-05-04 18:08:03 +08:00
Haojun Liao 9a35d4e950
Merge pull request #21087 from taosdata/fix/liaohj_main
refactor: do some internal refactor.
2023-04-26 17:57:37 +08:00
Haojun Liao 59725d1d87 refactor: do some internal refactor. 2023-04-26 12:02:43 +08:00
Haojun Liao 8d0a4772a5
Merge pull request #21070 from taosdata/fix/liaohj_main
enh(query): opt last row read performance. TD-23313
2023-04-26 11:54:48 +08:00
Hongze Cheng 49728a235e fix: more fix 2023-04-25 17:32:45 +08:00
Minglei Jin 2566bd4ae8 row/iter: fix null column iter 2023-04-25 16:17:58 +08:00
Haojun Liao 81e54541de refactor: do some internal refactor. 2023-04-25 14:24:24 +08:00
Haojun Liao ae8a9d25c0 refactor: do some internal refactor. 2023-04-25 09:41:49 +08:00
Haojun Liao c6daa68e54 enh(query): opt merge life cycle. 2023-04-25 00:17:37 +08:00
Haojun Liao 7360a6b65c enh(query): opt hash. 2023-04-24 16:39:55 +08:00
Haojun Liao 5663550de2 enh(query): opt query perf by allocate the SLDataIter when opening reader. 2023-04-24 15:47:02 +08:00
Minglei Jin 8f21090343 cache/delete: just remove affected cache entries 2023-04-24 10:47:28 +08:00
Minglei Jin 12fc21ae84 cache/get: use pRow from reader 2023-04-21 18:34:58 +08:00
Minglei Jin 642aa47887 last: first round implementation for column loading 2023-04-20 16:26:27 +08:00
Minglei Jin 76edc16ce1 operator/cache-scan: pass col list down to tsdb cache 2023-04-19 10:04:48 +08:00
Minglei Jin e159c4ead9 first round rocks batch write implementation 2023-04-18 14:25:35 +08:00
Minglei Jin ec4ea9cf5d enh(cache/rocks): base for rocks put/get 2023-04-14 18:28:15 +08:00
Hongze Cheng 3f8f7bb451 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-04-12 11:28:30 +08:00
Hongze Cheng a72633d715 more code 2023-04-11 14:22:36 +08:00
Minglei Jin 1ff8511eb3 tsdb/row merger: comment init out 2023-04-07 13:43:07 +08:00
Minglei Jin 55f7e41f3b tsdb/row merger: remove tsdbRowMerge 2023-04-07 13:31:33 +08:00
Hongze Cheng e8e0e4976e Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-04-06 15:51:20 +08:00
dapan1121 a87d35be08 fix: optimize performance 2023-03-28 17:40:46 +08:00
Hongze Cheng 8f84e88616 more code 2023-03-27 17:07:59 +08:00
Hongze Cheng d596f3be4a Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-03-23 16:29:03 +08:00
dapan1121 5b02af6a91 fix: merge main to 3.0 2023-03-22 16:08:16 +08:00
Hongze Cheng 4f0833e1a0 more code 2023-03-22 14:41:16 +08:00
Minglei Jin 0b31aac2c5 enh(tsdb/cache): skip data block with merge tree 2023-03-22 10:19:58 +08:00
Xiaoyu Wang ca39dfcf2d feat: show vgroup display num of cache tables 2023-03-13 17:21:32 +08:00
Xiaoyu Wang 62377619ba enh: optimizing stt file reading in last query 2023-03-13 15:05:24 +08:00
Xiaoyu Wang 47417e003e enh: optimize last/last_row cost when the cache was first loaded 2023-03-09 18:54:15 +08:00
Xiaoyu Wang 7deee1c4c7 fix: last cache read problem after schema change 2023-03-02 18:22:42 +08:00
Xiaoyu Wang c597de099f merge main 2023-02-20 13:41:27 +08:00
Xiaoyu Wang 9bc225ffda merge 3.0 2023-02-09 09:44:29 +08:00
Hongze Cheng 8d6e6d2fe0 more code 2023-02-08 17:46:11 +08:00
Xiaoyu Wang 09925437e3 merge main 2023-02-08 09:51:52 +08:00
Haojun Liao 3822225231 other: merge main. 2023-02-06 16:24:15 +08:00
Hongze Cheng 09628401f8 refact code 2023-02-06 14:49:50 +08:00
Minglei Jin 023b8377fb enh(tsdb/cache): new block index cache for querying 2023-02-06 14:12:57 +08:00
Haojun Liao e29ca4f5d8 refactor(query): use real number of stt instead of default value. 2023-02-03 10:04:15 +08:00
Haojun Liao ab8c977417 other: merge main. 2023-02-02 14:00:36 +08:00
Hongze Cheng 11bc53bbd7 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/vnode_compact 2023-01-31 14:07:58 +08:00
Hongze Cheng 5e7b6602c5 Merge branch 'main' of https://github.com/taosdata/TDengine into fix/3.0_merge_main 2023-01-29 14:05:15 +08:00
Hongze Cheng d6028bdde1 some code 2023-01-18 14:59:02 +08:00
Minglei Jin e48bdbfd0f tsdb/log-query: new proactive flag for mem table unref 2023-01-10 11:52:40 +08:00
Hongze Cheng bff8c216cc more code 2023-01-10 11:36:40 +08:00
Hongze Cheng ad9e8a9aa3 more code 2023-01-09 19:03:09 +08:00
Hongze Cheng 2e443c395e more code 2023-01-09 15:51:30 +08:00
Haojun Liao f90fa07ea9 refactor: add avx support zigzag decode. 2023-01-08 12:34:18 +08:00
Hongze Cheng a046dbb02b Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/vnode_compact 2023-01-05 13:57:55 +08:00
Minglei Jin 625bf9992f
Merge branch '3.0' into fix/long_query 2023-01-04 15:15:51 +08:00
Xiaoyu Wang 9df6f69371 merge 3.0 2023-01-04 15:02:31 +08:00
Xiaoyu Wang fdde287ca9 merge main 2023-01-04 11:43:20 +08:00
Hongze Cheng 5e579398e8 more code 2023-01-03 18:16:52 +08:00
Hongze Cheng 1567fe2f67 fix: skiplist concurrent access 2023-01-03 17:19:19 +08:00
Hongze Cheng 4936eb5b2c more code 2022-12-30 16:55:49 +08:00
Hongze Cheng 47d493e851 more code 2022-12-30 14:49:55 +08:00
Minglei Jin 2ed9c19da4 Merge branch 'v3.0' into fix/long_query 2022-12-29 17:43:51 +08:00
Hongze Cheng 6f30871fd6 more code 2022-12-29 09:10:57 +08:00
Hongze Cheng a0fa31954c Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/vnode_compact 2022-12-28 13:53:59 +08:00
Haojun Liao 723efba79b
Merge branch '3.0' into refact/submit_req 2022-12-26 13:25:25 +08:00
Hongze Cheng b000fb09ba Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/vnode_compact 2022-12-26 13:17:30 +08:00
Haojun Liao 224f5a72c2 refactor: do some internal refactor. 2022-12-23 17:45:12 +08:00
Hongze Cheng 3278c11491 more code 2022-12-22 15:02:39 +08:00
Hongze Cheng f4f08b24d2 fix: wrong row sversion 2022-12-06 19:56:43 +08:00
Hongze Cheng 2cfdf7bf62 finish more code 2022-12-02 14:24:23 +08:00
Hongze Cheng 4828a19e10 more code 2022-12-02 10:42:34 +08:00
Hongze Cheng 6dcdafa486 more code 2022-12-01 17:00:33 +08:00
Hongze Cheng 69617030fa more code 2022-12-01 16:51:36 +08:00
Hongze Cheng 0525b4fa0d more code 2022-12-01 15:36:10 +08:00
Hongze Cheng 73f8dc6a5b more code 2022-12-01 14:24:10 +08:00
Hongze Cheng fc50d94156 more coe 2022-12-01 11:45:26 +08:00
Hongze Cheng f5270f6a0c adjust api 2022-11-30 10:30:03 +08:00
Hongze Cheng 0f8016995c more code 2022-11-28 13:41:06 +08:00
Haojun Liao 9a208b2d09 other: merge 3.0 2022-11-24 17:08:15 +08:00
Shengliang Guan 335a572d86
Revert "Revert "enh: row optimize2"" 2022-11-24 10:12:25 +08:00
Hongze Cheng ffbb04d40a
Revert "enh: row optimize2" 2022-11-24 09:21:26 +08:00
Hongze Cheng 49c78ed5ed Merge branch 'feat/mapdata_to_array' of https://github.com/taosdata/TDengine into refact/submit_req 2022-11-23 21:15:35 +08:00
Hongze Cheng 390709e3c8 add interface 2022-11-22 12:37:47 +08:00
Hongze Cheng 7976d88402 add interface 2022-11-22 10:10:23 +08:00
Hongze Cheng a5725b506c more code 2022-11-16 17:22:09 +08:00
Hongze Cheng aaef32ca69 refact code for further code change 2022-11-16 10:27:05 +08:00
Hongze Cheng 5b51f97a48 more optimize 2022-11-14 16:52:39 +08:00
Hongze Cheng 86ed5e5674 more optimize 2022-11-09 16:02:04 +08:00
Shengliang Guan dfbb958128
Merge pull request #17929 from taosdata/perf/sma_optimize
perf: optimize sma calculation
2022-11-08 10:03:12 +08:00
Hongze Cheng d52b8966fc perf: optimize block data operation 2022-11-07 16:56:35 +08:00
Hongze Cheng 70f7e3e379 perf: optimize sma calculation 2022-11-07 15:42:53 +08:00
Haojun Liao 03f4918b3b refactor: do some internal refactor. 2022-11-04 18:46:48 +08:00
Haojun Liao fc20be8699 fix(query): get if the correct rows in last block exists, and set the correct flag to denote if the last blocks index have been loaded or not. 2022-11-02 22:27:23 +08:00
Minglei Jin 5ae5df1a17 Merge branch 'v3.0' into fix/long_query 2022-11-01 18:06:39 +08:00
Minglei Jin ef606d3fd9 tsdb/read: first round long query for non-cache reading 2022-11-01 16:38:35 +08:00
Haojun Liao 9b99c69785 fix(query): support partition by + limit push down. 2022-10-28 19:56:32 +08:00
Haojun Liao 4b2fa43dae
Revert "fix(query): handle partition by in table scan operator" 2022-10-28 18:05:19 +08:00
Haojun Liao 5a971dd03a fix(query): handle partition by in table scan operator with limit/offset value. 2022-10-27 16:58:32 +08:00
Minglei Jin eac3847532 fix: new reseek callback to separate tsdb & cache readers 2022-10-27 16:48:33 +08:00
Minglei Jin 7800b7731d Merge branch 'v3.0' into fix/long_query 2022-10-27 10:39:50 +08:00
Minglei Jin b52ad0f740 tsdb/cache: new separate dataf reader for last file reading 2022-10-26 08:58:38 +08:00
Minglei Jin 89f7ad2920 fix: optimize tsdb cache loading speed 2022-10-25 10:36:30 +08:00
Haojun Liao abff4fb1f2
Merge pull request #17336 from taosdata/feature/3_liaohj
other:merge 3.0, and support last query cache
2022-10-20 18:15:38 +08:00
Hongze Cheng 0706f2dea2 more code 2022-10-18 16:54:53 +08:00
Hongze Cheng 1779c17375 more code 2022-10-18 16:22:06 +08:00
Hongze Cheng b7342525c7 more code 2022-10-18 13:38:26 +08:00
Haojun Liao da9df99461 fix(query): opt last query. 2022-10-17 17:59:43 +08:00
Hongze Cheng 12371d344b Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/stream_compression 2022-09-28 17:49:16 +08:00
Shengliang Guan 53bfdf7bbb
Merge pull request #17117 from taosdata/revert-17106-feature/TD-18581-D
Revert "enh(tsdb): data migrate should not block data r/w and commit"
2022-09-28 17:43:21 +08:00
Haojun Liao 71e3993185
Merge pull request #17114 from taosdata/feature/3_liaohj
refactor(query): do some internal refactor.
2022-09-28 17:36:01 +08:00
Cary Xu 1fe66cb846
Revert "enh(tsdb): data migrate should not block data r/w and commit" 2022-09-28 15:50:29 +08:00
Haojun Liao 14412f2811 refactor(query): do some internal refactor. 2022-09-28 11:16:52 +08:00
Cary Xu 0841442db6 feat: logic optimization for data migration 2022-09-28 07:41:38 +08:00
Cary Xu 11d6db5ab2 Merge branch '3.0' into feature/TD-18581-D 2022-09-27 19:29:59 +08:00
Hongze Cheng 8bd8ff1523 more code 2022-09-27 18:59:29 +08:00
Hongze Cheng a53575a152 more code 2022-09-27 17:57:57 +08:00
Hongze Cheng a4d16f1c00 more code 2022-09-27 17:36:02 +08:00
Hongze Cheng e17c65fd82 Merge branch 'enh/load_by_column' of https://github.com/taosdata/TDengine into feat/stream_compression 2022-09-27 16:22:42 +08:00
Hongze Cheng 3bd6808335 fix coredump 2022-09-27 15:37:00 +08:00
Cary Xu 43c954b6e7 chore: data migration support specify max speed 2022-09-27 14:27:18 +08:00
Haojun Liao cbe91fd4c3 fix(query): initialize the blockdata before load last block. 2022-09-27 13:48:53 +08:00
Hongze Cheng 4bfdfe89a5 adjust api 2022-09-27 11:02:04 +08:00
Cary Xu 6c682daf42 Merge branch '3.0' into feature/TD-18581-D 2022-09-27 10:33:51 +08:00
Hongze Cheng bba042124f Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/stream_compression 2022-09-27 09:27:02 +08:00
Hongze Cheng 19529d6606 fix: wrong file corrupt report 2022-09-26 18:57:14 +08:00
Cary Xu ed2b3678a6 feat(tsdb): migrate support speed limit 2022-09-23 18:57:13 +08:00
Cary Xu 797b9376e7 chore: code optimization for fs destroy 2022-09-23 17:27:48 +08:00
Hongze Cheng 8ff1eb41d1 more code 2022-09-23 17:13:14 +08:00
Hongze Cheng da2150a15b more code 1 2022-09-23 16:45:38 +08:00
Cary Xu b8ea469aff enh(tsdb): data migrate should not block data r/w and commit 2022-09-23 16:42:36 +08:00
Hongze Cheng a3cedbf1bc more code 2022-09-22 13:49:34 +08:00
Hongze Cheng 9f7771cde4 refact more code 2022-09-22 11:52:47 +08:00
Hongze Cheng a8b919918f more code 2022-09-21 17:58:44 +08:00
Hongze Cheng fb45b8d577 refact code 2022-09-20 13:39:32 +08:00
Hongze Cheng f845a01480 more code 2022-09-15 18:04:39 +08:00
Hongze Cheng 9b29931f78 more code 2022-09-15 17:45:47 +08:00
Hongze Cheng 3a4273406e more code 2022-09-15 17:32:39 +08:00
Haojun Liao 22afbb5035
Merge branch '3.0' into feature/3_liaohj 2022-09-15 16:56:39 +08:00
Hongze Cheng d2141ea5ca more code 2022-09-15 16:44:33 +08:00
Haojun Liao 5ba41111b4 refactor: add some logs. 2022-09-15 16:17:39 +08:00
Hongze Cheng 87b59d2148 Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/long_query 2022-09-15 15:47:46 +08:00
Hongze Cheng 151fd39d1a more code 2022-09-15 14:51:40 +08:00
Hongze Cheng ce9fb84221 refact 2022-09-13 14:21:43 +08:00
Hongze Cheng b44eb59f5d tsdb retention fix done 2022-09-09 15:42:20 +08:00