Commit Graph

529 Commits

Author SHA1 Message Date
Haojun Liao 67bee17e5e other: merge main. 2023-10-16 09:55:41 +08:00
Haojun Liao f751f2bb3d fix(tsdb): enable pin stt datablock. 2023-10-16 09:49:51 +08:00
Haojun Liao bd72d080a9
Merge pull request #23242 from taosdata/fix/liaohj
refactor: do some internal refactor.
2023-10-13 16:40:14 +08:00
Haojun Liao 84c5359d5b other: merge 3.0 2023-10-13 08:58:26 +08:00
Haojun Liao eb4449999f other: merge 3.0 2023-10-12 10:33:48 +08:00
Haojun Liao a03f09c00f refactor: update some logs. 2023-10-11 10:32:31 +08:00
Shungang Li 2c66f44b31 fix(tsdb): ensure sst trigger array size for upgrade 2023-10-10 21:07:08 +08:00
Haojun Liao be09c173ab fix:fix coverity issue and remove unnecessary files. 2023-10-09 19:56:17 +08:00
Minglei Jin d155cfcf0f tsdb/readerwriter: use tsdb's s3 block cache to read file page 2023-09-20 15:24:54 +08:00
Minglei Jin 318281356b s3/block_cache: new tsdb block cache 2023-09-15 16:19:21 +08:00
Haojun Liao 9b70c0c457 fix:fix coverity issue and remove unnecessary files. 2023-09-14 09:06:10 +08:00
Haojun Liao cbd24bb254 refactor: do some internal refactor 2023-08-16 18:20:34 +08:00
Haojun Liao 6609882f9f fix(tsdb): add stt statistics block buffer, and do some internal refactor. 2023-08-16 10:55:07 +08:00
Minglei Jin 7d294cac5f tsdb/cache: load current fileset's brinblk once 2023-08-01 18:56:10 +08:00
Minglei Jin 424dd40078 tsdb/cache: reuse pDataFileReader for same fileset 2023-07-24 14:45:35 +08:00
Minglei Jin 48222f5dc3 tsdb/cache: move data file reader for fs iter to cache reader 2023-07-20 09:11:26 +08:00
Haojun Liao a84efab2c8 enh(tsdb): add table filter according to stt block statistics data. 2023-07-19 15:01:25 +08:00
Minglei Jin a127e91534 tsdb/cache skyline: first round implementation of cache skyline 2023-07-18 17:17:06 +08:00
Minglei Jin 9f9efe9a5e tsdb/cache reader: remove dataf & dataf last readers 2023-07-18 15:30:31 +08:00
Minglei Jin 998fbe574d tsdb/cache reader: move suid into reader's info field 2023-07-17 19:10:33 +08:00
Minglei Jin a05383e29e tsdb/cache: new load tomb callback from tsdb mergetree 2023-07-17 15:07:10 +08:00
Minglei Jin 27b8671f97 tsdb/cache: new cacheReader field for tsdb & cache reader 2023-07-17 14:27:27 +08:00
Minglei Jin 9b0b4061e0 tsdb/cache: relayout cache row reader 2023-07-17 14:16:54 +08:00
Minglei Jin 2b21c5e0f6 tsdb2: adapt cache with tsdb2 API 2023-07-17 08:50:54 +08:00
Haojun Liao 98349a4265 refactor(tsdb): do some internal refactor. 2023-07-09 18:05:24 +08:00
Haojun Liao 14844c7b4b refactor(tsdb): opt tsdb read perf 2023-07-08 21:25:11 +08:00
Hongze Cheng 1304c08cdd Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-07-05 10:57:55 +08:00
Haojun Liao 9e98c64b1e fix(tsdb): set correct stt load info. update the test case. 2023-06-30 22:57:49 +08:00
Haojun Liao 1ad05a06d6
Merge branch '3.0' into enh/tsdb_optimize 2023-06-27 11:46:37 +08:00
Haojun Liao 3289ad62be other: merge 3.0 2023-06-27 11:33:40 +08:00
Haojun Liao 1073b5e4c2 fix(tsdb): support to read multi-level of stt files. 2023-06-27 11:15:53 +08:00
dapan1121 4dae9f4eff merge main to 3.0 2023-06-26 18:43:00 +08:00
Hongze Cheng e79683a684 fix more 2023-06-26 13:57:18 +08:00
Haojun Liao cf02ac7229 fix(tsdb): extract tomb data in stt files. 2023-06-21 18:57:14 +08:00
Hongze Cheng 1160f53062 more code 2023-06-21 16:35:06 +08:00
Hongze Cheng 0e97340e50 more code 2023-06-21 14:53:36 +08:00
Haojun Liao f6e3ad27f0 fix(tsdb): fix memory leak. 2023-06-21 11:38:35 +08:00
Haojun Liao 524ef6edda fix(tsdb): read data from new storage format. 2023-06-19 17:51:05 +08:00
Haojun Liao 077e1a1ed4 Merge branch '3.0' into refact/fillhistory 2023-06-05 11:41:13 +08:00
Hongze Cheng efff4e77f0 more code 2023-06-05 09:36:26 +08:00
Hongze Cheng 3df9620450 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-06-05 09:10:16 +08:00
Haojun Liao becacbc84b fix(query): fix syntax error. 2023-06-02 23:36:47 +08:00
Haojun Liao b5b4cd2a05 fix(query): load del info with upper version limitation. 2023-06-02 23:15:27 +08:00
Hongze Cheng fbc4d649de more code 2023-06-01 10:36:12 +08:00
Haojun Liao eda06081ff enh(stream): refactor and serialize the attributes of history tasks. 2023-05-30 16:55:37 +08:00
Hongze Cheng e0889b404d more code 2023-05-30 15:31:11 +08:00
Hongze Cheng 41459a92c0 more code 2023-05-29 18:42:31 +08:00
Hongze Cheng fa00d0df77 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-05-26 09:55:27 +08:00
Haojun Liao cea8334427
Merge pull request #21449 from taosdata/refact/fillhistory
refactor: remove the module dependency.  TD-24279
2023-05-26 09:01:45 +08:00
Haojun Liao e67b532d8a refactor: refactor the module dependency. 2023-05-23 18:29:23 +08:00
Hongze Cheng 89eafa18cb Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-05-23 09:58:53 +08:00
Minglei Jin 75ccd024a2 cache/writebatch: separate read & write batches 2023-05-22 18:06:58 +08:00
Hongze Cheng 66ea10755e Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-05-19 10:58:12 +08:00
Minglei Jin b892b1fdfe cache/flag: fix cache flag compiling issue 2023-05-17 15:26:10 +08:00
Minglei Jin 756fefaa29 cache/batchread: load columns in one trip 2023-05-16 18:56:05 +08:00
Hongze Cheng c31b1034cd Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-05-15 14:26:40 +08:00
Haojun Liao 7ef16e1922 other: merge main. 2023-05-12 11:49:53 +08:00
Hongze Cheng 2a754394bf more code 2023-05-11 18:16:55 +08:00
Hongze Cheng faadf5d3a2 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-05-09 13:32:16 +08:00
Minglei Jin 2eec395720 cache/commit: flush cache when tsdb commits data 2023-05-08 11:14:59 +08:00
Minglei Jin 90be20a662 cache/lstring: use ltype with cache/get 2023-05-04 18:08:03 +08:00
Haojun Liao 9a35d4e950
Merge pull request #21087 from taosdata/fix/liaohj_main
refactor: do some internal refactor.
2023-04-26 17:57:37 +08:00
Haojun Liao 59725d1d87 refactor: do some internal refactor. 2023-04-26 12:02:43 +08:00
Haojun Liao 8d0a4772a5
Merge pull request #21070 from taosdata/fix/liaohj_main
enh(query): opt last row read performance. TD-23313
2023-04-26 11:54:48 +08:00
Hongze Cheng 49728a235e fix: more fix 2023-04-25 17:32:45 +08:00
Minglei Jin 2566bd4ae8 row/iter: fix null column iter 2023-04-25 16:17:58 +08:00
Haojun Liao 81e54541de refactor: do some internal refactor. 2023-04-25 14:24:24 +08:00
Haojun Liao ae8a9d25c0 refactor: do some internal refactor. 2023-04-25 09:41:49 +08:00
Haojun Liao c6daa68e54 enh(query): opt merge life cycle. 2023-04-25 00:17:37 +08:00
Haojun Liao 7360a6b65c enh(query): opt hash. 2023-04-24 16:39:55 +08:00
Haojun Liao 5663550de2 enh(query): opt query perf by allocate the SLDataIter when opening reader. 2023-04-24 15:47:02 +08:00
Minglei Jin 8f21090343 cache/delete: just remove affected cache entries 2023-04-24 10:47:28 +08:00
Minglei Jin 12fc21ae84 cache/get: use pRow from reader 2023-04-21 18:34:58 +08:00
Minglei Jin 642aa47887 last: first round implementation for column loading 2023-04-20 16:26:27 +08:00
Minglei Jin 76edc16ce1 operator/cache-scan: pass col list down to tsdb cache 2023-04-19 10:04:48 +08:00
Minglei Jin e159c4ead9 first round rocks batch write implementation 2023-04-18 14:25:35 +08:00
Minglei Jin ec4ea9cf5d enh(cache/rocks): base for rocks put/get 2023-04-14 18:28:15 +08:00
Hongze Cheng 3f8f7bb451 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-04-12 11:28:30 +08:00
Hongze Cheng a72633d715 more code 2023-04-11 14:22:36 +08:00
Minglei Jin 1ff8511eb3 tsdb/row merger: comment init out 2023-04-07 13:43:07 +08:00
Minglei Jin 55f7e41f3b tsdb/row merger: remove tsdbRowMerge 2023-04-07 13:31:33 +08:00
Hongze Cheng e8e0e4976e Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-04-06 15:51:20 +08:00
dapan1121 a87d35be08 fix: optimize performance 2023-03-28 17:40:46 +08:00
Hongze Cheng 8f84e88616 more code 2023-03-27 17:07:59 +08:00
Hongze Cheng d596f3be4a Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-03-23 16:29:03 +08:00
dapan1121 5b02af6a91 fix: merge main to 3.0 2023-03-22 16:08:16 +08:00
Hongze Cheng 4f0833e1a0 more code 2023-03-22 14:41:16 +08:00
Minglei Jin 0b31aac2c5 enh(tsdb/cache): skip data block with merge tree 2023-03-22 10:19:58 +08:00
Xiaoyu Wang ca39dfcf2d feat: show vgroup display num of cache tables 2023-03-13 17:21:32 +08:00
Xiaoyu Wang 62377619ba enh: optimizing stt file reading in last query 2023-03-13 15:05:24 +08:00
Xiaoyu Wang 47417e003e enh: optimize last/last_row cost when the cache was first loaded 2023-03-09 18:54:15 +08:00
Xiaoyu Wang 7deee1c4c7 fix: last cache read problem after schema change 2023-03-02 18:22:42 +08:00
Xiaoyu Wang c597de099f merge main 2023-02-20 13:41:27 +08:00
Xiaoyu Wang 9bc225ffda merge 3.0 2023-02-09 09:44:29 +08:00
Hongze Cheng 8d6e6d2fe0 more code 2023-02-08 17:46:11 +08:00
Xiaoyu Wang 09925437e3 merge main 2023-02-08 09:51:52 +08:00
Haojun Liao 3822225231 other: merge main. 2023-02-06 16:24:15 +08:00
Hongze Cheng 09628401f8 refact code 2023-02-06 14:49:50 +08:00
Minglei Jin 023b8377fb enh(tsdb/cache): new block index cache for querying 2023-02-06 14:12:57 +08:00
Haojun Liao e29ca4f5d8 refactor(query): use real number of stt instead of default value. 2023-02-03 10:04:15 +08:00