Commit Graph

546 Commits

Author SHA1 Message Date
Hongze Cheng 65ccc4aa48 feat: backgroud task priority 2023-11-29 18:01:31 +08:00
Hongze Cheng 8050d73202 first version 2023-11-15 13:41:00 +08:00
dapan1121 dfb3feb5dc Merge remote-tracking branch 'origin/main' into merge/m23 2023-11-15 11:39:18 +08:00
Minglei Jin 64644d673b
Merge branch '3.0' into fix/TD-26189-last-tier-write 2023-11-01 10:53:55 +08:00
Minglei Jin a61502411d tsdb/pg-cache: new page cache for tsdb s3 read file page 2023-11-01 10:49:05 +08:00
Hongze Cheng cdb1d8296d feat: concurrency on fileset 2023-10-27 17:48:19 +08:00
Benguang Zhao eb8c4d3e8c enh: use hash table for filtering fset in tsdbSnapReaderOpen and tsdbSnapWriterOpen 2023-10-19 11:18:57 +08:00
Benguang Zhao b80f8201ce feat: detect fs incompleteness of RSMA tsdbs 2023-10-19 11:04:39 +08:00
Benguang Zhao eb4e2aa58f feat: restore incomplete fsm state with maxVerValid via snapshot replication 2023-10-19 11:04:36 +08:00
Benguang Zhao 410ced8320 feat: use TLV format to encode data of snapshot info 2023-10-19 10:51:13 +08:00
Benguang Zhao c1b2eedd3c feat: impl tsdbSnapGetInfo 2023-10-19 10:51:08 +08:00
Benguang Zhao 399afe1094 refact: tidy up declarations of funcs in tsdbUpgrade.c 2023-10-19 10:37:25 +08:00
Benguang Zhao 573c28fd06 enh: iterate over a list of snap ranges for STsdbSnapReader 2023-10-19 10:17:28 +08:00
Haojun Liao 33018a0bdb fix(tsdb): fix syntax error. 2023-10-16 14:07:09 +08:00
Haojun Liao 6b86d050f2 fix(tsdb): record the pinned block iter. 2023-10-16 13:26:13 +08:00
Haojun Liao fb2172933a fix(tsdb): enable pin stt datablock. 2023-10-16 13:26:06 +08:00
Haojun Liao ccecf05ff8 fix(tsdb): record the pinned block iter. 2023-10-16 11:48:57 +08:00
Haojun Liao 67bee17e5e other: merge main. 2023-10-16 09:55:41 +08:00
Haojun Liao f751f2bb3d fix(tsdb): enable pin stt datablock. 2023-10-16 09:49:51 +08:00
Haojun Liao bd72d080a9
Merge pull request #23242 from taosdata/fix/liaohj
refactor: do some internal refactor.
2023-10-13 16:40:14 +08:00
Haojun Liao 84c5359d5b other: merge 3.0 2023-10-13 08:58:26 +08:00
Haojun Liao eb4449999f other: merge 3.0 2023-10-12 10:33:48 +08:00
Haojun Liao a03f09c00f refactor: update some logs. 2023-10-11 10:32:31 +08:00
Shungang Li 2c66f44b31 fix(tsdb): ensure sst trigger array size for upgrade 2023-10-10 21:07:08 +08:00
Haojun Liao be09c173ab fix:fix coverity issue and remove unnecessary files. 2023-10-09 19:56:17 +08:00
Minglei Jin d155cfcf0f tsdb/readerwriter: use tsdb's s3 block cache to read file page 2023-09-20 15:24:54 +08:00
Minglei Jin 318281356b s3/block_cache: new tsdb block cache 2023-09-15 16:19:21 +08:00
Haojun Liao 9b70c0c457 fix:fix coverity issue and remove unnecessary files. 2023-09-14 09:06:10 +08:00
Haojun Liao cbd24bb254 refactor: do some internal refactor 2023-08-16 18:20:34 +08:00
Haojun Liao 6609882f9f fix(tsdb): add stt statistics block buffer, and do some internal refactor. 2023-08-16 10:55:07 +08:00
Minglei Jin 7d294cac5f tsdb/cache: load current fileset's brinblk once 2023-08-01 18:56:10 +08:00
Minglei Jin 424dd40078 tsdb/cache: reuse pDataFileReader for same fileset 2023-07-24 14:45:35 +08:00
Minglei Jin 48222f5dc3 tsdb/cache: move data file reader for fs iter to cache reader 2023-07-20 09:11:26 +08:00
Haojun Liao a84efab2c8 enh(tsdb): add table filter according to stt block statistics data. 2023-07-19 15:01:25 +08:00
Minglei Jin a127e91534 tsdb/cache skyline: first round implementation of cache skyline 2023-07-18 17:17:06 +08:00
Minglei Jin 9f9efe9a5e tsdb/cache reader: remove dataf & dataf last readers 2023-07-18 15:30:31 +08:00
Minglei Jin 998fbe574d tsdb/cache reader: move suid into reader's info field 2023-07-17 19:10:33 +08:00
Minglei Jin a05383e29e tsdb/cache: new load tomb callback from tsdb mergetree 2023-07-17 15:07:10 +08:00
Minglei Jin 27b8671f97 tsdb/cache: new cacheReader field for tsdb & cache reader 2023-07-17 14:27:27 +08:00
Minglei Jin 9b0b4061e0 tsdb/cache: relayout cache row reader 2023-07-17 14:16:54 +08:00
Minglei Jin 2b21c5e0f6 tsdb2: adapt cache with tsdb2 API 2023-07-17 08:50:54 +08:00
Haojun Liao 98349a4265 refactor(tsdb): do some internal refactor. 2023-07-09 18:05:24 +08:00
Haojun Liao 14844c7b4b refactor(tsdb): opt tsdb read perf 2023-07-08 21:25:11 +08:00
Hongze Cheng 1304c08cdd Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-07-05 10:57:55 +08:00
Haojun Liao 9e98c64b1e fix(tsdb): set correct stt load info. update the test case. 2023-06-30 22:57:49 +08:00
Haojun Liao 1ad05a06d6
Merge branch '3.0' into enh/tsdb_optimize 2023-06-27 11:46:37 +08:00
Haojun Liao 3289ad62be other: merge 3.0 2023-06-27 11:33:40 +08:00
Haojun Liao 1073b5e4c2 fix(tsdb): support to read multi-level of stt files. 2023-06-27 11:15:53 +08:00
dapan1121 4dae9f4eff merge main to 3.0 2023-06-26 18:43:00 +08:00
Hongze Cheng e79683a684 fix more 2023-06-26 13:57:18 +08:00
Haojun Liao cf02ac7229 fix(tsdb): extract tomb data in stt files. 2023-06-21 18:57:14 +08:00
Hongze Cheng 1160f53062 more code 2023-06-21 16:35:06 +08:00
Hongze Cheng 0e97340e50 more code 2023-06-21 14:53:36 +08:00
Haojun Liao f6e3ad27f0 fix(tsdb): fix memory leak. 2023-06-21 11:38:35 +08:00
Haojun Liao 524ef6edda fix(tsdb): read data from new storage format. 2023-06-19 17:51:05 +08:00
Haojun Liao 077e1a1ed4 Merge branch '3.0' into refact/fillhistory 2023-06-05 11:41:13 +08:00
Hongze Cheng efff4e77f0 more code 2023-06-05 09:36:26 +08:00
Hongze Cheng 3df9620450 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-06-05 09:10:16 +08:00
Haojun Liao becacbc84b fix(query): fix syntax error. 2023-06-02 23:36:47 +08:00
Haojun Liao b5b4cd2a05 fix(query): load del info with upper version limitation. 2023-06-02 23:15:27 +08:00
Hongze Cheng fbc4d649de more code 2023-06-01 10:36:12 +08:00
Haojun Liao eda06081ff enh(stream): refactor and serialize the attributes of history tasks. 2023-05-30 16:55:37 +08:00
Hongze Cheng e0889b404d more code 2023-05-30 15:31:11 +08:00
Hongze Cheng 41459a92c0 more code 2023-05-29 18:42:31 +08:00
Hongze Cheng fa00d0df77 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-05-26 09:55:27 +08:00
Haojun Liao cea8334427
Merge pull request #21449 from taosdata/refact/fillhistory
refactor: remove the module dependency.  TD-24279
2023-05-26 09:01:45 +08:00
Haojun Liao e67b532d8a refactor: refactor the module dependency. 2023-05-23 18:29:23 +08:00
Hongze Cheng 89eafa18cb Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-05-23 09:58:53 +08:00
Minglei Jin 75ccd024a2 cache/writebatch: separate read & write batches 2023-05-22 18:06:58 +08:00
Hongze Cheng 66ea10755e Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-05-19 10:58:12 +08:00
Minglei Jin b892b1fdfe cache/flag: fix cache flag compiling issue 2023-05-17 15:26:10 +08:00
Minglei Jin 756fefaa29 cache/batchread: load columns in one trip 2023-05-16 18:56:05 +08:00
Hongze Cheng c31b1034cd Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-05-15 14:26:40 +08:00
Haojun Liao 7ef16e1922 other: merge main. 2023-05-12 11:49:53 +08:00
Hongze Cheng 2a754394bf more code 2023-05-11 18:16:55 +08:00
Hongze Cheng faadf5d3a2 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-05-09 13:32:16 +08:00
Minglei Jin 2eec395720 cache/commit: flush cache when tsdb commits data 2023-05-08 11:14:59 +08:00
Minglei Jin 90be20a662 cache/lstring: use ltype with cache/get 2023-05-04 18:08:03 +08:00
Haojun Liao 9a35d4e950
Merge pull request #21087 from taosdata/fix/liaohj_main
refactor: do some internal refactor.
2023-04-26 17:57:37 +08:00
Haojun Liao 59725d1d87 refactor: do some internal refactor. 2023-04-26 12:02:43 +08:00
Haojun Liao 8d0a4772a5
Merge pull request #21070 from taosdata/fix/liaohj_main
enh(query): opt last row read performance. TD-23313
2023-04-26 11:54:48 +08:00
Hongze Cheng 49728a235e fix: more fix 2023-04-25 17:32:45 +08:00
Minglei Jin 2566bd4ae8 row/iter: fix null column iter 2023-04-25 16:17:58 +08:00
Haojun Liao 81e54541de refactor: do some internal refactor. 2023-04-25 14:24:24 +08:00
Haojun Liao ae8a9d25c0 refactor: do some internal refactor. 2023-04-25 09:41:49 +08:00
Haojun Liao c6daa68e54 enh(query): opt merge life cycle. 2023-04-25 00:17:37 +08:00
Haojun Liao 7360a6b65c enh(query): opt hash. 2023-04-24 16:39:55 +08:00
Haojun Liao 5663550de2 enh(query): opt query perf by allocate the SLDataIter when opening reader. 2023-04-24 15:47:02 +08:00
Minglei Jin 8f21090343 cache/delete: just remove affected cache entries 2023-04-24 10:47:28 +08:00
Minglei Jin 12fc21ae84 cache/get: use pRow from reader 2023-04-21 18:34:58 +08:00
Minglei Jin 642aa47887 last: first round implementation for column loading 2023-04-20 16:26:27 +08:00
Minglei Jin 76edc16ce1 operator/cache-scan: pass col list down to tsdb cache 2023-04-19 10:04:48 +08:00
Minglei Jin e159c4ead9 first round rocks batch write implementation 2023-04-18 14:25:35 +08:00
Minglei Jin ec4ea9cf5d enh(cache/rocks): base for rocks put/get 2023-04-14 18:28:15 +08:00
Hongze Cheng 3f8f7bb451 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-04-12 11:28:30 +08:00
Hongze Cheng a72633d715 more code 2023-04-11 14:22:36 +08:00
Minglei Jin 1ff8511eb3 tsdb/row merger: comment init out 2023-04-07 13:43:07 +08:00
Minglei Jin 55f7e41f3b tsdb/row merger: remove tsdbRowMerge 2023-04-07 13:31:33 +08:00
Hongze Cheng e8e0e4976e Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-04-06 15:51:20 +08:00
dapan1121 a87d35be08 fix: optimize performance 2023-03-28 17:40:46 +08:00