Commit Graph

276 Commits

Author SHA1 Message Date
Minglei Jin 8ee1288611 fix(cache): remove deleted data 2023-05-25 17:47:55 +08:00
Minglei Jin fc5d06681e cache/last_row: treat none as null with last_row 2023-05-24 18:55:51 +08:00
Haojun Liao 1f7f326bed refactor: do some internal refactor and set the api function ptr. 2023-05-24 13:22:05 +08:00
wade zhang 68a98d4d09
Merge pull request #21429 from taosdata/fix/TD-24306
fix(cache): sychronize commit, read and write threads with writebatch
2023-05-23 16:20:59 +08:00
Minglei Jin 81048f93b0 fix(cache): sychronize commit, read and write threads with writebatch 2023-05-23 13:44:33 +08:00
wade zhang 9e73a69316
Merge pull request #21389 from taosdata/fix/TD-24306
fix(cache/commit): skip batch write if empty
2023-05-23 08:22:33 +08:00
Minglei Jin 75ccd024a2 cache/writebatch: separate read & write batches 2023-05-22 18:06:58 +08:00
Minglei Jin 21adc23af4 cache/loading: skip partial loading tables 2023-05-22 15:21:19 +08:00
Minglei Jin a5c1b9a054 cache/commit: skip batch write if empty 2023-05-19 17:10:24 +08:00
Minglei Jin 35f74ce2e8 cache/schema: not cache schema 2023-05-18 18:35:06 +08:00
Minglei Jin f95867d255 cache/del: fix lru key length 2023-05-18 14:48:08 +08:00
Minglei Jin 3b316051bf cache/schema: fix schema double free 2023-05-18 13:51:07 +08:00
Minglei Jin 0f8b7c87f7 cache/delete: fix rocks key length 2023-05-18 13:15:25 +08:00
Minglei Jin 765cc72618 cache/memtable: update cache when flag is on 2023-05-17 18:56:03 +08:00
Minglei Jin f428a68ec1 cache/update: update lru when deleting or updating 2023-05-17 16:08:48 +08:00
Minglei Jin b892b1fdfe cache/flag: fix cache flag compiling issue 2023-05-17 15:26:10 +08:00
Minglei Jin 86e3c1d20d cache/stt: remove ts from merge tree loading 2023-05-17 14:05:28 +08:00
Minglei Jin 756fefaa29 cache/batchread: load columns in one trip 2023-05-16 18:56:05 +08:00
Haojun Liao 7ef16e1922 other: merge main. 2023-05-12 11:49:53 +08:00
Minglei Jin 81d4673153 cache/get: clear writebatch after writing 2023-05-10 17:52:26 +08:00
Minglei Jin 74c9a4b80b Merge branch '3.0' into fix/TS-3181 2023-05-10 17:42:46 +08:00
Minglei Jin 10cee51d32 fix(cache/get): move rocks wring out of column iterating 2023-05-10 17:32:51 +08:00
Minglei Jin 9bbf36d35d cache/serialize: keep original col value untouched 2023-05-10 14:39:51 +08:00
Minglei Jin 84987c494a cache/fs: fix primary ts column loading 2023-05-10 12:25:36 +08:00
Minglei Jin 0958fe5635 cache/binary: memcpy binary pData if pLastCol is from rocks lookup 2023-05-10 10:15:48 +08:00
Minglei Jin 412fc9b0bc cache/memory: fix double free issue with tsim/parser/last_cache.sim 2023-05-09 11:09:53 +08:00
Minglei Jin 064c46bc7b cache/dclp: double check to load from tsdb 2023-05-09 09:17:26 +08:00
Minglei Jin 9b275f7421 cache/last_row cid: first round implementation for last_row with cid 2023-05-08 17:33:35 +08:00
Minglei Jin e0f0536d2d cache/serialize: nullize pData if zero-length 2023-05-08 15:56:54 +08:00
Minglei Jin 5349fac910 cache/last: use rowTs instead of lastRowTs 2023-05-08 11:33:01 +08:00
Minglei Jin 2eec395720 cache/commit: flush cache when tsdb commits data 2023-05-08 11:14:59 +08:00
Minglei Jin 198ce399d2 cache/get: store recalced column value back into rocks 2023-05-08 10:59:56 +08:00
Minglei Jin dca985214c cache/last: new api: merge last with cid 2023-05-06 18:44:15 +08:00
Minglei Jin 992480eb00 cache/read: fix ltype calc 2023-05-05 10:22:59 +08:00
Minglei Jin 90be20a662 cache/lstring: use ltype with cache/get 2023-05-04 18:08:03 +08:00
Minglei Jin 6835e75903 cache/get: malloc zero-length binary to unify frees 2023-04-26 10:07:15 +08:00
Minglei Jin c8cbabe419 cache/none column: move to outter scope 2023-04-25 18:13:33 +08:00
Minglei Jin 2566bd4ae8 row/iter: fix null column iter 2023-04-25 16:17:58 +08:00
Haojun Liao 81e54541de refactor: do some internal refactor. 2023-04-25 14:24:24 +08:00
Minglei Jin 4adc95f9db cache/deserialize: fix binary pData calc 2023-04-24 18:21:25 +08:00
Minglei Jin 3b88efbd5f cache/delete: fix null column values 2023-04-24 17:07:20 +08:00
Haojun Liao 5663550de2 enh(query): opt query perf by allocate the SLDataIter when opening reader. 2023-04-24 15:47:02 +08:00
Minglei Jin 8f21090343 cache/delete: just remove affected cache entries 2023-04-24 10:47:28 +08:00
Minglei Jin 12fc21ae84 cache/get: use pRow from reader 2023-04-21 18:34:58 +08:00
Minglei Jin 09c62e6ca2 fix values_list index when freeing 2023-04-21 16:30:00 +08:00
Minglei Jin 8e87b21a59 rocks/multi_get value: free rocks allocated memory 2023-04-21 16:23:40 +08:00
Minglei Jin 01d95b5e95 cache/read: use new interface with signle query 2023-04-21 16:07:22 +08:00
Minglei Jin 0394c6a50c free rocks errs array 2023-04-21 15:24:42 +08:00
Minglei Jin 7d896bbc85 last/empty_table: continue if table's empty 2023-04-20 17:36:46 +08:00
Minglei Jin 1e51b2d781
Merge branch '3.0' into fix/TD-23623 2023-04-20 16:32:43 +08:00
Minglei Jin 642aa47887 last: first round implementation for column loading 2023-04-20 16:26:27 +08:00
Minglei Jin 76edc16ce1 operator/cache-scan: pass col list down to tsdb cache 2023-04-19 10:04:48 +08:00
Minglei Jin dee2ca3476 tsdb/cache: inplace_update are commented out 2023-04-18 16:09:42 +08:00
Minglei Jin e159c4ead9 first round rocks batch write implementation 2023-04-18 14:25:35 +08:00
Minglei Jin ec4ea9cf5d enh(cache/rocks): base for rocks put/get 2023-04-14 18:28:15 +08:00
Xiaoyu Wang a44d455e56 merge 3.0 2023-04-13 14:32:05 +08:00
Minglei Jin 589ed9d0ce fix(tsdb/cache): fix block index ref releasing 2023-04-13 12:09:44 +08:00
Xiaoyu Wang 933660ae8d Merge remote-tracking branch 'origin/main' into fix/3.0_merge_main 2023-04-12 14:13:23 +08:00
Minglei Jin 3ac5b35f4b fix(tsdb/cache): skip schema updating for non ts row 2023-04-11 18:57:11 +08:00
Xiaoyu Wang e9d7a099cc merge main 2023-04-04 14:50:58 +08:00
dapan1121 5b02af6a91 fix: merge main to 3.0 2023-03-22 16:08:16 +08:00
Minglei Jin 0bf98096c9 fix(tsdb/cache): init isLast once for each fileset 2023-03-22 10:57:27 +08:00
Minglei Jin cb93ac2613 enh(tsdb/cache): make merge tree next one less 2023-03-22 10:50:34 +08:00
Minglei Jin 0b31aac2c5 enh(tsdb/cache): skip data block with merge tree 2023-03-22 10:19:58 +08:00
Minglei Jin 3a5542bbbc fix(tsdb/cache): update nCols of merge tree to avoid assert failed 2023-03-19 10:19:49 +08:00
Minglei Jin ca115b1c87 fix(tsdb/cache): break loop to return current row 2023-03-17 11:41:17 +08:00
Minglei Jin a8d146c512 ehn(tsdb/cache): skip invalid row or data block directly with merge tree 2023-03-17 10:22:36 +08:00
Minglei Jin b1949b5584 fix(tsdb/cache): skip remaining rows in current data block 2023-03-16 14:11:34 +08:00
Minglei Jin 6e0343fc08 enh(tsdb/cache): load necessary columns only 2023-03-16 11:18:36 +08:00
Minglei Jin 04d501d64a fix: destroy aColArray anyway 2023-03-15 17:41:29 +08:00
Minglei Jin f1414355e3 tsdb/cache: skip invalid datablock directly when traversing fs with last 2023-03-15 16:24:36 +08:00
Xiaoyu Wang ca39dfcf2d feat: show vgroup display num of cache tables 2023-03-13 17:21:32 +08:00
Xiaoyu Wang 62377619ba enh: optimizing stt file reading in last query 2023-03-13 15:05:24 +08:00
Xiaoyu Wang 25778754e2 fix: last redundant read stt file 2023-03-12 22:36:26 +08:00
Xiaoyu Wang 45e38d258c fix: last redundant read stt file 2023-03-12 20:40:17 +08:00
Xiaoyu Wang 11e55f028b fix: error in last cache handle deleted data 2023-03-10 17:49:27 +08:00
Xiaoyu Wang 4e4f7de0ab enh: optimize last/last_row cost when the cache was first loaded 2023-03-10 12:00:17 +08:00
Xiaoyu Wang 47417e003e enh: optimize last/last_row cost when the cache was first loaded 2023-03-09 18:54:15 +08:00
Xiaoyu Wang 0dc34018b6 fix: insert data crash after empty table last cache 2023-03-08 10:06:48 +08:00
Xiaoyu Wang 163224f4e2 fix: taosd crash when modify the schema and query last_row 2023-03-07 19:42:05 +08:00
Xiaoyu Wang ab86f6abee fix: taosd crash when modify the schema and query last_row 2023-03-07 18:15:17 +08:00
Xiaoyu Wang 8e6534d9f3 fix: insert data crash after empty table last_row cache 2023-03-07 16:06:56 +08:00
Xiaoyu Wang 7649ede074 fix: last cache read problem after schema change 2023-03-02 19:45:21 +08:00
Xiaoyu Wang 7deee1c4c7 fix: last cache read problem after schema change 2023-03-02 18:22:42 +08:00
Xiaoyu Wang d06dedd5cc
Merge pull request #20103 from taosdata/fix/TD-22668
fix: coverity scan issues
2023-02-24 10:53:49 +08:00
Minglei Jin 6929f74559 fix(tsdb/cache): check the return result of data block creating 2023-02-22 14:48:57 +08:00
Minglei Jin 724e7bc3a1 fix(tsdb/cache): use state's tsdb instead of readers 2023-02-21 18:23:18 +08:00
Xiaoyu Wang c597de099f merge main 2023-02-20 13:41:27 +08:00
Minglei Jin de9cafb04e fix(tsdb/cache): disable sharding for block index cache 2023-02-16 15:50:19 +08:00
Minglei Jin 56f1afb19c fix(tsdb/cache): use block index cache with last/last_row 2023-02-16 09:28:35 +08:00
Minglei Jin 8ec5df8d7d fix(tsdb/cache): Not free zero length var data 2023-02-14 10:20:55 +08:00
Minglei Jin ee9c59dc77 fix(tsdb/cache): invalidate cache entry if schema changed 2023-02-13 19:30:48 +08:00
Xiaoyu Wang 09925437e3 merge main 2023-02-08 09:51:52 +08:00
Minglei Jin a6d52aed4f fix(tsdb/cache): use 5M cache for block index instead of 1M 2023-02-06 14:18:49 +08:00
Minglei Jin 023b8377fb enh(tsdb/cache): new block index cache for querying 2023-02-06 14:12:57 +08:00
Shengliang Guan 398161eb5f Merge branch 'main' into merge/mainto3.0_0108 2023-01-09 10:00:53 +08:00
Benguang Zhao 137e7d009d fix: update nextRowIterGet of tsdbCache 2022-12-26 20:52:42 +08:00
Haojun Liao 723efba79b
Merge branch '3.0' into refact/submit_req 2022-12-26 13:25:25 +08:00
Haojun Liao 224f5a72c2 refactor: do some internal refactor. 2022-12-23 17:45:12 +08:00
Haojun Liao 48f7fc5c3d
Merge branch '3.0' into refact/submit_req 2022-12-12 18:11:17 +08:00