Minglei Jin
|
9bbf36d35d
|
cache/serialize: keep original col value untouched
|
2023-05-10 14:39:51 +08:00 |
|
Minglei Jin
|
84987c494a
|
cache/fs: fix primary ts column loading
|
2023-05-10 12:25:36 +08:00 |
|
Minglei Jin
|
0958fe5635
|
cache/binary: memcpy binary pData if pLastCol is from rocks lookup
|
2023-05-10 10:15:48 +08:00 |
|
Minglei Jin
|
412fc9b0bc
|
cache/memory: fix double free issue with tsim/parser/last_cache.sim
|
2023-05-09 11:09:53 +08:00 |
|
Minglei Jin
|
064c46bc7b
|
cache/dclp: double check to load from tsdb
|
2023-05-09 09:17:26 +08:00 |
|
Minglei Jin
|
9b275f7421
|
cache/last_row cid: first round implementation for last_row with cid
|
2023-05-08 17:33:35 +08:00 |
|
Minglei Jin
|
e0f0536d2d
|
cache/serialize: nullize pData if zero-length
|
2023-05-08 15:56:54 +08:00 |
|
Minglei Jin
|
5349fac910
|
cache/last: use rowTs instead of lastRowTs
|
2023-05-08 11:33:01 +08:00 |
|
Minglei Jin
|
2eec395720
|
cache/commit: flush cache when tsdb commits data
|
2023-05-08 11:14:59 +08:00 |
|
Minglei Jin
|
198ce399d2
|
cache/get: store recalced column value back into rocks
|
2023-05-08 10:59:56 +08:00 |
|
Minglei Jin
|
dca985214c
|
cache/last: new api: merge last with cid
|
2023-05-06 18:44:15 +08:00 |
|
Minglei Jin
|
992480eb00
|
cache/read: fix ltype calc
|
2023-05-05 10:22:59 +08:00 |
|
Minglei Jin
|
90be20a662
|
cache/lstring: use ltype with cache/get
|
2023-05-04 18:08:03 +08:00 |
|
Minglei Jin
|
6835e75903
|
cache/get: malloc zero-length binary to unify frees
|
2023-04-26 10:07:15 +08:00 |
|
Minglei Jin
|
c8cbabe419
|
cache/none column: move to outter scope
|
2023-04-25 18:13:33 +08:00 |
|
Minglei Jin
|
2566bd4ae8
|
row/iter: fix null column iter
|
2023-04-25 16:17:58 +08:00 |
Haojun Liao
|
81e54541de
|
refactor: do some internal refactor.
|
2023-04-25 14:24:24 +08:00 |
|
Minglei Jin
|
4adc95f9db
|
cache/deserialize: fix binary pData calc
|
2023-04-24 18:21:25 +08:00 |
|
Minglei Jin
|
3b88efbd5f
|
cache/delete: fix null column values
|
2023-04-24 17:07:20 +08:00 |
|
Haojun Liao
|
5663550de2
|
enh(query): opt query perf by allocate the SLDataIter when opening reader.
|
2023-04-24 15:47:02 +08:00 |
|
Minglei Jin
|
8f21090343
|
cache/delete: just remove affected cache entries
|
2023-04-24 10:47:28 +08:00 |
|
Minglei Jin
|
12fc21ae84
|
cache/get: use pRow from reader
|
2023-04-21 18:34:58 +08:00 |
|
Minglei Jin
|
09c62e6ca2
|
fix values_list index when freeing
|
2023-04-21 16:30:00 +08:00 |
|
Minglei Jin
|
8e87b21a59
|
rocks/multi_get value: free rocks allocated memory
|
2023-04-21 16:23:40 +08:00 |
|
Minglei Jin
|
01d95b5e95
|
cache/read: use new interface with signle query
|
2023-04-21 16:07:22 +08:00 |
|
Minglei Jin
|
0394c6a50c
|
free rocks errs array
|
2023-04-21 15:24:42 +08:00 |
|
Minglei Jin
|
7d896bbc85
|
last/empty_table: continue if table's empty
|
2023-04-20 17:36:46 +08:00 |
Minglei Jin
|
1e51b2d781
|
Merge branch '3.0' into fix/TD-23623
|
2023-04-20 16:32:43 +08:00 |
|
Minglei Jin
|
642aa47887
|
last: first round implementation for column loading
|
2023-04-20 16:26:27 +08:00 |
|
Minglei Jin
|
76edc16ce1
|
operator/cache-scan: pass col list down to tsdb cache
|
2023-04-19 10:04:48 +08:00 |
|
Minglei Jin
|
dee2ca3476
|
tsdb/cache: inplace_update are commented out
|
2023-04-18 16:09:42 +08:00 |
|
Minglei Jin
|
e159c4ead9
|
first round rocks batch write implementation
|
2023-04-18 14:25:35 +08:00 |
|
Minglei Jin
|
ec4ea9cf5d
|
enh(cache/rocks): base for rocks put/get
|
2023-04-14 18:28:15 +08:00 |
Xiaoyu Wang
|
a44d455e56
|
merge 3.0
|
2023-04-13 14:32:05 +08:00 |
|
Minglei Jin
|
589ed9d0ce
|
fix(tsdb/cache): fix block index ref releasing
|
2023-04-13 12:09:44 +08:00 |
|
Xiaoyu Wang
|
933660ae8d
|
Merge remote-tracking branch 'origin/main' into fix/3.0_merge_main
|
2023-04-12 14:13:23 +08:00 |
|
Minglei Jin
|
3ac5b35f4b
|
fix(tsdb/cache): skip schema updating for non ts row
|
2023-04-11 18:57:11 +08:00 |
|
Xiaoyu Wang
|
e9d7a099cc
|
merge main
|
2023-04-04 14:50:58 +08:00 |
dapan1121
|
5b02af6a91
|
fix: merge main to 3.0
|
2023-03-22 16:08:16 +08:00 |
|
Minglei Jin
|
0bf98096c9
|
fix(tsdb/cache): init isLast once for each fileset
|
2023-03-22 10:57:27 +08:00 |
|
Minglei Jin
|
cb93ac2613
|
enh(tsdb/cache): make merge tree next one less
|
2023-03-22 10:50:34 +08:00 |
|
Minglei Jin
|
0b31aac2c5
|
enh(tsdb/cache): skip data block with merge tree
|
2023-03-22 10:19:58 +08:00 |
|
Minglei Jin
|
3a5542bbbc
|
fix(tsdb/cache): update nCols of merge tree to avoid assert failed
|
2023-03-19 10:19:49 +08:00 |
|
Minglei Jin
|
ca115b1c87
|
fix(tsdb/cache): break loop to return current row
|
2023-03-17 11:41:17 +08:00 |
|
Minglei Jin
|
a8d146c512
|
ehn(tsdb/cache): skip invalid row or data block directly with merge tree
|
2023-03-17 10:22:36 +08:00 |
|
Minglei Jin
|
b1949b5584
|
fix(tsdb/cache): skip remaining rows in current data block
|
2023-03-16 14:11:34 +08:00 |
|
Minglei Jin
|
6e0343fc08
|
enh(tsdb/cache): load necessary columns only
|
2023-03-16 11:18:36 +08:00 |
|
Minglei Jin
|
04d501d64a
|
fix: destroy aColArray anyway
|
2023-03-15 17:41:29 +08:00 |
|
Minglei Jin
|
f1414355e3
|
tsdb/cache: skip invalid datablock directly when traversing fs with last
|
2023-03-15 16:24:36 +08:00 |
|
Xiaoyu Wang
|
ca39dfcf2d
|
feat: show vgroup display num of cache tables
|
2023-03-13 17:21:32 +08:00 |
|
Xiaoyu Wang
|
62377619ba
|
enh: optimizing stt file reading in last query
|
2023-03-13 15:05:24 +08:00 |
|
Xiaoyu Wang
|
25778754e2
|
fix: last redundant read stt file
|
2023-03-12 22:36:26 +08:00 |
|
Xiaoyu Wang
|
45e38d258c
|
fix: last redundant read stt file
|
2023-03-12 20:40:17 +08:00 |
|
Xiaoyu Wang
|
11e55f028b
|
fix: error in last cache handle deleted data
|
2023-03-10 17:49:27 +08:00 |
|
Xiaoyu Wang
|
4e4f7de0ab
|
enh: optimize last/last_row cost when the cache was first loaded
|
2023-03-10 12:00:17 +08:00 |
|
Xiaoyu Wang
|
47417e003e
|
enh: optimize last/last_row cost when the cache was first loaded
|
2023-03-09 18:54:15 +08:00 |
|
Xiaoyu Wang
|
0dc34018b6
|
fix: insert data crash after empty table last cache
|
2023-03-08 10:06:48 +08:00 |
|
Xiaoyu Wang
|
163224f4e2
|
fix: taosd crash when modify the schema and query last_row
|
2023-03-07 19:42:05 +08:00 |
|
Xiaoyu Wang
|
ab86f6abee
|
fix: taosd crash when modify the schema and query last_row
|
2023-03-07 18:15:17 +08:00 |
|
Xiaoyu Wang
|
8e6534d9f3
|
fix: insert data crash after empty table last_row cache
|
2023-03-07 16:06:56 +08:00 |
|
Xiaoyu Wang
|
7649ede074
|
fix: last cache read problem after schema change
|
2023-03-02 19:45:21 +08:00 |
|
Xiaoyu Wang
|
7deee1c4c7
|
fix: last cache read problem after schema change
|
2023-03-02 18:22:42 +08:00 |
Xiaoyu Wang
|
d06dedd5cc
|
Merge pull request #20103 from taosdata/fix/TD-22668
fix: coverity scan issues
|
2023-02-24 10:53:49 +08:00 |
|
Minglei Jin
|
6929f74559
|
fix(tsdb/cache): check the return result of data block creating
|
2023-02-22 14:48:57 +08:00 |
|
Minglei Jin
|
724e7bc3a1
|
fix(tsdb/cache): use state's tsdb instead of readers
|
2023-02-21 18:23:18 +08:00 |
|
Xiaoyu Wang
|
c597de099f
|
merge main
|
2023-02-20 13:41:27 +08:00 |
|
Minglei Jin
|
de9cafb04e
|
fix(tsdb/cache): disable sharding for block index cache
|
2023-02-16 15:50:19 +08:00 |
|
Minglei Jin
|
56f1afb19c
|
fix(tsdb/cache): use block index cache with last/last_row
|
2023-02-16 09:28:35 +08:00 |
|
Minglei Jin
|
8ec5df8d7d
|
fix(tsdb/cache): Not free zero length var data
|
2023-02-14 10:20:55 +08:00 |
|
Minglei Jin
|
ee9c59dc77
|
fix(tsdb/cache): invalidate cache entry if schema changed
|
2023-02-13 19:30:48 +08:00 |
|
Xiaoyu Wang
|
09925437e3
|
merge main
|
2023-02-08 09:51:52 +08:00 |
|
Minglei Jin
|
a6d52aed4f
|
fix(tsdb/cache): use 5M cache for block index instead of 1M
|
2023-02-06 14:18:49 +08:00 |
|
Minglei Jin
|
023b8377fb
|
enh(tsdb/cache): new block index cache for querying
|
2023-02-06 14:12:57 +08:00 |
Shengliang Guan
|
398161eb5f
|
Merge branch 'main' into merge/mainto3.0_0108
|
2023-01-09 10:00:53 +08:00 |
Benguang Zhao
|
137e7d009d
|
fix: update nextRowIterGet of tsdbCache
|
2022-12-26 20:52:42 +08:00 |
Haojun Liao
|
723efba79b
|
Merge branch '3.0' into refact/submit_req
|
2022-12-26 13:25:25 +08:00 |
|
Haojun Liao
|
224f5a72c2
|
refactor: do some internal refactor.
|
2022-12-23 17:45:12 +08:00 |
|
Haojun Liao
|
48f7fc5c3d
|
Merge branch '3.0' into refact/submit_req
|
2022-12-12 18:11:17 +08:00 |
|
Minglei Jin
|
c22fa53bc4
|
fix: release lock and memory in exceptional cases
|
2022-12-09 10:22:43 +08:00 |
|
Haojun Liao
|
27ebafdbaa
|
other: merge 3.0
|
2022-12-09 10:19:05 +08:00 |
|
Minglei Jin
|
1a066d19f7
|
fix: dismiss coverity issues
|
2022-12-08 10:55:08 +08:00 |
Shengliang Guan
|
6d94afe48f
|
Revert "refact: adjust some assert cases"
|
2022-12-07 21:51:17 +08:00 |
|
Shengliang Guan
|
f69a188f7e
|
refact: replcase ASSERT with tAssert
|
2022-12-07 18:37:40 +08:00 |
|
Minglei Jin
|
1e23f80597
|
tsdb/cache: use empty array as negative entry to empty table's last/lr
|
2022-12-07 14:34:38 +08:00 |
Hongze Cheng
|
899d7b0bcc
|
Merge branch '3.0' of https://github.com/taosdata/TDengine into refact/submit_req
|
2022-12-06 14:37:22 +08:00 |
|
Minglei Jin
|
55fb892e70
|
fix(tsdb/cache): use lru erase to invalidate cache entries
|
2022-12-02 17:53:16 +08:00 |
|
Hongze Cheng
|
6dcdafa486
|
more code
|
2022-12-01 17:00:33 +08:00 |
|
Hongze Cheng
|
73f8dc6a5b
|
more code
|
2022-12-01 14:24:10 +08:00 |
|
Hongze Cheng
|
f5270f6a0c
|
adjust api
|
2022-11-30 10:30:03 +08:00 |
|
Hongze Cheng
|
0f8016995c
|
more code
|
2022-11-28 13:41:06 +08:00 |
|
Haojun Liao
|
0948216ca9
|
fix(query): fix dead lock.
|
2022-11-26 21:13:34 +08:00 |
stephenkgu
|
8d6f129154
|
fix: skip empty data in delete file
|
2022-11-10 08:14:21 +08:00 |
|
Minglei Jin
|
a5052eb2d5
|
fix: remove last stt load info resetting from fs iterator
|
2022-11-01 17:29:18 +08:00 |
|
Minglei Jin
|
cb0a3ec042
|
fix: continue to fetch next row if deleted
|
2022-10-26 18:39:04 +08:00 |
|
Minglei Jin
|
89d74e5016
|
fix: malloc and copy binary data when inserting last & last_row
|
2022-10-26 10:52:35 +08:00 |
|
Minglei Jin
|
b52ad0f740
|
tsdb/cache: new separate dataf reader for last file reading
|
2022-10-26 08:58:38 +08:00 |
|
Minglei Jin
|
441fe8119c
|
Merge branch '3.0' into fix/TD-19468-2
|
2022-10-25 10:51:35 +08:00 |
|
Minglei Jin
|
89f7ad2920
|
fix: optimize tsdb cache loading speed
|
2022-10-25 10:36:30 +08:00 |
|
Minglei Jin
|
214df56e39
|
fix: return 0 usage when pTsdb is null
|
2022-10-23 06:54:24 +08:00 |
|
Minglei Jin
|
60b85028af
|
fix: do not copy binary when nData is 0
|
2022-10-19 18:53:51 +08:00 |
|
Minglei Jin
|
6dea891571
|
fix: release data file reader
|
2022-10-19 16:07:53 +08:00 |
|
Minglei Jin
|
640338893d
|
tsdb/cache: handle OOM exceptions
|
2022-10-19 15:01:49 +08:00 |
|
Minglei Jin
|
ceec953498
|
fix: copy binary type column data out
|
2022-10-19 14:50:36 +08:00 |
|
Minglei Jin
|
a1c18bba33
|
fix: cache load calculation
|
2022-10-19 13:58:59 +08:00 |
|
Minglei Jin
|
467c6386ed
|
fix: last_row array element type
|
2022-10-19 11:06:08 +08:00 |
|
Minglei Jin
|
109d50a4cc
|
fix: last row array form bug
|
2022-10-17 18:13:38 +08:00 |
|
Haojun Liao
|
da9df99461
|
fix(query): opt last query.
|
2022-10-17 17:59:43 +08:00 |
|
Haojun Liao
|
2c656a2cdc
|
Merge branch 'feature/3_liaohj' of github.com:taosdata/tdengine into feature/3_liaohj
|
2022-10-17 17:22:04 +08:00 |
|
Minglei Jin
|
b62fa20b53
|
tsdb/cache: return last row as array of SLastCol
|
2022-10-17 17:20:32 +08:00 |
|
Haojun Liao
|
aa9c99fa53
|
Merge branch '3.0' into feature/3_liaohj
|
2022-10-16 12:50:05 +08:00 |
|
Minglei Jin
|
3f46bd64b9
|
fix: dismiss some coverity scan issues
|
2022-10-14 17:47:21 +08:00 |
|
Minglei Jin
|
977fc4b15c
|
fix(tsdb/cache): release lock when table's empty
|
2022-10-14 15:28:19 +08:00 |
|
Minglei Jin
|
3a0ea21342
|
fix: get SLastCol from array instead of SColVal
|
2022-10-13 19:54:25 +08:00 |
|
Minglei Jin
|
66962bdddc
|
fix: close merge tree for each file set
|
2022-10-13 18:12:26 +08:00 |
|
Minglei Jin
|
997dfb41d9
|
fix(meta): use rwlock to favor writers
|
2022-10-10 11:00:55 +08:00 |
|
Haojun Liao
|
7674fa972c
|
Merge pull request #17184 from taosdata/feature/3_liaohj
fix(query): fix memory leak in last_row query
|
2022-09-30 17:51:45 +08:00 |
|
Haojun Liao
|
877c707ce6
|
fix(query): fix memory leak in last_row query
|
2022-09-30 17:10:55 +08:00 |
|
Shengliang Guan
|
b77a62dcd8
|
Merge pull request #17183 from taosdata/feature/3_liaohj
fix(query): fix memory leak.
|
2022-09-30 16:46:07 +08:00 |
|
Haojun Liao
|
4b1e8e0cec
|
fix(query): fix memory leak.
|
2022-09-30 16:02:28 +08:00 |
|
Hongze Cheng
|
12371d344b
|
Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/stream_compression
|
2022-09-28 17:49:16 +08:00 |
|
Haojun Liao
|
14412f2811
|
refactor(query): do some internal refactor.
|
2022-09-28 11:16:52 +08:00 |
|
Hongze Cheng
|
e17c65fd82
|
Merge branch 'enh/load_by_column' of https://github.com/taosdata/TDengine into feat/stream_compression
|
2022-09-27 16:22:42 +08:00 |
|
Haojun Liao
|
cbe91fd4c3
|
fix(query): initialize the blockdata before load last block.
|
2022-09-27 13:48:53 +08:00 |
|
Hongze Cheng
|
4bfdfe89a5
|
adjust api
|
2022-09-27 11:02:04 +08:00 |
|
Hongze Cheng
|
1a0dcddd62
|
Merge branch 'enh/cv_optimize' of https://github.com/taosdata/TDengine into feat/stream_compression
|
2022-09-23 18:59:13 +08:00 |
|
Hongze Cheng
|
f0fea204f2
|
enh: col value optimize
|
2022-09-23 18:55:27 +08:00 |
|
Hongze Cheng
|
f8619dfbe8
|
refact code for further refact
|
2022-09-21 15:28:04 +08:00 |
|
Haojun Liao
|
5ba41111b4
|
refactor: add some logs.
|
2022-09-15 16:17:39 +08:00 |
|
Hongze Cheng
|
bb0b1fda91
|
Merge branch '3.0' of https://github.com/taosdata/TDengine into refact/tsdb_new_snapshot
|
2022-09-08 15:16:22 +08:00 |
|
Haojun Liao
|
0b6070e518
|
refactor(query): add some logs.
|
2022-09-08 09:45:11 +08:00 |
|
Hongze Cheng
|
0e4b0459bd
|
more code
|
2022-09-07 17:06:42 +08:00 |
|
Haojun Liao
|
a5933fc682
|
fix(query): optimize last block read performance.
|
2022-09-06 15:25:54 +08:00 |
|
Haojun Liao
|
a6cece10df
|
fix(query): fix the invalid the check of last file blocks.
|
2022-09-05 18:57:46 +08:00 |
|
Hongze Cheng
|
0eb29455ae
|
refact code
|
2022-09-02 11:19:34 +08:00 |
|
Hongze Cheng
|
aec4297eb4
|
refact code
|
2022-09-02 11:16:23 +08:00 |
|
Minglei Jin
|
97d533d520
|
tsdbCache/usage: new cacheload column for db.vgroups to check usage
|
2022-09-01 16:41:08 +08:00 |
|
Minglei Jin
|
bd0523ddb9
|
tsdbCache/last: add DCLP to last lookup
|
2022-09-01 15:48:49 +08:00 |
|
Minglei Jin
|
94f4d746b4
|
tsdbCache: support multi-last data reading
|
2022-09-01 15:33:01 +08:00 |
|
Hongze Cheng
|
71e1049377
|
Merge branch '3.0' of https://github.com/taosdata/TDengine into refact/tsdb_optimize
|
2022-08-26 17:53:06 +08:00 |
|
Minglei Jin
|
083ce4e67d
|
fix: use sizeof(SBlockL) from aBlockL array's element size
|
2022-08-26 15:43:20 +08:00 |
|
Hongze Cheng
|
eb2fb724b1
|
more code
|
2022-08-25 18:15:20 +08:00 |
|
Hongze Cheng
|
478d5ebb64
|
more code
|
2022-08-23 13:49:10 +08:00 |
|
Minglei Jin
|
ab94107310
|
fix: create block data for last files
|
2022-08-22 19:10:55 +08:00 |
|
Minglei Jin
|
2ed38aad93
|
fix: use new API tBlockDataInit to init pBlockData
|
2022-08-22 17:08:19 +08:00 |
|
Haojun Liao
|
03879752a1
|
fix(query): fix syntax error on the darwin platform.
|
2022-08-20 19:17:17 +08:00 |
|
Hongze Cheng
|
538f130ac0
|
Merge branch '3.0' of https://github.com/taosdata/TDengine into refact/tsdb_last
|
2022-08-18 21:49:56 +08:00 |
|
Minglei Jin
|
65903a7c0d
|
fix: refact mutex locking
|
2022-08-18 20:14:50 +08:00 |
|
Minglei Jin
|
45dc2ec1f2
|
fix(tsdb/cache): add DCLP to tsdbCache
|
2022-08-18 14:32:11 +08:00 |
|
Minglei Jin
|
4b47476de1
|
fix: upgrade last files reading for last/last_row caching
|
2022-08-17 16:51:15 +08:00 |
|
Hongze Cheng
|
3359b8e620
|
more optimize
|
2022-08-15 10:16:07 +00:00 |