Commit Graph

173 Commits

Author SHA1 Message Date
Shengliang Guan 6d94afe48f
Revert "refact: adjust some assert cases" 2022-12-07 21:51:17 +08:00
Shengliang Guan f69a188f7e refact: replcase ASSERT with tAssert 2022-12-07 18:37:40 +08:00
Minglei Jin 1e23f80597 tsdb/cache: use empty array as negative entry to empty table's last/lr 2022-12-07 14:34:38 +08:00
Hongze Cheng 899d7b0bcc Merge branch '3.0' of https://github.com/taosdata/TDengine into refact/submit_req 2022-12-06 14:37:22 +08:00
Minglei Jin 55fb892e70 fix(tsdb/cache): use lru erase to invalidate cache entries 2022-12-02 17:53:16 +08:00
Hongze Cheng 6dcdafa486 more code 2022-12-01 17:00:33 +08:00
Hongze Cheng 73f8dc6a5b more code 2022-12-01 14:24:10 +08:00
Hongze Cheng f5270f6a0c adjust api 2022-11-30 10:30:03 +08:00
Hongze Cheng 0f8016995c more code 2022-11-28 13:41:06 +08:00
Haojun Liao 0948216ca9 fix(query): fix dead lock. 2022-11-26 21:13:34 +08:00
stephenkgu 8d6f129154 fix: skip empty data in delete file 2022-11-10 08:14:21 +08:00
Minglei Jin a5052eb2d5 fix: remove last stt load info resetting from fs iterator 2022-11-01 17:29:18 +08:00
Minglei Jin cb0a3ec042 fix: continue to fetch next row if deleted 2022-10-26 18:39:04 +08:00
Minglei Jin 89d74e5016 fix: malloc and copy binary data when inserting last & last_row 2022-10-26 10:52:35 +08:00
Minglei Jin b52ad0f740 tsdb/cache: new separate dataf reader for last file reading 2022-10-26 08:58:38 +08:00
Minglei Jin 441fe8119c Merge branch '3.0' into fix/TD-19468-2 2022-10-25 10:51:35 +08:00
Minglei Jin 89f7ad2920 fix: optimize tsdb cache loading speed 2022-10-25 10:36:30 +08:00
Minglei Jin 214df56e39 fix: return 0 usage when pTsdb is null 2022-10-23 06:54:24 +08:00
Minglei Jin 60b85028af fix: do not copy binary when nData is 0 2022-10-19 18:53:51 +08:00
Minglei Jin 6dea891571 fix: release data file reader 2022-10-19 16:07:53 +08:00
Minglei Jin 640338893d tsdb/cache: handle OOM exceptions 2022-10-19 15:01:49 +08:00
Minglei Jin ceec953498 fix: copy binary type column data out 2022-10-19 14:50:36 +08:00
Minglei Jin a1c18bba33 fix: cache load calculation 2022-10-19 13:58:59 +08:00
Minglei Jin 467c6386ed fix: last_row array element type 2022-10-19 11:06:08 +08:00
Minglei Jin 109d50a4cc fix: last row array form bug 2022-10-17 18:13:38 +08:00
Haojun Liao da9df99461 fix(query): opt last query. 2022-10-17 17:59:43 +08:00
Haojun Liao 2c656a2cdc Merge branch 'feature/3_liaohj' of github.com:taosdata/tdengine into feature/3_liaohj 2022-10-17 17:22:04 +08:00
Minglei Jin b62fa20b53 tsdb/cache: return last row as array of SLastCol 2022-10-17 17:20:32 +08:00
Haojun Liao aa9c99fa53 Merge branch '3.0' into feature/3_liaohj 2022-10-16 12:50:05 +08:00
Minglei Jin 3f46bd64b9 fix: dismiss some coverity scan issues 2022-10-14 17:47:21 +08:00
Minglei Jin 977fc4b15c fix(tsdb/cache): release lock when table's empty 2022-10-14 15:28:19 +08:00
Minglei Jin 3a0ea21342 fix: get SLastCol from array instead of SColVal 2022-10-13 19:54:25 +08:00
Minglei Jin 66962bdddc fix: close merge tree for each file set 2022-10-13 18:12:26 +08:00
Minglei Jin 997dfb41d9 fix(meta): use rwlock to favor writers 2022-10-10 11:00:55 +08:00
Haojun Liao 7674fa972c
Merge pull request #17184 from taosdata/feature/3_liaohj
fix(query): fix memory leak in last_row query
2022-09-30 17:51:45 +08:00
Haojun Liao 877c707ce6 fix(query): fix memory leak in last_row query 2022-09-30 17:10:55 +08:00
Shengliang Guan b77a62dcd8
Merge pull request #17183 from taosdata/feature/3_liaohj
fix(query): fix memory leak.
2022-09-30 16:46:07 +08:00
Haojun Liao 4b1e8e0cec fix(query): fix memory leak. 2022-09-30 16:02:28 +08:00
Hongze Cheng 12371d344b Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/stream_compression 2022-09-28 17:49:16 +08:00
Haojun Liao 14412f2811 refactor(query): do some internal refactor. 2022-09-28 11:16:52 +08:00
Hongze Cheng e17c65fd82 Merge branch 'enh/load_by_column' of https://github.com/taosdata/TDengine into feat/stream_compression 2022-09-27 16:22:42 +08:00
Haojun Liao cbe91fd4c3 fix(query): initialize the blockdata before load last block. 2022-09-27 13:48:53 +08:00
Hongze Cheng 4bfdfe89a5 adjust api 2022-09-27 11:02:04 +08:00
Hongze Cheng 1a0dcddd62 Merge branch 'enh/cv_optimize' of https://github.com/taosdata/TDengine into feat/stream_compression 2022-09-23 18:59:13 +08:00
Hongze Cheng f0fea204f2 enh: col value optimize 2022-09-23 18:55:27 +08:00
Hongze Cheng f8619dfbe8 refact code for further refact 2022-09-21 15:28:04 +08:00
Haojun Liao 5ba41111b4 refactor: add some logs. 2022-09-15 16:17:39 +08:00
Hongze Cheng bb0b1fda91 Merge branch '3.0' of https://github.com/taosdata/TDengine into refact/tsdb_new_snapshot 2022-09-08 15:16:22 +08:00
Haojun Liao 0b6070e518 refactor(query): add some logs. 2022-09-08 09:45:11 +08:00
Hongze Cheng 0e4b0459bd more code 2022-09-07 17:06:42 +08:00
Haojun Liao a5933fc682 fix(query): optimize last block read performance. 2022-09-06 15:25:54 +08:00
Haojun Liao a6cece10df fix(query): fix the invalid the check of last file blocks. 2022-09-05 18:57:46 +08:00
Hongze Cheng 0eb29455ae refact code 2022-09-02 11:19:34 +08:00
Hongze Cheng aec4297eb4 refact code 2022-09-02 11:16:23 +08:00
Minglei Jin 97d533d520 tsdbCache/usage: new cacheload column for db.vgroups to check usage 2022-09-01 16:41:08 +08:00
Minglei Jin bd0523ddb9 tsdbCache/last: add DCLP to last lookup 2022-09-01 15:48:49 +08:00
Minglei Jin 94f4d746b4 tsdbCache: support multi-last data reading 2022-09-01 15:33:01 +08:00
Hongze Cheng 71e1049377 Merge branch '3.0' of https://github.com/taosdata/TDengine into refact/tsdb_optimize 2022-08-26 17:53:06 +08:00
Minglei Jin 083ce4e67d fix: use sizeof(SBlockL) from aBlockL array's element size 2022-08-26 15:43:20 +08:00
Hongze Cheng eb2fb724b1 more code 2022-08-25 18:15:20 +08:00
Hongze Cheng 478d5ebb64 more code 2022-08-23 13:49:10 +08:00
Minglei Jin ab94107310 fix: create block data for last files 2022-08-22 19:10:55 +08:00
Minglei Jin 2ed38aad93 fix: use new API tBlockDataInit to init pBlockData 2022-08-22 17:08:19 +08:00
Haojun Liao 03879752a1 fix(query): fix syntax error on the darwin platform. 2022-08-20 19:17:17 +08:00
Hongze Cheng 538f130ac0 Merge branch '3.0' of https://github.com/taosdata/TDengine into refact/tsdb_last 2022-08-18 21:49:56 +08:00
Minglei Jin 65903a7c0d fix: refact mutex locking 2022-08-18 20:14:50 +08:00
Minglei Jin 45dc2ec1f2 fix(tsdb/cache): add DCLP to tsdbCache 2022-08-18 14:32:11 +08:00
Minglei Jin 4b47476de1 fix: upgrade last files reading for last/last_row caching 2022-08-17 16:51:15 +08:00
Hongze Cheng 3359b8e620 more optimize 2022-08-15 10:16:07 +00:00
Hongze Cheng 4f06c4bbdd make it compile 2022-08-08 07:32:02 +00:00
Hongze Cheng 33c3f34f34 more work 2022-08-08 03:22:24 +00:00
Hongze Cheng 71691eb7da make code compile 2022-08-07 13:14:43 +00:00
Hongze Cheng 43dec55fd7 more work 2022-08-06 12:48:58 +00:00
Hongze Cheng 3436d52316 more refact 2022-08-06 12:23:29 +00:00
Hongze Cheng 3324f4e5b7 more work 2022-08-06 12:04:42 +00:00
Minglei Jin 8cee6817ca fix: init mergedRow to NULL 2022-07-29 16:23:20 +08:00
Minglei Jin 34b0208f14 refact: tsdbCache/cleanup, remove tsRowFromTsdbRow 2022-07-28 15:29:22 +08:00
Minglei Jin 6e92950a4d fix: cleanup tsdbCache, removing unused functions 2022-07-28 14:06:44 +08:00
Hongze Cheng 684dd82358 fix read concurrency 2022-07-21 11:42:42 +00:00
Hongze Cheng 657c2dcaa4 more r/w concurrency 2022-07-19 07:21:15 +00:00
Hongze Cheng 58135a1aeb tsdb r/w concurrency 2022-07-19 06:19:01 +00:00
Hongze Cheng e6e9926d38 more vnode snapshot writer 2022-07-13 12:02:59 +00:00
Hongze Cheng 583742089e more vnode snapshot writer 2022-07-13 08:14:20 +00:00
Minglei Jin d220690d3c fix: skip file set if null pBlockIdx 2022-07-12 10:43:02 +08:00
Minglei Jin e7a920e430 fix: fix file set index bug 2022-07-11 20:44:55 +08:00
Minglei Jin 53f56217f7 tsdbCache: use cachelast & cachelastsize cfg from vnode 2022-07-11 20:16:48 +08:00
Minglei Jin 22eb20bb67 tsdbCache: new row iterator for mem/imem/fs 2022-07-11 14:29:10 +08:00
Minglei Jin e4c45e507f fix: release handle to keep refs correct 2022-07-08 18:51:44 +08:00
Minglei Jin 2ef8cd9a8f fix: invalidate last cache when it's covered by delete range 2022-07-08 17:37:49 +08:00
Minglei Jin 23fc0f0008 tsdbCache/last: save ts info of each column 2022-07-08 15:54:11 +08:00
Minglei Jin 4288ab412e fix: fix tsdb cache del index reading 2022-07-07 14:58:59 +08:00
Hongze Cheng 1145aabb94 adjust some apis 2022-07-05 03:20:25 +00:00
Minglei Jin 9aa5ee6ccf tsdbCache: fix row duplication 2022-07-04 16:58:42 +08:00
Minglei Jin 253291a146 tsdbCache: destroy del index array 2022-07-04 11:43:23 +08:00
Minglei Jin f34e43d7b8 tsdbCache: new clearNextRowFS to cleanup fs iter 2022-07-04 11:00:11 +08:00
Minglei Jin 47f31a09a6 tsdbCache/last: fix block data clear 2022-07-02 11:40:42 +08:00
Minglei Jin 36fbf6d7cb tsdbCache: free tmp ppRow 2022-07-01 17:19:01 +08:00
Minglei Jin ae2514efca tsdbCache/last: fix last loading crash issues 2022-07-01 16:15:29 +08:00
Minglei Jin e3bb10218a tsdbCache/insert: fix row merging from mem 2022-07-01 11:15:22 +08:00
Minglei Jin e5944b08fb tsdbCache: new dup parameter to insert last row 2022-07-01 10:23:32 +08:00