xxq250
/
homework-jianmu
1
0
Fork 0
Code Issues Pull Requests 1 Actions Packages Projects Releases Wiki Activity
58,579 Commits 3 Branches 0 Tags 479 MiB
Commit Graph

486 Commits

Author SHA1 Message Date
Hongze Cheng 86ed5e5674 more optimize 2022-11-09 16:02:04 +08:00
Shengliang Guan dfbb958128
Merge pull request #17929 from taosdata/perf/sma_optimize 
perf: optimize sma calculation
 2022-11-08 10:03:12 +08:00
Hongze Cheng d52b8966fc perf: optimize block data operation 2022-11-07 16:56:35 +08:00
Hongze Cheng 70f7e3e379 perf: optimize sma calculation 2022-11-07 15:42:53 +08:00
Haojun Liao 03f4918b3b refactor: do some internal refactor. 2022-11-04 18:46:48 +08:00
Haojun Liao fc20be8699 fix(query): get if the correct rows in last block exists, and set the correct flag to denote if the last blocks index have been loaded or not. 2022-11-02 22:27:23 +08:00
Minglei Jin 5ae5df1a17 Merge branch 'v3.0' into fix/long_query 2022-11-01 18:06:39 +08:00
Minglei Jin ef606d3fd9 tsdb/read: first round long query for non-cache reading 2022-11-01 16:38:35 +08:00
Haojun Liao 9b99c69785 fix(query): support partition by + limit push down. 2022-10-28 19:56:32 +08:00
Haojun Liao 4b2fa43dae
Revert "fix(query): handle partition by in table scan operator" 2022-10-28 18:05:19 +08:00
Haojun Liao 5a971dd03a fix(query): handle partition by in table scan operator with limit/offset value. 2022-10-27 16:58:32 +08:00
Minglei Jin eac3847532 fix: new reseek callback to separate tsdb & cache readers 2022-10-27 16:48:33 +08:00
Minglei Jin 7800b7731d Merge branch 'v3.0' into fix/long_query 2022-10-27 10:39:50 +08:00
Minglei Jin b52ad0f740 tsdb/cache: new separate dataf reader for last file reading 2022-10-26 08:58:38 +08:00
Minglei Jin 89f7ad2920 fix: optimize tsdb cache loading speed 2022-10-25 10:36:30 +08:00
Haojun Liao abff4fb1f2
Merge pull request #17336 from taosdata/feature/3_liaohj 
other:merge 3.0, and support last query cache
 2022-10-20 18:15:38 +08:00
Hongze Cheng 0706f2dea2 more code 2022-10-18 16:54:53 +08:00
Hongze Cheng 1779c17375 more code 2022-10-18 16:22:06 +08:00
Hongze Cheng b7342525c7 more code 2022-10-18 13:38:26 +08:00
Haojun Liao da9df99461 fix(query): opt last query. 2022-10-17 17:59:43 +08:00
Hongze Cheng 12371d344b Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/stream_compression 2022-09-28 17:49:16 +08:00
Shengliang Guan 53bfdf7bbb
Merge pull request #17117 from taosdata/revert-17106-feature/TD-18581-D 
Revert "enh(tsdb): data migrate should not block data r/w and commit"
 2022-09-28 17:43:21 +08:00
Haojun Liao 71e3993185
Merge pull request #17114 from taosdata/feature/3_liaohj 
refactor(query): do some internal refactor.
 2022-09-28 17:36:01 +08:00
Cary Xu 1fe66cb846
Revert "enh(tsdb): data migrate should not block data r/w and commit" 2022-09-28 15:50:29 +08:00
Haojun Liao 14412f2811 refactor(query): do some internal refactor. 2022-09-28 11:16:52 +08:00
Cary Xu 0841442db6 feat: logic optimization for data migration 2022-09-28 07:41:38 +08:00
Cary Xu 11d6db5ab2 Merge branch '3.0' into feature/TD-18581-D 2022-09-27 19:29:59 +08:00
Hongze Cheng 8bd8ff1523 more code 2022-09-27 18:59:29 +08:00
Hongze Cheng a53575a152 more code 2022-09-27 17:57:57 +08:00
Hongze Cheng a4d16f1c00 more code 2022-09-27 17:36:02 +08:00
Hongze Cheng e17c65fd82 Merge branch 'enh/load_by_column' of https://github.com/taosdata/TDengine into feat/stream_compression 2022-09-27 16:22:42 +08:00
Hongze Cheng 3bd6808335 fix coredump 2022-09-27 15:37:00 +08:00
Cary Xu 43c954b6e7 chore: data migration support specify max speed 2022-09-27 14:27:18 +08:00
Haojun Liao cbe91fd4c3 fix(query): initialize the blockdata before load last block. 2022-09-27 13:48:53 +08:00
Hongze Cheng 4bfdfe89a5 adjust api 2022-09-27 11:02:04 +08:00
Cary Xu 6c682daf42 Merge branch '3.0' into feature/TD-18581-D 2022-09-27 10:33:51 +08:00
Hongze Cheng bba042124f Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/stream_compression 2022-09-27 09:27:02 +08:00
Hongze Cheng 19529d6606 fix: wrong file corrupt report 2022-09-26 18:57:14 +08:00
Cary Xu ed2b3678a6 feat(tsdb): migrate support speed limit 2022-09-23 18:57:13 +08:00
Cary Xu 797b9376e7 chore: code optimization for fs destroy 2022-09-23 17:27:48 +08:00
Hongze Cheng 8ff1eb41d1 more code 2022-09-23 17:13:14 +08:00
Hongze Cheng da2150a15b more code 1 2022-09-23 16:45:38 +08:00
Cary Xu b8ea469aff enh(tsdb): data migrate should not block data r/w and commit 2022-09-23 16:42:36 +08:00
Hongze Cheng a3cedbf1bc more code 2022-09-22 13:49:34 +08:00
Hongze Cheng 9f7771cde4 refact more code 2022-09-22 11:52:47 +08:00
Hongze Cheng a8b919918f more code 2022-09-21 17:58:44 +08:00
Hongze Cheng fb45b8d577 refact code 2022-09-20 13:39:32 +08:00
Hongze Cheng f845a01480 more code 2022-09-15 18:04:39 +08:00
Hongze Cheng 9b29931f78 more code 2022-09-15 17:45:47 +08:00
Hongze Cheng 3a4273406e more code 2022-09-15 17:32:39 +08:00
Haojun Liao 22afbb5035
Merge branch '3.0' into feature/3_liaohj 2022-09-15 16:56:39 +08:00
Hongze Cheng d2141ea5ca more code 2022-09-15 16:44:33 +08:00
Haojun Liao 5ba41111b4 refactor: add some logs. 2022-09-15 16:17:39 +08:00
Hongze Cheng 87b59d2148 Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/long_query 2022-09-15 15:47:46 +08:00
Hongze Cheng 151fd39d1a more code 2022-09-15 14:51:40 +08:00
Hongze Cheng ce9fb84221 refact 2022-09-13 14:21:43 +08:00
Hongze Cheng b44eb59f5d tsdb retention fix done 2022-09-09 15:42:20 +08:00
Hongze Cheng e5e42524c7 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_page_size 2022-09-08 21:40:15 +08:00
Hongze Cheng f0a5820d01 add tsdb config support 2022-09-08 18:36:08 +08:00
Hongze Cheng eae7947c68 more refact 2022-09-08 17:58:33 +08:00
Hongze Cheng 2e8b43d01c more code 2022-09-08 16:56:29 +08:00
Hongze Cheng bb0b1fda91 Merge branch '3.0' of https://github.com/taosdata/TDengine into refact/tsdb_new_snapshot 2022-09-08 15:16:22 +08:00
Hongze Cheng 255f42e07f more tsdb snapshot 2022-09-08 15:13:58 +08:00
Haojun Liao 0b6070e518 refactor(query): add some logs. 2022-09-08 09:45:11 +08:00
Hongze Cheng 0e4b0459bd more code 2022-09-07 17:06:42 +08:00
Hongze Cheng 2d789f5ae0 more code 2022-09-07 15:37:51 +08:00
Hongze Cheng efb429ebd3 Merge branch '3.0' of https://github.com/taosdata/TDengine into refact/tsdb_new_snapshot 2022-09-07 09:45:52 +08:00
Hongze Cheng 56985c5217 snapshot read code 2022-09-06 17:41:06 +08:00
Haojun Liao 6f252d8d7a fix(query): opt perf on last block query. 2022-09-06 16:36:56 +08:00
Haojun Liao a5933fc682 fix(query): optimize last block read performance. 2022-09-06 15:25:54 +08:00
Haojun Liao 3719da865c other:merge 3.0 2022-09-05 19:02:04 +08:00
Haojun Liao a6cece10df fix(query): fix the invalid the check of last file blocks. 2022-09-05 18:57:46 +08:00
Hongze Cheng e70db79d10 refact: change sst to stt 2022-09-05 17:31:41 +08:00
Hongze Cheng c71455216c more code 2022-09-04 22:29:59 +08:00
Hongze Cheng 7e1306a976 more code 2022-09-04 20:28:12 +08:00
Hongze Cheng b85bde9a43 more code 2022-09-04 19:59:21 +08:00
Hongze Cheng 28b56baa98 more code 2022-09-04 18:23:19 +08:00
Hongze Cheng 3607b18368 more code 2022-09-04 18:20:12 +08:00
Hongze Cheng 8ec79c9d5c more code 2022-09-04 17:31:20 +08:00
Hongze Cheng fe20dea410 more code 2022-09-04 16:12:29 +08:00
Hongze Cheng 3e55e72ab5 more code 2022-09-04 14:31:32 +08:00
Hongze Cheng 173a8366e3 fix: compile warning 2022-09-02 17:20:50 +08:00
Hongze Cheng 696df47f05 more 2022-09-02 17:17:46 +08:00
Hongze Cheng 8329284a45 refact for further dev 2022-09-02 17:15:45 +08:00
Hongze Cheng 687dd81c44 refact more code 2022-09-02 14:26:57 +08:00
Hongze Cheng ecbca97ca4 more code 2022-09-02 13:55:05 +08:00
Haojun Liao cac1fd36b7 Merge remote-tracking branch 'origin/refact/tsdb_optimize' into refact/tsdb_optimize 
# Conflicts:
#	source/dnode/vnode/src/inc/tsdb.h
#	source/dnode/vnode/src/tsdb/tsdbMergeTree.c
#	source/dnode/vnode/src/tsdb/tsdbRead.c
 2022-09-02 11:23:01 +08:00
Haojun Liao 720f3b2482 refactor: do some internal refactor. 2022-09-02 11:20:12 +08:00
Hongze Cheng 0eb29455ae refact code 2022-09-02 11:19:34 +08:00
Hongze Cheng aec4297eb4 refact code 2022-09-02 11:16:23 +08:00
Hongze Cheng ff4fda8442 refact code 2022-09-02 10:43:49 +08:00
Hongze Cheng 1132a7f719 refact code 2022-09-02 10:17:40 +08:00
Hongze Cheng 3286ab2a9e refact 2022-09-02 10:09:38 +08:00
Haojun Liao d1b7d07790 refactor:do some internal refactor. 2022-09-02 09:54:22 +08:00
Haojun Liao 1cfd3e74f9 enh(query): support merge multiple last files. 2022-09-01 11:56:56 +08:00
Hongze Cheng e2f99ba072 more code 2022-08-30 11:19:25 +08:00
Hongze Cheng 6a5423d08d more 2022-08-28 00:25:44 +08:00
Hongze Cheng 8b58508e2e more code 2022-08-26 22:23:03 +08:00
Hongze Cheng 8ed246bdd3 more code 2022-08-26 21:57:02 +08:00
Hongze Cheng eb2fb724b1 more code 2022-08-25 18:15:20 +08:00
Hongze Cheng 5bce5c6935 more code 2022-08-24 14:59:55 +08:00
Hongze Cheng 23e82ff68b more code 2022-08-23 16:32:44 +08:00
Hongze Cheng fa257f50ce more code 2022-08-23 15:47:42 +08:00
Hongze Cheng 478d5ebb64 more code 2022-08-23 13:49:10 +08:00
Hongze Cheng 2fff10278f more code 2022-08-23 09:28:01 +08:00
Hongze Cheng 3f90f99d8f first step optimization 2022-08-22 18:12:40 +08:00
Hongze Cheng 4acc76b7c5 adjust more code 2022-08-19 18:35:09 +08:00
Hongze Cheng 875566d361 adjust more 2022-08-19 18:06:18 +08:00
Hongze Cheng d3d03d8c4d adjust more code 2022-08-19 17:45:52 +08:00
Hongze Cheng 029c16e487 more code 2022-08-19 17:13:39 +08:00
Hongze Cheng 538f130ac0 Merge branch '3.0' of https://github.com/taosdata/TDengine into refact/tsdb_last 2022-08-18 21:49:56 +08:00
Hongze Cheng 4de48e66de adjust more 2022-08-18 17:04:24 +08:00
Minglei Jin 45dc2ec1f2 fix(tsdb/cache): add DCLP to tsdbCache 2022-08-18 14:32:11 +08:00
Minglei Jin 4b47476de1 fix: upgrade last files reading for last/last_row caching 2022-08-17 16:51:15 +08:00
Hongze Cheng c6106be5da refact more work 2022-08-17 15:08:44 +08:00
Hongze Cheng 23a0af9d12 more work 2022-08-17 11:46:13 +08:00
Hongze Cheng 43c84c977a adjust more 2022-08-16 01:45:37 +00:00
Hongze Cheng 3359b8e620 more optimize 2022-08-15 10:16:07 +00:00
Hongze Cheng 0e06d86f7b fix some bug 2022-08-08 11:40:49 +00:00
Hongze Cheng 49fde0b1a8 more work 2022-08-08 07:27:44 +00:00
Hongze Cheng 6baae7d50f more work 2022-08-08 06:43:51 +00:00
Hongze Cheng 8ae2ab1c6e more work 2022-08-08 05:34:01 +00:00
Hongze Cheng 33c3f34f34 more work 2022-08-08 03:22:24 +00:00
Hongze Cheng 7671bfe19e more refact 2022-08-07 15:20:28 +00:00
Hongze Cheng 71691eb7da make code compile 2022-08-07 13:14:43 +00:00
Hongze Cheng 605e89b6a1 more work 2022-08-07 12:50:42 +00:00
Hongze Cheng 3698016ad9 more work 2022-08-07 09:25:50 +00:00
Hongze Cheng 2d50313586 more work 2022-08-07 08:12:59 +00:00
Hongze Cheng 85556a3c90 more work 2022-08-07 06:13:51 +00:00
Hongze Cheng 7c32e099d0 more work 2022-08-06 14:20:30 +00:00
Hongze Cheng 43dec55fd7 more work 2022-08-06 12:48:58 +00:00
Hongze Cheng 3436d52316 more refact 2022-08-06 12:23:29 +00:00
Hongze Cheng 3324f4e5b7 more work 2022-08-06 12:04:42 +00:00
Hongze Cheng 85907bc269 more work 2022-08-06 02:03:20 +00:00
Hongze Cheng 16f556354a more work 2022-08-05 15:22:05 +00:00
Hongze Cheng 51538a1710 more work 2022-08-05 09:47:26 +00:00
Hongze Cheng 2cb114caad more work 2022-08-04 10:15:51 +00:00
Hongze Cheng 67db73b560 more last refact work 2022-08-04 07:58:53 +00:00
Hongze Cheng d1c7e3a531 more last refact 2022-08-04 05:42:15 +00:00
Hongze Cheng 7075244183 more last file refact 2022-08-03 12:16:57 +00:00
Hongze Cheng e827d0bb7a more last file refact 2022-08-03 08:50:36 +00:00
Hongze Cheng ebd60a968c refact: tsdb last file optimize 1 2022-08-01 10:03:00 +00:00
Hongze Cheng 5e2a498660 refact: prepare last refact 2022-07-30 12:08:04 +00:00
Minglei Jin c2faef7377
Merge pull request #15555 from taosdata/fix/TD-17968 
fix: update schema to newest version to parsing rows
 2022-07-30 16:04:04 +08:00
Minglei Jin 56d2697308 fix: new tRowMergerInit2 for ts row merging 2022-07-30 12:46:40 +08:00
Hongze Cheng 1543e241d3 refact: do some insert optimization 2022-07-29 19:49:54 +08:00
Haojun Liao 6600540fd9 refactor: optimize the memory consumption during tsdbread 2022-07-26 11:43:45 +08:00
Hongze Cheng 476053e3e1 refact some code 2022-07-22 03:16:03 +00:00
Hongze Cheng 684dd82358 fix read concurrency 2022-07-21 11:42:42 +00:00
Hongze Cheng f195decac9 more fix 2022-07-21 06:27:32 +00:00
Hongze Cheng 6b454a4dd4 more 2022-07-19 06:26:09 +00:00
Hongze Cheng 58135a1aeb tsdb r/w concurrency 2022-07-19 06:19:01 +00:00
Hongze Cheng 322ec02e39 fix: delete causes coredump 2022-07-18 11:45:13 +00:00
Hongze Cheng 25a2d04b85 more vnode snapshot writer 2022-07-14 07:37:53 +00:00
Hongze Cheng e6e9926d38 more vnode snapshot writer 2022-07-13 12:02:59 +00:00
Hongze Cheng 583742089e more vnode snapshot writer 2022-07-13 08:14:20 +00:00
Hongze Cheng b691e76782 more vnode snapshot 2022-07-13 05:51:37 +00:00
Hongze Cheng 338a763853 more vnode snapshot 2022-07-13 02:41:37 +00:00
Minglei Jin 8ff644ffcf
Merge pull request #14784 from taosdata/fix/tsdb-cache-cfg 
tsdbCache: use cachelast & cachelastsize cfg from vnode
 2022-07-11 23:22:02 +08:00
Minglei Jin 53f56217f7 tsdbCache: use cachelast & cachelastsize cfg from vnode 2022-07-11 20:16:48 +08:00
Hongze Cheng fe2266af26 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/tsdb_snapshot 2022-07-11 07:19:10 +00:00
Minglei Jin 22eb20bb67 tsdbCache: new row iterator for mem/imem/fs 2022-07-11 14:29:10 +08:00
Hongze Cheng be1af580c2 tsdb retention function 2022-07-10 12:25:11 +00:00
Hongze Cheng 0840affc32 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/tsdb_snapshot 2022-07-08 12:33:12 +00:00
Minglei Jin 23fc0f0008 tsdbCache/last: save ts info of each column 2022-07-08 15:54:11 +08:00
Hongze Cheng 9720f05491 more tsdb snapshow writer 2022-07-06 06:59:53 +00:00
Hongze Cheng 08a7d9d38f fix ci coredump 2022-07-05 09:31:51 +00:00
Hongze Cheng 1145aabb94 adjust some apis 2022-07-05 03:20:25 +00:00
Hongze Cheng 27b719febd refact some code 2022-07-04 11:24:54 +00:00
Hongze Cheng b1466ad79c make sma work 2022-07-04 03:01:19 +00:00
Hongze Cheng 62519ae4bd more work 2022-07-02 09:52:21 +00:00
Hongze Cheng 1acbb50f24 finish read block sma api 2022-07-02 07:25:07 +00:00
Hongze Cheng 7d50bfcb0d more code 2022-07-01 15:10:46 +00:00
Minglei Jin ae2514efca tsdbCache/last: fix last loading crash issues 2022-07-01 16:15:29 +08:00
Minglei Jin e3bb10218a tsdbCache/insert: fix row merging from mem 2022-07-01 11:15:22 +08:00
Minglei Jin e5944b08fb tsdbCache: new dup parameter to insert last row 2022-07-01 10:23:32 +08:00
Minglei Jin 208dee8edc tsdb/cache: add insert last interface 2022-06-30 21:07:09 +08:00
Hongze Cheng cc181e0bc2 refact 2022-06-30 09:56:34 +00:00
Hongze Cheng 319e745dd5 more work 2022-06-30 06:02:47 +00:00
Hongze Cheng 1d88e84d10 add an API 2022-06-29 12:37:16 +00:00
Minglei Jin 703e876b4c tsdbCache: remove deprecated last row API 2022-06-29 20:03:27 +08:00
Minglei Jin 8cd3bffb36 tsdbCache/delete: refine tsdbCacheDelete API 2022-06-29 17:41:06 +08:00
Minglei Jin 847016aa21 tsdbCache: new H version api for last/last_row getting 2022-06-29 17:29:49 +08:00
Minglei Jin 90788972e5 tsdbCache: new release interface 2022-06-29 16:53:30 +08:00
Hongze Cheng d032dec4fb more work 2022-06-29 06:51:45 +00:00
Hongze Cheng 40dd9564f2 more work 2022-06-29 03:34:55 +00:00
Hongze Cheng 7dc8b876f3 more work 2022-06-29 01:59:22 +00:00
Hongze Cheng 3ba5d8e98a refact del data 2022-06-28 07:20:46 +00:00
Hongze Cheng 79e23420b4 refact more 2022-06-28 05:41:15 +00:00
Hongze Cheng 89026d754f more work 2022-06-28 03:22:56 +00:00
Hongze Cheng 44c473303f more work 2022-06-27 15:42:55 +00:00
Hongze Cheng f9fd39eb58 more work 2022-06-27 11:20:11 +00:00
Hongze Cheng d814016e23 more work 2022-06-27 07:23:38 +00:00
Hongze Cheng 2a41f1d3f6 more work 2022-06-27 06:07:45 +00:00
Hongze Cheng 4b5b3bad11 more work 2022-06-27 05:30:10 +00:00
Hongze Cheng 9a123ba608 Merge branch 'feat/tsdb_refact' of https://github.com/taosdata/TDengine into feat/tsdb_refact 2022-06-25 11:40:52 +00:00
Hongze Cheng e32961ce5e more work 2022-06-25 11:40:50 +00:00
Minglei Jin 65b54f9d73 tsdbCache: framework for last row merging 2022-06-25 19:31:16 +08:00
Hongze Cheng 7d1574feca fix map data encode bug 2022-06-25 08:52:24 +00:00
Hongze Cheng 21062f72d1 more work 2022-06-24 13:10:39 +00:00