Commit Graph

4025 Commits

Author SHA1 Message Date
Shengliang Guan 6fbde2d119
Merge pull request #17254 from taosdata/fix/TD-19416
fix(meta): use rwlock to favor writers
2022-10-10 11:49:38 +08:00
Liu Jicong b1594a6857 fix coverity scan 2022-10-10 11:44:17 +08:00
Shengliang Guan 4084140fa0
Merge pull request #17252 from taosdata/fix/TD-19254-D
fix: coverity scan for sma and tfs
2022-10-10 11:24:37 +08:00
Minglei Jin 997dfb41d9 fix(meta): use rwlock to favor writers 2022-10-10 11:00:55 +08:00
Cary Xu 6b984ab448 fix: coverity scan for sma and tfs 2022-10-10 10:23:57 +08:00
Cary Xu 37c2fd5b08 fix: coverity scan for sma and tfs 2022-10-10 10:16:00 +08:00
Liu Jicong 86d80ad478
Merge pull request #17244 from taosdata/feature/stream
feat(stream): support define table name (DO NOT MERGE)
2022-10-10 10:05:33 +08:00
Liu Jicong 57d1406096 add tbname column into stream special block 2022-10-09 22:49:37 +08:00
Shengliang Guan edaf09403f
Merge pull request #17247 from taosdata/feature/3_liaohj
fix(query): fix the last block search error for ordinary table.
2022-10-09 20:52:00 +08:00
Haojun Liao a356b4eb7c fix(query): fix the last block search error for ordinary table. 2022-10-09 18:55:01 +08:00
Shengliang Guan b4c53d8345
Merge pull request #17237 from taosdata/feat/alter_pages_buffer
feat: alter pages buffer
2022-10-09 17:29:34 +08:00
Liu Jicong eafe8666f7 merge 3.0 2022-10-09 17:00:18 +08:00
Liu Jicong 2f9aeeb5fc feat(stream): support define table name 2022-10-09 16:54:27 +08:00
Haojun Liao 5402f6bc26 enh(query): opt query perf when handling the query of last files. 2022-10-09 15:25:42 +08:00
Hongze Cheng 2015db5756 alter pages 2022-10-09 15:01:20 +08:00
Haojun Liao c5e094efd0 enh(query): optimize the perf for ordinary table query with data in last file. 2022-10-09 14:34:10 +08:00
Hongze Cheng 6825d2a143 alter vnode buffer 2022-10-09 13:55:14 +08:00
Hongze Cheng ee56c50069 more code 2022-10-09 13:52:44 +08:00
yihaoDeng 27003dfaa5 fix invalid tag value 2022-10-08 15:48:52 +08:00
yihaoDeng c62b1985d7 fix invalid tag value 2022-10-05 18:32:30 +08:00
yihaoDeng 16c1473823 enh(query): opt get table meta 2022-10-01 13:49:30 +08:00
Haojun Liao fac464792d other:merge 3.0 2022-09-30 17:54:03 +08:00
Haojun Liao 7674fa972c
Merge pull request #17184 from taosdata/feature/3_liaohj
fix(query): fix memory leak in last_row query
2022-09-30 17:51:45 +08:00
Haojun Liao 877c707ce6 fix(query): fix memory leak in last_row query 2022-09-30 17:10:55 +08:00
Shengliang Guan b77a62dcd8
Merge pull request #17183 from taosdata/feature/3_liaohj
fix(query): fix memory leak.
2022-09-30 16:46:07 +08:00
Shengliang Guan 3442d14f58
Merge pull request #17182 from taosdata/enh/optTbnameINMem
fix(query): fix mem leak
2022-09-30 16:45:39 +08:00
Hongze Cheng 856c990fbc
Merge pull request #17102 from taosdata/feat/stream_compression
feat: stream compression
2022-09-30 16:17:19 +08:00
Haojun Liao 4b1e8e0cec fix(query): fix memory leak. 2022-09-30 16:02:28 +08:00
yihaoDeng 90c6116373 fix mem leak 2022-09-30 15:42:58 +08:00
Shengliang Guan 084414bebc
Merge pull request #17173 from taosdata/fix/TD-19245
fix: coverity issues
2022-09-30 15:42:46 +08:00
Haojun Liao 6faf1af5f5 fix(query): handle the block read case. 2022-09-30 14:44:42 +08:00
Shengliang Guan dfb2b0678f fix: coverity issues 2022-09-30 14:03:46 +08:00
Hongze Cheng 7754471aaa Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/stream_compression 2022-09-30 13:50:01 +08:00
Haojun Liao f8a84a1d19 other:merge 3.0 2022-09-30 13:47:21 +08:00
Haojun Liao 1f57a5a1cc
Merge pull request #17172 from taosdata/feature/3_liaohj
fix(query): fix memory leak.
2022-09-30 13:45:01 +08:00
Haojun Liao c9286fed25 fix(query): fix memory leak. 2022-09-30 13:03:25 +08:00
Hongze Cheng 145abcb17f more 2022-09-30 10:52:17 +08:00
Hongze Cheng be482feacc Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/stream_compression 2022-09-30 10:32:10 +08:00
yihaoDeng f41b494ac6 opt tbname in 2022-09-30 10:19:56 +08:00
Shengliang Guan e6ac8ed3a9
Merge pull request #17121 from taosdata/szhou/fixbugs
enhance: optimize when select from ins_tags when table_name='xxxx'
2022-09-30 09:39:27 +08:00
yihaoDeng 0d3da10954 fix invalid read 2022-09-30 09:31:19 +08:00
yihaoDeng d74779805a opt tbname in 2022-09-29 23:13:54 +08:00
Shengliang Guan 3be4a2ed9c Merge remote-tracking branch 'origin/3.0' into fix/TD-19245 2022-09-29 19:42:09 +08:00
Shengliang Guan e94646ca70 fix: coverity issues 2022-09-29 19:41:54 +08:00
Hongze Cheng d60ec735ca Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/stream_compression 2022-09-29 17:07:58 +08:00
Hongze Cheng bdeb1ebcc5 compare 2022-09-29 17:06:18 +08:00
Shengliang Guan 752e13f94c Merge branch 'fix/TD-19325' into feature/tq 2022-09-29 14:52:08 +08:00
Shengliang Guan c56dd86399 fix: do not process query and fetch msg until vnode restore finished 2022-09-29 14:29:30 +08:00
Liu Jicong 586175ecfa check vnode status for poll msg 2022-09-29 14:25:56 +08:00
Shengliang Guan 4df3303514 fix: do not process query and fetch msg until vnode restore finished 2022-09-29 14:24:45 +08:00
Liu Jicong d41ce958f3 Merge branch 'fix/TD-19325' into feature/tq 2022-09-29 14:21:08 +08:00
Shengliang Guan f14d00a5d6 fix: do not process query and fetch msg until vnode restore finished 2022-09-29 14:19:43 +08:00
Shengliang Guan 7e85a15c31 fix: do not process query and fetch msg until vnode restore finished 2022-09-29 14:18:20 +08:00
Shengliang Guan 4223be379a fix: do not process query and fetch msg until vnode restore finished 2022-09-29 14:15:26 +08:00
Shengliang Guan ee484470f3 fix: do not process query and fetch msg until vnode restore finished 2022-09-29 14:13:44 +08:00
Liu Jicong 0c48581c86 check push ver 2022-09-29 13:52:09 +08:00
Hongze Cheng cb554920aa Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/stream_compression 2022-09-29 13:23:20 +08:00
Hongze Cheng 768ec8942a fix code 2022-09-29 13:23:12 +08:00
Liu Jicong bb1165f1e9 optimize projection return 2022-09-29 12:14:41 +08:00
dapan1121 95b6d3f67f
Merge pull request #17132 from taosdata/fix/TD-19310
fix: fix rows missed in query result issue
2022-09-29 11:41:52 +08:00
yihaoDeng 88ac809f87 Merge branch '3.0' of https://github.com/taosdata/TDengine into dv3 2022-09-29 11:09:02 +08:00
yihaoDeng 5b4d0eaabe enh: opt tbname in 2022-09-29 11:07:32 +08:00
Hongze Cheng f12449b1b8 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/stream_compression 2022-09-29 10:20:36 +08:00
Shengliang Guan 44b8d659ba
Merge pull request #17130 from taosdata/FIX/TD-19260-3.0
enh: improve error handling in syncNodeOpen instead of using assert, with allocated resources cleaned up properly
2022-09-29 09:23:28 +08:00
Liu Jicong a2a8fe0211 rsp consumer when taosd stop 2022-09-29 01:37:45 +08:00
Hongze Cheng 90915f1da3 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/stream_compression 2022-09-29 00:02:42 +08:00
Liu Jicong b0a46942c2 rsp to consumer if offset move forward 2022-09-28 23:47:47 +08:00
Liu Jicong fab0adde99 fix memory error 2022-09-28 23:06:45 +08:00
yihaoDeng 1286f7473c QRY: opt tbname in 2022-09-28 22:07:16 +08:00
Liu Jicong 057edd92c3
Merge branch '3.0' into feature/tq 2022-09-28 20:27:09 +08:00
Liu Jicong cde4085a6d optimize msg batch 2022-09-28 20:24:02 +08:00
Shengliang Guan 4ca305fd7a
Merge pull request #17131 from taosdata/fix/TD-19254-D
fix: coverity scan for sma
2022-09-28 20:22:58 +08:00
dapan1121 45fb658cec fix: fix rows missed in query result issue 2022-09-28 19:06:43 +08:00
Cary Xu bf377943e0 fix: api parameters 2022-09-28 18:56:57 +08:00
Cary Xu 9e49eb03e4 fix: coverity scan for sma 2022-09-28 18:54:39 +08:00
Haojun Liao 5a2c583c32 other:merge 3.0 2022-09-28 18:00:04 +08:00
Hongze Cheng 12371d344b Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/stream_compression 2022-09-28 17:49:16 +08:00
Shengliang Guan 53bfdf7bbb
Merge pull request #17117 from taosdata/revert-17106-feature/TD-18581-D
Revert "enh(tsdb): data migrate should not block data r/w and commit"
2022-09-28 17:43:21 +08:00
Benguang Zhao 4b4f7a44f4 fix: resolve memory leak in vnodeOpen when vnodeSyncOpen failure 2022-09-28 17:40:10 +08:00
Haojun Liao 71e3993185
Merge pull request #17114 from taosdata/feature/3_liaohj
refactor(query): do some internal refactor.
2022-09-28 17:36:01 +08:00
slzhou 00fc74acc9 Merge branch '3.0' of github.com:taosdata/TDengine into szhou/fixbugs 2022-09-28 16:39:33 +08:00
slzhou 99bc329384 enhance: optimize select from ins_tags where table_name='tablename' without iterating through meta tdb 2022-09-28 16:30:40 +08:00
Cary Xu 1fe66cb846
Revert "enh(tsdb): data migrate should not block data r/w and commit" 2022-09-28 15:50:29 +08:00
Liu Jicong 01c94a775b feat(tmq): push optimization 2022-09-28 14:55:19 +08:00
Hongze Cheng a4d426aa13 more fix 2022-09-28 13:39:48 +08:00
Benguang Zhao b71a9e3483 enh: improve error handling in syncNodeOpen 2022-09-28 13:34:13 +08:00
Cary Xu d3c335a06e chore: fs merge optimization for data migrate 2022-09-28 12:56:17 +08:00
Haojun Liao 14412f2811 refactor(query): do some internal refactor. 2022-09-28 11:16:52 +08:00
Liu Jicong 1ad4d16373 Merge branch '3.0' into feature/tq 2022-09-28 10:57:59 +08:00
Haojun Liao 04f087793e refactor(query): do some internal refactor. 2022-09-28 10:54:54 +08:00
Liu Jicong 0e8aaf4c9e feat(tmq): push optimization 2022-09-28 10:38:49 +08:00
Cary Xu b78a39ced1 fix: resource release when end commit 2022-09-28 09:47:51 +08:00
Cary Xu 0841442db6 feat: logic optimization for data migration 2022-09-28 07:41:38 +08:00
Hongze Cheng 18f3bd53c5 fix code 2022-09-27 23:34:06 +08:00
Cary Xu 11d6db5ab2 Merge branch '3.0' into feature/TD-18581-D 2022-09-27 19:29:59 +08:00
Haojun Liao 59b7435170 fix(query): fix memory copy 2022-09-27 19:17:35 +08:00
Hongze Cheng 8bd8ff1523 more code 2022-09-27 18:59:29 +08:00
Haojun Liao 7818bed189 Merge branch 'feature/3_liaohj' into refact/query_opt 2022-09-27 18:51:42 +08:00
Haojun Liao c565c4cb63 fix(query): remove the primary timestamp column in the required column list. 2022-09-27 18:50:51 +08:00
Cary Xu ddf121496f chore: adjust debug log 2022-09-27 18:42:42 +08:00
Haojun Liao e2fa878136 other:merge 3.0 2022-09-27 18:39:03 +08:00
Haojun Liao 398c23edec enh(query): only load the required columns. 2022-09-27 18:37:02 +08:00
Cary Xu 8943fd2fc2 chore: log optimization for data migrate 2022-09-27 18:16:48 +08:00
Haojun Liao 4058ae1f9b Merge branch '3.0' into feature/3_liaohj 2022-09-27 18:16:26 +08:00
Haojun Liao bd6cf3137f other:merge 3.0 2022-09-27 18:12:54 +08:00
Haojun Liao 1b3721b42e
Merge pull request #17078 from taosdata/enh/load_by_column
enh: load by col opt
2022-09-27 18:07:34 +08:00
Hongze Cheng a53575a152 more code 2022-09-27 17:57:57 +08:00
Cary Xu 70f2c68570 chore: code format 2022-09-27 17:57:44 +08:00
Cary Xu b7253d8814 chore: code optimization for tsdb commit 2022-09-27 17:55:01 +08:00
Cary Xu 6536ad72a6 chore: update file naming for tsdb retention 2022-09-27 17:48:09 +08:00
Cary Xu 5c61e5da3e Merge branch '3.0' into feature/TD-18581-D 2022-09-27 17:43:52 +08:00
Cary Xu c426fa8bb1 feat: code optimization for data migrate 2022-09-27 17:43:33 +08:00
Hongze Cheng a4d16f1c00 more code 2022-09-27 17:36:02 +08:00
Hongze Cheng dc0d687a06 make it compile 2022-09-27 16:26:16 +08:00
Hongze Cheng e17c65fd82 Merge branch 'enh/load_by_column' of https://github.com/taosdata/TDengine into feat/stream_compression 2022-09-27 16:22:42 +08:00
Haojun Liao 144a0c573b fix(query): set schema info for inner reader. 2022-09-27 16:17:03 +08:00
Hongze Cheng faea22cc56 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/stream_compression 2022-09-27 15:40:48 +08:00
Hongze Cheng 3bd6808335 fix coredump 2022-09-27 15:37:00 +08:00
Haojun Liao a70a657f5f fix(query): initialize array list 2022-09-27 14:43:57 +08:00
Cary Xu 3d92b6c6f9 chore: remove debug logs when migrate 2022-09-27 14:33:17 +08:00
Cary Xu 024f6a2149 chore: send file with specified speed 2022-09-27 14:30:53 +08:00
Cary Xu 43c954b6e7 chore: data migration support specify max speed 2022-09-27 14:27:18 +08:00
Haojun Liao dbf7d01a84 fix(query): set the correct uid. 2022-09-27 14:01:17 +08:00
Haojun Liao cbe91fd4c3 fix(query): initialize the blockdata before load last block. 2022-09-27 13:48:53 +08:00
Shengliang Guan c16f4ae3f7
Merge pull request #17037 from taosdata/fix/TD-19220
fix: do not send ttl msg on taosd startup
2022-09-27 11:24:03 +08:00
Hongze Cheng 4bfdfe89a5 adjust api 2022-09-27 11:02:04 +08:00
Haojun Liao aa055abd7c refactor:do some internal refactor. 2022-09-27 10:52:55 +08:00
Cary Xu 6c682daf42 Merge branch '3.0' into feature/TD-18581-D 2022-09-27 10:33:51 +08:00
Hongze Cheng bba042124f Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/stream_compression 2022-09-27 09:27:02 +08:00
Shengliang Guan 1e5dc921e0 fix: set wal apply version on vnode reopen 2022-09-26 20:32:02 +08:00
Hongze Cheng 19529d6606 fix: wrong file corrupt report 2022-09-26 18:57:14 +08:00
Cary Xu 9169c90f8d fix: migrate logic for multi-tier storage 2022-09-26 18:29:08 +08:00
Haojun Liao 927478bff6 refactor(query): do some internal refactor. 2022-09-26 15:55:26 +08:00
Haojun Liao 54712ae302 other:merge 3.0 2022-09-26 14:50:51 +08:00
Hongze Cheng 08feade5fe more code 2022-09-26 14:24:35 +08:00
Hongze Cheng 30937189aa refact more code 2022-09-26 14:10:58 +08:00
Cary Xu f8702c03e7 Merge branch '3.0' into feature/TD-18581-D 2022-09-26 14:06:33 +08:00
Cary Xu d4fb75df8b chore: merge 3.0 and migrate fix for multi-tier storage 2022-09-26 14:02:57 +08:00
Hongze Cheng 6cb7bd2f23 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/stream_compression 2022-09-26 13:43:39 +08:00
Haojun Liao 5c1f55f6ca other:merge 3.0 2022-09-26 11:35:19 +08:00
Haojun Liao 4ebee6b232 refactor(query): do some internal refactor. 2022-09-26 11:22:26 +08:00
Hongze Cheng efacafde33 refact more code 2022-09-26 10:47:24 +08:00
Cary Xu b101e425c3 chore: more logic for migrate with speed limited 2022-09-25 22:30:48 +08:00
Hongze Cheng f24c8fbe56 make it compile 2022-09-23 19:03:29 +08:00
Cary Xu 132425b194 chore: remove obsolete codes 2022-09-23 19:00:38 +08:00
Hongze Cheng 1a0dcddd62 Merge branch 'enh/cv_optimize' of https://github.com/taosdata/TDengine into feat/stream_compression 2022-09-23 18:59:13 +08:00
Cary Xu ed2b3678a6 feat(tsdb): migrate support speed limit 2022-09-23 18:57:13 +08:00
Hongze Cheng f0fea204f2 enh: col value optimize 2022-09-23 18:55:27 +08:00
Hongze Cheng 14b0b458e7 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/stream_compression 2022-09-23 18:07:19 +08:00
Hongze Cheng b682fdd261 more code 2022-09-23 17:57:38 +08:00