Commit Graph

4054 Commits

Author SHA1 Message Date
Cary Xu 3734dd32b0 chore: code optimization for insert_req statistics 2022-10-11 18:32:02 +08:00
Cary Xu 114ae8dbda fix: support statistics of insert_req 2022-10-11 18:22:29 +08:00
Haojun Liao cee7185450 fix(query): update the copy function. 2022-10-11 18:02:46 +08:00
Minglei Jin de113ccf5f fix: use stable stats cache to get ctbNum 2022-10-11 17:50:42 +08:00
Cary Xu 6680ed32d2 chore: code format revert 2022-10-11 17:50:26 +08:00
Cary Xu 02979f081d fix: support statistics of insert_req 2022-10-11 17:47:23 +08:00
Minglei Jin 25b279dd7a meta/cache: a new cache for stable's ctbNum 2022-10-11 17:00:49 +08:00
Hongze Cheng c310d4a177 more code 2022-10-11 16:43:01 +08:00
Shengliang Guan e1ef696a09 Merge remote-tracking branch 'origin/3.0' into fix/TD-19441 2022-10-11 16:24:07 +08:00
Shengliang Guan dbae9a47da fix: check memory while alter db buffer 2022-10-11 16:23:23 +08:00
Hongze Cheng 1a8877c787 more code 2022-10-11 16:15:38 +08:00
Liu Jicong 11ca4ddf8c
Merge pull request #17288 from taosdata/feature/stream
refactor(stream): state/session map id to tbname
2022-10-11 16:07:22 +08:00
Cary Xu 7da3ed2748 fix: support statistics of insert_req 2022-10-11 15:36:35 +08:00
Liu Jicong 26fae13c61 refactor(stream): state/session map id to tbname 2022-10-11 15:27:56 +08:00
Hongze Cheng b412f19e73 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/tdlite 2022-10-11 13:27:50 +08:00
Liu Jicong 596ea98c2f
Merge pull request #17281 from taosdata/feature/stream
refactor(stream)
2022-10-11 09:27:49 +08:00
Liu Jicong fbfae317b3 refactor 2022-10-11 02:09:15 +08:00
Hongze Cheng 8fbf4af35f more code 2022-10-10 21:30:23 +08:00
Hongze Cheng dfc91a38b0 more code 2022-10-10 21:29:36 +08:00
Hongze Cheng 6c097be04e more code 2022-10-10 18:29:14 +08:00
Cary Xu fe115ab02e fix: support statistics of insert_req 2022-10-10 18:20:53 +08:00
Hongze Cheng 4eecd7fd4a more code 2022-10-10 18:17:58 +08:00
Minglei Jin 8f61346d29 meta/cache: separate entry cache to parepare for a new stats cache 2022-10-10 18:07:09 +08:00
Shengliang Guan f0a7430238
Merge pull request #17263 from taosdata/feature/3_liaohj
refactor: do some internal refactor.
2022-10-10 16:13:27 +08:00
Shengliang Guan f9df999a05
Merge pull request #17262 from taosdata/fix/TD-19416
fix(query): new META_READER_NOLOCK flag for metaReaderInit
2022-10-10 15:55:20 +08:00
Haojun Liao 7c3ddc4920 other:merge 3.0 2022-10-10 15:35:38 +08:00
Minglei Jin 9a410b96ef fix(query): new META_READER_NOLOCK flag for metaReaderInit 2022-10-10 15:04:33 +08:00
Haojun Liao 68842b9c64 refactor: do some internal refactor. 2022-10-10 14:55:58 +08:00
Shengliang Guan 66a5f6cc8d
Merge pull request #17255 from taosdata/feature/stream
fix: coverity scan
2022-10-10 13:44:07 +08:00
Shengliang Guan 6fbde2d119
Merge pull request #17254 from taosdata/fix/TD-19416
fix(meta): use rwlock to favor writers
2022-10-10 11:49:38 +08:00
Liu Jicong b1594a6857 fix coverity scan 2022-10-10 11:44:17 +08:00
Shengliang Guan 4084140fa0
Merge pull request #17252 from taosdata/fix/TD-19254-D
fix: coverity scan for sma and tfs
2022-10-10 11:24:37 +08:00
Minglei Jin 997dfb41d9 fix(meta): use rwlock to favor writers 2022-10-10 11:00:55 +08:00
Cary Xu 6b984ab448 fix: coverity scan for sma and tfs 2022-10-10 10:23:57 +08:00
Cary Xu 37c2fd5b08 fix: coverity scan for sma and tfs 2022-10-10 10:16:00 +08:00
Liu Jicong 86d80ad478
Merge pull request #17244 from taosdata/feature/stream
feat(stream): support define table name (DO NOT MERGE)
2022-10-10 10:05:33 +08:00
Liu Jicong 57d1406096 add tbname column into stream special block 2022-10-09 22:49:37 +08:00
Shengliang Guan edaf09403f
Merge pull request #17247 from taosdata/feature/3_liaohj
fix(query): fix the last block search error for ordinary table.
2022-10-09 20:52:00 +08:00
Haojun Liao a356b4eb7c fix(query): fix the last block search error for ordinary table. 2022-10-09 18:55:01 +08:00
Shengliang Guan b4c53d8345
Merge pull request #17237 from taosdata/feat/alter_pages_buffer
feat: alter pages buffer
2022-10-09 17:29:34 +08:00
Liu Jicong eafe8666f7 merge 3.0 2022-10-09 17:00:18 +08:00
Liu Jicong 2f9aeeb5fc feat(stream): support define table name 2022-10-09 16:54:27 +08:00
Haojun Liao 5402f6bc26 enh(query): opt query perf when handling the query of last files. 2022-10-09 15:25:42 +08:00
Hongze Cheng 2015db5756 alter pages 2022-10-09 15:01:20 +08:00
Haojun Liao c5e094efd0 enh(query): optimize the perf for ordinary table query with data in last file. 2022-10-09 14:34:10 +08:00
Hongze Cheng 6825d2a143 alter vnode buffer 2022-10-09 13:55:14 +08:00
Hongze Cheng ee56c50069 more code 2022-10-09 13:52:44 +08:00
yihaoDeng 27003dfaa5 fix invalid tag value 2022-10-08 15:48:52 +08:00
yihaoDeng c62b1985d7 fix invalid tag value 2022-10-05 18:32:30 +08:00
yihaoDeng 16c1473823 enh(query): opt get table meta 2022-10-01 13:49:30 +08:00
Haojun Liao fac464792d other:merge 3.0 2022-09-30 17:54:03 +08:00
Haojun Liao 7674fa972c
Merge pull request #17184 from taosdata/feature/3_liaohj
fix(query): fix memory leak in last_row query
2022-09-30 17:51:45 +08:00
Haojun Liao 877c707ce6 fix(query): fix memory leak in last_row query 2022-09-30 17:10:55 +08:00
Shengliang Guan b77a62dcd8
Merge pull request #17183 from taosdata/feature/3_liaohj
fix(query): fix memory leak.
2022-09-30 16:46:07 +08:00
Shengliang Guan 3442d14f58
Merge pull request #17182 from taosdata/enh/optTbnameINMem
fix(query): fix mem leak
2022-09-30 16:45:39 +08:00
Hongze Cheng 856c990fbc
Merge pull request #17102 from taosdata/feat/stream_compression
feat: stream compression
2022-09-30 16:17:19 +08:00
Haojun Liao 4b1e8e0cec fix(query): fix memory leak. 2022-09-30 16:02:28 +08:00
yihaoDeng 90c6116373 fix mem leak 2022-09-30 15:42:58 +08:00
Shengliang Guan 084414bebc
Merge pull request #17173 from taosdata/fix/TD-19245
fix: coverity issues
2022-09-30 15:42:46 +08:00
Haojun Liao 6faf1af5f5 fix(query): handle the block read case. 2022-09-30 14:44:42 +08:00
Shengliang Guan dfb2b0678f fix: coverity issues 2022-09-30 14:03:46 +08:00
Hongze Cheng 7754471aaa Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/stream_compression 2022-09-30 13:50:01 +08:00
Haojun Liao f8a84a1d19 other:merge 3.0 2022-09-30 13:47:21 +08:00
Haojun Liao 1f57a5a1cc
Merge pull request #17172 from taosdata/feature/3_liaohj
fix(query): fix memory leak.
2022-09-30 13:45:01 +08:00
Haojun Liao c9286fed25 fix(query): fix memory leak. 2022-09-30 13:03:25 +08:00
Hongze Cheng 145abcb17f more 2022-09-30 10:52:17 +08:00
Hongze Cheng be482feacc Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/stream_compression 2022-09-30 10:32:10 +08:00
yihaoDeng f41b494ac6 opt tbname in 2022-09-30 10:19:56 +08:00
Shengliang Guan e6ac8ed3a9
Merge pull request #17121 from taosdata/szhou/fixbugs
enhance: optimize when select from ins_tags when table_name='xxxx'
2022-09-30 09:39:27 +08:00
yihaoDeng 0d3da10954 fix invalid read 2022-09-30 09:31:19 +08:00
yihaoDeng d74779805a opt tbname in 2022-09-29 23:13:54 +08:00
Shengliang Guan 3be4a2ed9c Merge remote-tracking branch 'origin/3.0' into fix/TD-19245 2022-09-29 19:42:09 +08:00
Shengliang Guan e94646ca70 fix: coverity issues 2022-09-29 19:41:54 +08:00
Hongze Cheng d60ec735ca Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/stream_compression 2022-09-29 17:07:58 +08:00
Hongze Cheng bdeb1ebcc5 compare 2022-09-29 17:06:18 +08:00
Shengliang Guan 752e13f94c Merge branch 'fix/TD-19325' into feature/tq 2022-09-29 14:52:08 +08:00
Shengliang Guan c56dd86399 fix: do not process query and fetch msg until vnode restore finished 2022-09-29 14:29:30 +08:00
Liu Jicong 586175ecfa check vnode status for poll msg 2022-09-29 14:25:56 +08:00
Shengliang Guan 4df3303514 fix: do not process query and fetch msg until vnode restore finished 2022-09-29 14:24:45 +08:00
Liu Jicong d41ce958f3 Merge branch 'fix/TD-19325' into feature/tq 2022-09-29 14:21:08 +08:00
Shengliang Guan f14d00a5d6 fix: do not process query and fetch msg until vnode restore finished 2022-09-29 14:19:43 +08:00
Shengliang Guan 7e85a15c31 fix: do not process query and fetch msg until vnode restore finished 2022-09-29 14:18:20 +08:00
Shengliang Guan 4223be379a fix: do not process query and fetch msg until vnode restore finished 2022-09-29 14:15:26 +08:00
Shengliang Guan ee484470f3 fix: do not process query and fetch msg until vnode restore finished 2022-09-29 14:13:44 +08:00
Liu Jicong 0c48581c86 check push ver 2022-09-29 13:52:09 +08:00
Hongze Cheng cb554920aa Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/stream_compression 2022-09-29 13:23:20 +08:00
Hongze Cheng 768ec8942a fix code 2022-09-29 13:23:12 +08:00
Liu Jicong bb1165f1e9 optimize projection return 2022-09-29 12:14:41 +08:00
dapan1121 95b6d3f67f
Merge pull request #17132 from taosdata/fix/TD-19310
fix: fix rows missed in query result issue
2022-09-29 11:41:52 +08:00
yihaoDeng 88ac809f87 Merge branch '3.0' of https://github.com/taosdata/TDengine into dv3 2022-09-29 11:09:02 +08:00
yihaoDeng 5b4d0eaabe enh: opt tbname in 2022-09-29 11:07:32 +08:00
Hongze Cheng f12449b1b8 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/stream_compression 2022-09-29 10:20:36 +08:00
Shengliang Guan 44b8d659ba
Merge pull request #17130 from taosdata/FIX/TD-19260-3.0
enh: improve error handling in syncNodeOpen instead of using assert, with allocated resources cleaned up properly
2022-09-29 09:23:28 +08:00
Liu Jicong a2a8fe0211 rsp consumer when taosd stop 2022-09-29 01:37:45 +08:00
Hongze Cheng 90915f1da3 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/stream_compression 2022-09-29 00:02:42 +08:00
Liu Jicong b0a46942c2 rsp to consumer if offset move forward 2022-09-28 23:47:47 +08:00
Liu Jicong fab0adde99 fix memory error 2022-09-28 23:06:45 +08:00
yihaoDeng 1286f7473c QRY: opt tbname in 2022-09-28 22:07:16 +08:00
Liu Jicong 057edd92c3
Merge branch '3.0' into feature/tq 2022-09-28 20:27:09 +08:00
Liu Jicong cde4085a6d optimize msg batch 2022-09-28 20:24:02 +08:00
Shengliang Guan 4ca305fd7a
Merge pull request #17131 from taosdata/fix/TD-19254-D
fix: coverity scan for sma
2022-09-28 20:22:58 +08:00
dapan1121 45fb658cec fix: fix rows missed in query result issue 2022-09-28 19:06:43 +08:00
Cary Xu bf377943e0 fix: api parameters 2022-09-28 18:56:57 +08:00
Cary Xu 9e49eb03e4 fix: coverity scan for sma 2022-09-28 18:54:39 +08:00
Haojun Liao 5a2c583c32 other:merge 3.0 2022-09-28 18:00:04 +08:00
Hongze Cheng 12371d344b Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/stream_compression 2022-09-28 17:49:16 +08:00
Shengliang Guan 53bfdf7bbb
Merge pull request #17117 from taosdata/revert-17106-feature/TD-18581-D
Revert "enh(tsdb): data migrate should not block data r/w and commit"
2022-09-28 17:43:21 +08:00
Benguang Zhao 4b4f7a44f4 fix: resolve memory leak in vnodeOpen when vnodeSyncOpen failure 2022-09-28 17:40:10 +08:00
Haojun Liao 71e3993185
Merge pull request #17114 from taosdata/feature/3_liaohj
refactor(query): do some internal refactor.
2022-09-28 17:36:01 +08:00
slzhou 00fc74acc9 Merge branch '3.0' of github.com:taosdata/TDengine into szhou/fixbugs 2022-09-28 16:39:33 +08:00
slzhou 99bc329384 enhance: optimize select from ins_tags where table_name='tablename' without iterating through meta tdb 2022-09-28 16:30:40 +08:00
Cary Xu 1fe66cb846
Revert "enh(tsdb): data migrate should not block data r/w and commit" 2022-09-28 15:50:29 +08:00
Liu Jicong 01c94a775b feat(tmq): push optimization 2022-09-28 14:55:19 +08:00
Hongze Cheng a4d426aa13 more fix 2022-09-28 13:39:48 +08:00
Benguang Zhao b71a9e3483 enh: improve error handling in syncNodeOpen 2022-09-28 13:34:13 +08:00
Cary Xu d3c335a06e chore: fs merge optimization for data migrate 2022-09-28 12:56:17 +08:00
Haojun Liao 14412f2811 refactor(query): do some internal refactor. 2022-09-28 11:16:52 +08:00
Liu Jicong 1ad4d16373 Merge branch '3.0' into feature/tq 2022-09-28 10:57:59 +08:00
Haojun Liao 04f087793e refactor(query): do some internal refactor. 2022-09-28 10:54:54 +08:00
Liu Jicong 0e8aaf4c9e feat(tmq): push optimization 2022-09-28 10:38:49 +08:00
Cary Xu b78a39ced1 fix: resource release when end commit 2022-09-28 09:47:51 +08:00
Cary Xu 0841442db6 feat: logic optimization for data migration 2022-09-28 07:41:38 +08:00
Hongze Cheng 18f3bd53c5 fix code 2022-09-27 23:34:06 +08:00
Cary Xu 11d6db5ab2 Merge branch '3.0' into feature/TD-18581-D 2022-09-27 19:29:59 +08:00
Haojun Liao 59b7435170 fix(query): fix memory copy 2022-09-27 19:17:35 +08:00
Hongze Cheng 8bd8ff1523 more code 2022-09-27 18:59:29 +08:00
Haojun Liao 7818bed189 Merge branch 'feature/3_liaohj' into refact/query_opt 2022-09-27 18:51:42 +08:00
Haojun Liao c565c4cb63 fix(query): remove the primary timestamp column in the required column list. 2022-09-27 18:50:51 +08:00
Cary Xu ddf121496f chore: adjust debug log 2022-09-27 18:42:42 +08:00
Haojun Liao e2fa878136 other:merge 3.0 2022-09-27 18:39:03 +08:00
Haojun Liao 398c23edec enh(query): only load the required columns. 2022-09-27 18:37:02 +08:00
Cary Xu 8943fd2fc2 chore: log optimization for data migrate 2022-09-27 18:16:48 +08:00
Haojun Liao 4058ae1f9b Merge branch '3.0' into feature/3_liaohj 2022-09-27 18:16:26 +08:00
Haojun Liao bd6cf3137f other:merge 3.0 2022-09-27 18:12:54 +08:00
Haojun Liao 1b3721b42e
Merge pull request #17078 from taosdata/enh/load_by_column
enh: load by col opt
2022-09-27 18:07:34 +08:00
Hongze Cheng a53575a152 more code 2022-09-27 17:57:57 +08:00
Cary Xu 70f2c68570 chore: code format 2022-09-27 17:57:44 +08:00
Cary Xu b7253d8814 chore: code optimization for tsdb commit 2022-09-27 17:55:01 +08:00
Cary Xu 6536ad72a6 chore: update file naming for tsdb retention 2022-09-27 17:48:09 +08:00
Cary Xu 5c61e5da3e Merge branch '3.0' into feature/TD-18581-D 2022-09-27 17:43:52 +08:00
Cary Xu c426fa8bb1 feat: code optimization for data migrate 2022-09-27 17:43:33 +08:00
Hongze Cheng a4d16f1c00 more code 2022-09-27 17:36:02 +08:00
Hongze Cheng dc0d687a06 make it compile 2022-09-27 16:26:16 +08:00
Hongze Cheng e17c65fd82 Merge branch 'enh/load_by_column' of https://github.com/taosdata/TDengine into feat/stream_compression 2022-09-27 16:22:42 +08:00
Haojun Liao 144a0c573b fix(query): set schema info for inner reader. 2022-09-27 16:17:03 +08:00
Hongze Cheng faea22cc56 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/stream_compression 2022-09-27 15:40:48 +08:00
Hongze Cheng 3bd6808335 fix coredump 2022-09-27 15:37:00 +08:00
Haojun Liao a70a657f5f fix(query): initialize array list 2022-09-27 14:43:57 +08:00
Cary Xu 3d92b6c6f9 chore: remove debug logs when migrate 2022-09-27 14:33:17 +08:00
Cary Xu 024f6a2149 chore: send file with specified speed 2022-09-27 14:30:53 +08:00