Commit Graph

4658 Commits

Author SHA1 Message Date
Liu Jicong 548684e5ac fix(stream): delete multiple row 2022-11-29 23:39:58 +08:00
Haojun Liao 445c4f28f0 enh(query): optimize the perf. 2022-11-29 23:34:22 +08:00
slzhou 6d86fb5b51 Merge branch 'enh/3.0_planner_optimize' into szhou/table-count-scan 2022-11-29 22:19:36 +08:00
Benguang Zhao 470441c541 Merge branch 3.0 to FIX/TD-19334-3.0 2022-11-29 18:24:01 +08:00
yihaoDeng d463f05b3f change paramter 2022-11-29 10:28:32 +08:00
Minglei Jin 506554b5d2 Merge branch 'v3.0' into fix/tdb-async-commit 2022-11-28 16:20:48 +08:00
Shengliang Guan fc87007086
Merge pull request #18509 from taosdata/feature/3_liaohj
refactor: do some internal refactor.
2022-11-28 15:58:12 +08:00
Benguang Zhao dc2dcea3de Merge branch 3.0 to FIX/TD-19334-3.0 2022-11-28 14:27:10 +08:00
Benguang Zhao 8475aaaaf1 enh: add ASSERT info msg in tsdbStartCommit 2022-11-28 13:48:57 +08:00
Haojun Liao 6e81e8cc73 refactor: do some internal refactor. 2022-11-28 12:32:40 +08:00
Shengliang Guan c75fa4f7d2
Merge pull request #18504 from taosdata/feature/stream
fix: memory leak
2022-11-28 11:05:36 +08:00
Liu Jicong bdfef853e5 fix: memory leak 2022-11-28 09:37:56 +08:00
Shengliang Guan e6aed5195d
Merge pull request #18468 from taosdata/feature/3_liaohj
refactor: improve the perf in query
2022-11-27 23:10:00 +08:00
Haojun Liao 203ea1f9c8 fix(query): fix error 2022-11-27 14:57:44 +08:00
slzhou b5b6fff68b feature: save work 2022-11-27 13:50:36 +08:00
Benguang Zhao 4edef438ea enh: transfer ownership of msgs while committing sync log entries 2022-11-26 21:57:23 +08:00
Haojun Liao 0948216ca9 fix(query): fix dead lock. 2022-11-26 21:13:34 +08:00
Liu Jicong 22372ad1e0 fix: memory leak 2022-11-26 16:09:16 +08:00
Haojun Liao 60d6b8e2ee fix(query): change the ptr 2022-11-26 11:51:15 +08:00
Haojun Liao 861b9b8264 fix(query): fix memory leak. 2022-11-26 11:46:36 +08:00
Shengliang Guan ccc2407fe6
Merge pull request #18459 from taosdata/feature/stream
enh(stream): new api for stream queue
2022-11-26 09:26:01 +08:00
Haojun Liao 0015e65f5b fix(query): remove invalid free 2022-11-26 02:13:46 +08:00
Haojun Liao 98771bb461 fix(query): deprecate the error reported by asan. 2022-11-26 01:50:17 +08:00
Haojun Liao 802ca0f607 fix(query): fix memory leak. 2022-11-26 00:58:29 +08:00
Haojun Liao c6795b68d2 fix(query): check list size before iterate it. 2022-11-26 00:12:27 +08:00
slzhou c2a7404b42 save work in case it losts 2022-11-25 23:00:14 +08:00
Haojun Liao 7fe4cf7bbe
Merge branch '3.0' into feature/3_liaohj 2022-11-25 22:24:59 +08:00
Minglei Jin 59a1571945 fix(meta/cache): invalidate suid cache when create/drop ctb & update tag 2022-11-25 21:15:02 +08:00
Liu Jicong 48894c8bdb enh(stream): new api for stream queue 2022-11-25 18:03:40 +08:00
kailixu 993e569403 fix: asan problems for rsma 2022-11-25 16:16:36 +08:00
kailixu a70583c4af fix: asan problems for rsma 2022-11-25 16:15:15 +08:00
Benguang Zhao 68f8ebac9d Merge branch 3.0 to FIX/TD-19334-3.0 2022-11-25 13:10:06 +08:00
Haojun Liao f8bc4df4af refactor: do some internal refactor. 2022-11-25 11:58:46 +08:00
Minglei Jin f570d61d48 fix(meta): return invalid message if cannot getting value from uididx 2022-11-24 19:24:44 +08:00
Haojun Liao 9a208b2d09 other: merge 3.0 2022-11-24 17:08:15 +08:00
Minghao Li 9f38bfeb2c refactor(sync): modify info log to trace log 2022-11-24 16:50:58 +08:00
Minghao Li 7fba711d40 refactor(sync): add info log 2022-11-24 16:03:43 +08:00
Benguang Zhao 22d64b9c0b fix: remove syncNodeReplicateOne from syncNodeOnSnapshotReply 2022-11-24 15:55:31 +08:00
Minghao Li e43794c366 fix(sync): if msg commit, put it into apply-queue, do not care return code 2022-11-24 15:51:48 +08:00
Shengliang Guan 335a572d86
Revert "Revert "enh: row optimize2"" 2022-11-24 10:12:25 +08:00
Hongze Cheng ffbb04d40a
Revert "enh: row optimize2" 2022-11-24 09:21:26 +08:00
Shengliang Guan 7f4a14fbb7
Merge pull request #18369 from taosdata/szhou/fixbugs
fix: build data from mem/imem first when large nchar column incur …eBlockShouldLoad since SDataBlockToLoadInfo.moreThanCapacity
2022-11-24 08:24:41 +08:00
Shengliang Guan 962aa4aff4
Merge pull request #18383 from taosdata/feature/stream
fix(stream): memory leak
2022-11-24 08:17:40 +08:00
shenglian zhou 7f6ff39648 feat: table merge scan save work 2022-11-23 19:47:24 +08:00
slzhou db7a7fa4bd Merge branch '3.0' of github.com:taosdata/TDengine into szhou/fixbugs 2022-11-23 15:59:58 +08:00
Hongze Cheng df5bcae11b more code 2022-11-23 15:45:19 +08:00
slzhou 9a85050ff3 fix: direct return file block only rows <= capacity 2022-11-23 15:43:57 +08:00
Hongze Cheng d7c30d6e4a Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/row_optimize2 2022-11-23 15:04:51 +08:00
slzhou c1ba62b26f fix: build from buf first when buf data is in block gap and only capacity caused load 2022-11-23 14:52:07 +08:00
dapan1121 188e6e6c7d
Merge pull request #18325 from taosdata/enh/msgRefactor2
enh: refact some messages
2022-11-23 13:53:37 +08:00
Liu Jicong 3b84053893 fix(stream): memory leak 2022-11-23 12:32:02 +08:00
Hongze Cheng 6e23c8cdb3 more code 2022-11-23 10:45:58 +08:00
Hongze Cheng 2313ebc648 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/row_optimize 2022-11-23 09:36:31 +08:00
Shengliang Guan f06145d37b
Merge pull request #18368 from taosdata/feature/stream
fix(stream): memory leak
2022-11-23 09:18:05 +08:00
slzhou 0161374a8b Merge branch '3.0' of github.com:taosdata/TDengine into szhou/fixbugs 2022-11-22 22:59:06 +08:00
slzhou 272a161a61 fix: build data from mem/imem first when large nchar column incur fileBlockShouldLoad since SDataBlockToLoadInfo.moreThanCapacity 2022-11-22 22:06:39 +08:00
Liu Jicong d4c7394143 fix(stream): memory leak 2022-11-22 22:03:08 +08:00
Shengliang Guan d588cd37f8
Merge pull request #18357 from taosdata/fix/liao_cov
fix(query): fix memory leak.
2022-11-22 20:49:33 +08:00
Haojun Liao 7c7b2f1cef fix(query): fix memory leak. 2022-11-22 18:06:01 +08:00
kailixu da535cd04c fix: init/free SBatchDeleteReq for tsma 2022-11-22 15:38:21 +08:00
kailixu d1249017dd fix: init/free SBatchDeleteReq for tsma 2022-11-22 15:35:53 +08:00
kailixu bcac60ae35 fix: init/free SBatchDeleteReq for tsma 2022-11-22 15:32:51 +08:00
Haojun Liao b70a616a2d refactor: do some internal refactor. 2022-11-22 15:27:33 +08:00
Haojun Liao 4d206fd3b2 refactor: do some internal refactor. 2022-11-22 14:59:17 +08:00
Haojun Liao 93ad9e9d3d refactor: do some internal refactor. 2022-11-22 14:29:30 +08:00
Hongze Cheng cede9e14da Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/row_optimize 2022-11-22 13:54:40 +08:00
dapan1121 44462ef869
Merge pull request #18321 from taosdata/szhou/fixbugs
fix: fix error for select count(c2),count(ts) from table caused by null ts column aggregation
2022-11-22 13:17:11 +08:00
Haojun Liao 0af77e6ae2 refactor: do some internal refactor. 2022-11-22 12:43:00 +08:00
Shengliang Guan 4f89b690df
Merge pull request #18318 from taosdata/fix/liao_cov
fix(query): fix some memory leaks.
2022-11-22 12:41:34 +08:00
Hongze Cheng 390709e3c8 add interface 2022-11-22 12:37:47 +08:00
Shengliang Guan c2bebf3f16
Merge pull request #18326 from taosdata/fix/TD-20606
fix: free the batch create table reqs' decoded comment field
2022-11-22 12:17:33 +08:00
Hongze Cheng 40470531e7 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/row_optimize 2022-11-22 11:59:47 +08:00
Haojun Liao fbb0a1e921 fix(query): set correct tsdbreader during the creation of tableblockscan info 2022-11-22 11:08:55 +08:00
Minglei Jin b9f7d181b6 fix: free the batch create table reqs' decoded comment field 2022-11-22 10:47:50 +08:00
dapan1121 19852ba85b Merge remote-tracking branch 'origin/3.0' into enh/msgRefactor2 2022-11-22 10:45:11 +08:00
Haojun Liao 56edf57c12 refactor: do some internal refactor. 2022-11-22 09:52:53 +08:00
slzhou bb51d3cac7 fix: fix error for select count(c2),count(ts) from table caused by invalid ts column aggregation 2022-11-21 23:11:00 +08:00
Haojun Liao 8fee089aaf refactor: do some internal refactor. 2022-11-21 22:48:25 +08:00
Haojun Liao 6d5a256774 fix(query): fix some memory leaks. 2022-11-21 22:40:20 +08:00
Liu Jicong 9358429e78 Merge branch '3.0' into feature/stream 2022-11-21 20:54:21 +08:00
dapan1121 c66390d401 enh: refact tmq pull message 2022-11-21 20:38:42 +08:00
Minghao Li e7e17302a4 enh(sync): use TSDB_CODE_SYN_NOT_LEADER instead of TSDB_CODE_RPC_REDIRECT 2022-11-21 15:35:36 +08:00
Liu Jicong 5d471a0ceb enh(taosx): split block when none column not match 2022-11-21 15:32:27 +08:00
Benguang Zhao b90ee79623 fix: use syncLogBufferCommit in syncNodeOnLocalCmd 2022-11-21 13:51:01 +08:00
Hongze Cheng 593f694fdc Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/row_optimize 2022-11-21 09:27:25 +08:00
Hongze Cheng 23f7b67b8a fix: binary NONE + NULL commit coredump 2022-11-20 15:51:40 +08:00
Hongze Cheng a0dc7859ec Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/row_optimize 2022-11-20 10:12:38 +08:00
Shengliang Guan bfa3d1fa27
Merge pull request #18272 from taosdata/fix/TS-2120
fix(meta): new error for creating sub tb already exist in other stables
2022-11-19 09:37:05 +08:00
Minglei Jin cdaafb7b89 fix(meta): new error for creating sub tb already exist in other stables 2022-11-19 08:19:03 +08:00
Shengliang Guan a12cf7f91d
Merge pull request #18266 from taosdata/feature/stream
enh(stream): put user defined tb name into stream state
2022-11-18 19:56:56 +08:00
Haojun Liao d3452f6630 fix(query): fix error. 2022-11-18 17:38:31 +08:00
Haojun Liao 066735964d other: merge with original branch. 2022-11-18 17:35:24 +08:00
Liu Jicong 9a603e5663 enh(stream): put user defined tb name into stream state 2022-11-18 17:21:50 +08:00
Minglei Jin 35b9dc6b6c meta: use meta cache to get uid's version instead of fetching from tdb 2022-11-18 17:07:19 +08:00
Haojun Liao 0d10294b2e Merge remote-tracking branch 'origin/feature/3_liaohj' into feature/3_liaohj 2022-11-18 14:54:36 +08:00
dapan1121 1167c86b34
Merge pull request #18230 from taosdata/fix/TD-19618-D
fix: real path optimization in case of invalid read
2022-11-18 14:54:28 +08:00
Haojun Liao 71de2f056b fix(query): fix invalid write/read. 2022-11-18 14:53:39 +08:00
Minglei Jin 3ca38c41a7 meta: use meta cache to get uid's version instead of fetching from tdb 2022-11-18 14:44:14 +08:00
Hongze Cheng 93089916e4 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/row_optimize 2022-11-18 13:25:57 +08:00
Benguang Zhao 363cbc8985 fix: update cbMeta rsp handle info in syncLogFsmExecute 2022-11-18 09:37:58 +08:00
Benguang Zhao da469149db enh: debug to info 2022-11-17 20:28:18 +08:00
Minglei Jin 78335f83d2 tdb/api: migrate txn related api changes of meta, sma, tq, and stream meta/state 2022-11-17 20:02:13 +08:00
Benguang Zhao 051b73c1ed Merge branch 3.0 to FIX/TD-19334-3.0 2022-11-17 17:28:11 +08:00
dapan1121 448fee1744 fix: fix asan issues 2022-11-17 16:31:22 +08:00
dapan1121 fb861a3935 enh: refactor tmq messages 2022-11-17 14:09:15 +08:00
kailixu 6515c9c7c5 fix: real path optimization in case of invalid read 2022-11-17 10:56:24 +08:00
dapan1121 3a642f06d0 Merge remote-tracking branch 'origin/3.0' into enh/msgRefactor0 2022-11-17 10:42:29 +08:00
dapan1121 49917d5156 enh: refactor batch meta msg 2022-11-17 10:35:25 +08:00
Haojun Liao a464053692 fix(query): set correct size of array list. 2022-11-17 00:46:06 +08:00
Haojun Liao 9c459a24e2 fix(query): fix memory leak. 2022-11-17 00:38:35 +08:00
Haojun Liao a54275a7b5 fix(query): support null columns sma optimization. 2022-11-16 23:46:59 +08:00
Benguang Zhao 6062632722 enh: turn commit-cb logging msg to debug level in vnodeSyncCommitMsg 2022-11-16 19:53:22 +08:00
Hongze Cheng a5725b506c more code 2022-11-16 17:22:09 +08:00
Hongze Cheng 56db6e6630 fix: omit sma for all NONE/NULL column 2022-11-16 15:47:40 +08:00
Haojun Liao a36c24eb1c fix(query): remove invalid free. 2022-11-16 15:47:24 +08:00
Haojun Liao 47a7664e2c refactor: add some logs. 2022-11-16 14:52:38 +08:00
Haojun Liao 7d00b7a6c4 refactor: add tag filter cache. 2022-11-16 14:23:12 +08:00
Hongze Cheng aaef32ca69 refact code for further code change 2022-11-16 10:27:05 +08:00
Shengliang Guan 555bf7d4cb
Merge pull request #18181 from taosdata/feature/stream
fix(stream): check task
2022-11-16 08:11:30 +08:00
Liu Jicong 6478fcb2c1 fix(stream): check task 2022-11-15 22:32:52 +08:00
Shengliang Guan 7d443b1679
Merge pull request #18174 from taosdata/feature/stream
refactor: stream meta ref count
2022-11-15 20:07:42 +08:00
Liu Jicong a9bf05bc01 refactor: stream meta ref count 2022-11-15 19:11:42 +08:00
Shengliang Guan d07209a4e8
Merge pull request #18165 from taosdata/fix/TD-20443
fix: free value return by tdb
2022-11-15 17:03:23 +08:00
Shengliang Guan 6cc31761dd
Merge pull request #18163 from taosdata/fix/TD-20441
fix: clear meta reader's decoder to free leaked memory
2022-11-15 16:47:42 +08:00
Haojun Liao ba5244d1b6 refactor: add tag filter results cache. 2022-11-15 16:06:29 +08:00
Minglei Jin 5ad1bca624 fix: free value return by tdb 2022-11-15 15:57:50 +08:00
Shengliang Guan c3cc259928
Merge pull request #18157 from taosdata/feature/stream
fix: reset cache when table is dropped
2022-11-15 15:30:26 +08:00
Minglei Jin 276fc51969 fix: clear meta reader's decoder to free leaked memory 2022-11-15 15:28:51 +08:00
Liu Jicong 76cd3122d1 fix: memory leak 2022-11-15 14:28:20 +08:00
Liu Jicong ccd3bb20a7 fix: reset cache when table is dropped 2022-11-15 14:10:46 +08:00
Shengliang Guan ea0b090c33
Merge pull request #18147 from taosdata/feature/stream
fix: memory leak
2022-11-15 13:01:02 +08:00
Liu Jicong efde22f081 fix: memory leak 2022-11-15 11:59:29 +08:00
54liuyao cf021b4330 fix:applying non-zero offset in tqSink.c 2022-11-15 09:11:26 +08:00
Shengliang Guan 1312b9c785
Merge pull request #18125 from taosdata/fix/liao_cov
fix(query): fix errors found by asan.
2022-11-14 20:55:25 +08:00
Haojun Liao fc83468156
Merge branch '3.0' into fix/liao_cov 2022-11-14 19:02:30 +08:00
Hongze Cheng 6aefbbf3b2 more optimize 2022-11-14 17:32:09 +08:00
Hongze Cheng 10921cc09a more opt 2022-11-14 17:13:22 +08:00
Haojun Liao cf56c38e7a fix(query): fix errors found by asan. 2022-11-14 17:10:25 +08:00
Hongze Cheng 5b51f97a48 more optimize 2022-11-14 16:52:39 +08:00
dapan1121 d2468c5548 fix: fix asan issues 2022-11-14 14:22:13 +08:00
dapan1121 14a1f4e373
Merge pull request #18074 from taosdata/fix/TD-20300
fix: fix query thread quit issue
2022-11-14 11:28:30 +08:00
Shengliang Guan 93447107e1
Merge pull request #18064 from taosdata/perf/insert_optimize
perf: insert optimize
2022-11-12 09:41:16 +08:00
Cary Xu 33861a9d4c fix: allocate memory for lock 2022-11-11 22:13:21 +08:00
Cary Xu 08aaf97657 chore: code optimization 2022-11-11 19:11:06 +08:00
Cary Xu 0dcbe92006 fix: adjust the the varData offset of tp row 2022-11-11 19:04:54 +08:00
dapan1121 56b33e9200 Merge remote-tracking branch 'origin/3.0' into fix/TD-20300 2022-11-11 18:57:12 +08:00
dapan1121 f60441e2dd fix: fix query thread quitting issue 2022-11-11 18:44:59 +08:00
dapan1121 89c13efba8 fix: fix query thread quit issue 2022-11-11 17:13:55 +08:00
Cary Xu 97e83a905b fix: iter next column for kv row 2022-11-11 17:07:16 +08:00
Shengliang Guan 672384eca1
Merge pull request #18056 from taosdata/feature/stream
refactor(tmq): add more strict drop condition check
2022-11-11 16:06:31 +08:00