Commit Graph

8021 Commits

Author SHA1 Message Date
Minghao Li 0b3d749228 refactor(sync): put heartbeat-reply msg into sync-ctrl-queue 2022-12-01 16:12:22 +08:00
Shengliang Guan 2d48563959 fix: crash if failed to decode sdb row 2022-12-01 16:04:39 +08:00
Shengliang Guan af58402afc
Merge pull request #18593 from taosdata/fix/TD-20798
enh: show leader ** if vnode can read and can't write
2022-12-01 15:08:46 +08:00
Shengliang Guan fe759c85f3 Merge remote-tracking branch 'origin/3.0' into FIX/TD-19334-3.0 2022-12-01 15:04:55 +08:00
Shengliang Guan 9f9e2081f1 enh: add topic privilege 2022-12-01 13:37:32 +08:00
Minghao Li 86d5cba6be refactor(sync): delete code wait snapshot end in pre-close 2022-12-01 13:34:33 +08:00
Shengliang Guan 51378aae40 enh: add topic privilege 2022-12-01 12:22:43 +08:00
Shengliang Guan 395dedaa3a Merge remote-tracking branch 'origin/3.0' into fix/TD-20798 2022-12-01 11:55:16 +08:00
Shengliang Guan b01120f0d2
Merge pull request #18584 from taosdata/fix/3.0_bugfix_wxy
feat: sql command 'show user privileges'
2022-12-01 11:53:21 +08:00
Shengliang Guan 04b0280693 enh: add topic privilege in mnode 2022-12-01 11:45:31 +08:00
slzhou 58c75dde6f fix: add seperate group for normal table when group by db_name/stbable_name 2022-12-01 11:38:34 +08:00
Shengliang Guan 5998f72bfd Merge remote-tracking branch 'origin/fix/3.0_bugfix_wxy' into fix/TD-20848 2022-12-01 09:55:38 +08:00
dapan1121 89be771b61 enh: add retry for vnode stopped case 2022-12-01 09:53:41 +08:00
slzhou 903718940d Merge branch '3.0' of github.com:taosdata/TDengine into szhou/table-count-scan 2022-12-01 09:14:10 +08:00
Haojun Liao cefe4be1ab refactor: do some internal refactor. 2022-12-01 00:34:06 +08:00
Benguang Zhao 55bae49d56 Merge branch 3.0 to FIX/TD-19334-3.0 2022-11-30 23:47:30 +08:00
Benguang Zhao 3cbe109e4b fix: initialize vnode state applyTerm with commitTerm in vnodeOpen 2022-11-30 22:41:33 +08:00
Shengliang Guan 1e8a816155 enh: show leader ** if vnode can read and can't write 2022-11-30 21:42:42 +08:00
Haojun Liao 4fef284cfe refactor: do some internal refactor. 2022-11-30 21:26:27 +08:00
Shengliang Guan d4035e26e1
Merge pull request #18579 from taosdata/fix/liao_cov
refactor: do some internal refactor.
2022-11-30 20:16:56 +08:00
Xiaoyu Wang 4e8acca2eb feat: sql command 'show user privileges' 2022-11-30 19:24:15 +08:00
Haojun Liao 124fb5fc50 refactor: do some internal refactor. 2022-11-30 17:52:12 +08:00
Shengliang Guan d58640dd53 enh: show more info while drop dnode 2022-11-30 17:15:23 +08:00
Hongze Cheng df7c07a541 Merge branch 'fix/tdb-async-commit' of https://github.com/taosdata/TDengine into feat/async_commit 2022-11-30 16:48:09 +08:00
Shengliang Guan d639198be5
Merge pull request #18561 from taosdata/fix/TD-20805
enh: show more info while drop dnode
2022-11-30 16:10:42 +08:00
slzhou 323e52b8c5 Merge branch 'enh/3.0_planner_optimize' into szhou/table-count-scan 2022-11-30 15:43:41 +08:00
Haojun Liao 3f0c93a623 enh(query): optimize query perf. 2022-11-30 14:53:25 +08:00
Shengliang Guan 7e9b7f4e15 enh: show more info while drop dnode 2022-11-30 14:06:22 +08:00
Haojun Liao e45023f3e9 fix(query): add an null ptr checking before copying memory. 2022-11-30 12:23:08 +08:00
Shengliang Guan 5556fd0c45 enh: add sync offline state 2022-11-30 12:02:54 +08:00
Shengliang Guan 3850b58a3d fix: cannot close vnode while transferring snapshot 2022-11-30 11:08:30 +08:00
Shengliang Guan 5ecbcb1054 fix: cannot close mnode while transferring snapshot 2022-11-30 11:07:14 +08:00
Shengliang Guan 82bc543ed7 fix: cannot close mnode while transferring snapshot 2022-11-30 11:05:25 +08:00
Shengliang Guan b6d3d2322c fix: cannot close vnode while transferring snapshot 2022-11-30 11:02:07 +08:00
Shengliang Guan 4b11f358dd
Merge pull request #18554 from taosdata/feature/stream
fix(stream): delete multiple row
2022-11-30 10:54:38 +08:00
Shengliang Guan 189cdc4f63
Merge pull request #18533 from taosdata/enh/clientRetry
enh: refactor retry
2022-11-30 10:47:13 +08:00
Liu Jicong 548684e5ac fix(stream): delete multiple row 2022-11-29 23:39:58 +08:00
Haojun Liao 445c4f28f0 enh(query): optimize the perf. 2022-11-29 23:34:22 +08:00
slzhou 6d86fb5b51 Merge branch 'enh/3.0_planner_optimize' into szhou/table-count-scan 2022-11-29 22:19:36 +08:00
Benguang Zhao 470441c541 Merge branch 3.0 to FIX/TD-19334-3.0 2022-11-29 18:24:01 +08:00
Shengliang Guan fb140a285e enh: add dropping status for vgroups 2022-11-29 16:24:59 +08:00
yihaoDeng 21391ea77b change paramter 2022-11-29 10:52:06 +08:00
yihaoDeng d463f05b3f change paramter 2022-11-29 10:28:32 +08:00
Shengliang Guan 99c00acf9f
Merge pull request #18502 from taosdata/enh/changeParamter2
enh: adjust para
2022-11-29 09:22:13 +08:00
Shengliang Guan b56b9414a3
Merge pull request #18516 from taosdata/feature/3_liaohj
refactor: do some internal refactor.
2022-11-28 20:56:33 +08:00
Shengliang Guan af06f93f4e fix: deadlock while alter db replica 2022-11-28 18:00:51 +08:00
Shengliang Guan 232287a8b4 refact: adjust mnode log 2022-11-28 17:43:22 +08:00
Minglei Jin 506554b5d2 Merge branch 'v3.0' into fix/tdb-async-commit 2022-11-28 16:20:48 +08:00
Haojun Liao 3878af10c9 refactor: do some internal refactor. 2022-11-28 16:13:18 +08:00
Shengliang Guan fc87007086
Merge pull request #18509 from taosdata/feature/3_liaohj
refactor: do some internal refactor.
2022-11-28 15:58:12 +08:00
Benguang Zhao dc2dcea3de Merge branch 3.0 to FIX/TD-19334-3.0 2022-11-28 14:27:10 +08:00
Benguang Zhao 8475aaaaf1 enh: add ASSERT info msg in tsdbStartCommit 2022-11-28 13:48:57 +08:00
Haojun Liao 6e81e8cc73 refactor: do some internal refactor. 2022-11-28 12:32:40 +08:00
Shengliang Guan c75fa4f7d2
Merge pull request #18504 from taosdata/feature/stream
fix: memory leak
2022-11-28 11:05:36 +08:00
yihaoDeng 0611ecbe31 change paramter 2022-11-28 10:53:27 +08:00
Liu Jicong bdfef853e5 fix: memory leak 2022-11-28 09:37:56 +08:00
Shengliang Guan aa59831c9b
Merge pull request #18497 from taosdata/fix/TD-20781
fix: memory leak while subscribe
2022-11-28 08:57:41 +08:00
Shengliang Guan e6aed5195d
Merge pull request #18468 from taosdata/feature/3_liaohj
refactor: improve the perf in query
2022-11-27 23:10:00 +08:00
Shengliang Guan 74f83a362b fix: memory while use taosx 2022-11-27 22:23:40 +08:00
Shengliang Guan c4045de4bb fix: memory leak while subscribe 2022-11-27 21:27:15 +08:00
Haojun Liao 203ea1f9c8 fix(query): fix error 2022-11-27 14:57:44 +08:00
slzhou b5b6fff68b feature: save work 2022-11-27 13:50:36 +08:00
Benguang Zhao 4edef438ea enh: transfer ownership of msgs while committing sync log entries 2022-11-26 21:57:23 +08:00
Haojun Liao 0948216ca9 fix(query): fix dead lock. 2022-11-26 21:13:34 +08:00
Liu Jicong 22372ad1e0 fix: memory leak 2022-11-26 16:09:16 +08:00
Haojun Liao 60d6b8e2ee fix(query): change the ptr 2022-11-26 11:51:15 +08:00
Haojun Liao 861b9b8264 fix(query): fix memory leak. 2022-11-26 11:46:36 +08:00
Shengliang Guan ccc2407fe6
Merge pull request #18459 from taosdata/feature/stream
enh(stream): new api for stream queue
2022-11-26 09:26:01 +08:00
Haojun Liao 0015e65f5b fix(query): remove invalid free 2022-11-26 02:13:46 +08:00
Haojun Liao 98771bb461 fix(query): deprecate the error reported by asan. 2022-11-26 01:50:17 +08:00
Haojun Liao 802ca0f607 fix(query): fix memory leak. 2022-11-26 00:58:29 +08:00
Haojun Liao c6795b68d2 fix(query): check list size before iterate it. 2022-11-26 00:12:27 +08:00
Haojun Liao f9d1726c89 fix(query): fix error in ut. 2022-11-25 23:27:36 +08:00
slzhou c2a7404b42 save work in case it losts 2022-11-25 23:00:14 +08:00
Haojun Liao 7fe4cf7bbe
Merge branch '3.0' into feature/3_liaohj 2022-11-25 22:24:59 +08:00
Minglei Jin 59a1571945 fix(meta/cache): invalidate suid cache when create/drop ctb & update tag 2022-11-25 21:15:02 +08:00
Shengliang Guan 97ba608756
Merge pull request #18462 from taosdata/fix/TD-20677
fix: memory leak while subscribe
2022-11-25 21:05:27 +08:00
Liu Jicong 48894c8bdb enh(stream): new api for stream queue 2022-11-25 18:03:40 +08:00
Shengliang Guan 729b35b6e5 fix: memory leak while subscribe 2022-11-25 17:22:12 +08:00
kailixu 993e569403 fix: asan problems for rsma 2022-11-25 16:16:36 +08:00
kailixu a70583c4af fix: asan problems for rsma 2022-11-25 16:15:15 +08:00
Benguang Zhao 68f8ebac9d Merge branch 3.0 to FIX/TD-19334-3.0 2022-11-25 13:10:06 +08:00
Haojun Liao f8bc4df4af refactor: do some internal refactor. 2022-11-25 11:58:46 +08:00
Minglei Jin f570d61d48 fix(meta): return invalid message if cannot getting value from uididx 2022-11-24 19:24:44 +08:00
Haojun Liao 9a208b2d09 other: merge 3.0 2022-11-24 17:08:15 +08:00
Minghao Li 9f38bfeb2c refactor(sync): modify info log to trace log 2022-11-24 16:50:58 +08:00
Minghao Li 7fba711d40 refactor(sync): add info log 2022-11-24 16:03:43 +08:00
Benguang Zhao 22d64b9c0b fix: remove syncNodeReplicateOne from syncNodeOnSnapshotReply 2022-11-24 15:55:31 +08:00
Minghao Li e43794c366 fix(sync): if msg commit, put it into apply-queue, do not care return code 2022-11-24 15:51:48 +08:00
Shengliang Guan 01e8b03bf0
Merge pull request #18429 from taosdata/feature/stream
fix(stream): heap uaf
2022-11-24 15:32:20 +08:00
Liu Jicong fcf46059e9 fix(stream): heap uaf 2022-11-24 14:34:15 +08:00
Shengliang Guan 73d51870ab fix: memory leak while schedule stream 2022-11-24 11:10:14 +08:00
Shengliang Guan 335a572d86
Revert "Revert "enh: row optimize2"" 2022-11-24 10:12:25 +08:00
Hongze Cheng ffbb04d40a
Revert "enh: row optimize2" 2022-11-24 09:21:26 +08:00
Shengliang Guan 7f4a14fbb7
Merge pull request #18369 from taosdata/szhou/fixbugs
fix: build data from mem/imem first when large nchar column incur …eBlockShouldLoad since SDataBlockToLoadInfo.moreThanCapacity
2022-11-24 08:24:41 +08:00
Shengliang Guan 962aa4aff4
Merge pull request #18383 from taosdata/feature/stream
fix(stream): memory leak
2022-11-24 08:17:40 +08:00
Shengliang Guan ba62164767
Merge pull request #18396 from taosdata/enh/row_optimize2
enh: row optimize2
2022-11-24 00:30:48 +08:00
Shengliang Guan dbf270a0c4
Merge pull request #18403 from taosdata/feature/3.0_mhli
refactor(sync): can not propose when heartbeat timeout
2022-11-23 22:57:08 +08:00
Haojun Liao e0e55b2d65 refactor: do some internal refactor. 2022-11-23 22:08:35 +08:00
shenglian zhou 7f6ff39648 feat: table merge scan save work 2022-11-23 19:47:24 +08:00
slzhou db7a7fa4bd Merge branch '3.0' of github.com:taosdata/TDengine into szhou/fixbugs 2022-11-23 15:59:58 +08:00
Hongze Cheng df5bcae11b more code 2022-11-23 15:45:19 +08:00
slzhou 9a85050ff3 fix: direct return file block only rows <= capacity 2022-11-23 15:43:57 +08:00
Hongze Cheng d7c30d6e4a Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/row_optimize2 2022-11-23 15:04:51 +08:00
slzhou c1ba62b26f fix: build from buf first when buf data is in block gap and only capacity caused load 2022-11-23 14:52:07 +08:00
Minghao Li 2b411912d9 refactor(sync): can not propose when heartbeat timeout 2022-11-23 14:17:13 +08:00
dapan1121 188e6e6c7d
Merge pull request #18325 from taosdata/enh/msgRefactor2
enh: refact some messages
2022-11-23 13:53:37 +08:00
Liu Jicong 3b84053893 fix(stream): memory leak 2022-11-23 12:32:02 +08:00
Hongze Cheng 6e23c8cdb3 more code 2022-11-23 10:45:58 +08:00
Hongze Cheng 2313ebc648 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/row_optimize 2022-11-23 09:36:31 +08:00
Shengliang Guan f06145d37b
Merge pull request #18368 from taosdata/feature/stream
fix(stream): memory leak
2022-11-23 09:18:05 +08:00
slzhou 0161374a8b Merge branch '3.0' of github.com:taosdata/TDengine into szhou/fixbugs 2022-11-22 22:59:06 +08:00
slzhou 272a161a61 fix: build data from mem/imem first when large nchar column incur fileBlockShouldLoad since SDataBlockToLoadInfo.moreThanCapacity 2022-11-22 22:06:39 +08:00
Liu Jicong d4c7394143 fix(stream): memory leak 2022-11-22 22:03:08 +08:00
Shengliang Guan d588cd37f8
Merge pull request #18357 from taosdata/fix/liao_cov
fix(query): fix memory leak.
2022-11-22 20:49:33 +08:00
Shengliang Guan 7322ebb897
Merge pull request #18356 from taosdata/fix/TD-20536
fix: the message is repeatedly compressed when redirect
2022-11-22 19:58:31 +08:00
Haojun Liao 7c7b2f1cef fix(query): fix memory leak. 2022-11-22 18:06:01 +08:00
kailixu da535cd04c fix: init/free SBatchDeleteReq for tsma 2022-11-22 15:38:21 +08:00
kailixu d1249017dd fix: init/free SBatchDeleteReq for tsma 2022-11-22 15:35:53 +08:00
kailixu bcac60ae35 fix: init/free SBatchDeleteReq for tsma 2022-11-22 15:32:51 +08:00
Haojun Liao b70a616a2d refactor: do some internal refactor. 2022-11-22 15:27:33 +08:00
Haojun Liao 4d206fd3b2 refactor: do some internal refactor. 2022-11-22 14:59:17 +08:00
Haojun Liao 93ad9e9d3d refactor: do some internal refactor. 2022-11-22 14:29:30 +08:00
Hongze Cheng cede9e14da Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/row_optimize 2022-11-22 13:54:40 +08:00
dapan1121 44462ef869
Merge pull request #18321 from taosdata/szhou/fixbugs
fix: fix error for select count(c2),count(ts) from table caused by null ts column aggregation
2022-11-22 13:17:11 +08:00
Haojun Liao 0af77e6ae2 refactor: do some internal refactor. 2022-11-22 12:43:00 +08:00
Shengliang Guan 4f89b690df
Merge pull request #18318 from taosdata/fix/liao_cov
fix(query): fix some memory leaks.
2022-11-22 12:41:34 +08:00
Hongze Cheng 390709e3c8 add interface 2022-11-22 12:37:47 +08:00
Shengliang Guan c2bebf3f16
Merge pull request #18326 from taosdata/fix/TD-20606
fix: free the batch create table reqs' decoded comment field
2022-11-22 12:17:33 +08:00
Hongze Cheng 40470531e7 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/row_optimize 2022-11-22 11:59:47 +08:00
Haojun Liao fbb0a1e921 fix(query): set correct tsdbreader during the creation of tableblockscan info 2022-11-22 11:08:55 +08:00
Minglei Jin b9f7d181b6 fix: free the batch create table reqs' decoded comment field 2022-11-22 10:47:50 +08:00
dapan1121 19852ba85b Merge remote-tracking branch 'origin/3.0' into enh/msgRefactor2 2022-11-22 10:45:11 +08:00
Haojun Liao 56edf57c12 refactor: do some internal refactor. 2022-11-22 09:52:53 +08:00
slzhou bb51d3cac7 fix: fix error for select count(c2),count(ts) from table caused by invalid ts column aggregation 2022-11-21 23:11:00 +08:00
Shengliang Guan ae0bd036a0 fix: more log 2022-11-21 23:11:00 +08:00
Haojun Liao 8fee089aaf refactor: do some internal refactor. 2022-11-21 22:48:25 +08:00
Haojun Liao 6d5a256774 fix(query): fix some memory leaks. 2022-11-21 22:40:20 +08:00
Liu Jicong 9358429e78 Merge branch '3.0' into feature/stream 2022-11-21 20:54:21 +08:00
dapan1121 c66390d401 enh: refact tmq pull message 2022-11-21 20:38:42 +08:00
Minghao Li e7e17302a4 enh(sync): use TSDB_CODE_SYN_NOT_LEADER instead of TSDB_CODE_RPC_REDIRECT 2022-11-21 15:35:36 +08:00
Liu Jicong 5d471a0ceb enh(taosx): split block when none column not match 2022-11-21 15:32:27 +08:00
Benguang Zhao b90ee79623 fix: use syncLogBufferCommit in syncNodeOnLocalCmd 2022-11-21 13:51:01 +08:00
Hongze Cheng 593f694fdc Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/row_optimize 2022-11-21 09:27:25 +08:00
Hongze Cheng 23f7b67b8a fix: binary NONE + NULL commit coredump 2022-11-20 15:51:40 +08:00
Hongze Cheng a0dc7859ec Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/row_optimize 2022-11-20 10:12:38 +08:00
Shengliang Guan bfa3d1fa27
Merge pull request #18272 from taosdata/fix/TS-2120
fix(meta): new error for creating sub tb already exist in other stables
2022-11-19 09:37:05 +08:00
Minglei Jin cdaafb7b89 fix(meta): new error for creating sub tb already exist in other stables 2022-11-19 08:19:03 +08:00
Shengliang Guan 9c426540e7 fix: memory leaks while check mnode state 2022-11-18 20:15:13 +08:00
Shengliang Guan a12cf7f91d
Merge pull request #18266 from taosdata/feature/stream
enh(stream): put user defined tb name into stream state
2022-11-18 19:56:56 +08:00
Haojun Liao d3452f6630 fix(query): fix error. 2022-11-18 17:38:31 +08:00
Haojun Liao 066735964d other: merge with original branch. 2022-11-18 17:35:24 +08:00
Liu Jicong 9a603e5663 enh(stream): put user defined tb name into stream state 2022-11-18 17:21:50 +08:00
Minglei Jin 35b9dc6b6c meta: use meta cache to get uid's version instead of fetching from tdb 2022-11-18 17:07:19 +08:00
Haojun Liao 0d10294b2e Merge remote-tracking branch 'origin/feature/3_liaohj' into feature/3_liaohj 2022-11-18 14:54:36 +08:00
dapan1121 1167c86b34
Merge pull request #18230 from taosdata/fix/TD-19618-D
fix: real path optimization in case of invalid read
2022-11-18 14:54:28 +08:00
Haojun Liao 71de2f056b fix(query): fix invalid write/read. 2022-11-18 14:53:39 +08:00
Minglei Jin 3ca38c41a7 meta: use meta cache to get uid's version instead of fetching from tdb 2022-11-18 14:44:14 +08:00
Hongze Cheng 93089916e4 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/row_optimize 2022-11-18 13:25:57 +08:00
Benguang Zhao 363cbc8985 fix: update cbMeta rsp handle info in syncLogFsmExecute 2022-11-18 09:37:58 +08:00
dapan1121 a3f0283eba
Merge pull request #18226 from taosdata/enh/msgRefactor0
enh: refactor batch meta msg
2022-11-18 09:20:15 +08:00
Benguang Zhao da469149db enh: debug to info 2022-11-17 20:28:18 +08:00
Minglei Jin 78335f83d2 tdb/api: migrate txn related api changes of meta, sma, tq, and stream meta/state 2022-11-17 20:02:13 +08:00
Shengliang Guan bb2e88c9d8 fix: minus redoActionPos if sync failed 2022-11-17 18:39:04 +08:00
Benguang Zhao 051b73c1ed Merge branch 3.0 to FIX/TD-19334-3.0 2022-11-17 17:28:11 +08:00
Shengliang Guan 4efb9d2ac8 fix: memory leak in mndVgroup.c 2022-11-17 17:15:14 +08:00
dapan1121 448fee1744 fix: fix asan issues 2022-11-17 16:31:22 +08:00
dapan1121 fb861a3935 enh: refactor tmq messages 2022-11-17 14:09:15 +08:00
kailixu 6515c9c7c5 fix: real path optimization in case of invalid read 2022-11-17 10:56:24 +08:00
dapan1121 3a642f06d0 Merge remote-tracking branch 'origin/3.0' into enh/msgRefactor0 2022-11-17 10:42:29 +08:00
dapan1121 49917d5156 enh: refactor batch meta msg 2022-11-17 10:35:25 +08:00
Shengliang Guan d906c44c16 fix: memory leak in while balance vgroup 2022-11-17 09:24:29 +08:00
Haojun Liao a464053692 fix(query): set correct size of array list. 2022-11-17 00:46:06 +08:00
Haojun Liao 9c459a24e2 fix(query): fix memory leak. 2022-11-17 00:38:35 +08:00
Haojun Liao a54275a7b5 fix(query): support null columns sma optimization. 2022-11-16 23:46:59 +08:00
Hongze Cheng 804c281197 Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/sma_for_null 2022-11-16 20:44:58 +08:00
Benguang Zhao 6062632722 enh: turn commit-cb logging msg to debug level in vnodeSyncCommitMsg 2022-11-16 19:53:22 +08:00
Shengliang Guan bffe0eea2a
Merge pull request #18216 from taosdata/feature/stream
fix(stream): skip check update for scalar
2022-11-16 19:53:03 +08:00
Liu Jicong e2005cfa86 fix(stream): skip check update for scalar 2022-11-16 18:48:08 +08:00
Hongze Cheng a5725b506c more code 2022-11-16 17:22:09 +08:00
Shengliang Guan 92019df519
Merge pull request #18189 from taosdata/fix/TD-20458_g
fix: memory leak while create stream
2022-11-16 17:15:54 +08:00
Hongze Cheng 56db6e6630 fix: omit sma for all NONE/NULL column 2022-11-16 15:47:40 +08:00
Haojun Liao a36c24eb1c fix(query): remove invalid free. 2022-11-16 15:47:24 +08:00
Shengliang Guan 201ce10fbc fix: restore wal info changes 2022-11-16 15:45:40 +08:00
Haojun Liao 47a7664e2c refactor: add some logs. 2022-11-16 14:52:38 +08:00
Haojun Liao 7d00b7a6c4 refactor: add tag filter cache. 2022-11-16 14:23:12 +08:00
Shengliang Guan 853c22de28 fix: memory leak while create stream 2022-11-16 10:55:19 +08:00
Hongze Cheng aaef32ca69 refact code for further code change 2022-11-16 10:27:05 +08:00
Shengliang Guan 555bf7d4cb
Merge pull request #18181 from taosdata/feature/stream
fix(stream): check task
2022-11-16 08:11:30 +08:00
Liu Jicong 6478fcb2c1 fix(stream): check task 2022-11-15 22:32:52 +08:00
Shengliang Guan 7d443b1679
Merge pull request #18174 from taosdata/feature/stream
refactor: stream meta ref count
2022-11-15 20:07:42 +08:00
Liu Jicong a9bf05bc01 refactor: stream meta ref count 2022-11-15 19:11:42 +08:00
Shengliang Guan d07209a4e8
Merge pull request #18165 from taosdata/fix/TD-20443
fix: free value return by tdb
2022-11-15 17:03:23 +08:00
Shengliang Guan 6cc31761dd
Merge pull request #18163 from taosdata/fix/TD-20441
fix: clear meta reader's decoder to free leaked memory
2022-11-15 16:47:42 +08:00
Haojun Liao ba5244d1b6 refactor: add tag filter results cache. 2022-11-15 16:06:29 +08:00
Minglei Jin 5ad1bca624 fix: free value return by tdb 2022-11-15 15:57:50 +08:00
Shengliang Guan c3cc259928
Merge pull request #18157 from taosdata/feature/stream
fix: reset cache when table is dropped
2022-11-15 15:30:26 +08:00
Minglei Jin 276fc51969 fix: clear meta reader's decoder to free leaked memory 2022-11-15 15:28:51 +08:00
Liu Jicong 76cd3122d1 fix: memory leak 2022-11-15 14:28:20 +08:00
Liu Jicong ccd3bb20a7 fix: reset cache when table is dropped 2022-11-15 14:10:46 +08:00
Shengliang Guan a57efc49b4 fix: memory leak of sync timer 2022-11-15 13:43:30 +08:00
Shengliang Guan 665e2400ef
Merge pull request #18150 from taosdata/fix/TD-20410
fix: memory leak in smworker.c
2022-11-15 13:33:36 +08:00
Shengliang Guan ea0b090c33
Merge pull request #18147 from taosdata/feature/stream
fix: memory leak
2022-11-15 13:01:02 +08:00
Shengliang Guan 2da3cabd58 fix: memory in smworker.c 2022-11-15 12:21:56 +08:00
Liu Jicong efde22f081 fix: memory leak 2022-11-15 11:59:29 +08:00
54liuyao cf021b4330 fix:applying non-zero offset in tqSink.c 2022-11-15 09:11:26 +08:00
Shengliang Guan 1312b9c785
Merge pull request #18125 from taosdata/fix/liao_cov
fix(query): fix errors found by asan.
2022-11-14 20:55:25 +08:00
Shengliang Guan 9e18a86ad2
Merge pull request #18134 from taosdata/feature/stream
enh(stream): add stream task info into information schema
2022-11-14 20:55:00 +08:00
Shengliang Guan f5f1bae376
Merge pull request #18130 from taosdata/perf/insert_optimize
perf: insert optimize
2022-11-14 20:53:32 +08:00
Liu Jicong 7c8b2867ce enh(stream): add stream task info into information schema 2022-11-14 19:23:42 +08:00
Haojun Liao fc83468156
Merge branch '3.0' into fix/liao_cov 2022-11-14 19:02:30 +08:00
Hongze Cheng 6aefbbf3b2 more optimize 2022-11-14 17:32:09 +08:00
Hongze Cheng 10921cc09a more opt 2022-11-14 17:13:22 +08:00
Haojun Liao cf56c38e7a fix(query): fix errors found by asan. 2022-11-14 17:10:25 +08:00
Hongze Cheng 5b51f97a48 more optimize 2022-11-14 16:52:39 +08:00
Shengliang Guan c0ad5b838b test: add asan cases 2022-11-14 16:17:28 +08:00
dapan1121 2c265b861b
Merge pull request #18113 from taosdata/fix/asanIssues
fix: fix asan issues
2022-11-14 15:19:24 +08:00
dapan1121 d2468c5548 fix: fix asan issues 2022-11-14 14:22:13 +08:00
Shengliang Guan 70b937cfac
Merge pull request #18063 from taosdata/refacotr/add_debug_log
refactor(tmq): add debug log
2022-11-14 12:35:04 +08:00
dapan1121 14a1f4e373
Merge pull request #18074 from taosdata/fix/TD-20300
fix: fix query thread quit issue
2022-11-14 11:28:30 +08:00
Liu Jicong d6c389a6cc refactor(tmq): add debug log 2022-11-14 10:46:05 +08:00
Shengliang Guan 7bcda46c59 refact: remove sync pre snapshot 2022-11-13 16:03:45 +08:00
Shengliang Guan 0597c01107
Merge pull request #18070 from taosdata/fix/TD-20052
refact: remove sync ping and pingreply
2022-11-12 09:41:43 +08:00
Shengliang Guan 93447107e1
Merge pull request #18064 from taosdata/perf/insert_optimize
perf: insert optimize
2022-11-12 09:41:16 +08:00
Cary Xu 33861a9d4c fix: allocate memory for lock 2022-11-11 22:13:21 +08:00
Cary Xu 08aaf97657 chore: code optimization 2022-11-11 19:11:06 +08:00
Cary Xu 0dcbe92006 fix: adjust the the varData offset of tp row 2022-11-11 19:04:54 +08:00
dapan1121 56b33e9200 Merge remote-tracking branch 'origin/3.0' into fix/TD-20300 2022-11-11 18:57:12 +08:00
dapan1121 f60441e2dd fix: fix query thread quitting issue 2022-11-11 18:44:59 +08:00
Shengliang Guan 278cf9d327 refact: remove sync ping and pingreply 2022-11-11 17:48:15 +08:00
dapan1121 89c13efba8 fix: fix query thread quit issue 2022-11-11 17:13:55 +08:00
Cary Xu 97e83a905b fix: iter next column for kv row 2022-11-11 17:07:16 +08:00
Shengliang Guan 672384eca1
Merge pull request #18056 from taosdata/feature/stream
refactor(tmq): add more strict drop condition check
2022-11-11 16:06:31 +08:00
Hongze Cheng 6076bb0245 Merge branch '3.0' of https://github.com/taosdata/TDengine into perf/insert_optimize 2022-11-11 16:04:02 +08:00
Cary Xu 41a2b0e8ea chore: append kv row to block data 2022-11-11 16:01:41 +08:00
Hongze Cheng 74223b3467 more optimize 2022-11-11 15:22:13 +08:00
Liu Jicong 603cc02671 refactor(tmq): add more strict drop condition check 2022-11-11 15:00:34 +08:00
Liu Jicong 2386e0b513 refactor(tmq): add more strict drop condition check 2022-11-11 14:37:31 +08:00
Hongze Cheng 057af11ae8 format more 2022-11-11 13:57:38 +08:00
Cary Xu d9faec5e9f enh: lock buf pool only for rsma vnode 2022-11-11 13:53:16 +08:00
Hongze Cheng 5f97ea3ce1 perf: more optimize 2022-11-11 13:11:48 +08:00
dapan1121 8ddef2e43e
Merge pull request #18046 from taosdata/fix/TS-2046-D
chore: set stream fill history on for tsma
2022-11-11 12:56:35 +08:00
Shengliang Guan 2983f9ba48
Merge pull request #18047 from taosdata/fix/TD-20327
fix: update stb stats cache when creating/dropping child tables
2022-11-11 12:19:45 +08:00
Shengliang Guan 1b54e7fa1f
Merge pull request #18044 from taosdata/perf/insert_optimize
perf: insert optimize
2022-11-11 11:24:00 +08:00
Shengliang Guan b28f05e6fb
Merge pull request #18037 from taosdata/feature/stream
fix(stream): tbname max len to 192
2022-11-11 11:08:40 +08:00
Cary Xu 37b7e34fe2 chore: revert the code change 2022-11-11 10:58:25 +08:00
Cary Xu 936daff09b chore: revert the code change 2022-11-11 10:57:48 +08:00
Cary Xu 5651bde6fe enh: use lock in buf pool only for rsma vnode 2022-11-11 10:54:46 +08:00
stephenkgu 4a8196b520 fix: update stb stats cache when creating/dropping child tables 2022-11-11 10:36:27 +08:00
Cary Xu 13680e2ee6 chore: set stream fill history on for tsma 2022-11-11 10:25:16 +08:00
Liu Jicong df4fd528c0 fix(stream): tbname max len to 192 2022-11-11 10:09:46 +08:00
Hongze Cheng f55292dd6d perf: optimize write 2022-11-11 10:00:40 +08:00
Shengliang Guan 87255f7181
Merge pull request #18002 from taosdata/feat/TS-2007
enh: support wider range for future timestamp
2022-11-11 09:09:52 +08:00
yihaoDeng 27ebbdadf2 add rpc retry config 2022-11-10 19:44:45 +08:00
Cary Xu 65d9d2cd1e chore: code refactor for tsMaxKey definition 2022-11-10 15:58:16 +08:00
Cary Xu 69c1465142 Merge branch '3.0' into feat/TS-2007 2022-11-10 15:49:15 +08:00
Haojun Liao 9f5cf450de refactor: do some internal refactor. 2022-11-10 15:37:18 +08:00
Shengliang Guan 1a1ce767e2
Merge pull request #18011 from taosdata/fix/TS-2029
fix: skip empty data in delete file
2022-11-10 09:44:29 +08:00
dapan1121 56c5eb29b9
Merge pull request #18005 from taosdata/enh/TD-20288
enh: support vgroup epset update
2022-11-10 09:41:25 +08:00
stephenkgu 8d6f129154 fix: skip empty data in delete file 2022-11-10 08:14:21 +08:00
Shengliang Guan b067079d7a
Merge pull request #18007 from taosdata/feature/3_liaohj
refactor: do some internal refactor.
2022-11-10 08:12:36 +08:00
Shengliang Guan b882e45505
Merge pull request #17988 from taosdata/perf/default_buffer_size
perf: optimize write by changing default buffer size
2022-11-09 21:45:26 +08:00
Shengliang Guan b595c07149 fix: wait until db created while process use db req 2022-11-09 19:47:22 +08:00
Cary Xu 14dc1d3f84 Merge branch '3.0' into feat/TS-2007 2022-11-09 19:42:41 +08:00
Shengliang Guan 808ee3775d fix: wait until db created while process use db req 2022-11-09 19:42:30 +08:00
Haojun Liao 015f1a1df8 other: merge 3.0 2022-11-09 19:17:45 +08:00
Hongze Cheng 0c92bd6e37 make pass ci 2022-11-09 18:58:35 +08:00
dapan1121 2f807a85d0 Merge remote-tracking branch 'origin/3.0' into enh/TD-20288 2022-11-09 18:52:00 +08:00
dapan1121 9f7e06721c enh: support vgroup epset update 2022-11-09 18:48:52 +08:00
Cary Xu 25148268e6 enh: support wider range for future timestamp 2022-11-09 18:10:30 +08:00
Shengliang Guan 35bacc2f96
Merge pull request #17995 from taosdata/feature/3.0_mhli
refactor(sync): add FpApplyQueueItems in fsm
2022-11-09 17:40:28 +08:00
Minghao Li d672e7a05c refactor(sync): add FpApplyQueueItems in fsm 2022-11-09 16:18:28 +08:00
Hongze Cheng 86ed5e5674 more optimize 2022-11-09 16:02:04 +08:00
Shengliang Guan 7f03194299
Merge pull request #17991 from taosdata/feature/stream
enh(tmq): auto clear lost consumer
2022-11-09 15:57:08 +08:00
Liu Jicong 4000176dc7 enh(tmq): auto clear lost consumer 2022-11-09 14:44:09 +08:00
Haojun Liao 411371ba48 refactor: do some internal refactor. 2022-11-09 14:16:21 +08:00
Haojun Liao b48752686e refactor: do some internal refactor. 2022-11-09 13:45:46 +08:00
Haojun Liao 0c427b5f5b refactor: do some internal refactor. 2022-11-09 10:39:32 +08:00
Haojun Liao 68f2f92116 fix(query): fix the syntax errors. 2022-11-09 09:07:21 +08:00
Haojun Liao d238f387ce other: merge 3.0 2022-11-09 00:00:14 +08:00
Shengliang Guan 9a5e82267e Merge branch '3.0' into fix/TD-20286 2022-11-08 19:37:01 +08:00
Shengliang Guan ecd75c0d2c
Merge pull request #17967 from taosdata/fix/TD-20264
enh: check vgroup status changes at regular intervals
2022-11-08 19:34:35 +08:00
dapan1121 718ccf5dfa Merge remote-tracking branch 'origin/fix/TD-20264' into enh/TD-20288 2022-11-08 19:11:01 +08:00
Shengliang Guan 0183fe6e73 fix: crash if db not exist while process status msg 2022-11-08 18:36:24 +08:00
Haojun Liao 663138ba1e enh(query): optimize the query perf. 2022-11-08 18:33:57 +08:00
Shengliang Guan 6c0f46ff03 fix: the vnode was created to the wrong dnode when network was misconfigured 2022-11-08 18:10:26 +08:00
dapan1121 d5874419ec
Merge pull request #17935 from taosdata/fix/TD-20246
fix: fix tsdbRead crash caused by reuse after free
2022-11-08 17:48:25 +08:00
Haojun Liao cc3e97da36 fix(query): fix an typo. 2022-11-08 17:41:29 +08:00
Haojun Liao 6e1a2b1e54 enh(query): improve the perf. 2022-11-08 17:38:09 +08:00
Shengliang Guan 5a5d2c448b enh: process some msg in mnode read queue 2022-11-08 17:26:31 +08:00
Shengliang Guan 1dbb086045 enh: check vgroup status changes at regular intervals 2022-11-08 17:17:24 +08:00
Haojun Liao f85d66f5ee enh(query): opt query perf. 2022-11-08 16:59:00 +08:00
Shengliang Guan 8f0ecd46cd
Merge pull request #17961 from taosdata/feature/stream
enh(tmq): offset commit only when needed
2022-11-08 16:08:10 +08:00
Shengliang Guan 920fc400a0
Merge pull request #17964 from taosdata/fix/TD-20264
fix: add log for use db rsp
2022-11-08 16:07:55 +08:00
Haojun Liao b0a54d3fab enh(query): improve the perf. 2022-11-08 14:54:42 +08:00
Liu Jicong 118e5bf5d3 enh(tmq): offset commit only when needed 2022-11-08 14:46:34 +08:00
Hongze Cheng 7bba9996cf perf: optimize insert 2022-11-08 14:36:18 +08:00
Shengliang Guan 7a5be43d14
Merge pull request #17954 from taosdata/feature/stream
fix(stream): delete tb should be checked in write thread
2022-11-08 13:50:15 +08:00
Shengliang Guan fb7d45303b fix: add log for use db rsp 2022-11-08 13:46:18 +08:00
Shengliang Guan 75d7ae5a9d
Merge pull request #17953 from taosdata/enh/TD-20263
enh: optimize the error code when create and drop a db in dropping status
2022-11-08 13:24:48 +08:00
Shengliang Guan abd95562a0 enh: optimize the error code when create and delete a database in a dropping state 2022-11-08 12:36:28 +08:00
Liu Jicong bc469f7f7b fix(stream): delete tb should be checked in write thread 2022-11-08 11:30:29 +08:00
Shengliang Guan 30058f7619 enh: optimize the error code when create and delete a database in a dropping state 2022-11-08 10:46:32 +08:00
dapan1121 ba570b2bb7
Merge pull request #17938 from taosdata/fix/preprocessQuery
fix: fix error handling for query msg preprocessing
2022-11-08 10:13:14 +08:00
Shengliang Guan dfbb958128
Merge pull request #17929 from taosdata/perf/sma_optimize
perf: optimize sma calculation
2022-11-08 10:03:12 +08:00
Shengliang Guan 1f91eef038
Merge pull request #17932 from taosdata/fix/tdb-prep-async-commit
enh(tdb): new interface of meta prep async commit
2022-11-08 09:43:36 +08:00
Minglei Jin 1a4cf6964b fix: add post commit to tq & stream 2022-11-07 20:34:23 +08:00
Shengliang Guan e04c821292
Merge pull request #17933 from taosdata/perf/block_data_optimize
perf: optimize block data operation
2022-11-07 19:32:23 +08:00
dapan1121 f7fa81ee2c fix: fix error handling for query msg preprocessing 2022-11-07 18:51:13 +08:00
Shengliang Guan b0f469adb1
Merge pull request #17931 from taosdata/feature/3.0_mhli
fix(sync): when apply queue not empty, can not read
2022-11-07 18:29:53 +08:00
dapan1121 3e3354782c
Merge pull request #17930 from taosdata/enh/showWrite
enh: support grant check in vnode query
2022-11-07 17:42:15 +08:00
Ganlin Zhao d590a38d62 fix: fix tsdbRead crash caused by reuse after free
TD-20246
2022-11-07 17:36:58 +08:00
Hongze Cheng d52b8966fc perf: optimize block data operation 2022-11-07 16:56:35 +08:00
Minglei Jin c17f8244be enh(tdb): new interface of meta prep async commit 2022-11-07 16:45:29 +08:00
Minghao Li b6aea6ae17 fix(sync): when apply queue not empty, can not read 2022-11-07 16:40:53 +08:00
dapan1121 5ab6166efe enh: support grant check in vnode query 2022-11-07 16:23:40 +08:00
Hongze Cheng 70f7e3e379 perf: optimize sma calculation 2022-11-07 15:42:53 +08:00
Benguang Zhao 5878c9a31a fix: impl ring log buffer 2022-11-07 14:27:22 +08:00
Haojun Liao be5b72b25d enh(query): add cache for table meta entry in table scan. 2022-11-07 10:17:42 +08:00
Haojun Liao e3d0bc6bf7 other: merge 3.0. 2022-11-06 11:37:21 +08:00
Haojun Liao d200fe5145 refactor: do some internal refactor. 2022-11-06 01:34:04 +08:00
Shengliang Guan adb335467c fix: coverity issues 2022-11-05 19:59:18 +08:00
dapan1121 7081ebe9e6
Merge pull request #17877 from taosdata/enh/TD-19920
enh: add show rewrite mask in query msg
2022-11-05 15:35:51 +08:00
Shengliang Guan 1c892e3e3d
Merge pull request #17894 from taosdata/fix/TD-20161
enh: adjust tqueue and tworker log
2022-11-04 19:11:13 +08:00
Haojun Liao 03f4918b3b refactor: do some internal refactor. 2022-11-04 18:46:48 +08:00
Shengliang Guan 8ce2e12423
Merge pull request #17886 from taosdata/feature/3_liaohj
fix(query): set the last key of each tablescan info
2022-11-04 18:46:17 +08:00
Shengliang Guan 2e6f75107d enh: adjust the number of vnode threads so that one vnode has one write thread 2022-11-04 17:38:35 +08:00
Shengliang Guan 4fc0e3bd55 enh: adjust the number of vnode threads so that one vnode has one write thread 2022-11-04 17:21:00 +08:00
Shengliang Guan fc41f43c9d fix: deadlock while drop db 2022-11-04 16:15:37 +08:00
Shengliang Guan 8886785be1
Merge pull request #17853 from taosdata/fix/liao_cov
refactor(query): do some internal  refactor.
2022-11-04 15:58:11 +08:00
Shengliang Guan a0983cf8c1 enh: adjust tqueue and tworker log 2022-11-04 10:58:23 +08:00
dapan1121 65636154ea fix: fix msg head issue 2022-11-04 10:47:49 +08:00
dapan1121 9ce099a2cf Merge remote-tracking branch 'origin/3.0' into enh/TD-19920 2022-11-04 08:51:43 +08:00
Haojun Liao 0315414623 other: merge 3.0 2022-11-03 19:03:09 +08:00
Haojun Liao 4959529127 fix(query): set the last key of each tablescan info 2022-11-03 19:00:13 +08:00
Shengliang Guan 0a45e80613
Merge pull request #17875 from taosdata/fix/TD-20125-2
fix: reset last load info when close dataf reader for stt last files
2022-11-03 17:05:17 +08:00
dapan1121 ae5f6ef175 enh: add show rewrite mask in query msg 2022-11-03 16:28:48 +08:00
Shengliang Guan 33d64b67ff
Merge pull request #17865 from taosdata/feature/stream
refactor(stream): stream deploy and state transfer
2022-11-03 15:24:39 +08:00
Shengliang Guan c392abb0ad
Merge pull request #17869 from taosdata/feature/3.0_mhli
refactor(sync): add syncIsReadyForRead
2022-11-03 15:23:34 +08:00
Minglei Jin 93190003a3 fix: reset last load info when close dataf reader for stt last files 2022-11-03 15:19:21 +08:00
Liu Jicong 31f574359d fix:log empty msg 2022-11-03 14:29:51 +08:00
Minghao Li a4b54c4f0e refactor(sync): add syncIsReadyForRead 2022-11-03 13:57:57 +08:00
Shengliang Guan 6cef3fa4fa
Merge pull request #17856 from taosdata/feature/3.0_mhli
enh(sync): add sync pre stop, local-cmd:follower-commit
2022-11-03 13:40:35 +08:00
Liu Jicong 15ad147c40 Merge branch '3.0' into feature/stream 2022-11-03 13:37:59 +08:00
Liu Jicong 2fbc8e6306 refactor(stream): stream deploy and state transfer 2022-11-03 13:22:23 +08:00
Shengliang Guan df53e7591d
Merge pull request #17857 from taosdata/fix/TD-20095
refact: add sequence for status msg
2022-11-03 12:23:27 +08:00
Shengliang Guan e61829856a
Merge pull request #17852 from taosdata/fix/TD-20125
fix: set fs and last dataf reader to null when resetting
2022-11-03 11:31:34 +08:00
Shengliang Guan 843e17744e refact: add sequence for status msg 2022-11-03 10:57:20 +08:00
Haojun Liao 7a14bc05ea fix(query): fix some issues about the initialization of SColumnInfoData. 2022-11-03 10:57:05 +08:00
Shengliang Guan 0b69a23220 Merge remote-tracking branch 'origin/3.0' into fix/TD-20095 2022-11-03 10:42:57 +08:00
Shengliang Guan 108b9ffed6 refact: add sequence for status msg 2022-11-03 10:42:33 +08:00
dapan1121 2bf5b0405d
Merge pull request #17851 from taosdata/enh/TD-19956
enh: optimize submit response message
2022-11-03 10:19:39 +08:00
Haojun Liao 9f5a0f01ea Merge branch '3.0' into fix/liao_cov 2022-11-03 10:02:23 +08:00
Haojun Liao 11c4878ca1 refactor(query): do some internal refactor. 2022-11-03 10:01:11 +08:00
Minghao Li 1a4b7622e4 enh(sync): add sync pre stop 2022-11-03 09:39:20 +08:00
Shengliang Guan 9de4bfb230
Merge pull request #17834 from taosdata/fix/liao_cov
fix(query): update the lastkey for each table during table scanning.
2022-11-03 09:29:55 +08:00
Shengliang Guan 3a4101f724
Merge pull request #17849 from taosdata/fix/TD-20095
fix: status access time error
2022-11-03 09:29:22 +08:00
Minglei Jin 0bbe049e58 fix: set fs and last dataf reader to null when resetting 2022-11-03 09:14:51 +08:00
Haojun Liao fc20be8699 fix(query): get if the correct rows in last block exists, and set the correct flag to denote if the last blocks index have been loaded or not. 2022-11-02 22:27:23 +08:00
Shengliang Guan 0d60817268
Merge pull request #17837 from taosdata/feature/3.0_mhli
refactor(sync): add pre snapshot
2022-11-02 21:11:22 +08:00
Shengliang Guan b98e3f343d fix: status access time error 2022-11-02 18:57:38 +08:00
Shengliang Guan 1bae78464c
Merge pull request #17842 from taosdata/fix/TD-20128
fix: failed to read sdb while udf larger then 10M
2022-11-02 18:37:59 +08:00
dapan1121 83fc35c8ee
Merge pull request #17841 from taosdata/fix/TS-1965-new
fix: fix reverse table scan when checking if block from file overlap with skyline deletion result error
2022-11-02 17:56:09 +08:00
Shengliang Guan 5625ea9f2a fix: failed to read sdb while udf larger then 10M 2022-11-02 17:09:53 +08:00
Shengliang Guan f2e1bd55d3 fix: failed to read sdb while udf larger then 10M 2022-11-02 17:08:15 +08:00
Ganlin Zhao 215257f7f1 fix: fix reverse table scan when checking if block from file overlap
with skyline deletion result error
2022-11-02 16:58:36 +08:00
Minghao Li 70aff8451f refactor(sync): add pre snapshot 2022-11-02 15:38:30 +08:00
Shengliang Guan b5f0041af1 refact: adjust error code in vnode 2022-11-02 15:28:32 +08:00
dapan1121 ecfcf7054c enh: optimize submit response msg 2022-11-02 15:18:32 +08:00
Haojun Liao ecad94c419 fix(query): add one more check. 2022-11-02 14:59:34 +08:00
Haojun Liao f83b863cf9 fix(query): update the lastkey for each table during table scanning. 2022-11-02 14:36:00 +08:00
Shengliang Guan 21748defea Merge remote-tracking branch 'origin/3.0' into fix/TD-20095 2022-11-02 11:49:34 +08:00
Shengliang Guan b2e3c7800f
Merge pull request #17813 from taosdata/feature/3_liaohj
fix(query): optimize the performance of tsdbread.
2022-11-02 11:23:29 +08:00
Shengliang Guan 17e3c59aeb fix: add dnode status log 2022-11-02 11:21:13 +08:00
Shengliang Guan 1c77d5381a Merge remote-tracking branch 'origin/3.0' into fix/TD-20052 2022-11-02 10:26:19 +08:00
Shengliang Guan 7a537bba09 refact: adjust sync.h and syncState 2022-11-02 10:24:55 +08:00
Haojun Liao c3ece576f2 Merge branch '3.0' into feature/3_liaohj 2022-11-02 09:13:13 +08:00
Shengliang Guan 15308ad140
Merge pull request #17820 from taosdata/fix/msg_compat
fix(vnode): ignore unhandled msg
2022-11-02 08:37:08 +08:00
Haojun Liao 698ae90e5b fix(query): set correct value in hash map reset. 2022-11-01 23:37:51 +08:00
Haojun Liao b610b23981 fix(query): check for null value. 2022-11-01 21:47:12 +08:00
Liu Jicong a0910c87f7 fix(vnode): ignore unhandled msg 2022-11-01 21:23:50 +08:00
Shengliang Guan a2abb3a411
Merge pull request #17817 from taosdata/fix/msg_compat
fix: msg compatibility
2022-11-01 21:10:46 +08:00
Shengliang Guan cec6642700
Merge pull request #17811 from taosdata/feature/stream
fix(tmq): handle adding subtable for subscribing stb
2022-11-01 21:09:43 +08:00
Shengliang Guan fee43064f7
Merge pull request #17812 from taosdata/fix/TD-20052
enh: refact sync callback func
2022-11-01 21:09:00 +08:00
Liu Jicong 411373a7c5 fix: msg compatibility 2022-11-01 20:02:17 +08:00
Shengliang Guan 0578d034bc
Merge pull request #17810 from taosdata/fix/TD-20028
fix: remove last stt load info resetting from fs iterator
2022-11-01 19:36:12 +08:00
Liu Jicong f0a66602da fix(taosx): set version 2022-11-01 19:28:42 +08:00
Shengliang Guan 871757240a
Merge pull request #17777 from taosdata/FIX/TS-1984-3.0
fix: fsync wal files and meta if data size not synced yet beyond a threshold
2022-11-01 18:53:10 +08:00
Haojun Liao 026b82145e Merge branch '3.0' into feature/3_liaohj 2022-11-01 18:49:51 +08:00
Haojun Liao 68db9b1cc9 fix(query): optimize the performance of tsdbread. 2022-11-01 18:48:57 +08:00
Shengliang Guan df2c443a80
Merge pull request #17807 from taosdata/fix/TD-20097
fix: wrong cpu usage
2022-11-01 18:35:28 +08:00
Shengliang Guan 64633e3dbb enh: refact syncMsg code 2022-11-01 18:34:09 +08:00
Liu Jicong 60bb2c18dc Merge branch '3.0' into feature/stream 2022-11-01 18:19:15 +08:00
Liu Jicong 94e7c79ca0 fix(tmq): handle adding subtable for subscribing stb 2022-11-01 18:18:26 +08:00
Minglei Jin a5052eb2d5 fix: remove last stt load info resetting from fs iterator 2022-11-01 17:29:18 +08:00
Shengliang Guan ee63b49800 Merge remote-tracking branch 'origin/3.0' into fix/TD-20052 2022-11-01 17:11:27 +08:00
Shengliang Guan d53ab62f00
Merge pull request #17797 from taosdata/fix/td_19618
fix: invalid read problem of tsdb path
2022-11-01 16:46:58 +08:00
Shengliang Guan 18f7d658d9
Merge pull request #17804 from taosdata/feature/3_liaohj
refactor: add some logs.
2022-11-01 16:46:24 +08:00
Shengliang Guan a71dbd83d2
Merge pull request #17803 from taosdata/fix/TD-20052
enh: refact syncMsg code
2022-11-01 16:45:56 +08:00
Shengliang Guan 92b1c12330 fix: wrong cpu usage 2022-11-01 16:38:52 +08:00
Shengliang Guan 68f1641991
Merge pull request #17800 from taosdata/feature/stream
refactor(stream): fill history
2022-11-01 16:15:07 +08:00
Shengliang Guan d35028ae4a enh: refact sync callback func 2022-11-01 16:10:07 +08:00
Liu Jicong 92804d317e Merge branch '3.0' into feature/stream 2022-11-01 15:47:37 +08:00
Shengliang Guan f4dc7d0766 enh: refact sync callback func 2022-11-01 15:35:10 +08:00
Cary Xu 872085bef4 fix: add TD_PATH_MAX to support multi-platform 2022-11-01 15:18:26 +08:00
Haojun Liao cff5d9295e refactor: add some logs. 2022-11-01 15:00:02 +08:00
Cary Xu 65943b3712 chore: revert the code change 2022-11-01 14:51:37 +08:00
Shengliang Guan e79e50ae36 enh: refact syncMsg code 2022-11-01 13:58:25 +08:00
Haojun Liao b78249c548 other: merge 3.0 2022-11-01 13:52:08 +08:00
Haojun Liao 83495ed5d3 fix(query): set the correct buffer to accommodate the tag values. 2022-11-01 13:49:02 +08:00
dapan1121 801d65cb9a
Merge pull request #17789 from taosdata/fix/TD-20027-D
fix(query): set search key according to order
2022-11-01 13:48:19 +08:00
Shuduo Sang 7a8c2efbc3
fix: add jemalloc as build dependency of taosd, udf and shell (#17785)
* fix: jemalloc compile error

* fix: jemalloc compile error

* fix: add jemalloc as dependency of taosd and udf

Co-authored-by: afwerar <1296468573@qq.com>
2022-11-01 13:44:04 +08:00
Liu Jicong 8ca5f0bd9c Merge branch '3.0' into feature/stream 2022-11-01 13:20:20 +08:00
Liu Jicong 5e253cc8ea refactor(stream): fill history 2022-11-01 11:56:14 +08:00
Minghao Li 21d60cb5be refactor(sync): pre snapshot on message 2022-11-01 11:46:29 +08:00
Cary Xu 0b6d117121 fix: add TD_PATH_MAX to support multi-platform 2022-11-01 11:44:17 +08:00
Cary Xu 9f14c599f2 fix: add TD_PATH_MAX to support multi-platform 2022-11-01 10:49:27 +08:00
Shengliang Guan 1724aa5638
Merge pull request #17779 from taosdata/fix/sync
refactor(sync): check msgcb, putToQueueFp NULL
2022-11-01 10:43:56 +08:00
Cary Xu 2e950c6696 chore: comment out tfs_test and dbTest 2022-11-01 10:06:09 +08:00
Cary Xu 64f07523e2 Merge branch '3.0' into fix/td_19618 2022-11-01 10:02:45 +08:00
Haojun Liao e533794cb7 Merge branch '3.0' into fix/liao_cov 2022-11-01 09:08:46 +08:00
benguang.zhao 07db554fab enh: persist wal at the beginning of vnodeCommit 2022-11-01 00:00:18 +08:00
Shengliang Guan 9bc48e2658 Merge remote-tracking branch 'origin/3.0' into fix/TD-20052 2022-10-31 23:42:03 +08:00
Shengliang Guan 392564cc7d enh: refact syncEnv code 2022-10-31 23:40:43 +08:00
Shengliang Guan 1c446b1bf4 Merge branch '3.0' into fix/sync 2022-10-31 23:30:24 +08:00
Shengliang Guan e817e649c6
Merge pull request #17788 from taosdata/enh/TD-19090
enh: force drop dnode
2022-10-31 23:27:54 +08:00
Shengliang Guan 26f1e64f2a enh: force drop dnode 2022-10-31 21:33:06 +08:00
Shengliang Guan 8cdbcb89f5
Merge pull request #17762 from taosdata/fix/memReturn
enh: return mem to os
2022-10-31 20:12:22 +08:00
Shengliang Guan f32d347bb8
Merge pull request #17778 from taosdata/feature/3.0_mhli
refactor(sync): add sync local cmd, step down
2022-10-31 20:05:01 +08:00
Cary Xu 8a5f94d35c fix: set search key according to order 2022-10-31 20:03:21 +08:00
Shengliang Guan 1ad604a5f9 enh: force drop dnode 2022-10-31 19:57:27 +08:00
Liu Jicong 2e640c38a2 refactor: stream and tmq message 2022-10-31 18:37:28 +08:00
Minghao Li d246514da2 refactor(sync): check msgcb, putToQueueFp NULL 2022-10-31 18:16:58 +08:00
Haojun Liao f29127a15e ehn(query): do some internal refactor. 2022-10-31 18:04:58 +08:00
Haojun Liao 1fa5eafa8a ehn(query): keep the time window for each block to avoid repeatly parsing the compressed data block meta info. 2022-10-31 17:49:50 +08:00
Shengliang Guan 7ddde569a0 enh: force drop dnode 2022-10-31 17:29:24 +08:00
Haojun Liao fac516a196 refactor: do some internal refactor. 2022-10-31 17:20:27 +08:00
Haojun Liao 9703ab510b enh(query): avoid parse the mapdata to improve the performance by keep the offset of each block. 2022-10-31 17:19:15 +08:00
Haojun Liao ba37a58192 enh(query): reduce the number of malloc. 2022-10-31 15:39:16 +08:00
Haojun Liao f38e9664f9 other:merge 3.0 2022-10-31 15:32:48 +08:00
Haojun Liao adf085ab46 refactor: do some internal refactor. 2022-10-31 14:17:57 +08:00
Minghao Li 0b20b914bb refactor(sync): add sync local cmd 2022-10-31 14:17:26 +08:00
Haojun Liao c11ed48937 Merge branch 'fix/liao_cov' of github.com:taosdata/tdengine into fix/liao_cov 2022-10-31 14:00:31 +08:00
Haojun Liao f790d91b45 fix(query): check null before free resource, and some internal refactor. 2022-10-31 10:41:25 +08:00
Haojun Liao ab2c7c575b Merge branch '3.0' into feature/3_liaohj 2022-10-30 11:18:36 +08:00
Haojun Liao 52c3777823 refactor: do some internal refactor. 2022-10-30 03:01:40 +08:00
gccgdb1234 f52000d86e return mem to os 2022-10-29 22:25:40 +08:00
Haojun Liao afdb1467b7 refactor: do some internal refactor. 2022-10-29 18:27:22 +08:00
Shengliang Guan 24f31b0f72
Merge pull request #17746 from taosdata/feature/3.0_mhli
refactor(sync): adjust elect timer, add some tests
2022-10-29 17:02:19 +08:00
Haojun Liao d583f1fab6 other: merge 3.0 2022-10-29 13:05:35 +08:00
Haojun Liao bae6d824c2 fix(query): init blockscanInfo correctly. 2022-10-29 12:54:39 +08:00
Haojun Liao f9aa286dc1 fix(query): fix syntax error on aarch64 2022-10-29 10:22:02 +08:00
Haojun Liao 61634070ec other: merge 3.0 2022-10-28 23:23:53 +08:00
Haojun Liao 307b7e0ac8 other: merge 3.0 2022-10-28 22:27:57 +08:00
Haojun Liao 029a4a85b3 fix(query): support partition by + limit push down. 2022-10-28 22:21:02 +08:00
Haojun Liao 9b99c69785 fix(query): support partition by + limit push down. 2022-10-28 19:56:32 +08:00
Haojun Liao 0035bb1966
Merge branch '3.0' into feature/3_liaohj 2022-10-28 19:43:47 +08:00
Haojun Liao 6ff3668ecc refactor: update the log. 2022-10-28 19:38:37 +08:00
Haojun Liao 335cb6513e other:merge 3.0 2022-10-28 19:32:57 +08:00
Haojun Liao 9ccf7addb3 other:merge 3.0 2022-10-28 18:46:08 +08:00
Liu Jicong d058475fac
Merge pull request #17750 from taosdata/feature/stream
feat(stream): snode
2022-10-28 18:12:48 +08:00
Haojun Liao 4b2fa43dae
Revert "fix(query): handle partition by in table scan operator" 2022-10-28 18:05:19 +08:00
Haojun Liao d0a7a43e6f other:merge 3.0 2022-10-28 18:02:50 +08:00
Haojun Liao d103581eb8 Merge remote-tracking branch 'origin/fix/liao_cov' into fix/liao_cov 2022-10-28 17:59:20 +08:00
Haojun Liao 6c19e886df fix(query): move the init function for different reader. 2022-10-28 17:58:59 +08:00
Shengliang Guan 8a8aa3efea
Merge pull request #17723 from taosdata/enh/optQueryMem
enh: opt query mem
2022-10-28 17:09:17 +08:00
Liu Jicong b26cc9c318 feat(snode) 2022-10-28 17:03:17 +08:00
Shengliang Guan 2664cf2ea6
Merge pull request #17736 from taosdata/fix/TD-19624
fix: split vgroup
2022-10-28 16:16:01 +08:00
Shengliang Guan b9abfd6798
Merge pull request #17742 from taosdata/fix/TD-19845
fix: failed to start unitest in mac
2022-10-28 16:15:16 +08:00
Shengliang Guan 57960661d4 fix: failed to start unitest in mac 2022-10-28 15:24:32 +08:00
Shengliang Guan 52cef327b2 Merge remote-tracking branch 'origin/3.0' into fix/TD-19963 2022-10-28 13:56:59 +08:00
Shengliang Guan 507e135b1f fix: split vgroup 2022-10-28 13:52:00 +08:00
Shengliang Guan a67cbc15cd
Merge pull request #17726 from taosdata/feature/stream_ly
fix(stream):tqBuildDeleteReq error
2022-10-28 13:01:06 +08:00
Shengliang Guan ff26385185
Merge pull request #17717 from taosdata/fix/TD-19872
test: improve coverall
2022-10-28 12:40:37 +08:00
Shengliang Guan ab90ce5a05 fix: avoid deadlock 2022-10-28 12:14:49 +08:00
Shengliang Guan 19ee34c7c2 fix: compile error 2022-10-28 11:35:43 +08:00
54liuyao 7d8a282258 fix(stream):tqBuildDeleteReq error 2022-10-28 11:19:26 +08:00
Haojun Liao 2c896012df fix(query): check status before add table uid in hash map. and do some other refactor. 2022-10-28 10:43:25 +08:00
Haojun Liao f25387018d
Merge pull request #17724 from taosdata/fix/liao_cov
fix(query): handle the case of the single block in last files.
2022-10-28 10:25:38 +08:00
Shengliang Guan 5101d21551 fix: compile error 2022-10-28 10:17:48 +08:00
Liu Jicong 9b1ba10fbc Merge branch '3.0' into feature/stream 2022-10-28 09:18:59 +08:00
Haojun Liao 70c3825ee5 fix(query): remove invalid check. 2022-10-28 09:12:40 +08:00
Haojun Liao 4774baa635 fix(query): handle the case of the single block in last files. 2022-10-27 22:43:42 +08:00
Haojun Liao e7b59ae56d fix(query): handle the case of the single block in last files. 2022-10-27 21:51:54 +08:00
yihaoDeng 9de0afc8ea opt mem 2022-10-27 21:22:36 +08:00
yihaoDeng 6a978be730 opt mem 2022-10-27 20:38:57 +08:00
Haojun Liao d8102fc8d8 fix(query): fix invalid number of tables check. 2022-10-27 18:58:10 +08:00
Haojun Liao a7ca29c627 other: merge 3.0 2022-10-27 18:04:28 +08:00
Shengliang Guan 5240814261 test: improve coverall 2022-10-27 17:45:50 +08:00
Shengliang Guan 4e190d9702
Merge pull request #17713 from taosdata/enh/TD-19459
test: restore some cases
2022-10-27 17:35:01 +08:00
dapan1121 b6326c7f14
Merge pull request #17710 from taosdata/fix/TD-19815
fix: add query heartbeat configuration
2022-10-27 17:33:27 +08:00
Haojun Liao 5a971dd03a fix(query): handle partition by in table scan operator with limit/offset value. 2022-10-27 16:58:32 +08:00
Liu Jicong 70311d95dd refactor(vnode): add log for failed deletion 2022-10-27 16:45:40 +08:00
Liu Jicong 5abeacc299
Merge pull request #17711 from taosdata/feature/stream
refactor(mnode): remove unused code
2022-10-27 16:41:09 +08:00
Minghao Li bbb624b63e Merge branch '3.0' of https://github.com/taosdata/TDengine into feature/3.0_mhli 2022-10-27 16:22:08 +08:00
Minghao Li 7cb3112d77 refactor(sync): modify function name 2022-10-27 15:52:48 +08:00
Shengliang Guan fe31be0640
Merge pull request #17708 from taosdata/enh/TD-19459
enh: drop dnode
2022-10-27 15:37:11 +08:00
Liu Jicong dcf2c980c5 refactor(mnode): remove unused code 2022-10-27 15:32:20 +08:00
Shengliang Guan 4844b9158e test: add replica case 2022-10-27 15:29:03 +08:00
Shengliang Guan 8b31cd87d1
Merge pull request #17706 from taosdata/feature/stream_ly
fix(stream): read preversion data with delete many times
2022-10-27 15:05:23 +08:00