Commit Graph

5765 Commits

Author SHA1 Message Date
Haojun Liao ac9773b5df
Merge pull request #20670 from taosdata/fix/liaohj
refactor: do some internal refactor.
2023-03-28 14:32:10 +08:00
Haojun Liao c36c5253c5 refactor: do some internal refactor. 2023-03-28 13:31:40 +08:00
Haojun Liao fca79dbc53 Merge branch 'fix/liaohj' into main 2023-03-28 11:20:01 +08:00
Haojun Liao c158087d66 fix(tmq): kill the ongoing tsdb scans while transferring the ownership of vnode to other consumers. 2023-03-28 09:53:49 +08:00
Haojun Liao 5c128e2292 refactor: do some internal refactor. 2023-03-28 09:27:48 +08:00
dapan1121 61571d9296 enh: optimize count performance 2023-03-27 19:40:29 +08:00
Xiaoyu Wang 77f27bb9df
Merge pull request #20613 from taosdata/FIX/TD-23308-main
enh: disable timely vnodeCommit
2023-03-27 17:58:20 +08:00
wangmm0220 f1d67b6059 fix:conflict 2023-03-25 19:03:23 +08:00
wangmm0220 750cd8c5a4 fix:ci error 2023-03-25 16:33:47 +08:00
dapan1121 8a89550f16 fix: skiplist level 2023-03-25 13:10:14 +08:00
wangmm0220 9f5e435140 fix:conflict from main 2023-03-25 11:49:37 +08:00
dapan1121 dd12e41227
Merge pull request #20618 from taosdata/fix/TS-2974
fix: change float display mode
2023-03-25 09:19:04 +08:00
dapan1121 481091bae6 fix: sma load issue 2023-03-24 19:01:19 +08:00
dapan1121 8bf49fdbd2 fix: skiplist level 2023-03-24 17:16:06 +08:00
Haojun Liao b22cc82270 others: merge main. 2023-03-24 15:43:13 +08:00
Haojun Liao 8f6ac6d771 fix(tmq): wait for 2mins when subscribe topics. 2023-03-24 15:36:42 +08:00
dapan1121 4167e4c00c fix: some columns sma are not set issue 2023-03-24 15:20:27 +08:00
wangmm0220 57331cd71d Merge branch 'main' of https://github.com/taosdata/TDengine into fix/TD023101 2023-03-24 14:51:11 +08:00
wangmm0220 5d06474f2e fix:send data batch if consume wal where subscribe db 2023-03-24 14:43:29 +08:00
wangmm0220 1a2513d212 Merge branch 'fix/TD023101' of https://github.com/taosdata/TDengine into fix/TD023101 2023-03-24 10:12:12 +08:00
wangmm0220 bf78f63e22 fix:send data batch if consume wal where subscribe db 2023-03-24 10:10:52 +08:00
cadem 86ca5ce210 fix/trigger election by sync msg 2023-03-24 09:13:20 +08:00
Benguang Zhao 9be09492f0 enh: disable timely vnodeCommit 2023-03-24 09:05:06 +08:00
Xiaoyu Wang bddba107be
Merge pull request #20608 from taosdata/fix/TS-2960
fix(tdb/restore): rollback journal files backward
2023-03-23 19:47:31 +08:00
dapan1121 7f50b463bb
Merge pull request #20599 from taosdata/fix/mainT3.0
fix: merge main to 3.0
2023-03-23 16:17:01 +08:00
Xiaoyu Wang a5d8549cb1
Merge pull request #20593 from taosdata/FEAT/TD-23258-3.0
feat: support WAL_RETENTION_PERIOD and WAL_RETENTION_SIZE for alter database
2023-03-23 11:43:01 +08:00
Xiaoyu Wang 323d8ee0b4
Merge pull request #20598 from taosdata/FIX/TD-23187-main
fix: set pWriter->info.state.committed as ever in vnodeSnapWriterClose
2023-03-23 11:42:48 +08:00
wangmm0220 5f9c7e9a7d fix:[TS-2961] consume error change from snapshot to wal for taosx 2023-03-22 20:14:19 +08:00
wangmm0220 6fae38619d fix:error in TD-23218 & remove useless logic 2023-03-22 19:36:12 +08:00
dapan1121 e58afd12e1 fix: merge main to 3.0 2023-03-22 17:42:09 +08:00
wangmm0220 dd4cf0597b fix:error in optimize consume logic 2023-03-22 17:04:02 +08:00
dapan1121 5b02af6a91 fix: merge main to 3.0 2023-03-22 16:08:16 +08:00
Benguang Zhao 24af249f55 fix: set pWriter->info.state.committed as ever in vnodeSnapWriterClose 2023-03-22 16:05:57 +08:00
Benguang Zhao 0b101e4952 feat: support WAL_RETENTION_PERIOD and WAL_RETENTION_SIZE for alter database 2023-03-22 11:40:24 +08:00
Minglei Jin 0bf98096c9 fix(tsdb/cache): init isLast once for each fileset 2023-03-22 10:57:27 +08:00
Minglei Jin cb93ac2613 enh(tsdb/cache): make merge tree next one less 2023-03-22 10:50:34 +08:00
wangmm0220 c07e563ecd fix:error in optimize consume logic 2023-03-22 10:43:11 +08:00
Minglei Jin 0b31aac2c5 enh(tsdb/cache): skip data block with merge tree 2023-03-22 10:19:58 +08:00
cadem ea35f0ae11 feat/balance vgroup leader 2023-03-22 09:36:59 +08:00
Haojun Liao 69ca2b2f7b fix(tmq): do some internal refactor. 2023-03-21 19:40:36 +08:00
Haojun Liao c3acab2070 fix(tmq): do some internal refactor. 2023-03-21 19:38:34 +08:00
dapan1121 3ab55496c1
Merge pull request #20561 from taosdata/fix/TS-2891-M
fix: select ins_columns from stb/tb
2023-03-21 16:24:46 +08:00
Haojun Liao ca29dd344f other: merge main. 2023-03-21 14:04:52 +08:00
Haojun Liao d5a386a563 fix(client): fix coverity issues. 2023-03-21 14:03:36 +08:00
Haojun Liao 18b121c69c fix(tmq): fix the invalid write and do some internal refactor. 2023-03-21 13:45:43 +08:00
Haojun Liao ea0cc2c584
Merge pull request #20554 from taosdata/fix/TS-2828
fix: add retry if insert error with meta change
2023-03-21 09:01:22 +08:00
kailixu 179579f204 chore: more code 2023-03-20 17:41:22 +08:00
wangmm0220 f7b7320f5f fix:set offset if read wal none 2023-03-20 16:57:45 +08:00
wangmm0220 506c192bff fix:error in TD-23218 & remove useless logic 2023-03-20 16:26:15 +08:00
Haojun Liao ca1dffff45
Merge pull request #20508 from taosdata/fix/liaohj
fix(client): fix potential memory leak.
2023-03-20 16:11:22 +08:00
wangmm0220 f80078030c fix:error in TD-23218 & remove useless logic 2023-03-20 15:40:01 +08:00
Haojun Liao 625b2dc901
Merge pull request #20513 from taosdata/fix/TD-23136
fix:converity scan defects
2023-03-20 15:37:59 +08:00
Haojun Liao 2517f9bb83 fix(tmq): add some logs. 2023-03-20 15:27:16 +08:00
wangmm0220 c0b41ea0b3 fix:error in TD-23218 & remove useless logic 2023-03-20 14:09:13 +08:00
Haojun Liao a24d537d9e Merge remote-tracking branch 'origin/fix/liaohj' into fix/liaohj 2023-03-20 13:28:13 +08:00
Haojun Liao 4cb1c51d4e fix(tmq): update some logs. 2023-03-20 13:27:58 +08:00
yihaoDeng 192570ce77 fix tag filter 2023-03-20 04:14:57 +00:00
wangmm0220 a5144f0ba2 fix:set offset if read wal none 2023-03-20 10:10:07 +08:00
Haojun Liao a5e9fad0f9 fix(query): set correct lastkeyInstt. 2023-03-19 23:58:17 +08:00
Haojun Liao c678740968 refactor: do some internal refactor. 2023-03-19 19:22:43 +08:00
Haojun Liao 7e712a14b6 fix(tmq): adjust log. 2023-03-19 19:06:28 +08:00
Xiaoyu Wang f86c8d0d6e enh: optimize last pruning logic 2023-03-19 14:40:16 +08:00
Xiaoyu Wang 6277b2564b enh: optimize last pruning logic 2023-03-19 13:41:32 +08:00
Xiaoyu Wang 9affd11eb7
Merge pull request #20542 from taosdata/fix/main_bugfix_wxy
enh: optimize last pruning logic
2023-03-19 12:00:18 +08:00
Xiaoyu Wang 5a4fe943dc enh: optimize last pruning logic 2023-03-19 11:01:39 +08:00
Haojun Liao ae5155edcf fix(tmq): do some internal refactor. 2023-03-19 10:49:30 +08:00
Minglei Jin 3a5542bbbc fix(tsdb/cache): update nCols of merge tree to avoid assert failed 2023-03-19 10:19:49 +08:00
wangmm0220 ccba1d07c6 fix:error in TD-23218 & remove useless logic 2023-03-18 18:42:49 +08:00
wangmm0220 7616a283e3 fix:error in TD-23218 & remove useless logic 2023-03-18 18:23:38 +08:00
yihaoDeng afaa77cc3e fix tag filter 2023-03-18 10:01:45 +00:00
yihaoDeng f24e06f36b fix tag filter 2023-03-18 08:58:26 +00:00
dapan1121 859f2594ed fix: add sma load time 2023-03-17 15:21:43 +08:00
wangmm0220 0a54d00cd2 fix:converity scan defects 2023-03-17 14:54:27 +08:00
Shengliang Guan aa656c9c29
Merge pull request #20505 from taosdata/fix/TD-23196
ehn(tsdb/cache): skip invalid row or data block directly with merge tree
2023-03-17 13:19:06 +08:00
Haojun Liao d5a8a4aefe
Merge pull request #20502 from taosdata/fix/liaohj
fix(client): set the initial value for num_of_rows.
2023-03-17 12:50:04 +08:00
Minglei Jin ca115b1c87 fix(tsdb/cache): break loop to return current row 2023-03-17 11:41:17 +08:00
wangmm0220 4fdef7421c fix:add log for taosCreateLog error 2023-03-17 10:50:54 +08:00
Minglei Jin a8d146c512 ehn(tsdb/cache): skip invalid row or data block directly with merge tree 2023-03-17 10:22:36 +08:00
Haojun Liao 970155a845 fix(query): fix coverity issues. 2023-03-16 21:53:34 +08:00
wangmm0220 6323a6e801 fix:conflicts 2023-03-16 19:18:07 +08:00
wangmm0220 14970478dc fix:conflicts 2023-03-16 19:15:08 +08:00
wangmm0220 fa2e7b234c fix:add log for schemaless & sleep longer if modify schema error 2023-03-16 19:13:15 +08:00
Shengliang Guan 925693c8a9
Merge pull request #20493 from taosdata/fix/TD-23172
ehn(tsdb/cache): load necessary columns only
2023-03-16 15:49:04 +08:00
yihaoDeng 3ac11ce87a enh: change log 2023-03-16 06:17:45 +00:00
Minglei Jin b1949b5584 fix(tsdb/cache): skip remaining rows in current data block 2023-03-16 14:11:34 +08:00
Haojun Liao 345b46769c
Merge pull request #20490 from taosdata/fix/liaohj
fix(tmq): disable non-leader vnode responsing the poll request.
2023-03-16 14:00:42 +08:00
Minglei Jin 6e0343fc08 enh(tsdb/cache): load necessary columns only 2023-03-16 11:18:36 +08:00
Haojun Liao a1682664f2 fix(tmq): disable non-leader vnode responsing the poll request. 2023-03-16 10:12:34 +08:00
yihaoDeng ef092c1cce enh: add queue limit 2023-03-15 11:54:36 +00:00
Shengliang Guan af4532dc63
Merge pull request #20476 from taosdata/fix/TD-23163
enh(tsdb/cache): skip invalid datablock directly when traversing fs with last
2023-03-15 19:03:48 +08:00
Minglei Jin 04d501d64a fix: destroy aColArray anyway 2023-03-15 17:41:29 +08:00
Minglei Jin f1414355e3 tsdb/cache: skip invalid datablock directly when traversing fs with last 2023-03-15 16:24:36 +08:00
Haojun Liao 36cec7894b
Merge pull request #20472 from taosdata/fix/liaohj
fix(query): set the correct cached tags list key length, and update s…
2023-03-15 15:56:50 +08:00
Haojun Liao 52576071ae refactor: do some internal refactor. 2023-03-15 14:37:48 +08:00
Haojun Liao 253a760810 fix(query): set the correct cached tags list key length, and update some logs. 2023-03-15 14:30:12 +08:00
Shengliang Guan 09ca41b3f7
Merge pull request #20467 from taosdata/fix/TS-2893
fix:create same sub table
2023-03-15 14:07:47 +08:00
54liuyao d5defa3def fix:create same sub table 2023-03-15 11:10:55 +08:00
Hongze Cheng e43b606917 current from binary to json 2023-03-15 10:48:51 +08:00
Benguang Zhao cc76d78673 enh: separate sync read and write events 2023-03-14 20:35:39 +08:00
Haojun Liao 32ddecc347 other: merge main. 2023-03-14 12:13:09 +08:00
Shengliang Guan e98b32a69f
Merge pull request #20427 from taosdata/fix/main_bugfix_wxy
fix: last redundant read stt file
2023-03-14 09:41:19 +08:00
Shengliang Guan 214c595491
Merge pull request #20412 from taosdata/fix/TD-23095
fix:auto fill null column
2023-03-14 09:36:57 +08:00
Shengliang Guan bf03965931
Merge pull request #20413 from taosdata/FIX/TD-22564-main
enh: not allow to propose if fsm applying progress lagging behind too far
2023-03-14 09:36:04 +08:00
Shengliang Guan 6989f1be61
Merge pull request #20418 from taosdata/fix/TD-22671
fix:deal with ASSERT in tmq
2023-03-14 09:34:52 +08:00
Xiaoyu Wang ca39dfcf2d feat: show vgroup display num of cache tables 2023-03-13 17:21:32 +08:00
Haojun Liao 731a2138df fix(tmq): fix error in tmq. 2023-03-13 17:08:17 +08:00
Xiaoyu Wang 62377619ba enh: optimizing stt file reading in last query 2023-03-13 15:05:24 +08:00
Haojun Liao 7f2aae69d4 fix(tmq): fix error in taosx 2023-03-13 01:54:29 +08:00
Xiaoyu Wang 25778754e2 fix: last redundant read stt file 2023-03-12 22:36:26 +08:00
Xiaoyu Wang 45e38d258c fix: last redundant read stt file 2023-03-12 20:40:17 +08:00
Haojun Liao 564e9bb833 Merge branch 'main' into fix/liaohj 2023-03-12 14:38:38 +08:00
wangmm0220 0e2cf0ed73 fix:deal with ASSERT in tmq 2023-03-11 16:51:34 +08:00
Xiaoyu Wang a846c26ef9 merge main 2023-03-11 16:14:27 +08:00
wangmm0220 9cc7a9f504 fix:deal with ASSERT in tmq 2023-03-11 16:12:11 +08:00
Shengliang Guan 584f213739
Merge pull request #20401 from taosdata/fix/main_bugfix_wxy
fix: error in last cache handle deleted data
2023-03-11 15:43:55 +08:00
54liuyao 84ef1c78d4 fix:auto fill null column 2023-03-11 11:33:50 +08:00
Xiaoyu Wang 38a6d02ca9 Merge remote-tracking branch 'origin/main' into fix/main_bugfix_wxy 2023-03-11 10:58:47 +08:00
Benguang Zhao d679eaf648 enh: update pMnode->applied only when pMsg->code as zero 2023-03-10 18:10:34 +08:00
Xiaoyu Wang 11e55f028b fix: error in last cache handle deleted data 2023-03-10 17:49:27 +08:00
Hongze Cheng 7e071ff458 enh: optimize snapshot transfer 2023-03-10 16:01:40 +08:00
Shengliang Guan cf1bf07bbb
Merge pull request #20387 from taosdata/fix/main_bugfix_wxy
enh: optimize last/last_row cost when the cache was first loaded
2023-03-10 14:51:45 +08:00
Haojun Liao 05ddf68247 fix(tmq): fix invalid free. 2023-03-10 14:27:34 +08:00
Haojun Liao d8807d3d5a fix(tmq): fix memory leak. 2023-03-10 14:23:16 +08:00
Xiaoyu Wang 4e4f7de0ab enh: optimize last/last_row cost when the cache was first loaded 2023-03-10 12:00:17 +08:00
Haojun Liao 0d1b2e4b5a fix(tmq): use before remove hash item. 2023-03-10 10:31:53 +08:00
Shengliang Guan c70c9546f2
Merge pull request #20372 from taosdata/fix/main_bugfix_wxy
enh: optimize last/last_row cost when the cache was first loaded
2023-03-10 10:07:22 +08:00
Shengliang Guan 37bc466f59
Merge pull request #20373 from taosdata/fix/TS-2853
fix:get dest table version
2023-03-10 10:05:01 +08:00
Haojun Liao 691cb08e88 refactor: remove some unused attributes. 2023-03-10 09:23:03 +08:00
Haojun Liao 09e84884be refactor: remove invalid assert 2023-03-09 23:31:29 +08:00
Haojun Liao 03aa391859 fix(tmq): add lock before close the tsdbreader. 2023-03-09 23:03:51 +08:00
Benguang Zhao 96e70c2795 enh: update logging msg in vnodeRestoreFinish 2023-03-09 20:05:19 +08:00
54liuyao 5acf665b7e fix:get dest table version 2023-03-09 19:36:10 +08:00
Benguang Zhao 5e53b1225b enh: finish restore with commit and applied indexes instead of num of items in apply queue 2023-03-09 19:35:42 +08:00
Xiaoyu Wang 47417e003e enh: optimize last/last_row cost when the cache was first loaded 2023-03-09 18:54:15 +08:00
Benguang Zhao 1392711e66 enh: add fsm FpAppliedIndexCb to get the current applied index 2023-03-09 18:14:04 +08:00
Benguang Zhao 9d10739908 enh: send rsp of negotiation failure ahead of apply queue 2023-03-09 16:18:44 +08:00
Hongze Cheng afd01bb9b6 Merge branch 'main' of https://github.com/taosdata/TDengine into feat/TS-2846 2023-03-09 15:26:04 +08:00
Hongze Cheng 16262512b2 feat: alter stt_trigger and minrows 2023-03-09 15:25:47 +08:00
Shengliang Guan 00854f677c
Merge pull request #20335 from taosdata/fix/TD-22753
fix: unit  sma and tag index error msg
2023-03-09 15:20:47 +08:00
Xiaoyu Wang 66bb55187d Merge remote-tracking branch 'origin/main' into fix/3.0_merge_main 2023-03-08 18:30:24 +08:00
yihaoDeng 01a5d5d219 unit sma and tag index error msg 2023-03-08 18:16:29 +08:00
yihaoDeng d8d74b3514 unit sma and tag index error msg 2023-03-08 16:02:46 +08:00
Hongze Cheng 05688386a0 little fix 2023-03-08 15:19:55 +08:00
Hongze Cheng a56c99daac fix: add more msg check 2023-03-08 14:45:04 +08:00
Hongze Cheng b5b6f31023 Merge branch 'main' of https://github.com/taosdata/TDengine into feat/compact_with_time_range 2023-03-08 13:47:40 +08:00
Xiaoyu Wang 4c8bab7e58 merge main 2023-03-08 10:59:33 +08:00
Xiaoyu Wang 0dc34018b6 fix: insert data crash after empty table last cache 2023-03-08 10:06:48 +08:00
Hongze Cheng dc0d7c26ea Merge branch 'main' of https://github.com/taosdata/TDengine into feat/compact_with_time_range 2023-03-08 08:53:56 +08:00
Hongze Cheng 89281ee488 compact with time range 2023-03-07 21:46:34 +08:00
Shengliang Guan fe729a4756
Merge pull request #20305 from taosdata/fix/main_bugfix_wxy
fix: taosd crash when modify the schema and query last_row
2023-03-07 20:31:18 +08:00