Commit Graph

10820 Commits

Author SHA1 Message Date
Haojun Liao c2588d71c3
Merge pull request #22173 from taosdata/fix/TS-3728
fix:avoid request offset type is 0
2023-07-25 14:59:30 +08:00
wade zhang 2bf84c2676
Merge pull request #22179 from taosdata/FIX/TS-3702-3.0
enh: compatibility between getFileNamePrefix and tsdbTFileName
2023-07-25 14:26:14 +08:00
Benguang Zhao 01f45b2a99 enh: compatibility between getFileNamePrefix and tsdbTFileName 2023-07-25 11:35:35 +08:00
Minglei Jin 1bce96ea27 fix(tsdb/pageSize): use tsdbPageSize instead of szPage(tdb's) 2023-07-25 10:46:03 +08:00
wade zhang 7ea9cf1ddc
Merge pull request #22166 from taosdata/fix/TD-24422
fix(tsdb/cache): reuse data file reader
2023-07-25 10:28:59 +08:00
Haojun Liao 96722a07b1
Merge pull request #22174 from taosdata/fix/3_liaohj
fix(stream): fix the invalid check of step2 .
2023-07-25 00:30:06 +08:00
Haojun Liao a2694b9ce9 fix(stream): fix the invalid check of step2 . 2023-07-24 19:44:28 +08:00
Haojun Liao c0e35df927
Merge pull request #22131 from taosdata/mark/tmq
fix:optimize log & change return value for async interface
2023-07-24 19:40:01 +08:00
wangmm0220 6a0e994169 fix:avoid request offset type is 0 2023-07-24 19:24:05 +08:00
Haojun Liao d36903bf08
Merge pull request #22162 from taosdata/fix/3_liaohj
fix(stream): add some logs, and remove the invalid loop.
2023-07-24 16:29:51 +08:00
dapan1121 dce1f579ea
Merge pull request #22143 from taosdata/enh/TD-24987-3.0
enh: expire time optimize
2023-07-24 16:18:59 +08:00
wangmm0220 9628a9f74e fix:open info log in tmq & ignore wal apply ver when read wal 2023-07-24 15:53:02 +08:00
kailixu 7946ce4994 chore: code optimization 2023-07-24 14:46:59 +08:00
Minglei Jin 424dd40078 tsdb/cache: reuse pDataFileReader for same fileset 2023-07-24 14:45:35 +08:00
kailixu cf59a6cff0 chore: set user for dm transport 2023-07-24 14:24:47 +08:00
Haojun Liao 9bae91bcba fix(stream): add some logs, and remove the invalid loop. 2023-07-24 13:37:44 +08:00
Haojun Liao 13bab114cb
Merge pull request #22155 from taosdata/fix/3_liaohj
fix(stream): refactor the halt status to check more status.
2023-07-24 11:04:08 +08:00
Minglei Jin 968cfd9e65 tsdb/cache: pLastIter null pointer check 2023-07-24 11:03:07 +08:00
wade zhang 5f25d70fc2
Merge pull request #22154 from taosdata/enh/tsdb_optimize
fix(tsdb/cache): new next stt row state for fs tranverse
2023-07-24 10:47:51 +08:00
Haojun Liao 1367552f38 fix(stream): refactor the halt status to check more status. 2023-07-24 10:04:15 +08:00
Haojun Liao 6a19ad3127
Merge pull request #22151 from taosdata/fix/3_liaohj
fix(stream): set the correct flag of pause/resume.
2023-07-24 09:07:49 +08:00
Minglei Jin 13491fab95 tsdb/cache: new next stt row state for fs tranverse 2023-07-24 08:51:20 +08:00
Haojun Liao 0b6e1a12bb refactor: do some internal refactor. 2023-07-23 19:09:43 +08:00
Haojun Liao e387b2f932 refactor: do some internal refactor. 2023-07-23 18:59:34 +08:00
Haojun Liao 4e0f7ffbf8 fix(stream): set the correct flag of pause/resume. 2023-07-23 18:49:56 +08:00
Haojun Liao 321be1f83f
Merge pull request #22135 from taosdata/fix/3_liaohj
refactor: do some internal refactor.
2023-07-22 15:06:28 +08:00
Haojun Liao bfc4a07207 fix(stream): fix memory leak. 2023-07-22 00:20:02 +08:00
Haojun Liao 1b2636028a fix(stream): fix memory leak. 2023-07-21 23:05:42 +08:00
wangmm0220 8f15795cc1 fix:judge if pTopic is NULL 2023-07-21 19:47:31 +08:00
Haojun Liao 16d7707b90 fix(stream): align the scan real time data for stream task. 2023-07-21 19:33:43 +08:00
wade zhang 7b1e809d98
Merge pull request #21794 from taosdata/enh/tsdb_optimize
for test purpose
2023-07-21 14:18:32 +08:00
wangmm0220 bb86f5c580 fix:commit offset should not plus 1 2023-07-21 11:13:05 +08:00
wangmm0220 10ebf1f438 fix:subscribeStb.py maybe failed 2023-07-21 11:07:34 +08:00
Haojun Liao d0da988b7d Merge branch '3.0' into fix/3_liaohj 2023-07-21 09:47:44 +08:00
Haojun Liao 39ca9b537f fix(stream): fix syntax error 2023-07-21 09:43:08 +08:00
dapan1121 d81727afa9
Merge pull request #22130 from taosdata/fix/TD-25270
enh: support show create table for system tables
2023-07-21 09:26:11 +08:00
Haojun Liao c9d75eab5a refactor: do some internal refactor. 2023-07-21 09:16:13 +08:00
Haojun Liao db46d31ca5 fix(stream): refactor the halt function. 2023-07-21 01:32:42 +08:00
Ganlin Zhao 076a425d53 fix: fix show create table issue for system tables 2023-07-20 17:21:24 +08:00
Haojun Liao 9353f7c8cf refactor: do some internal refactor. 2023-07-20 16:35:02 +08:00
Haojun Liao c9fa170e65 refactor: do some internal refactor. 2023-07-20 16:31:46 +08:00
Haojun Liao 45cb478b31 refactor: do some internal refactor. 2023-07-20 15:36:46 +08:00
Haojun Liao 87fa8f0c4c Merge branch '3.0' into fix/3_liaohj 2023-07-20 12:15:23 +08:00
Haojun Liao aed99da6c1 refactor: refactor the stream task starting order. 2023-07-20 12:14:53 +08:00
Minglei Jin 48222f5dc3 tsdb/cache: move data file reader for fs iter to cache reader 2023-07-20 09:11:26 +08:00
Minglei Jin 6dd4ec41ae tsdb/cache cleanup: remove unused fs methods 2023-07-20 08:51:03 +08:00
Minglei Jin 7f0ea10573 Merge branch 'enh/tsdb_optimize' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-07-20 08:42:12 +08:00
Minglei Jin 46d6dcda3e tsdb/cache: reset skyline when clearing fileset 2023-07-20 08:41:32 +08:00
Haojun Liao bfcc538205 fix(tsdb):disable stt statistics. 2023-07-20 00:01:30 +08:00
wangmm0220 9378a0ef83 Merge branch 'main' of https://github.com/taosdata/TDengine into mark/tmq 2023-07-19 23:42:23 +08:00
Haojun Liao 97c44e7c18 refactor: do some internal refactor. 2023-07-19 18:42:02 +08:00
wangmm0220 d7d81d82a0 feat:add committed & position & commite_offset interface 2023-07-19 18:27:19 +08:00
Minglei Jin ce71b8bbe7 Merge branch 'enh/tsdb_optimize' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-07-19 18:11:14 +08:00
Minglei Jin 4eaecd11de tsdb/cache: merge fs & stt row 2023-07-19 18:10:36 +08:00
dapan1121 cbe03ef212
Merge pull request #22069 from taosdata/enh/TS-2288
enh: add scope for show xx variables
2023-07-19 18:01:11 +08:00
wangmm0220 5cb35f2fa6 feat:add committed & position & commite_offset interface 2023-07-19 17:29:39 +08:00
Haojun Liao 37ae80d135 fix(tsdb): fix memory leak. 2023-07-19 16:42:51 +08:00
tangfangzhi 69fae62003 error message 2023-07-19 15:04:39 +08:00
Haojun Liao d82fb45a4f Merge remote-tracking branch 'origin/enh/tsdb_optimize' into enh/tsdb_optimize 2023-07-19 15:01:37 +08:00
Haojun Liao a84efab2c8 enh(tsdb): add table filter according to stt block statistics data. 2023-07-19 15:01:25 +08:00
Minglei Jin 913cfe43e8 tsdb/cache: remove input[3] 2023-07-19 12:20:54 +08:00
Minglei Jin 7a716d452e tsdb/fs2: fix vnode get primary dir args 2023-07-19 11:36:26 +08:00
Minglei Jin 4b96bc7147
Merge branch '3.0' into enh/tsdb_optimize 2023-07-19 11:15:57 +08:00
Shungang Li 1d88a6a7c6 enh: ttlMgrFlush adjust log level 2023-07-19 11:15:54 +08:00
Minglei Jin 185081a948 tsdb/fsreader: clear last fileset's resources 2023-07-19 11:04:28 +08:00
tangfangzhi 4cdfd0e1e8 conflict 2023-07-19 10:50:46 +08:00
wade zhang c3e5375f15
Merge pull request #22085 from taosdata/FEAT/TS-2699-3.0
feat: distribute vnode primary dirs among disks of level 0
2023-07-19 09:44:43 +08:00
wangmm0220 5c344b0159 fix:conflicts from main 2023-07-19 09:05:05 +08:00
Haojun Liao 9513f76172 fix(stream): set downstream task ready state. 2023-07-18 19:02:24 +08:00
wade zhang 5f6afc6661
Merge pull request #22107 from taosdata/fix/TD-25232
fix/TD-25232: alter keeptimeoffset by 'k v' or 'k' 'v'
2023-07-18 18:30:30 +08:00
Minglei Jin a127e91534 tsdb/cache skyline: first round implementation of cache skyline 2023-07-18 17:17:06 +08:00
Benguang Zhao 224f90761e fix: set wrapperCfg.diskPrimary in vmProcessAlterVnodeTypeReq 2023-07-18 16:57:52 +08:00
Shungang Li dfaf9134c6 fix: alter keeptimeoffset by 'k v' or 'k' 'v' 2023-07-18 16:04:38 +08:00
Benguang Zhao 02f4613154 enh: report VND_INIT_FAILED on vnodes open failure in vmOpenVnodes 2023-07-18 15:44:51 +08:00
Benguang Zhao 2faa3d2e7b enh: check validity of diskPrimary during vnodeOpen 2023-07-18 15:39:29 +08:00
Minglei Jin 9f9efe9a5e tsdb/cache reader: remove dataf & dataf last readers 2023-07-18 15:30:31 +08:00
wangmm0220 08c50dfbb4 fix:add sdbFetchCancel to release hash node 2023-07-18 15:21:35 +08:00
wangmm0220 2c80d7e621 Merge branch 'main' of https://github.com/taosdata/TDengine into fix/TS-3672 2023-07-18 14:59:06 +08:00
Benguang Zhao 24fed51137 enh: tfsRename dir on primary disk at last 2023-07-18 13:58:43 +08:00
Benguang Zhao 5624ecc8df fix: prepare vnode dir recursively in vnodeCreate 2023-07-18 11:32:23 +08:00
Benguang Zhao 6b6b7d8d8f enh: alloc disk of vnode primary dir in vmAllocPrimaryDisk 2023-07-18 11:32:23 +08:00
dmchen 97a81bd8ed fix/TD-25179 2023-07-18 11:27:01 +08:00
wangmm0220 6c35081507 fix:add sdbFetchCancel to release hash node 2023-07-18 09:54:35 +08:00
wade zhang 7e89622149
Merge pull request #22092 from taosdata/fix/TD-25232
fix/TD-25232: alter dnode keeptimeoffset err
2023-07-18 09:10:40 +08:00
dapan1121 73c6666e62
Merge pull request #22096 from taosdata/fix/TD-25210-3.0
fix: add sma option when show create table for stb/ntb
2023-07-18 09:09:49 +08:00
kailixu cf39fcdd12 fix: add sma option when show create table for stb/ntb 2023-07-17 22:24:27 +08:00
wangmm0220 da9e30434a fix:add sdbFetchCancel to release hash node 2023-07-17 20:21:23 +08:00
wangmm0220 8d8e12ee0d fix:add sdbFetchCancel to release hash node 2023-07-17 20:20:34 +08:00
Minglei Jin 998fbe574d tsdb/cache reader: move suid into reader's info field 2023-07-17 19:10:33 +08:00
Shungang Li 1d0c73feb6 fix: alter dnode keeptimeoffset err 2023-07-17 18:37:00 +08:00
Minglei Jin 463b5b608b tsdb/read2: fix null pointer runtime error 2023-07-17 18:35:56 +08:00
Minglei Jin 62cfda1a88 tsdb/read2: fix UAF 2023-07-17 17:35:08 +08:00
dapan1121 3c7924ed8d
Merge pull request #22081 from taosdata/enh/TD-24920-3.0
enh: dm monitor refactor
2023-07-17 17:12:50 +08:00
Ganlin Zhao 929db3d647 Merge branch '3.0' into enh/TS-2288 2023-07-17 16:09:07 +08:00
Ganlin Zhao 13e6a04e8f fix scope 2023-07-17 15:56:21 +08:00
Minglei Jin 832b68e17d tsdb/cache: load mem del data 2023-07-17 15:48:08 +08:00
Minglei Jin a05383e29e tsdb/cache: new load tomb callback from tsdb mergetree 2023-07-17 15:07:10 +08:00
Minglei Jin 27b8671f97 tsdb/cache: new cacheReader field for tsdb & cache reader 2023-07-17 14:27:27 +08:00
Minglei Jin 9b0b4061e0 tsdb/cache: relayout cache row reader 2023-07-17 14:16:54 +08:00
Benguang Zhao b21e603481 enh: add the field diskPrimary to vnodeGetPrimaryDir, and entries of vnodes.json 2023-07-17 11:48:48 +08:00