Commit Graph

170 Commits

Author SHA1 Message Date
shenglian zhou cdb7eb462d Revert "Revert "fix: pass compilation""
This reverts commit 644dbad920.
2023-11-28 10:31:18 +08:00
shenglian zhou df4f7d6956 Revert "Revert "enhance: duration notification""
This reverts commit 3331e25aaf.
2023-11-28 10:31:18 +08:00
shenglian zhou 3331e25aaf Revert "enhance: duration notification"
This reverts commit 9dd306e1ef.
2023-11-28 08:29:05 +08:00
shenglian zhou 644dbad920 Revert "fix: pass compilation"
This reverts commit 1a7ee3643e.
2023-11-28 08:28:49 +08:00
slzhou 1a7ee3643e fix: pass compilation 2023-11-22 14:09:09 +08:00
shenglian zhou 9dd306e1ef enhance: duration notification 2023-11-22 13:56:16 +08:00
Haojun Liao 7a0dfdb0cc fix(tsdb): fix invalid read. 2023-11-22 08:40:10 +08:00
dapan1121 dfb3feb5dc Merge remote-tracking branch 'origin/main' into merge/m23 2023-11-15 11:39:18 +08:00
kailixu b9f389a49f Merge branch '3.0' into enh/TD-23769-3.0x 2023-11-08 08:36:35 +08:00
kailixu 6b738884a4 chore: rsma checkpoint 2023-11-07 19:59:05 +08:00
kailixu a48968e5e8 enh: rsma checkpoint 2023-11-03 14:33:45 +08:00
Haojun Liao b4d14d3847 fix(tsdb): fix error during add on-demand opening stt file reader. 2023-11-03 13:51:18 +08:00
Haojun Liao 675c9ca613 enh(tsdb): on-demand open stt file reader. 2023-11-03 13:51:18 +08:00
Haojun Liao c980e2030c fix(tsdb): fix error during add on-demand opening stt file reader. 2023-11-03 11:04:32 +08:00
Haojun Liao 0acf4f1795 enh(tsdb): on-demand open stt file reader. 2023-11-03 10:35:05 +08:00
kailixu ab266c712f chore: checkpoint for rsma stream state 2023-11-01 12:29:54 +08:00
Haojun Liao a1aa2380ae other: merge 3.0 2023-10-31 16:42:51 +08:00
Haojun Liao fc70fa053c fix(tsdb): fix syntax error. 2023-10-31 10:45:14 +08:00
Haojun Liao 6a7ba0f5f5 fix(tsdb): handle the case where stt not exists, possibly exists while the stt-trigger is 1. 2023-10-31 10:45:14 +08:00
Haojun Liao 00626de6e4 fix(tsdb): fix error in decide if data buffer overlaps with stt files/block-files. 2023-10-31 10:45:13 +08:00
Haojun Liao cb43299faa fix(tsdb): avoid to read duplicated rows in buf. 2023-10-31 10:45:13 +08:00
Haojun Liao 8b9bc988f1 fix(tsdb): fix syntax error. 2023-10-31 10:42:34 +08:00
Haojun Liao eaf76854f6 fix(tsdb): handle the case where stt not exists, possibly exists while the stt-trigger is 1. 2023-10-31 09:29:24 +08:00
Haojun Liao ed07486405 fix(tsdb): fix error in decide if data buffer overlaps with stt files/block-files. 2023-10-30 16:40:09 +08:00
Haojun Liao bc1c2a879a fix(tsdb): avoid to read duplicated rows in buf. 2023-10-30 16:12:08 +08:00
Hongze Cheng cdb1d8296d feat: concurrency on fileset 2023-10-27 17:48:19 +08:00
Haojun Liao 6dc8fc50bc
Merge pull request #23359 from taosdata/fix/3_liaohj
fix(tsdb): apply the window range when building blocks from stt files.
2023-10-21 14:57:14 +08:00
Haojun Liao f667bf3866 fix(tsdb): apply the window range when building blocks from stt files. 2023-10-20 18:19:45 +08:00
Haojun Liao f1207d8d42 fix(tsdb): apply the window range when building blocks from stt files. 2023-10-20 18:18:58 +08:00
Benguang Zhao 5c85525fd0 enh: add tsdbFSCreateRefSnapshotWithoutLock 2023-10-19 11:18:57 +08:00
Haojun Liao f98e454c5d
Merge pull request #23193 from taosdata/fix/3_liaohj
other: merge stream fix in main branch.
2023-10-16 15:17:04 +08:00
Haojun Liao fb2172933a fix(tsdb): enable pin stt datablock. 2023-10-16 13:26:06 +08:00
Haojun Liao 67bee17e5e other: merge main. 2023-10-16 09:55:41 +08:00
Haojun Liao f751f2bb3d fix(tsdb): enable pin stt datablock. 2023-10-16 09:49:51 +08:00
wade zhang 0f9da01c88
Merge pull request #23264 from taosdata/3.0_main_merge.2
3.0 main merge
2023-10-14 09:45:49 +08:00
Haojun Liao bd72d080a9
Merge pull request #23242 from taosdata/fix/liaohj
refactor: do some internal refactor.
2023-10-13 16:40:14 +08:00
dapan1121 a418307570
Merge pull request #23236 from taosdata/fix/TD-26658-3.0
enh: close stt before untake read snap
2023-10-13 14:16:47 +08:00
Haojun Liao 506c55001d fix(tsdb): fix race condition. 2023-10-12 17:57:03 +08:00
kailixu 3d32d55ea5 enh: close stt before untake read snap 2023-10-12 16:44:55 +08:00
Haojun Liao ea6ffac403 refactor: do some internal refactor. 2023-10-11 16:51:27 +08:00
Haojun Liao a03f09c00f refactor: update some logs. 2023-10-11 10:32:31 +08:00
Haojun Liao b4d7e66f19 other: add some logs. 2023-10-10 19:57:17 +08:00
Haojun Liao 0047d1e1a6 Merge branch 'main' into fix/liaohj 2023-09-28 14:35:14 +08:00
Haojun Liao 0a8f4530f7 fix(tsdb): replace destroy with reset. 2023-09-28 11:42:19 +08:00
kailixu e1cd54a1b3 fix: rwlock reentrant problem on windows 2023-09-26 15:44:35 +08:00
kailixu c680180894 fix: rwlock reentrant problem on windows 2023-09-26 15:37:29 +08:00
Haojun Liao fd6344b319 fix(tsdb): check return code. 2023-09-14 09:25:35 +08:00
Haojun Liao 9b70c0c457 fix:fix coverity issue and remove unnecessary files. 2023-09-14 09:06:10 +08:00
wade zhang f4e785788a
Merge pull request #22833 from taosdata/fix/TS-3943-3.m
fix: neighbor block overlap judgement
2023-09-12 11:51:03 +08:00
Haojun Liao a5b93aaf97 fix(tsdb): fix invalid read. 2023-09-11 23:55:34 +08:00
Haojun Liao e8f7146a2c fix(tsdb): check the schema before merge rows in buffer, and do some refactor. 2023-09-11 22:19:10 +08:00
kailixu 78d136dffd fix: neighbor block overlap judgement 2023-09-11 15:10:39 +08:00
dapan1121 cc17848b78 fix: merge 3.0 to main 2023-09-01 13:24:47 +08:00
Haojun Liao 0c599fa869
Merge pull request #22415 from taosdata/szhou/tsdb-neigh-block
tsdb neighbouring block search and set it to global block iterator
2023-08-31 09:46:37 +08:00
Haojun Liao b740ce8ad6 fix(tsdb): add more check for block rows to detect the duplicate rows in data block. 2023-08-29 17:49:43 +08:00
shenglian-zhou 1965703d53
Merge branch '3.0' into szhou/tsdb-neigh-block 2023-08-24 10:58:23 +08:00
Haojun Liao cbd24bb254 refactor: do some internal refactor 2023-08-16 18:20:34 +08:00
Haojun Liao 4ea58e5682 refactor: do some internal refactor. 2023-08-16 11:44:05 +08:00
Haojun Liao 6609882f9f fix(tsdb): add stt statistics block buffer, and do some internal refactor. 2023-08-16 10:55:07 +08:00
shenglian zhou 46f92d222d fix: typo error 2023-08-14 08:52:25 +08:00
slzhou 8e7fc91095 enhance: set file data block iter 2023-08-13 18:30:30 +08:00
shenglian zhou eb9d77d639 ehance: destroy blocklist of table scan info, add block global index list to table scan info 2023-08-11 16:33:49 +08:00
shenglian zhou e9e06d1eae fix: restore stt block/data block merge back 2023-08-09 10:36:54 +08:00
shenglian zhou 2b1478f46e Revert "fix(tsdb/read2): reset stt reader when suspended"
This reverts commit 079d7ff69e.
2023-08-09 10:36:26 +08:00
slzhou 1cb1451e41 fix: set nextIndex when get neighbouring index 2023-08-03 18:26:29 +08:00
Minglei Jin 079d7ff69e fix(tsdb/read2): reset stt reader when suspended 2023-07-31 15:21:47 +08:00
Haojun Liao 087d54a807
Merge pull request #22198 from taosdata/fix/3_liaohj
fix(stream): do filter before the update check.
2023-07-26 18:57:48 +08:00
Haojun Liao 6a6830761d fix(tsdb): check for null ptr of pScanInfo 2023-07-26 17:08:29 +08:00
shenglian zhou 1357e623d0 fix: fix compilation error 2023-07-26 15:43:50 +08:00
shenglian zhou 79020ea4a4 fix: stt and data block merge 2023-07-26 15:01:20 +08:00
Minglei Jin 1bce96ea27 fix(tsdb/pageSize): use tsdbPageSize instead of szPage(tdb's) 2023-07-25 10:46:03 +08:00
Minglei Jin 463b5b608b tsdb/read2: fix null pointer runtime error 2023-07-17 18:35:56 +08:00
Minglei Jin 62cfda1a88 tsdb/read2: fix UAF 2023-07-17 17:35:08 +08:00
Minglei Jin 832b68e17d tsdb/cache: load mem del data 2023-07-17 15:48:08 +08:00
Minglei Jin a05383e29e tsdb/cache: new load tomb callback from tsdb mergetree 2023-07-17 15:07:10 +08:00
Minglei Jin 2b21c5e0f6 tsdb2: adapt cache with tsdb2 API 2023-07-17 08:50:54 +08:00
Haojun Liao 98349a4265 refactor(tsdb): do some internal refactor. 2023-07-09 18:05:24 +08:00
Haojun Liao ba4d726af6 fix(tsdb): fix error in tsdbread. 2023-07-09 01:31:02 +08:00
Haojun Liao b39198a53a refactor: do some internal refactor. 2023-07-08 21:44:58 +08:00
Haojun Liao 14844c7b4b refactor(tsdb): opt tsdb read perf 2023-07-08 21:25:11 +08:00
Haojun Liao a94ace4cc8 refactor:do some internal refactor. 2023-07-06 15:10:45 +08:00
Haojun Liao 851f6df094 enh(tsdb): opt perf. 2023-07-06 09:58:15 +08:00
Haojun Liao aeb9473382 enh(tsdb): add some logs. 2023-07-05 19:41:34 +08:00
Haojun Liao a0a116b674 fix(tsdb): fix error in sma extracting and do NOT clear fileDelData when extracting data from stt files. 2023-07-05 19:11:14 +08:00
Haojun Liao a738b6eba6 fix(tsdb): add empty del skyline check. 2023-07-05 17:43:41 +08:00
Haojun Liao f35db3ba6c fix(tsdb): add none check. 2023-07-05 17:36:55 +08:00
Haojun Liao f0cec22d4f fix(tsdb): fix some error. 2023-07-05 17:20:17 +08:00
Haojun Liao 8c8aa5cd57 fix(tsdb): fix error in extract brinblock. 2023-07-05 16:39:04 +08:00
Haojun Liao 7d7e12a5e7 fix(tsdb): fix syntax error. 2023-07-05 11:22:58 +08:00
Haojun Liao 6e15478c43 fix(tsdb): do some internal refactor. 2023-07-05 10:31:38 +08:00
Haojun Liao 8ab10a8da1 fix(tsdb): fix error in check tomb record. #TD-25117 2023-07-05 10:30:55 +08:00
Haojun Liao 37ff3a419a fix(tsdb): fix error in load tomb from stt files. 2023-07-04 23:35:52 +08:00
Hongze Cheng 8384b6ce29 fix CI case 2023-07-03 15:01:05 +08:00
Haojun Liao 9e98c64b1e fix(tsdb): set correct stt load info. update the test case. 2023-06-30 22:57:49 +08:00
Haojun Liao 15487c9c8f fix(tsdb): fix memory leak. 2023-06-29 22:52:07 +08:00
Haojun Liao 17c6b9f81b fix(tsdb): fix error in set file reader. 2023-06-29 18:40:14 +08:00
Haojun Liao 81eb8523f1 fix(tsdb): fix invalid ptr. 2023-06-29 15:09:01 +08:00
Haojun Liao ba38a625cf fix(stream): remove the shared ptr between reader ptr. 2023-06-29 13:42:23 +08:00
Haojun Liao c4a6b85bdf fix(tsdb): support stt and file block overlap. 2023-06-28 22:38:51 +08:00
Haojun Liao 9116a4092a fix(tsdb):fix memory leak. 2023-06-28 01:04:58 +08:00