Commit Graph

275 Commits

Author SHA1 Message Date
Haojun Liao 018e6f2a71 refactor: do some internal refactor. 2024-03-22 17:18:31 +08:00
Haojun Liao 2ec24c1e04 refactor: do some internal refactor. 2024-03-22 16:43:34 +08:00
Haojun Liao 7d2110bb12 refactor: do some internal refactor. 2024-03-22 15:09:30 +08:00
Haojun Liao a8a0e3edf8 refactor: do some internal refactor. 2024-03-22 14:47:00 +08:00
Haojun Liao 8c5ec3205c refactor: do some internal refactor. 2024-03-22 10:56:04 +08:00
Haojun Liao ecd09059f5 fix(tsdb): fix error in reading data from file block 2024-03-22 10:16:56 +08:00
Haojun Liao 8bdd12c3a8 refactor: do some internal refactor. 2024-03-21 17:47:40 +08:00
Haojun Liao fd8f065c67 refactor: do some internal refactor. 2024-03-21 15:08:23 +08:00
Haojun Liao 0c578ab6c0 refactor: do some internal refactor. 2024-03-21 10:44:27 +08:00
Haojun Liao b12e65d144 fix(tsdb): set pk column index. 2024-03-21 09:37:46 +08:00
Haojun Liao 1d77cde433 refactor: do some internal refactor. 2024-03-20 23:03:48 +08:00
Haojun Liao 55f7bc2c9c fix(tsdb):add attributes for ssdatablock. 2024-03-20 15:29:05 +08:00
Haojun Liao 78b0d3fa74 fix(tsdb): fix error in comparing pk. 2024-03-20 14:27:48 +08:00
Haojun Liao 5ed0283494 fix(tsdb): support composite primary key. 2024-03-20 14:17:37 +08:00
Haojun Liao 6795f6e1cc fix(tsdb): handle the case that no stt statistics info existsin stt files generated by early version of TDengine. 2024-03-19 15:16:46 +08:00
Haojun Liao 15e65d5f07 refactor: do some internal refactor. 2024-03-16 22:42:49 +08:00
Haojun Liao 34c849bdbe enh(tsdb): read composed key in stt. 2024-03-14 17:03:57 +08:00
Haojun Liao 2b7fd0d15c fix(tsdb): set strict varchar length check. 2024-03-14 10:04:14 +08:00
Haojun Liao 0315e5ac63 feat(tsdb): read complex primary key from buf. 2024-03-12 16:22:56 +08:00
Haojun Liao bc98f12798 feat(tsdb): read complex primary key from buf. 2024-03-12 14:06:59 +08:00
Hongze Cheng acbde220bf more bug fix 2024-03-08 17:04:26 +08:00
Hongze Cheng f43a7a6153 fix copy bug 2024-03-07 15:43:15 +08:00
Hongze Cheng a6423b7816 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TS-4243-3.0 2024-02-23 14:47:10 +08:00
Hongze Cheng aaa36b580e more code 2024-02-23 14:44:46 +08:00
Haojun Liao da0265ddde fix(tsdb): set correct error code info extract method. 2024-02-22 15:52:47 +08:00
Hongze Cheng 665cc2c2c4 more code change 2024-02-22 10:13:35 +08:00
Hongze Cheng 4b71031014 more code 2024-02-21 14:29:10 +08:00
Hongze Cheng 52ed1ec5f7 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TS-4243-3.0 2024-02-18 09:52:53 +08:00
Haojun Liao 6736fd1615 fix(tsdb): check and return if the rows in stt are before the data rows in data files. 2024-02-04 14:11:17 +08:00
Hongze Cheng b79859d2a3 more code 2024-02-02 12:26:05 +08:00
Haojun Liao 3236ef7bae feat(stream): return the stream source task exec delay, and do some internal refactor. 2024-02-02 11:26:47 +08:00
Haojun Liao cb2ea4a721 fix(stream): take ver snapshot for all vgroups before launching stream with fill-history option opened. 2024-02-01 11:37:57 +08:00
Haojun Liao d1dbd03341 fix(tsdb): fix invalid set. 2024-01-17 17:29:00 +08:00
Haojun Liao d44dc5bbb2 fix(tsdb): fix race condition. 2024-01-17 15:20:17 +08:00
factosea 2c0dd3db03 fix: memory leak 2024-01-15 16:41:52 +08:00
dapan1121 3b928237d7
Merge pull request #24419 from wangjiaming0909/draft/fix/TD-28182
fix: table merge scan return disordered rows
2024-01-12 10:16:21 +08:00
wangjiaming0909 686108050b fix: table merge scan return disordered rows 2024-01-11 09:57:35 +08:00
Haojun Liao b0202bb853 fix(tsdb): open reader during resume task for main reader after suspending reader. 2024-01-10 13:44:21 +08:00
Haojun Liao 1b6d55616f fix(stream): fix syntax error. 2024-01-10 11:28:06 +08:00
Haojun Liao eac0d14868 fix(stream): add check when merging rows from files and buffer. 2024-01-10 11:02:44 +08:00
wangmm0220 6444af84e4 opti:[TD-28142]memory size if block num is too large 2024-01-09 16:28:58 +08:00
dapan1121 f0fbffa772
Merge pull request #24301 from taosdata/fix/3.0/TD-28104
fix: last table scan reported invalid param when col was dropped which
2024-01-03 15:47:33 +08:00
Haojun Liao 5bbf12c2c9 fix(tsdb): check if stt blocks are clean before building composed data blocks. 2024-01-02 18:35:17 +08:00
wangjiaming0909 be0d35a5af fix: last table scan reported invalid param when col was dropped which
should report invalid col
2024-01-02 10:20:04 +08:00
Hongze Cheng a7c8563c06 fix: remove useless code 2023-12-25 16:13:30 +08:00
Haojun Liao e5087f6e23 fix(tsdb): fix invalid delete check. 2023-12-25 10:40:36 +08:00
Haojun Liao 00fac852e8 fix(tsdb): fix invalid delete check. 2023-12-25 09:55:24 +08:00
Haojun Liao 81d8b2434f refactor: do some internal refactor. 2023-12-20 10:25:31 +08:00
Haojun Liao 541967e99e refactor: do some internal refactor. 2023-12-20 10:24:03 +08:00
Haojun Liao bba5a4f08b other: merge main into 3.0 2023-12-18 18:26:42 +08:00
Haojun Liao 0526e619ad
Merge pull request #24095 from taosdata/fix/3_liaohj
fix(tsdb): add desc check for clean file block.
2023-12-16 18:10:15 +08:00
Haojun Liao 4cc0f5be59 fix(tsdb): add desc check for clean file block. 2023-12-16 15:37:17 +08:00
slzhou 8a6317b76a Merge branch '3.0' of github.com:taosdata/TDengine into szhou/fix-tms-duration 2023-12-15 22:09:43 +08:00
Haojun Liao e2fa4cba8c refactor: do some internal refactor. 2023-12-15 15:28:01 +08:00
shenglian zhou cc4a6c6d55 fix: add new duration block event 2023-12-15 15:04:47 +08:00
slzhou d3146a5bec fix: when no file block, no proc mem before fileset 2023-12-15 09:51:06 +08:00
slzhou 5bf364cc0a enhance: refactor code 2023-12-15 08:23:25 +08:00
slzhou 4dc39e74c5 fix: the block return from buildBlockFromFiles should be of new fileset 2023-12-14 16:57:04 +08:00
Haojun Liao 88a8e4e9f0 fix(tsdb): fix syntax error. 2023-12-13 17:01:55 +08:00
Haojun Liao 840b457308 fix(tsdb): fix error in tsdb read. 2023-12-13 17:00:39 +08:00
Haojun Liao 9acd4af1f9 fix(tsdb):fix capacity rows value. 2023-12-09 01:49:55 +08:00
Haojun Liao 5528c2bf67 fix(tsdb): do some internal refactor. 2023-12-08 23:47:49 +08:00
Haojun Liao f2592f7399 fix(tsdb): prepare the memory buffer. 2023-12-08 23:44:05 +08:00
Haojun Liao 67d967e22f fix(tsdb): check the overlap between stt blocks and data file blocks. 2023-12-08 18:48:00 +08:00
Haojun Liao 9c72ce846e fix(tsdb): add more condition for not load data. 2023-12-08 14:23:37 +08:00
Haojun Liao da1207ef74 fix(tsdb): add return flag for stt files. 2023-12-08 11:07:45 +08:00
Haojun Liao 2e13b0b97d refactor: do some internal refactor. 2023-12-08 10:43:17 +08:00
Haojun Liao 9477146b30 fix(tsdb): fix syntax error. 2023-12-08 10:29:38 +08:00
Haojun Liao 4ffaff4d50 other: merge 3.0 2023-12-08 10:14:42 +08:00
Haojun Liao 446c14da72 fix(tsdb): opt read stt file 2023-12-08 10:03:36 +08:00
dapan1121 a2ee41233e
Merge pull request #23835 from taosdata/szhou/tms-duration
feat: tsdb output in duration order
2023-12-08 09:07:41 +08:00
Haojun Liao 7c17d6f313 fix(tsdb): opt read performance by check clean stt block if only row number required. 2023-12-07 23:12:54 +08:00
shenglian zhou a2e7c78d27 refactor: rename variables 2023-12-06 09:39:38 +08:00
Haojun Liao cb8dfae0cc refactor: do some internal refactor. 2023-12-05 10:47:19 +08:00
slzhou e690076331 Merge branch '3.0' of github.com:taosdata/TDengine into szhou/tms-duration 2023-12-05 09:53:29 +08:00
Haojun Liao 7145a7b8a1 fix(tsdb): calculate the rows in next fileset. 2023-12-04 18:03:32 +08:00
Haojun Liao 6d82900a32 fix(tsdb): fix error in block dist. 2023-12-04 18:00:41 +08:00
slzhou 8c290587b7 fix: typo error 2023-12-04 16:19:07 +08:00
Haojun Liao 24d9337632 enh(tsdb): extract rows for the given tables in all stt files. 2023-12-04 15:38:24 +08:00
slzhou a517271f39 Merge branch 'szhou/tms-duration-2' into szhou/tms-duration 2023-12-04 14:56:19 +08:00
slzhou 07e43fe56b fix: two intervals are intesected or not 2023-12-04 14:54:15 +08:00
Haojun Liao 5467bba86b fix(tsdb): do some internal refactor. 2023-12-04 09:03:40 +08:00
Haojun Liao 7b0cf47fd6 fix(tsdb): do some internal refactor. 2023-12-04 08:58:10 +08:00
Haojun Liao 29a1c6d518 fix(tsdb): do some internal refactor. 2023-12-04 08:55:53 +08:00
shenglian zhou bff88e0639 fix: set duration order api 2023-12-01 16:27:36 +08:00
slzhou 82629c2658 fix: notify when there are no memory pre fileset 2023-12-01 15:11:43 +08:00
slzhou 4d755562af fix: resolve conflicts 2023-12-01 13:02:14 +08:00
Haojun Liao e008d0f440 fix(tsdb): fix invalid read. 2023-12-01 10:20:45 +08:00
Haojun Liao fbb604d1f5 fix(tsdb): fix bugs in suspend/resume. adjust code to conduct the test more easily. td-27579 2023-12-01 10:20:44 +08:00
Haojun Liao 1c9ff8030b fix(tsdb):clear the tsdb stt file reader flag when suspending the tsdbReader 2023-12-01 10:20:39 +08:00
slzhou 80ee5bfb3e fix: the initial value of first fileset start / end key 2023-11-30 11:08:18 +08:00
Haojun Liao 28e17a61b9 fix(tsdb): fix invalid read. 2023-11-29 19:28:53 +08:00
Haojun Liao 66f25712fd fix(tsdb): fix bugs in suspend/resume. adjust code to conduct the test more easily. td-27579 2023-11-29 18:07:15 +08:00
slzhou 1a3e280ea8 fix: use imem maxKey/minKey 2023-11-29 13:50:53 +08:00
slzhou 09e314c3ae fix: pStatus->pTableIter is set to null when getting mem table time range 2023-11-29 12:26:32 +08:00
shenglian zhou 4691a7767a restore buildBlockFromBufferSequentially back 2023-11-29 10:29:40 +08:00
shenglian zhou 8a79df1113 enhance: prepare duration for next fileset 2023-11-29 10:15:43 +08:00
shenglian zhou 765b8384c0 Merge branch 'szhou/tms-duration' of github.com:taosdata/TDengine into szhou/tms-duration-2 2023-11-29 08:18:27 +08:00
slzhou b2fa6209d9 fix: descending traverse wrong endkey 2023-11-29 08:09:00 +08:00
Haojun Liao a5c8eaacaa fix(tsdb):clear the tsdb stt file reader flag when suspending the tsdbReader 2023-11-28 23:52:19 +08:00