Commit Graph

10305 Commits

Author SHA1 Message Date
Haojun Liao 43ad35f911 refactor: adjust the lock procedure for unregister stream tasks. 2024-12-06 09:20:39 +08:00
Haojun Liao 406e877700 fix(stream): send chkpt-source rsp to mnd even if it is failed. 2024-12-06 00:11:51 +08:00
wangmm0220 0165684131 feat:[TD-32642] merge from 3.0 2024-12-05 23:47:46 +08:00
Minglei Jin d88e8d297a release simple hash 2024-12-05 18:35:15 +08:00
Minglei Jin 2b062ed146 tsdb/cache: merge lru with mem 2024-12-05 17:13:59 +08:00
dmchen 302758db1b fix/skip-trim-during-restore 2024-12-05 17:08:18 +08:00
Hongze Cheng 60ffaddc92 fix: CI issue 2024-12-05 16:57:25 +08:00
yihaoDeng c5c56606c4 use safe sys func 2024-12-05 16:35:45 +08:00
Hongze Cheng a51be1cee3 fix: invalid logic 2024-12-05 14:50:00 +08:00
Hongze Cheng 96b9e3d20e fix error 2024-12-05 13:41:54 +08:00
Hongze Cheng 98c7111f13 fix: compile issue 2024-12-04 19:28:35 +08:00
Hongze Cheng 23fb0fcc24 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/TD-29367-3.0 2024-12-04 17:39:41 +08:00
Hongze Cheng 3e06712493 refact: create super table code 2024-12-04 17:39:28 +08:00
Minglei Jin 65e6c04a2d tsdb/cache: iterator for mem row 2024-12-04 14:14:54 +08:00
yihaoDeng 215208a985 Replace unsafe memory functions with safe versions 2024-12-04 13:35:11 +08:00
Minglei Jin a0509ab93d tsdb/cache: framework for merging lru & mem 2024-12-04 09:57:15 +08:00
Haojun Liao 3847ed2dc9 refactor: 1) adjust wal scan interval to be 500ms, 2) record the checkpointVer to be timestamp for force_window_close, 3) do some other internal refactor. 2024-12-04 09:43:51 +08:00
kailixu 92471c5834 feat: add time range list for auto compact 2024-12-03 17:51:41 +08:00
Hongze Cheng 8120765b24 Make a copy of old code 2024-12-03 17:00:37 +08:00
Hongze Cheng cc1da2ebc7 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/TD-29367-3.0 2024-12-03 16:39:52 +08:00
kailixu 583c4e8bb6 Merge branch '3.0' into enh/TD-30933-3.0 2024-12-03 15:28:19 +08:00
Hongze Cheng 3d2a5be1b6 more code 2024-12-03 15:20:27 +08:00
Hongze Cheng 25b9de5d51 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TS-4994-3.0 2024-12-03 14:32:03 +08:00
kailixu c47cbc42cc Merge branch '3.0' into enh/TD-30933-3.0 2024-12-03 07:04:13 +08:00
yihaoDeng 3d92cbb691 Merge remote-tracking branch 'origin/3.0' into enh/addDiskUsage 2024-12-02 19:05:33 +08:00
Hongze Cheng 0e1d731954 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TS-4994-3.0 2024-12-02 17:29:37 +08:00
Shengliang Guan fb8a10e717
Merge pull request #28958 from taosdata/fix/TD-33037
fix(meta/commit): make begin return code instead of 0
2024-12-02 16:43:02 +08:00
kailixu a157caa38d enh: process log rotate every 30 minutes 2024-11-29 18:57:09 +08:00
Minglei Jin 451093188d tsdb/cache: remove uid array when loading from imem 2024-11-29 15:47:49 +08:00
Minglei Jin d20ef164b3 Merge branch '3.0' into fix/TS-4937-2 2024-11-29 15:15:09 +08:00
Hongze Cheng 9f6f82ff98 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TS-4994-3.0 2024-11-29 15:10:27 +08:00
yihaoDeng e495d39220 Merge remote-tracking branch 'origin/3.0' into enh/addDiskUsage 2024-11-29 13:50:09 +08:00
Shengliang Guan fb4486cedb Merge branch 'main' into merge/mainto3.0 2024-11-28 19:21:25 +08:00
yihaoDeng 95a1005e1f update test case and remove invalid code 2024-11-28 15:09:20 +08:00
Shengliang Guan ab604c18f9
Merge pull request #28925 from taosdata/feat/updateMultiTag
Feat/updateMultiTag
2024-11-28 14:24:23 +08:00
dapan1121 90b60d9d01 fix: scheduler timer stop issue 2024-11-28 13:56:27 +08:00
Minglei Jin cd22ddbdd2 fix(meta/commit): make begin return code instead of 0 2024-11-28 10:53:23 +08:00
Minglei Jin c60b6d9912 tsdb/cache: close col iter early 2024-11-28 10:44:24 +08:00
Shengliang Guan 26ba4b1f29 Merge branch '3.0' into merge/mainto3.0 2024-11-27 22:32:50 +08:00
Shengliang Guan 6db8a25c98 Merge branch 'main' into merge/mainto3.0 2024-11-27 22:31:17 +08:00
Hongze Cheng df8a4ea6dc more code 2024-11-27 18:49:48 +08:00
Hongze Cheng 3ae5a72a4c more code 2024-11-27 17:53:53 +08:00
Shengliang Guan 642a5152f7
Merge pull request #28900 from taosdata/fix/liaohj
fix(stream): check whether dispatch trigger block is expired or not
2024-11-27 15:47:47 +08:00
Haojun Liao 5e49268cd8 Merge branch 'main' into fix/liaohj 2024-11-27 15:44:53 +08:00
wangmm0220 0e2a16d70f feat:[TD-32642] add charset for connection support 2024-11-27 14:25:34 +08:00
yihaoDeng 221eac50ca refactor code 2024-11-27 09:28:01 +08:00
yihaoDeng a84a849ef7 add test case 2024-11-27 09:12:17 +08:00
yihaoDeng 2aac26e0a9 fix partial failure 2024-11-27 07:56:24 +08:00
yihaoDeng e87570c036 fix invalid free 2024-11-26 20:50:37 +08:00
Hongze Cheng 9ec73f6ca6 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TS-4994-3.0 2024-11-26 13:23:54 +08:00
Shengliang Guan 135131fb3a
Merge pull request #28921 from taosdata/fix/TD-33008-main
fix(query)[TD-33008]. fix error handling in tsdbCacheRead
2024-11-26 11:56:41 +08:00
Shengliang Guan 7e8ef8ed98
Merge pull request #28920 from taosdata/fix/TD-33008-3.0
fix(query)[TD-33008]. fix error handling in tsdbCacheRead
2024-11-26 11:56:32 +08:00
Shengliang Guan c8c208be2f
Merge pull request #28918 from taosdata/fix/TD-33006-3.0
fix(query)[TD-33006]. resolve wild pointer release issue in tsdbCreateReader
2024-11-26 11:55:28 +08:00
Minglei Jin 12b0e70a22 tsdb/cache: use macro to check error code 2024-11-25 16:43:42 +08:00
Hongze Cheng 9bac4f4da2 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TS-4994-3.0 2024-11-25 16:39:22 +08:00
Shengliang Guan ed3cc87575
Merge pull request #28851 from taosdata/ehn/vnode-open-log
ehn/vnode-open-log
2024-11-25 16:07:24 +08:00
Hongze Cheng ef2e694a36 more code 2024-11-25 16:05:32 +08:00
Minglei Jin 65698470b7 cache/row iter close: move close to cleanup section 2024-11-25 16:02:58 +08:00
Minglei Jin 270e9f0bcf tsdb/cache: Not lazy init ctxArray 2024-11-25 15:55:40 +08:00
yihaoDeng 4d857b0149 fix mem leak 2024-11-25 15:22:53 +08:00
Jinqing Kuang 513ccaaad8 fix(query)[TD-33008]. fix error handling in tsdbCacheRead
Fix an issue that a freed null pointer was accessed during error
handling in tsdbCacheRead, which would cause a crash.
2024-11-25 15:11:53 +08:00
Jinqing Kuang 7bbda0c92a fix(query)[TD-33008]. fix error handling in tsdbCacheRead
Fix an issue that a freed null pointer was accessed during error
handling in tsdbCacheRead, which would cause a crash.
2024-11-25 15:09:11 +08:00
Jinqing Kuang ab7badb0c0 fix(query)[TD-33006]. resolve wild pointer release issue in tsdbCreateReader
Initialize pointer member variables in tsdbCreateReader to prevent
random memory errors. It addresses a bug where uninitialized pointers
are freed during error cleanup.
2024-11-25 15:01:49 +08:00
Jinqing Kuang fbc77d1e71 fix(query)[TD-33006]. resolve wild pointer release issue in tsdbCreateReader
Initialize pointer member variables in tsdbCreateReader to prevent
random memory errors. It addresses a bug where uninitialized pointers
are freed during error cleanup.
2024-11-25 14:58:42 +08:00
yihaoDeng 97e08abe8c support update multi tag 2024-11-25 10:55:28 +08:00
yihaoDeng 3027e377fa support update multi tag 2024-11-23 22:18:30 +08:00
Haojun Liao d397c9a9b7 fix(stream): remove failed task in hash table and array list. 2024-11-22 19:22:37 +08:00
yihaoDeng 407eeb6620 Unable to 2024-11-22 14:43:11 +08:00
Hongze Cheng 4d6faa8f13 enh: (TD-29367-2) add a new meta handle function called `metaHandleEntry2` 2024-11-21 16:09:55 +08:00
Hongze Cheng 8991e50eee enh: (TD-29367-1)Add delete entry encode and decode 2024-11-21 15:52:20 +08:00
Shengliang Guan ba15fb0644 Merge branch '3.0' into merge/mainto3.0 2024-11-21 11:04:36 +08:00
Shengliang Guan cfa7d275f2 Merge branch 'main' into merge/mainto3.0 2024-11-21 11:00:00 +08:00
Shengliang Guan e8d663809d
Merge pull request #28756 from taosdata/fix/main/tsbs_perf_optimization
fix tsbs perf issue
2024-11-21 10:40:47 +08:00
dapan1121 2738d5dd9c fix: code merge issue 2024-11-21 10:30:16 +08:00
dapan1121 164fa67db5 Merge remote-tracking branch 'origin/3.0' into feat/TD-30268 2024-11-21 10:23:57 +08:00
Minglei Jin 4113921448 Merge branch '3.0' into fix/TS-4937-2 2024-11-20 18:41:24 +08:00
Minglei Jin 7947b94b03 tsdb/commit: update lru from imem 2024-11-20 18:40:49 +08:00
dmchen a7fdabb6d7 ehn/vnode-open-log 2024-11-20 17:27:35 +08:00
wangjiaming0909 9314dfb80c fix not setting step in tsdbread 2024-11-20 14:29:27 +08:00
Minglei Jin ffab4e8886 tsdb/cache: get first row from imem 2024-11-19 14:36:16 +08:00
Shengliang Guan a4b6d9dee0
Merge pull request #28797 from taosdata/enh/TD-32907-3.0
enh: add bypassFlag to facilitate performance testing
2024-11-19 14:24:09 +08:00
Shengliang Guan 99bebacd8e
Merge pull request #28784 from taosdata/fix/TD-32861-main
fix(query)[TD-32861]. fix that WHERE condition not work in statements with INTERP function
2024-11-19 09:40:28 +08:00
Shengliang Guan 6044bb06f1
Merge pull request #28793 from taosdata/fix/main/TD-32883
remove duplicate group by cols
2024-11-18 19:32:16 +08:00
kailixu 3ebb664953 enh: add bypassFlag to facilitate performance testing 2024-11-18 18:12:39 +08:00
Jinqing Kuang f5c66cec19 fix(query)[TD-32861]. fix that WHERE condition not work with INTERP function
Previously, a statement with INTERP would force underlying TABLE SCAN
operator to scan all data within the RANGE clause, causing the time
range constraint in the WHERE condition to be ignored. This fix ensures
that the TABLE SCAN respects both the RANGE clause and WHERE condition,
improving query accuracy and performance.
2024-11-18 16:08:27 +08:00
kailixu 3225c381e2 enh: add bypassFlag to facilitate performance testing 2024-11-18 15:41:08 +08:00
wangjiaming0909 6c18289de0 fix tsbs perf issue 2024-11-18 14:11:21 +08:00
kailixu 748c7f9cf2 enh: add bypassFlag to facilitate performance testing 2024-11-15 19:26:12 +08:00
wangjiaming0909 2be0ca15d8 fix group_partition test 2024-11-15 18:10:44 +08:00
Minglei Jin 66535adb70 tsdb/cache: update lru when committing 2024-11-15 17:04:22 +08:00
Hongze Cheng 0c45c80d71 enh: add dangle child table filter in recovery mode 2024-11-15 14:26:53 +08:00
Haojun Liao b74a1bc726 refactor: update logs, and set correct vgId. 2024-11-15 13:48:42 +08:00
Haojun Liao fd1996a1d1 fix(stream): fix error in build msg. 2024-11-15 01:27:31 +08:00
Haojun Liao f65651f6ef fix(stream): update the msg encoder. 2024-11-15 00:19:35 +08:00
yihaoDeng 42065bf2e8 Merge remote-tracking branch 'origin/3.0' into enh/addDiskUsage 2024-11-14 17:44:29 +08:00
Haojun Liao c9a120e1d0 Merge branch '3.0' into fix/3_liaohj 2024-11-14 17:42:04 +08:00
Haojun Liao b2b5a14d9d fix(stream): reset task add the failed chkptId info. 2024-11-14 17:38:40 +08:00
Shengliang Guan b88088792e
Merge pull request #28752 from taosdata/fix/liaohj
fix(stream): always return success for resume req.
2024-11-14 15:58:03 +08:00
Shengliang Guan a1f3b0a1ed
Merge pull request #28758 from taosdata/fix/3_liaohj
refactor: return the error code and do some refactor.
2024-11-14 15:57:51 +08:00
Minglei Jin e3f57a1678 tsdb/cache: reuse update ctx array 2024-11-14 10:34:19 +08:00
Shengliang Guan 80b7cbdb84 Merge branch '3.0' into merge/mainto3.0 2024-11-13 23:11:05 +08:00
Haojun Liao 3b129f7e36 fix(stream): alwasy return success for resume req. 2024-11-13 19:35:01 +08:00
Haojun Liao 67a547f65a fix(stream): alwasy return success for resume req. 2024-11-13 13:46:23 +08:00
yihaoDeng 11064d43e6 support disk usage 2024-11-11 18:16:41 +08:00
Jinqing Kuang b4e0f9a922 enh(query)[TD-32127]: improve code quality of tsdbRead module
- Add parameter validation for functions to ensure robustness
- Nullify pointers when freeing memory to prevent dangling pointers
- Initialize local variables to avoid undefined behavior
- Add error handling and logging for better debugging
2024-11-11 11:53:28 +08:00
dapan1121 a8561fba4f Merge remote-tracking branch 'origin/3.0' into feat/TD-30268 2024-11-11 11:01:22 +08:00
dapan1121 411d61504f fix: remove taosMem calling 2024-11-11 09:09:40 +08:00
dapan1121 371094cc13 Merge remote-tracking branch 'origin/3.0' into feat/TD-30268 2024-11-08 10:13:20 +08:00
wangjiaming0909 274a7fd876 refine unused codes 2024-11-08 09:50:32 +08:00
wangjiaming0909 2ddd07142a remove logs 2024-11-08 09:50:32 +08:00
wangjiaming0909 a70b4e28c8 fix tests 2024-11-08 09:50:30 +08:00
wangjiaming0909 9a92c136ce fix drop child table with tsma 2024-11-08 09:47:47 +08:00
wangjiaming0909 65dffbda0c fix tsma drop ctb 2024-11-08 09:47:04 +08:00
wangjiaming0909 413cf3e504 sink submit data one-by-one 2024-11-08 09:42:59 +08:00
54liuyao f452ca47fe delete window state when drop table 2024-11-08 09:42:56 +08:00
wangjiaming0909 a5a3d1d8ad fix same timestamp written into same tsma res ctb 2024-11-08 09:40:06 +08:00
yihaoDeng 4f9c9a15db support disk usage 2024-11-07 20:20:44 +08:00
Hongze Cheng 6c487c3f48
Merge pull request #28472 from taosdata/enh/TD-31867-main
enh: add more log for last cache retrieve
2024-11-07 19:46:46 +08:00
yihaoDeng 8c56a75f4f support disk usage 2024-11-07 17:09:57 +08:00
yihaoDeng 12beff2a0a support disk usage 2024-11-06 21:22:26 +08:00
yihaoDeng a6436882a2 support disk usage 2024-11-06 15:25:50 +08:00
54liuyao 719a3faa12 Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/TD-30837 2024-11-06 11:13:15 +08:00
54liuyao ba31bf2c52 Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/TD-30837 2024-11-06 09:42:50 +08:00
Shengliang Guan 0be118c0aa
Merge pull request #28408 from taosdata/enh/TD-32181/client
Enh/td 32181/client
2024-11-06 09:42:05 +08:00
yihaoDeng af80d0a6bf opt disk 2024-11-05 20:05:54 +08:00
yihaoDeng dc576905f0 support disk usage 2024-11-05 19:57:13 +08:00
Shungang Li e3beccbde1 enh: add more log for last cache retrieve 2024-11-05 13:49:38 +08:00
Haojun Liao 8148f26d30
Merge branch '3.0' into fix/ref 2024-11-05 10:50:28 +08:00
54liuyao 158eda13f9 Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/TD-30837 2024-10-31 17:49:58 +08:00
Shungang Li 2879fafc1c fix: typo issue 2024-10-31 14:54:01 +08:00
Haojun Liao b1ad121bae fix(stream): release task before returning. 2024-10-31 14:49:16 +08:00
Shungang Li fde2a56076 enh: tsdbCacheRowFormatUpdate check for memory funcs 2024-10-31 11:47:32 +08:00
xsren 73be7ddbc6 fix: set tablefield of stream block to NULL 2024-10-30 19:38:08 +08:00
Shungang Li 84b17a144b Merge branch 'fix/TS-4937' into fix/TD-32338-3.0 2024-10-30 16:33:09 +08:00
Shungang Li 6da22e6483 enh: tsdb cache schema 2024-10-30 16:13:27 +08:00
54liuyao b6d16eccdb Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/TD-30837 2024-10-30 14:54:42 +08:00
Shengliang Guan ea9ed2e538
Merge pull request #28300 from taosdata/enh/TS-5441-3.0
enh:[TS-5441] cost too long in tmq write meta data by cache meta and vg info
2024-10-30 13:43:41 +08:00
Minglei Jin d8df6db06a fix schema update with sver param 2024-10-30 10:23:32 +08:00
54liuyao d065d71821 Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/TD-30837 2024-10-30 10:09:48 +08:00
Shengliang Guan c026f26289
Merge pull request #28546 from taosdata/merge/mainto3.0
merge: from main to 3.0 branch
2024-10-30 08:57:21 +08:00
Haojun Liao 9bae0adba6 fix(stream): start scheduler task after set the refId. 2024-10-29 19:14:37 +08:00
Minglei Jin 6b67c2ebf0 uncomment tsdb cache commit 2024-10-29 15:07:13 +08:00
Minglei Jin e364d5aa66 tsdb/cache: invalidate cached schema 2024-10-29 14:41:14 +08:00
Minglei Jin cf3e84e79d tsdb/cache: cache schema to reuse 2024-10-29 12:25:25 +08:00
yihaoDeng b523cf8802 fix:conflicts from 3.0 2024-10-28 17:34:20 +08:00
Shungang Li d34fc78a22 fix: (last) eliminate redundant logs caused by incorrect return results 2024-10-28 11:18:06 +08:00
Haojun Liao 51f3f29d5b fix(stream): fix syntax check failure. 2024-10-27 21:52:46 +08:00
Haojun Liao 4802f59dfe fix(stream): use the refId in stream meta list, in order to avoid access already freed stream tasks. 2024-10-27 15:49:40 +08:00
xinsheng Ren 412c10ed94
Merge branch '3.0' into enh/TD-32181/client 2024-10-25 22:54:04 +08:00
54liuyao f79dcffc8c Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/TD-30837 2024-10-25 14:14:43 +08:00