Commit Graph

6393 Commits

Author SHA1 Message Date
Haojun Liao c4a6b85bdf fix(tsdb): support stt and file block overlap. 2023-06-28 22:38:51 +08:00
liuyao 2fc5eeb810 session win range 2023-06-28 17:20:08 +08:00
Hongze Cheng 9be13427f6 fix tomb record loss bug 2023-06-28 17:01:08 +08:00
Haojun Liao 8867a57262 fix(stream): fix syntax error. 2023-06-28 14:48:59 +08:00
Haojun Liao 57fcd553f8 refactor: do some internal refactor. 2023-06-28 13:13:13 +08:00
wangmm0220 1fc664693e fix:continue consume if wal is dropped 2023-06-28 11:54:48 +08:00
Haojun Liao 3710ea4aca refactor: do some internal refactor. 2023-06-28 09:41:08 +08:00
Hongze Cheng c3a34f5012 Merge branch 'enh/tsdb_optimize' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-06-28 09:16:48 +08:00
Hongze Cheng b13010c490 fix retention infinit loop 2023-06-28 09:16:43 +08:00
Haojun Liao 9116a4092a fix(tsdb):fix memory leak. 2023-06-28 01:04:58 +08:00
Haojun Liao 15c55508ac fix(stream): fix error in read tombblock in stt files. 2023-06-27 23:37:11 +08:00
Haojun Liao a19e63fd23 fix(stream): fix error in handling fill history. 2023-06-27 23:00:14 +08:00
Haojun Liao 4bb78df27c fix(stream): reduce the sleep time. 2023-06-27 16:44:35 +08:00
Haojun Liao 32fddeff18 fix(stream): fix error retrieve data from source task.And optimize the test cases. 2023-06-27 16:24:47 +08:00
Hongze Cheng d23902877e make it compile on win 2023-06-27 14:33:55 +08:00
Haojun Liao 1ad05a06d6
Merge branch '3.0' into enh/tsdb_optimize 2023-06-27 11:46:37 +08:00
Haojun Liao 3289ad62be other: merge 3.0 2023-06-27 11:33:40 +08:00
Haojun Liao 1073b5e4c2 fix(tsdb): support to read multi-level of stt files. 2023-06-27 11:15:53 +08:00
liuyao 71f4226e15 fix coverity san issues 2023-06-27 10:39:38 +08:00
Haojun Liao b73444b291 fix(stream): start stream task in case of scan history completing. 2023-06-27 09:44:51 +08:00
Hongze Cheng 3edee3fe9f fix memory leak 2023-06-26 22:04:29 +08:00
dapan1121 4dae9f4eff merge main to 3.0 2023-06-26 18:43:00 +08:00
Hongze Cheng 3172306f65 more fix 2023-06-26 16:38:26 +08:00
Hongze Cheng 5a0218d1ca fix memory leak 2023-06-26 16:34:58 +08:00
Hongze Cheng 58ce6a3f26 fix vnode close 2023-06-26 16:28:33 +08:00
Haojun Liao 6a29bce44e Merge remote-tracking branch 'origin/enh/tsdb_optimize' into enh/tsdb_optimize 2023-06-26 15:56:11 +08:00
Haojun Liao 9f664cbf14 fix(tsdb): fix error in extracting block distribution. 2023-06-26 15:54:44 +08:00
Hongze Cheng 5ad9bd938f change default stt trigger as 2 2023-06-26 15:47:36 +08:00
Hongze Cheng e79683a684 fix more 2023-06-26 13:57:18 +08:00
Minglei Jin 020678391c fix(tsdb/cache): refine del locks 2023-06-26 11:19:31 +08:00
Hongze Cheng 27e17048ac fix: retention coredump 2023-06-26 09:06:59 +08:00
Minglei Jin 5eb57f2e6e enh(tsdb/cache): writebatch with rcache locked 2023-06-26 08:41:14 +08:00
Haojun Liao 402c091df0 fix(stream): fix sma error. 2023-06-25 19:41:44 +08:00
Hongze Cheng b881b87218 more code 2023-06-25 18:02:31 +08:00
liuyao e236bf818c set fill history info 2023-06-25 17:47:10 +08:00
Hongze Cheng cc0727aee3 more code 2023-06-25 17:13:12 +08:00
Hongze Cheng 014bfc4ad4 more code 2023-06-25 16:27:14 +08:00
Hongze Cheng 5b1492cb4b refact code 2023-06-25 15:09:15 +08:00
wangmm0220 7a49d67078 Merge branch '3.0' of https://github.com/taosdata/TDengine into feature/TS-3495 2023-06-25 14:54:16 +08:00
Haojun Liao 7e7feeffdf fix: fix memory leak. 2023-06-25 14:38:31 +08:00
liuyao c950c7379d Merge branch 'refact/fillhistory' of https://github.com/taosdata/TDengine into refact/fillhistory 2023-06-25 10:58:43 +08:00
liuyao e9d3198e05 mem leak 2023-06-25 10:57:10 +08:00
Haojun Liao 6ac179501a fix: fix syntax error. 2023-06-25 10:46:21 +08:00
Haojun Liao 6857881742 Merge branch '3.0' into refact/fillhistory 2023-06-25 10:41:32 +08:00
Hongze Cheng c161943fe0 fix snapshot problem 2023-06-25 10:01:30 +08:00
Hongze Cheng 3582046129 fix coredump 2023-06-25 09:45:58 +08:00
Haojun Liao 3099ec31cb fix(tsdb): fix syntax error. 2023-06-25 09:36:43 +08:00
Haojun Liao dad1854cbb other: merge 3.0 2023-06-25 09:33:37 +08:00
Haojun Liao 7c23630fe4 fix(stream): set correct stream error code. 2023-06-25 09:26:37 +08:00
wade zhang 254a20bdf3
Merge pull request #21660 from luckeverda/feat/TD-23739
feat/TD-23739: enhance ttl, deletetime modified by writing-op
2023-06-25 09:06:57 +08:00
Haojun Liao a8de3694fa Merge branch 'refact/fillhistory' of github.com:taosdata/tdengine into refact/fillhistory 2023-06-24 18:55:03 +08:00
Haojun Liao ceb78fdad2
Merge branch '3.0' into refact/fillhistory 2023-06-24 18:53:48 +08:00
Haojun Liao 4a7698d4ab fix(tsdb): add null ptr check. 2023-06-24 00:41:05 +08:00
Haojun Liao 4ce1614045 fix(tsdb): fix error in retrieve sma. 2023-06-24 00:33:47 +08:00
Haojun Liao 5cac7c7a02 fix(tsdb): fix error in query super table. 2023-06-23 02:06:50 +08:00
Hongze Cheng a5049b4861 fix bug 2023-06-21 20:26:52 +08:00
Haojun Liao 0c2273daf2 fix(tsdb): fix memory leak. 2023-06-21 19:38:25 +08:00
Haojun Liao 3ca3dc54ae Merge branch 'enh/tsdb_optimize' of github.com:taosdata/tdengine into enh/tsdb_optimize 2023-06-21 19:22:58 +08:00
Haojun Liao cf02ac7229 fix(tsdb): extract tomb data in stt files. 2023-06-21 18:57:14 +08:00
Hongze Cheng feda122fdc more code 2023-06-21 17:29:41 +08:00
Haojun Liao f49f96049e Merge branch 'enh/tsdb_optimize' of github.com:taosdata/tdengine into enh/tsdb_optimize 2023-06-21 16:56:11 +08:00
Hongze Cheng 32a256bfee fix commit bug 2023-06-21 16:55:31 +08:00
Haojun Liao e76ae4ffc5 fix(tsdb) : fix memory leak. 2023-06-21 16:53:47 +08:00
Hongze Cheng 1160f53062 more code 2023-06-21 16:35:06 +08:00
Haojun Liao 84bd2fb7a1 Merge branch 'enh/tsdb_optimize' of github.com:taosdata/tdengine into enh/tsdb_optimize 2023-06-21 16:15:04 +08:00
Hongze Cheng 5e9d263e19 fix: infinite loop 2023-06-21 15:08:16 +08:00
Hongze Cheng 0e97340e50 more code 2023-06-21 14:53:36 +08:00
Haojun Liao 6261359efe fix(tsdb): reset the stt reader for new files. 2023-06-21 14:46:35 +08:00
Hongze Cheng 4a1010cdec more 2023-06-21 13:39:29 +08:00
wade zhang e95b430e89
Merge pull request #21786 from taosdata/FIX/TD-24817-3.0
enh: make alter-hashrange atomic and idempotent
2023-06-21 13:29:04 +08:00
Haojun Liao ea7b8e91d3 fix(stream): fix memory leak. 2023-06-21 12:03:26 +08:00
Haojun Liao f6e3ad27f0 fix(tsdb): fix memory leak. 2023-06-21 11:38:35 +08:00
Haojun Liao a92d16a508 fix(tsdb): adjust invalid assert. 2023-06-21 00:12:08 +08:00
Hongze Cheng 413d00db9e fix memory leak 2023-06-20 20:10:57 +08:00
Haojun Liao f8437789f9 Merge remote-tracking branch 'origin/enh/tsdb_optimize' into enh/tsdb_optimize 2023-06-20 18:38:59 +08:00
Haojun Liao a16dce1873 fix(tsdb): set correct callback fp. 2023-06-20 18:38:45 +08:00
Hongze Cheng a3f784a5bc more code 2023-06-20 18:25:24 +08:00
Hongze Cheng ccc8faf3ee Merge branch 'enh/tsdb_optimize' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-06-20 18:24:02 +08:00
Hongze Cheng 8855659534 more code 2023-06-20 18:23:58 +08:00
liuyao 74bea44300 stream op transform 2023-06-20 17:30:59 +08:00
Haojun Liao 2d4eed4234 other: merge other branch. 2023-06-20 17:12:31 +08:00
Hongze Cheng fbc4cc9053 fix commit issue 2023-06-20 16:48:54 +08:00
Haojun Liao 7627035629 fix(tsdb): set the hasVal initial value. 2023-06-20 15:58:22 +08:00
Benguang Zhao 424086e324 enh: restore vgroup id in vmOpenVnodes for vnodeAlterHashRange 2023-06-20 15:40:09 +08:00
Haojun Liao a87c3cfd24 fix(tsdb):check null ptr. 2023-06-20 15:39:53 +08:00
liuyao aafbdcb492 set task status 2023-06-20 15:20:04 +08:00
Haojun Liao a1f2ce389b fix(tsdb): fix memory leak. 2023-06-20 14:46:32 +08:00
Hongze Cheng 09f2858927 fix some coredump 2023-06-20 14:34:52 +08:00
Haojun Liao 976dc322db enh(tsdb): support delete data read. 2023-06-20 14:26:15 +08:00
Hongze Cheng a33ce92e5d more code 2023-06-20 13:33:31 +08:00
liuyao 870d75bf82 fill history pause&resume 2023-06-20 11:34:09 +08:00
Hongze Cheng 927f6861be more code 2023-06-20 10:41:24 +08:00
Hongze Cheng a4ca770449 refact code 2023-06-20 09:33:22 +08:00
Shungang Li aa3dd2bbe8 fix for compile 2023-06-20 09:06:23 +08:00
Shungang Li b93f653d7e feat: enhance ttl, deletetime modified by writing-ops
new config item: ttlChangeOnWrite (default 0)
ttl delete time changes on last write if true
2023-06-19 19:03:35 +08:00
Haojun Liao 77af819708 Merge branch 'enh/tsdb_optimize' of github.com:taosdata/tdengine into enh/tsdb_optimize 2023-06-19 17:57:00 +08:00
Haojun Liao 524ef6edda fix(tsdb): read data from new storage format. 2023-06-19 17:51:05 +08:00
liuyao 41c193945f fill history pause&resume 2023-06-19 17:28:19 +08:00
Benguang Zhao 090a1a1595 enh: rename dir at the end in vnodeRenameVgroupId 2023-06-19 15:48:32 +08:00
Hongze Cheng 6d2ce5cd39 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-06-19 14:13:08 +08:00
Hongze Cheng 3074ab6541 more code 2023-06-19 14:12:48 +08:00
Hongze Cheng de60e688f6 more fix 2023-06-19 12:52:09 +08:00
Hongze Cheng 9ce58a2d80 refact more code 2023-06-19 11:32:19 +08:00
Hongze Cheng 073a2b8dd3 refact more code 2023-06-19 09:32:29 +08:00
kailixu b40069c0e1 chore: log optimization 2023-06-17 05:05:43 +08:00
Hongze Cheng aba73614df more code 2023-06-17 00:12:11 +08:00
wangmm0220 c5dfe169a6 fix:error 2023-06-16 19:33:03 +08:00
kailixu 4097b860d3 enh: support delete tsma interval 2023-06-16 19:04:12 +08:00
dapan1121 1329dce320
Merge pull request #21712 from taosdata/fix/TS-3484
fix: fix order by ts desc error
2023-06-16 18:01:16 +08:00
Hongze Cheng a9fcebbdaf more code 2023-06-16 17:12:05 +08:00
Haojun Liao 64365666b7 fix(stream): update the info, and do some internal refactor. 2023-06-16 16:04:43 +08:00
Hongze Cheng d97f34931d Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-06-16 13:54:59 +08:00
Hongze Cheng ec288ade15 change stt from multi seg to one seg 2023-06-16 12:16:53 +08:00
wade zhang 01b1cfe965
Merge pull request #21676 from taosdata/fix/TD-24715
enh(vnd/svr): convert msyType to string
2023-06-16 12:06:47 +08:00
wade zhang d5f37359f4
Merge pull request #21722 from taosdata/fix/TD-24761
fix(tsdb/cache): rewrite cache update to fix cpu usage
2023-06-16 11:52:02 +08:00
Minglei Jin 968e3cf1ea lru/applyF: fix ret value 2023-06-16 10:00:17 +08:00
Haojun Liao 4c82558eab Merge remote-tracking branch 'origin/refact/fillhistory' into refact/fillhistory 2023-06-16 09:55:24 +08:00
Haojun Liao 933801269a fix(stream): fix memory leak and failed to close vnode. 2023-06-16 09:55:11 +08:00
liuyao 0aa141ec77 use stream task state 2023-06-15 18:24:40 +08:00
Haojun Liao a3e1882fb2 fix: fix dead lock. 2023-06-15 18:17:38 +08:00
Haojun Liao 2ad30e2946 other: add files. 2023-06-15 17:31:59 +08:00
Minglei Jin 2cb6c7af16 cache/commit: use outter lock 2023-06-15 17:16:14 +08:00
Minglei Jin 9d6a22e35e cache/apply: use tsdb's flushState as ud 2023-06-15 17:07:56 +08:00
Minglei Jin c56f29c031 cache/flushState: init flush state when open cache 2023-06-15 17:01:27 +08:00
Minglei Jin 158ae209bf cache/lru: new applyF API for tlrucache 2023-06-15 16:34:51 +08:00
Haojun Liao 74e0138f72 Merge branch '3.0' into refact/fillhistory 2023-06-15 15:25:00 +08:00
wangmm0220 22776e60d5 fix:control memory size if consumer group is too much 2023-06-15 14:51:04 +08:00
Hongze Cheng b6a567f92e more code 2023-06-15 14:43:14 +08:00
Hongze Cheng eacd2ac234 more code 2023-06-15 14:23:12 +08:00
liuyao 693942b821 trans state 2023-06-15 14:13:17 +08:00
Hongze Cheng e34ff2a894 more code 2023-06-15 14:10:35 +08:00
Haojun Liao 5fdfe98696 fix: fix syntax error. 2023-06-15 13:31:30 +08:00
Hongze Cheng 56dfeadd50 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-06-15 13:17:44 +08:00
Haojun Liao 1b9eca5ce0 other: merge main. 2023-06-15 13:03:17 +08:00
Haojun Liao 13028744df refactor: do some internal refactor. 2023-06-15 10:24:21 +08:00
Minglei Jin 6d23ea93ea cache/update: fix memory leak 2023-06-15 08:40:36 +08:00
Haojun Liao 53377c2c1f fix(stream): wait for stream task completed. 2023-06-15 01:14:41 +08:00
Benguang Zhao b86fc3a697 fix: vnodeRenameVgroupId correctly 2023-06-14 21:38:25 +08:00
Hongze Cheng 33eaeb743c more code 2023-06-14 16:15:40 +08:00
liuyao 9a3708e17b pause&resume fill history 2023-06-14 15:54:07 +08:00
Minglei Jin d04a33f349 fix(tsdb/cache): rewrite cache update to fix cpu usage 2023-06-14 15:35:21 +08:00
Haojun Liao 7c6fbd7772 enh(stream): do some internal refactor and support secondary scan for history data. 2023-06-14 14:10:09 +08:00
Hongze Cheng 4138361839 refact code 2023-06-14 14:05:41 +08:00
Hongze Cheng 5bacfb4f94 refact code 2023-06-14 13:38:51 +08:00
Hongze Cheng 48ea3963e7 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-06-14 13:12:31 +08:00
Haojun Liao b44447e6f3 enh(stream): support restore from disk. 2023-06-14 10:19:03 +08:00
Haojun Liao 844a23225a
Merge pull request #21600 from taosdata/mark/tmq
fix:check wal not exist again before register to push & move push log…
2023-06-14 10:18:39 +08:00
Ganlin Zhao 4bd1ae90fa fix: fix order by ts desc error 2023-06-14 09:52:41 +08:00
Hongze Cheng c85c032158 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-06-14 09:14:16 +08:00
wangmm0220 8070223aba fix:lock error 2023-06-13 18:27:06 +08:00
Ganlin Zhao 647ddaad97 fix: fix order by ts desc error 2023-06-13 17:28:31 +08:00
Hongze Cheng e01d598da9 more code 2023-06-13 17:16:06 +08:00
Haojun Liao 97da2a8fac fix(stream): set the fill history status. 2023-06-13 16:10:55 +08:00
wangmm0220 d8d6b6dd21 Merge branch '3.0' of https://github.com/taosdata/TDengine into feature/TD-24749 2023-06-13 15:15:05 +08:00
wangmm0220 8a81278024 fix:load pHandle if necessary wher tq restore 2023-06-13 15:14:11 +08:00
Haojun Liao 933d08b489
Merge pull request #21690 from taosdata/feature/TS-3495
feat:add parameters for consumer & add offset rows for subscription
2023-06-13 14:59:15 +08:00
Hongze Cheng 42a09cc9df more code 2023-06-13 14:30:24 +08:00
Hongze Cheng 7baeabc6b9 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-06-13 13:21:12 +08:00
wangmm0220 fb123d8761 fix:conflict from 3.0 2023-06-13 09:47:08 +08:00
Haojun Liao fb24ed161d enh(stream): set correct task status. 2023-06-12 22:48:23 +08:00
Hongze Cheng e4840cb5ab fix 2023-06-12 17:48:49 +08:00
Hongze Cheng bd01d08b05 mroe code 2023-06-12 17:19:31 +08:00
Hongze Cheng 71df0a00be more code 2023-06-12 17:17:00 +08:00
Hongze Cheng 438d0caef7 mroe code 2023-06-12 16:55:20 +08:00
Hongze Cheng 9a4f6abe54 more code 2023-06-12 16:12:29 +08:00
Benguang Zhao 16fbcbb67a fix: filter by tbFName in metaFilterTableByHash 2023-06-12 14:19:50 +08:00
Hongze Cheng 5405a967fb refact code 2023-06-12 13:39:25 +08:00
Hongze Cheng 4813af0867 refact code 2023-06-12 13:27:02 +08:00
Haojun Liao 78a240be8f enh(stream): add dispatch msg. 2023-06-12 13:12:45 +08:00
Hongze Cheng 22b80c55bf refact code 2023-06-12 10:27:22 +08:00
Hongze Cheng e6039839f1 refact code 2023-06-12 10:26:18 +08:00
Hongze Cheng b8fb34e6c6 refact 2023-06-12 10:13:15 +08:00
Hongze Cheng 8be0e1710e refact code 2023-06-12 10:08:35 +08:00
wangmm0220 1903b815d4 fix:modify offset description to string 2023-06-12 09:45:06 +08:00
wangmm0220 6657b8d849 fix:modify offset description to string 2023-06-12 09:44:00 +08:00
Benguang Zhao 3689b41f3a Merge branch '3.0' into FIX/TD-24182-3.0 2023-06-12 09:39:49 +08:00
Hongze Cheng 0c6acda102 refact code 2023-06-10 17:16:01 +08:00
Minglei Jin 4884d0af53 vnd/svr: convert msyType to string 2023-06-09 18:00:04 +08:00
Hongze Cheng 9cdaf24113 more code 2023-06-09 17:52:57 +08:00
Hongze Cheng 2c5b5289d0 fix more code 2023-06-09 16:43:09 +08:00
Hongze Cheng cbd5da5dee more code 2023-06-09 16:07:06 +08:00
Hongze Cheng 1ee9f80e1f more code 2023-06-09 15:10:54 +08:00
Haojun Liao 69c9eda7af fix(stream): fix race condition. 2023-06-09 11:37:38 +08:00
Haojun Liao 63ef04593d fix: fix syntax error. 2023-06-09 09:48:18 +08:00
Haojun Liao 53246ed6bb other: merge other branch. 2023-06-09 09:41:10 +08:00
Hongze Cheng 3753c7d602 refact more 2023-06-09 09:23:56 +08:00
Minglei Jin cab07b2736 vnode/svr: fix missing colon post vgId 2023-06-09 08:21:45 +08:00
wangmm0220 3f46a9bbc9 feat:add parameters for consumer & add offset rows for subscription 2023-06-08 18:14:02 +08:00
Haojun Liao 6726edae0c fix(stream): add more logs. 2023-06-08 17:54:22 +08:00
Hongze Cheng e9a0210ea6 more code 2023-06-08 17:31:35 +08:00
Haojun Liao 2b6ace653a refactor: do some internal refactor. 2023-06-08 16:14:27 +08:00
Hongze Cheng ef524f6965 more code 2023-06-08 15:35:43 +08:00
Minglei Jin a6968485a8 enh(vnd/sync): refine invalid message log 2023-06-08 14:45:02 +08:00
Hongze Cheng 13229b0ee1 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-06-08 13:38:32 +08:00
Hongze Cheng 9d4a626f42 more code 2023-06-08 13:28:13 +08:00
Hongze Cheng 685c0e5593 more code 2023-06-08 11:41:01 +08:00
Hongze Cheng 0c9b66b574 more code 2023-06-08 10:51:43 +08:00
Hongze Cheng 2f5f0b75df refact code 2023-06-08 10:31:19 +08:00
Hongze Cheng 91c8391bff Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-06-08 09:53:57 +08:00
Haojun Liao 06cf3588da refactor: do some internal refactor. 2023-06-07 15:03:04 +08:00