Commit Graph

14525 Commits

Author SHA1 Message Date
Haojun Liao 5307f15766 refactor: do some internal refactor. 2024-05-16 19:54:29 +08:00
kailixu a0167f91b5 Merge branch '3.0' into feat/TD-30053-3.0 2024-05-16 17:30:52 +08:00
kailixu cb5bdd29b5 feat(grant): support industry edition 2024-05-16 17:30:03 +08:00
Haojun Liao 41b55cf4d6
Merge pull request #25792 from taosdata/fix/TD-29745-1
adj code
2024-05-16 13:56:31 +08:00
Shungang Li fc047ddafc fix: last cache update rule 2024-05-16 09:30:27 +08:00
Hongze Cheng f4a9c5e3c8
Merge pull request #25669 from taosdata/enh/TD-29953
Enh/TD-29953
2024-05-15 17:26:26 +08:00
Hongze Cheng 9dd3f326ea
Merge pull request #25731 from taosdata/enh/TD-29968-3.0
enh: grant support s3/active-active/dual-replica/db_encryption
2024-05-15 15:52:28 +08:00
Haojun Liao abd90c733a fix(stream): remove backend files only after the in-memory task is dropped. 2024-05-15 14:24:35 +08:00
54liuyao 2a67b83a27 adj code 2024-05-15 14:11:55 +08:00
Haojun Liao 43e018e210
Merge pull request #25733 from taosdata/fix/TD-29745
optimize scan data
2024-05-15 13:41:08 +08:00
54liuyao 167cdc79c5 format code 2024-05-15 10:54:53 +08:00
54liuyao 4c603fee55 format code 2024-05-15 10:54:24 +08:00
54liuyao 3c56f623ed adj inline func 2024-05-15 10:46:19 +08:00
Hongze Cheng 156b5e71f4
Merge pull request #25735 from taosdata/fix/TD-29772-3.0
fix/TD-29772
2024-05-15 09:13:01 +08:00
54liuyao ab3ba3f2e4 optimize scan tsdb 2024-05-15 09:09:20 +08:00
Haojun Liao a3bd3a4c76
Merge pull request #25769 from taosdata/fix/TS-4791
fix(tsdb): fix the length of column type overflow.
2024-05-15 00:44:59 +08:00
Haojun Liao 610aa80e65 fix(stream): init backend for fill-history task. 2024-05-15 00:08:38 +08:00
Haojun Liao 9300b7a401 fix(tsdb): fix the length of column type overflow. 2024-05-14 16:22:11 +08:00
Haojun Liao 6898eba6ed fix(stream): expand stream tasks are divided into two phase, the first is to build stream task and then expand stream task before start stream tasks. 2024-05-14 14:34:31 +08:00
Minglei Jin b6eec20dfb fix(s3/grant): checking grant when doing migrate 2024-05-14 11:01:06 +08:00
Shungang Li 694680600e fix: tsdbCache vartype of zero size 2024-05-14 09:23:32 +08:00
Haojun Liao b7e7de0354 fix(stream): set the stream task load flag. 2024-05-13 16:45:38 +08:00
Haojun Liao 3dfffe9113 fix(stream): async load and start stream tasks. 2024-05-13 15:31:26 +08:00
kailixu 6f07e48826 Merge branch '3.0' into enh/TD-29968-3.0 2024-05-13 10:35:53 +08:00
dmchen 939183d3df fix/TD-29772 2024-05-13 01:56:49 +00:00
Haojun Liao 56a1e7e01f
Merge pull request #25727 from taosdata/fix/xftan/TD-29988-3.0
fix: build fails on macOS and Windows
2024-05-13 09:44:19 +08:00
kailixu 60e02eb3e6 Merge branch '3.0' into enh/TD-29968-3.0 2024-05-12 23:15:40 +08:00
kailixu e3442474cf fix: grants for database encryption 2024-05-12 23:09:56 +08:00
dapan1121 05788d25b0
Merge pull request #25629 from taosdata/fix/TD-29893-3.0
fix:[TD-29893]avoid returning 0 if vnode init error
2024-05-12 18:07:08 +08:00
Shungang Li c575d7a850 enh: grant check for dual-replica-ha 2024-05-11 18:32:04 +08:00
t_max f030af3aab fix: build fails on macOS and Windows 2024-05-11 14:59:05 +08:00
Haojun Liao d7e1f37cd4 Merge branch '3.0' into fix/3_liaohj 2024-05-11 10:28:12 +08:00
dmchen 9cf2529cac check grant first 2024-05-11 02:12:31 +00:00
Haojun Liao 7f93ec2c53 fix(stream): update the checkpoint info for followers, and some internal refactor. 2024-05-11 09:37:02 +08:00
Hongze Cheng 4d4fa9ea94
Merge pull request #25703 from taosdata/fix/TD-29912
fix: handle memleak in vnodeSnapWriterOpen, add log for abort_edit
2024-05-10 15:29:44 +08:00
Hongze Cheng db68b9a1f0
Merge pull request #25707 from taosdata/fix/TD-29981
fix: refactor lastcache ser/des for compatibility
2024-05-10 09:15:29 +08:00
Shungang Li 0ac5d393e6 fix: tsdbcache last disk data format change 2024-05-09 23:37:28 +08:00
Shungang Li 544999c01b fix: tsdbCacheSerialize copy from null ptr 2024-05-09 22:55:29 +08:00
Shungang Li 457b98fee8 fix: adjust SValueV0 data order 2024-05-09 21:52:43 +08:00
Shungang Li 7ae4415890 fix: refactor lastcache ser/des for compatibility 2024-05-09 19:04:11 +08:00
Minglei Jin 41eb82c4de enh(s3/grant): disable s3 with expired grant 2024-05-09 15:19:50 +08:00
Shungang Li 6895bb121f fix: handle memleak in vnodeSnapWriterOpen, add log for abort_edit 2024-05-09 14:55:48 +08:00
dmchen e5547eccbf encrypt grant 2024-05-09 02:44:38 +00:00
dmchen 454b4047cb fix/audit-memory-leak 2024-05-09 10:19:14 +08:00
Hongze Cheng e76d15e33f
Merge pull request #25690 from taosdata/fix/TD-29962
enh: refactor tsdbCache ser/des
2024-05-09 09:04:09 +08:00
Shungang Li 70598a3038 enh: refactor tsdbCache ser/des 2024-05-09 00:13:19 +08:00
Hongze Cheng 9e21eacf26
Merge pull request #25687 from taosdata/fix/TD-29934-3.0
fix(tsdb/cache-update): compare when rocks's colVal not null
2024-05-08 21:48:01 +08:00
Minglei Jin 3d1612e44b fix(tsdb/cache-update): compare when rocks's colVal not null 2024-05-08 19:27:43 +08:00
Hongze Cheng 431c3c0066
Merge pull request #25675 from taosdata/fix/TD-29934-3.0
fix(tsdb/cache-update): discard none colVals for same timestamp
2024-05-08 18:54:17 +08:00
Minglei Jin bb227a9798 fix(tsdb/cache-update): discard none colVals for same timestamp 2024-05-08 17:29:07 +08:00
Shungang Li 733c8f8f9a fix: (compatibility) SLastCol field change cause 'last' crash 2024-05-08 16:12:43 +08:00
yihaoDeng 697ca8914e enh compress 2024-06-22 11:35:47 +08:00
Haojun Liao b26656fd1c
Merge pull request #25661 from taosdata/fix/3_liaohj
refactor: do some internal refactor.
2024-05-08 13:03:13 +08:00
Haojun Liao 64ae35affe fix(test): fix syntax error. 2024-05-08 09:18:36 +08:00
Haojun Liao cdeb4462fb refactor: do some internal refactor. 2024-05-07 23:43:21 +08:00
Haojun Liao 55a630911d
Merge pull request #25653 from taosdata/fix/3_liaohj
refactor: do some internal refactor.
2024-05-07 23:12:30 +08:00
Haojun Liao b6debd985b fix(stream): always return success if repeatly recv checkpoint source msg. 2024-05-07 16:33:08 +08:00
Hongze Cheng c4b2f5681c
Merge pull request #25654 from taosdata/fix/TD-29845
fix: fix last col version when updating rocks
2024-05-07 11:33:51 +08:00
Haojun Liao 0e0f98eb8d refactor: do some internal refactor. 2024-05-07 10:50:44 +08:00
Minglei Jin 562bf0fe1e tsdb/cache: fix last col version when updating rocks 2024-05-07 10:24:07 +08:00
Shungang Li b979c584fb fix: tsdbCacheGetBatch ref of tmp memory 2024-05-07 10:22:58 +08:00
Hongze Cheng 3ffe2740e5
Merge pull request #25138 from taosdata/ENH/TD-29195-3.0
enh: add logging info for alter vnode hash range action
2024-05-07 09:02:32 +08:00
Haojun Liao 3b43b8f8c7
Merge pull request #25646 from taosdata/fix/3_liaohj
fix(stream): set global close flag in the streamMeta.
2024-05-06 22:19:23 +08:00
Haojun Liao 18c66a5491 refactor: do some internal refactor. 2024-05-06 18:17:38 +08:00
Haojun Liao 7ad7ef7cfc refactor: do some internal refactor. 2024-05-06 17:03:41 +08:00
wangmm0220 5f6d3fcf7e fix:[TD-29893]avoid returning 0 if vnode init error 2024-05-06 10:09:53 +08:00
Haojun Liao 44100139a4
Merge pull request #25614 from taosdata/fix/3_liaohj
fix(stream): close task if it's in checkdown stream procedure.
2024-05-01 08:06:59 +08:00
dapan1121 355db3a0a3
Merge pull request #25609 from taosdata/fix/TD-29869
fix:[TD-29869]use latest vg info when drop topic
2024-05-01 07:37:03 +08:00
Haojun Liao cdc7b03ac6 fix(stream): fix syntax error. 2024-04-30 22:44:32 +08:00
Haojun Liao 732e52d64d refactor: do some internal refactor, and add some logs. 2024-04-30 19:11:58 +08:00
Haojun Liao 94a0f9ab8f other: merge 3.0 2024-04-30 17:12:46 +08:00
Haojun Liao 629502e12e refactor: do some internal refactor. 2024-04-30 17:00:51 +08:00
Haojun Liao f2bc93b78d
Merge pull request #25598 from taosdata/fix/3_liaohj
refactor(stream): opt stream sink perf.
2024-04-30 16:59:22 +08:00
dapan1121 f54dd2b818
Merge pull request #25602 from taosdata/fix/TS-4728-3.0
fix:use path of SStreamMeta
2024-04-30 16:12:50 +08:00
Haojun Liao cb5a0563e6 fix(stream): fix error caused by merge. 2024-04-30 15:43:12 +08:00
wangmm0220 0758c4ece0 fix:[TD-29869]use latest vg info when drop topic 2024-04-30 15:38:09 +08:00
wangmm0220 35003cbb34 fix:use path of SStreamMeta 2024-04-30 14:36:16 +08:00
Haojun Liao d73fd5492a fix(test): update test case. 2024-04-30 14:24:20 +08:00
Haojun Liao 4c27af9b13 refactor: do some internal refactor. 2024-04-30 13:25:39 +08:00
wangmm0220 3a1c210601 fix:use path of SStreamMeta 2024-04-30 11:06:03 +08:00
Hongze Cheng 09dcbdd352
Merge pull request #25593 from taosdata/opt/optTransfer30
opt transfer
2024-04-30 10:50:28 +08:00
Haojun Liao d3e676b084 fix(cos): fix syntax error. 2024-04-30 10:14:32 +08:00
Haojun Liao 9c39d11ea0 other: add some logs for drop streams. 2024-04-30 09:55:56 +08:00
Haojun Liao 54e9522c62 refactor(stream): opt stream sink perf. 2024-04-30 09:41:29 +08:00
Haojun Liao 9ba8e6bd34 refactor: add logs for drop streams. 2024-04-30 09:26:06 +08:00
dapan1121 6187bf4e06
Merge pull request #25584 from taosdata/fix/TS-4728-3.0
fix:[TS-4728]transform store data if data is too big
2024-04-30 09:02:40 +08:00
wangmm0220 cd3f3046f7 fix:memory leak 2024-04-29 19:36:41 +08:00
Yihao Deng f99cad9443 opt transfer 2024-04-29 11:30:38 +00:00
wangmm0220 1f85cb42e6 fix:[TS-4728]transform strore data if data is too big 2024-04-29 17:22:40 +08:00
Haojun Liao ed73617cc3
Merge pull request #25575 from taosdata/fix/3_liaohj
fix(tsdb): set the correct start pos for binary search.
2024-04-29 16:48:01 +08:00
Haojun Liao b0ef022e87 fix(tsdb): set the correct start pos for binary search. 2024-04-29 15:13:52 +08:00
Haojun Liao 7a5cdb81d5 fix(tsdb): set the correct start pos for binary search. 2024-04-29 14:40:49 +08:00
dapan1121 0997355460
Merge pull request #25560 from taosdata/tsma_tradeoff
usable tsma
2024-04-29 09:22:50 +08:00
wangjiaming0909 cb008f18dc usable tsma 2024-04-29 09:18:40 +08:00
dapan1121 df4421b0a2
Merge pull request #25542 from taosdata/fix/TD-29841
use debug log when fetching no tsmas for table
2024-04-29 08:26:12 +08:00
Haojun Liao f115a33a94
Merge pull request #25538 from taosdata/fix/3_liaohj
refactor: do some internal refactor.
2024-04-28 23:21:52 +08:00
Haojun Liao bf5d523116 fix(stream): disable the exec of complete check status in timer thread. 2024-04-28 17:57:34 +08:00
Hongze Cheng 13cd60f17f
Merge pull request #25524 from taosdata/feat/TD-29823
Feat/TD-29823
2024-04-28 17:51:39 +08:00
Hongze Cheng 0253aed220
Merge pull request #25522 from taosdata/enh/TD-29801-3.0
enh: batch create table
2024-04-28 17:16:23 +08:00
Haojun Liao 3c5ca17737 Merge branch '3.0' into fix/3_liaohj 2024-04-28 13:57:16 +08:00
kailixu 4eb1763b52 enh: batch create table 2024-04-28 13:52:17 +08:00
wangjiaming0909 88cc43250f use debug log when fetching no tsmas for table 2024-04-28 12:42:10 +08:00
Yihao Deng d9c112244b profile opt 2024-04-28 03:48:00 +00:00
kailixu 4d572ebe88 enh: batch create table 2024-04-28 11:25:40 +08:00
kailixu bc1f9bca93 enh: batch create table 2024-04-28 11:07:53 +08:00
kailixu e392b39323 enh: batch create table 2024-04-28 10:24:16 +08:00
Haojun Liao ed962186a1 enh(stream): add attrs for stream tasks. 2024-04-28 10:22:09 +08:00
Haojun Liao b2d8260f14 refactor: do some internal refactor. 2024-04-28 10:05:22 +08:00
Haojun Liao 384efdc185
Merge pull request #25531 from taosdata/fix/3_liaohj
fix(stream):add ref for task in check rsp monitor timer.
2024-04-28 09:22:00 +08:00
kailixu 53e9e0b3af enh: batch create table 2024-04-28 04:58:05 +08:00
kailixu 3b504e6e96 enh: batch create table 2024-04-28 04:47:00 +08:00
kailixu 504263315d enh: batch create table 2024-04-28 04:37:30 +08:00
kailixu 0b5e35643c Merge branch '3.0' into enh/TD-29801-3.0 2024-04-28 04:27:25 +08:00
Haojun Liao 8e47adba09 fix(util): fix syntax error. 2024-04-27 17:46:23 +08:00
Haojun Liao 324072fed8
Merge pull request #25525 from taosdata/fix/3_liaohj
fix(stream): update stream task meta info.
2024-04-26 18:15:09 +08:00
Haojun Liao 6d06188b9f fix(stream): fix memory leak. 2024-04-26 17:06:15 +08:00
Haojun Liao b1b3246066 fix(stream): update the checkpoint executed transId range. 2024-04-26 17:03:01 +08:00
Haojun Liao 5f5595a6ab
Merge pull request #25517 from taosdata/fix/3_liaohj
fix(stream): add task node into update list if it is timeout for more than 100sec.
2024-04-26 17:00:23 +08:00
Hongze Cheng 63a735a546
Merge pull request #25512 from taosdata/fix/TD-29713
fix: arb reduce duplicate updates
2024-04-26 16:33:04 +08:00
Yihao Deng ac15015cb8 Add RpcNoDelayfp function to handle specific message types 2024-04-26 08:10:39 +00:00
Haojun Liao 8b53f76691 fix(stream): discard the repeatly recv checkpoint-source msg. 2024-04-26 15:56:34 +08:00
kailixu 55ec5f164c enh: batch create table 2024-04-26 15:09:53 +08:00
Hongze Cheng efdc943a3d Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/TS-4706-3.0 2024-04-26 14:57:58 +08:00
Haojun Liao c565e31638
Merge pull request #25510 from taosdata/fix/3_liaohj
fix(stream): handle disorder node Update trans Id.
2024-04-26 12:44:00 +08:00
wangjiaming0909 ffea69ac5c remove forbid funcs 2024-04-26 12:14:43 +08:00
Shungang Li 21f508fe58 fix: arb reduce duplicate updates 2024-04-26 11:40:06 +08:00
Haojun Liao 815489d20a fix(tsdb): set the pk info when converting fileblockinfo to binrecord. 2024-04-26 11:10:20 +08:00
Haojun Liao 77961ea791 fix(stream): handle disorder node Update trans Id. 2024-04-26 09:45:42 +08:00
Haojun Liao feb176149e
Merge pull request #25507 from taosdata/fix/3_liaohj
fix(tsdb): overlap check take pk into consideration.
2024-04-26 09:06:38 +08:00
Hongze Cheng f500762af7 Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/TS-4706-3.0 2024-04-26 09:00:09 +08:00
Haojun Liao 59a3e8ca40 fix(tsdb): overlap check take pk into consideration. 2024-04-25 23:25:24 +08:00
Haojun Liao b3d2ccec83
Merge pull request #25483 from taosdata/fix/3_liaohj
fix(query): add ts in cache_scan_operator if pk exists and only retri…
2024-04-25 22:32:26 +08:00
Haojun Liao eef5e6e409 fix(stream): fix syntax error. 2024-04-25 18:30:33 +08:00
Haojun Liao 3b932599ab fix(stream): fix syntax error. 2024-04-25 17:47:03 +08:00
Minglei Jin eaa1e7a775 tsdb/writer: use latest version of data for writing 2024-04-25 16:40:58 +08:00
Haojun Liao cd8baa7ba0 fix(stream): add log for update task epset, set correct update flag if epset updated. 2024-04-25 16:39:11 +08:00
Minglei Jin a9094d7602 fix(cos/multi-writing): use lasted version of data 2024-04-25 16:37:24 +08:00
Haojun Liao c7806ebca2 fix(util): fix race condition. 2024-04-25 13:58:02 +08:00
Haojun Liao 740115e117
Merge pull request #25474 from taosdata/fix/TD-29749
fix(stream):opt bloom filter
2024-04-25 11:29:28 +08:00
Hongze Cheng 10d82a3acf
Merge pull request #25476 from taosdata/enh/TS-4710-3.0
enh: recover file
2024-04-25 11:15:02 +08:00
Hongze Cheng ca9aebc5ff
Merge pull request #25473 from taosdata/fix/TD-29773
Fix/TD-29773
2024-04-25 09:45:47 +08:00
Haojun Liao ac860f7fe8 fix(query): add ts in cache_scan_operator if pk exists and only retrieve ts column. 2024-04-25 09:29:42 +08:00
54liuyao 2a72ceadd1 Merge branch '3.0' of https://github.com/taosdata/TDengine into 3.0 2024-04-24 18:57:22 +08:00
Haojun Liao 3b08ee3d16
Merge pull request #25458 from taosdata/fix/3_liaohj
fix(stream): add task update trans conflict level.
2024-04-24 18:54:06 +08:00
Hongze Cheng c085efb4f8
Merge pull request #25456 from taosdata/FIX/TD-29704-3.0
fix: execute undo actions of TRN_EXEC_SERIAL trans sequentially
2024-04-24 18:09:56 +08:00
Hongze Cheng 2cac0d5691 enh: recover file 2024-04-24 18:04:10 +08:00
dapan1121 ab2c9aaf5b
Merge pull request #25466 from taosdata/enh/TD-29758
enh:[TD-29758]optimize log in tmq
2024-04-24 17:47:28 +08:00
54liuyao 3300bf04c1 opt bloom filter 2024-04-24 17:27:24 +08:00
Yihao Deng 1181f9de28 Fix metaGetColCmpr function and remove commented code 2024-04-24 08:22:54 +00:00
Hongze Cheng b1fb14e49e
Merge pull request #25465 from taosdata/fix/TD-29759
fix(s3migrate/datas3): init fd of from & to early
2024-04-24 11:29:47 +08:00
Benguang Zhao 9f8e970a32 enh: set default errcode as action in progress in executing serial trans 2024-04-24 11:23:53 +08:00
Hongze Cheng e47d17e826
Merge pull request #25451 from taosdata/enh/refactorCompress
refactor compress
2024-04-24 10:55:00 +08:00
Hongze Cheng c3275dc61c
Merge pull request #25459 from taosdata/fix/TD-29750-3.0
fix: if not exists logic for topic/stream/table
2024-04-24 10:52:53 +08:00
Benguang Zhao 396c08e14a fix: execute undo actions of TRN_EXEC_SERIAL trans sequentially 2024-04-24 10:52:49 +08:00
Benguang Zhao edcd1b87d8 refact: add mndTransExecuteActionsSerial 2024-04-24 10:52:49 +08:00
Hongze Cheng 0eae851257
Merge pull request #25425 from taosdata/fix/ci_monitor_memory
fix ci monitor memory
2024-04-24 10:35:04 +08:00
wangmm0220 20cedc3339 enh:[TD-29758]optimize log in tmq 2024-04-24 10:02:58 +08:00
Minglei Jin c76f886c91 fix(s3migrate/datas3): init fd of from & to early 2024-04-24 09:36:44 +08:00
kailixu c173be667c Merge branch '3.0' into fix/TD-29750-3.0 2024-04-24 08:44:43 +08:00
Haojun Liao ace5e12e65 fix(tsdb): set the correct lflag when creating tsdbCache reader. 2024-04-23 19:25:51 +08:00
Cary Xu 44b4580bd5
Update metaTable.c 2024-04-23 18:37:40 +08:00
Yihao Deng 7ddfe085f1 refactor code 2024-04-23 10:26:56 +00:00
kailixu 89ee62ac09 fix: if not exists logic for topic/stream/table 2024-04-23 18:19:16 +08:00
Haojun Liao 0f8ff48c6b fix(stream): fix double free 2024-04-23 18:18:01 +08:00
Haojun Liao 0c7373509e fix(stream): add task update trans conflict level. 2024-04-23 18:07:00 +08:00
Hongze Cheng 328f95f7cb fix: possible write block when error occurs 2024-04-23 16:48:49 +08:00
Benguang Zhao 10e9d79201 refact: rename STrans redoActionPos to actionPos 2024-04-23 16:44:05 +08:00
Haojun Liao 7fda9d9fcb Merge branch '3.0' into fix/3_liaohj 2024-04-23 15:08:43 +08:00
Haojun Liao b0f68a9147 refactor: do some internal refactor. 2024-04-23 14:58:51 +08:00
Haojun Liao 1adf59e7d8 fix(stream): do check when task is paused, and do some internal refactor. 2024-04-23 13:53:23 +08:00
dapan1121 07e01b3e97
Merge pull request #25386 from taosdata/fix/3.0/TD-29631
fix cancel create tsma memory use after free
2024-04-23 13:17:55 +08:00
Haojun Liao d7a08909dd
Merge pull request #25442 from taosdata/fix/3_liaohj
fix(stream): save the epset if task epset updated.
2024-04-23 09:10:45 +08:00
Haojun Liao 315b86cf66 fix(stream): save the epset if task epset updated. 2024-04-22 23:52:45 +08:00
Haojun Liao ada1c6d4c0
Merge pull request #25434 from taosdata/fix/3_liaohj
fix(stream):update the check-rsp prcedure, to avoid repeatly start check-rsp procedure.
2024-04-22 22:13:19 +08:00
Haojun Liao a8fac441be fix(stream):update the check-rsp prcedure, to avoid repeatly start check-rsp procedure. 2024-04-22 14:02:31 +08:00
wangjiaming0909 2c0624a8ae fix create tsma transaction 2024-04-22 13:21:32 +08:00
Yihao Deng 541b070765 Remove commented out code in metaCreateSTable function 2024-04-20 07:45:39 +00:00
Yihao Deng ba30339d4e Refactor meteDecodeColCmprEntry function to return -1 on error 2024-04-20 03:07:12 +00:00
Yihao Deng 517365467d Merge branch '3.0' into fix/compatibleWithVeryOldMeta 2024-04-20 01:54:02 +00:00
Haojun Liao e5dddc4abf Merge branch '3.0' into fix/3_liaohj 2024-04-19 19:13:28 +08:00
Haojun Liao ea527b19b8 fix(stream): set correct start version if no checkpoint exist. 2024-04-19 19:12:23 +08:00
dmchen 62bc1074c0 fix monitor memory 2024-04-19 10:44:08 +00:00
dapan1121 a46b7cca3d
Merge pull request #25413 from taosdata/feat/TS-4243-tmq
opti:raw data from tmq
2024-04-19 18:22:21 +08:00
Yihao Deng 18cdeaf960 compatible with older meta 2024-04-19 07:37:43 +00:00
Hongze Cheng 69222543a2
Merge pull request #25401 from taosdata/fix/TD-29562
Fix/td 29562
2024-04-19 13:57:19 +08:00
wangmm0220 1695824c73 fix:merge from 3.0 2024-04-19 13:52:57 +08:00
wangmm0220 42467c0e00 opti:raw data from tmq 2024-04-19 13:48:17 +08:00
Hongze Cheng fc5c84422e
Merge pull request #25256 from taosdata/feat/TD-24834
Feat/td 24834
2024-04-19 13:34:37 +08:00
Haojun Liao 62260bff79
Merge pull request #25389 from taosdata/fix/3_liaohj
fix(stream): reset checkpoint info after receiving task-reset info.
2024-04-19 11:23:55 +08:00
Hongze Cheng e4e00c8953
Merge pull request #25403 from taosdata/fix/TD-29621
fix: geometry crash in stream & tmq
2024-04-19 11:15:26 +08:00
kailixu a044308150 enh: error code optimization for encryption key 2024-04-19 10:36:09 +08:00
Yihao Deng 2314771209 fix TD-29562 2024-04-19 02:09:40 +00:00
Yihao Deng ee8a96fb42 fix TD-29562 2024-04-19 02:04:32 +00:00
Haojun Liao 34f7dc4782
Merge pull request #25404 from taosdata/feat/TS-4243-3.0
fix(tsdb): set correct compare func for merge tree.
2024-04-19 09:10:03 +08:00
Haojun Liao eb1fed177f fix(tsdb): set correct compare func for merge tree. 2024-04-19 00:32:41 +08:00
Haojun Liao 525b574c85
Merge pull request #25402 from taosdata/feat/TS-4243-3.0
fix(tsdb): update the initial value of pk for varchar type.
2024-04-18 19:49:05 +08:00
Shungang Li f3438ce04e fix: geometry crash in stream & tmq 2024-04-18 19:27:02 +08:00
Haojun Liao 815d12fd77 fix(stream): set check downstream completed for sink task. 2024-04-18 18:36:02 +08:00
Haojun Liao 4802cd1ddf Merge branch '3.0' into fix/3_liaohj 2024-04-18 17:53:30 +08:00
Hongze Cheng 05d853bd9e
Merge pull request #25383 from taosdata/fix/dropStreamData
Fix/drop stream data
2024-04-18 17:10:57 +08:00
Hongze Cheng 874b4b1911
Merge pull request #25400 from taosdata/enh/TD-28945-pk
fix(vnode): encode the missing tsdbPageSize
2024-04-18 17:04:29 +08:00
Haojun Liao 8962010caf other: merge 3.0 2024-04-18 16:31:15 +08:00
Haojun Liao c94c9a900c fix(tsdb): update the initial value of pk for varchar type. 2024-04-18 16:17:29 +08:00
Yihao Deng d21341c943 fix TD-29562 2024-04-18 08:16:40 +00:00
kailixu 20c4385d27 Merge branch '3.0' into feat/TD-24834 2024-04-18 15:54:01 +08:00
Yihao Deng 3f4fa8b74e fix TD-29562 2024-04-18 07:03:18 +00:00
Minglei Jin eb51a7c5b5 vnode: encode the missing tsdbPageSize 2024-04-18 14:48:05 +08:00
Hongze Cheng a4edab720c
Merge pull request #25391 from taosdata/enh/TD-28945-pk
cos/multi-writing: init fid & cid for s3 page cache
2024-04-18 14:05:28 +08:00
Haojun Liao deee0c3793 refactor: do some internal refactor. 2024-04-18 13:05:45 +08:00
Haojun Liao d5d23b0434 fix(tsdb): set reader status normal once successful taking snapshot. 2024-04-18 13:05:44 +08:00
Minglei Jin 8ca2b08d5c cos/multi-writing: fix remove_file with -1 lcn 2024-04-18 08:48:44 +08:00
Haojun Liao 9056a48efd refactor: do some internal refactor. 2024-04-17 21:58:02 +08:00
Haojun Liao ac84a5f82b refactor: do some internal refactor. 2024-04-17 21:57:09 +08:00
Minglei Jin 7034cbee22 cos/multi-writing: init fid & cid for s3 page cache 2024-04-17 19:48:50 +08:00
Haojun Liao ddf98ae0c2 refactor: do some internal refactor. 2024-04-17 18:04:02 +08:00
Haojun Liao 289ec6cf66 fix(stream): reset checkpoint info after receiving task-reset info. 2024-04-17 17:57:12 +08:00
dm chen 1196ea72da
Merge branch '3.0' into feat/TD-24834 2024-04-17 17:13:29 +08:00
kailixu 3bad06b76f enh: error log optimization for invalid dnode cfg 2024-04-17 16:59:43 +08:00
Hongze Cheng a34b644640
Merge pull request #25366 from taosdata/feat/compress_3.0
Feat/compress 3.0
2024-04-17 16:15:26 +08:00
kailixu 384e650882 enh: show encryptions 2024-04-17 14:41:47 +08:00
Yihao Deng 354f33fa88 drop stream data 2024-04-17 05:38:45 +00:00
Yihao Deng 74b7bf6bbc drop stream data 2024-04-17 05:37:35 +00:00
Haojun Liao 2ce7d18e94 refactor: do some internal refactor. 2024-04-17 11:35:03 +08:00
Haojun Liao 69cb630e7f fix(tsdb): update the compare func. 2024-04-17 11:32:48 +08:00
Yihao Deng 04e78d0ce7 Merge branch 'feat/3.0' into feat/compress_3.0 2024-04-17 03:23:02 +00:00
kailixu 74afb8deae chore: solve conflicts 2024-04-17 10:52:34 +08:00
dapan1121 5936d3a1b0
Merge pull request #25300 from taosdata/draft/tsma_before_ci
feat: support tsma
2024-04-17 10:00:17 +08:00
Haojun Liao a439f61708
Merge pull request #25375 from taosdata/fix/3_liaohj
fix(stream): generate the checkpoint id
2024-04-16 19:41:07 +08:00
wangjiaming0909 fb72e29fe1 fix stream progress delay 2024-04-16 18:17:33 +08:00
Yihao Deng 6f9de676f0 Merge branch 'fix/compress_3.0' into feat/compress_3.0 2024-04-16 09:27:26 +00:00
Haojun Liao 5ae8b68b17 fix(stream): fix deadlock. 2024-04-16 15:37:51 +08:00
Haojun Liao 8bdd43c305 fix(stream): wait for 50ms when no token in bucket for sink task. 2024-04-16 14:42:21 +08:00
wangjiaming0909 92e91c2032 fix ci 2024-04-16 14:27:06 +08:00
wangjiaming0909 1978a06e6e merge with 3.0 2024-04-16 14:27:06 +08:00
wangjiaming0909 039939196a forbid tsma agg funcs with tag columns 2024-04-16 14:25:34 +08:00
wangjiaming0909 1b37ef03fb fix duplicate tsma funcs 2024-04-16 14:25:34 +08:00
wangjiaming0909 97498e1844 fix create tsma txn and fix fetch wrong stream progress 2024-04-16 14:25:34 +08:00
wangjiaming0909 de1c28d623 tsma avoid fetching tsma for no tsma tables 2024-04-16 14:25:34 +08:00
wangjiaming0909 f6200dd923 support long ctb names 2024-04-16 14:25:34 +08:00
wangjiaming0909 6ce0616ffd fix ci and TODOs 2024-04-16 14:25:34 +08:00
wangjiaming0909 e43580f71b fix ci 2024-04-16 14:25:20 +08:00
wangjiaming0909 2b594e02d2 fix tsma name too long 2024-04-16 14:25:20 +08:00
wangjiaming0909 7de0a34ae6 support maxTsmaCalcDelay, maxTsmaNum, skip_tsma 2024-04-16 14:25:01 +08:00
wangjiaming0909 3566cac206 add max tsma num opt 2024-04-16 14:23:26 +08:00
wangjiaming0909 a2cbbba24d find TODO 2024-04-16 14:23:26 +08:00
wangjiaming0909 d1101a0325 support filter out tsma res tbs when show stables/tables 2024-04-16 14:23:26 +08:00
wangjiaming0909 a8e00f7410 drop tb in transaction 2024-04-16 14:23:26 +08:00
wangjiaming0909 3d77e8432d support rm ttl tb 2024-04-16 14:23:26 +08:00
wangjiaming0909 1ef153de63 support drop ctb for tsma 2024-04-16 14:23:25 +08:00
wangjiaming0909 1a06dd684e support drop ctb 2024-04-16 14:23:25 +08:00
wangjiaming0909 94f2f6ae22 fix drop ctb 2024-04-16 14:23:25 +08:00
wangjiaming0909 98ca847eb8 add tests 2024-04-16 14:18:11 +08:00
wangjiaming0909 a75c67efc8 rebase with stream sub table name no group id 2024-04-16 14:18:10 +08:00
wangjiaming0909 c3e73d9168 fix recursive tsma 2024-04-16 14:18:10 +08:00
wangjiaming0909 d8200b2f63 fetch lastts vnode version before create tsma 2024-04-16 14:18:10 +08:00
wangjiaming0909 8e56d9a359 fix tsmas 2024-04-16 14:18:10 +08:00
wangjiaming0909 e947a2fb0d catalog cache get stream progress 2024-04-16 14:18:10 +08:00
wangjiaming0909 a4d2dfed67 stream supported api 2024-04-16 14:18:10 +08:00
wangjiaming0909 6e7dc4b7b4 normal table tsma and add tests 2024-04-16 14:17:12 +08:00
wangjiaming0909 70ca830378 support recursive tsma creation 2024-04-16 14:17:12 +08:00
Haojun Liao 810eb22eb2 fix(stream): generate the checkpoint id after checking the max checkpoint id from vnode. 2024-04-16 14:15:18 +08:00
wangjiaming0909 a438a77e78 rewrite tbname for partition by tbname 2024-04-16 14:14:40 +08:00
wangjiaming0909 895a4584e6 generate tsma plan 2024-04-16 14:14:39 +08:00
wangjiaming0909 4b6fb0ffc6 tsma optimization 2024-04-16 14:14:39 +08:00
wangjiaming0909 0fd66d7e8a tsma optimization 2024-04-16 14:14:39 +08:00
wangjiaming0909 ef47fd57d6 support tsma catalog cache 2024-04-16 14:14:34 +08:00
wangjiaming0909 f77cd43d26 ins_tsmas 2024-04-16 14:13:10 +08:00
wangjiaming0909 08fc9170f5 refine 2024-04-16 14:13:10 +08:00
wangjiaming0909 6324d1293a drop tsma 2024-04-16 14:13:10 +08:00
wangjiaming0909 8e2977d083 create tsma request 2024-04-16 14:13:10 +08:00
wangjiaming0909 5589cf0309 server handle tsma creation 2024-04-16 14:13:10 +08:00
Haojun Liao e0cb17211b
Merge pull request #25358 from taosdata/feat/TS-4243-3.0
fix: extracted data block shall initialize pks of datablock info
2024-04-16 13:30:48 +08:00
dmchen b2bc5d4df1 fix/TD-29612 2024-04-16 03:37:41 +00:00
dm chen aedec5ead7
Merge branch '3.0' into feat/TD-24834 2024-04-16 11:35:49 +08:00
Hongze Cheng ace8f30bdf
Merge pull request #25361 from taosdata/fix/TD-29560-3.0
fix: drop table after commit
2024-04-16 11:15:29 +08:00
Haojun Liao 51dfa20cf4 fix(tsdb): set correct initial value for compare. 2024-04-16 10:13:15 +08:00
kailixu 91215d7cc0 enh: code optimization 2024-04-16 09:10:21 +08:00
kailixu 8ea9c8b879 enh: code optimization 2024-04-16 09:04:33 +08:00
kailixu a6fe9a861f sdb release for dnode 2024-04-16 08:34:41 +08:00
Haojun Liao ee62b66b07 Merge branch 'enh/TD-28945-pk' into fix/3_liaohj 2024-04-15 19:15:39 +08:00
Haojun Liao 13bd296d58 Merge branch '3.0' into fix/3_liaohj 2024-04-15 18:53:48 +08:00
Haojun Liao d92f0706e7 fix(tsdb): check the boundary value when reseting range. 2024-04-15 18:43:58 +08:00
Haojun Liao 1ac192c069 fix(stream): keep the original tsdb scan version range. 2024-04-15 18:41:38 +08:00
Haojun Liao 87dfc1f931 fix(stream):fix error in unit test cases. 2024-04-15 18:40:51 +08:00
Yihao Deng ce137d3084 Merge branch 'enh/TD-28945-pk' into feat/compress_3.0 2024-04-15 10:36:13 +00:00
Minglei Jin 9cce9c221d cos/multi-write: empty impl for tsdb async compact 2024-04-15 18:32:06 +08:00
Hongze Cheng 29194df1ec Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/TD-29560-3.0 2024-04-15 18:26:21 +08:00
Hongze Cheng b936969a01 more fix 2024-04-15 18:25:23 +08:00
Yihao Deng a7722fbf3c Merge branch '3.0' into feat/compress_3.0 2024-04-15 09:33:15 +00:00
Yihao Deng ea9385912f Merge branch '3.0' into feat/compress_3.0 2024-04-15 09:06:30 +00:00
kailixu 4862a18d44 Merge branch 'feat/TD-24834' of https://github.com/taosdata/TDengine into feat/TD-24834 2024-04-15 16:29:59 +08:00
kailixu 545519bc3d enh: default encrypt algorightm for db 2024-04-15 16:29:49 +08:00
dmchen 9a99b8526d resolve conflict 2024-04-15 08:24:40 +00:00
kailixu 123090e18a fix: solve conflicts 2024-04-15 16:12:15 +08:00
Hongze Cheng ac2853f28c fix: drop table after commit 2024-04-15 15:36:54 +08:00
dmchen a6c36a6cf3 resolve conflict 2024-04-15 07:36:41 +00:00
dm chen 4d660d89c0
Merge branch '3.0' into feat/TD-24834 2024-04-15 15:12:32 +08:00
Haojun Liao 665107ad3a enh(stream): add more info in meta table. 2024-04-15 14:23:37 +08:00
dmchen 0526618fe5 resolve conflict 2024-04-15 03:45:37 +00:00
yihaoDeng 4948bd690d 3.0 merge compress 2024-04-15 11:38:44 +08:00