Commit Graph

4866 Commits

Author SHA1 Message Date
Haojun Liao 9ba8e6bd34 refactor: add logs for drop streams. 2024-04-30 09:26:06 +08:00
Yihao Deng f99cad9443 opt transfer 2024-04-29 11:30:38 +00:00
dapan1121 0997355460
Merge pull request #25560 from taosdata/tsma_tradeoff
usable tsma
2024-04-29 09:22:50 +08:00
wangjiaming0909 cb008f18dc usable tsma 2024-04-29 09:18:40 +08:00
dapan1121 df4421b0a2
Merge pull request #25542 from taosdata/fix/TD-29841
use debug log when fetching no tsmas for table
2024-04-29 08:26:12 +08:00
Haojun Liao f115a33a94
Merge pull request #25538 from taosdata/fix/3_liaohj
refactor: do some internal refactor.
2024-04-28 23:21:52 +08:00
Hongze Cheng 0253aed220
Merge pull request #25522 from taosdata/enh/TD-29801-3.0
enh: batch create table
2024-04-28 17:16:23 +08:00
Haojun Liao 3c5ca17737 Merge branch '3.0' into fix/3_liaohj 2024-04-28 13:57:16 +08:00
wangjiaming0909 88cc43250f use debug log when fetching no tsmas for table 2024-04-28 12:42:10 +08:00
Yihao Deng d9c112244b profile opt 2024-04-28 03:48:00 +00:00
Haojun Liao ed962186a1 enh(stream): add attrs for stream tasks. 2024-04-28 10:22:09 +08:00
Haojun Liao b2d8260f14 refactor: do some internal refactor. 2024-04-28 10:05:22 +08:00
kailixu 504263315d enh: batch create table 2024-04-28 04:37:30 +08:00
Haojun Liao 5f5595a6ab
Merge pull request #25517 from taosdata/fix/3_liaohj
fix(stream): add task node into update list if it is timeout for more than 100sec.
2024-04-26 17:00:23 +08:00
Hongze Cheng 63a735a546
Merge pull request #25512 from taosdata/fix/TD-29713
fix: arb reduce duplicate updates
2024-04-26 16:33:04 +08:00
Haojun Liao 8b53f76691 fix(stream): discard the repeatly recv checkpoint-source msg. 2024-04-26 15:56:34 +08:00
wangjiaming0909 ffea69ac5c remove forbid funcs 2024-04-26 12:14:43 +08:00
Shungang Li 21f508fe58 fix: arb reduce duplicate updates 2024-04-26 11:40:06 +08:00
54liuyao 2a72ceadd1 Merge branch '3.0' of https://github.com/taosdata/TDengine into 3.0 2024-04-24 18:57:22 +08:00
Haojun Liao 3b08ee3d16
Merge pull request #25458 from taosdata/fix/3_liaohj
fix(stream): add task update trans conflict level.
2024-04-24 18:54:06 +08:00
Hongze Cheng c085efb4f8
Merge pull request #25456 from taosdata/FIX/TD-29704-3.0
fix: execute undo actions of TRN_EXEC_SERIAL trans sequentially
2024-04-24 18:09:56 +08:00
dapan1121 ab2c9aaf5b
Merge pull request #25466 from taosdata/enh/TD-29758
enh:[TD-29758]optimize log in tmq
2024-04-24 17:47:28 +08:00
54liuyao 3300bf04c1 opt bloom filter 2024-04-24 17:27:24 +08:00
Benguang Zhao 9f8e970a32 enh: set default errcode as action in progress in executing serial trans 2024-04-24 11:23:53 +08:00
Hongze Cheng e47d17e826
Merge pull request #25451 from taosdata/enh/refactorCompress
refactor compress
2024-04-24 10:55:00 +08:00
Benguang Zhao 396c08e14a fix: execute undo actions of TRN_EXEC_SERIAL trans sequentially 2024-04-24 10:52:49 +08:00
Benguang Zhao edcd1b87d8 refact: add mndTransExecuteActionsSerial 2024-04-24 10:52:49 +08:00
wangmm0220 20cedc3339 enh:[TD-29758]optimize log in tmq 2024-04-24 10:02:58 +08:00
kailixu c173be667c Merge branch '3.0' into fix/TD-29750-3.0 2024-04-24 08:44:43 +08:00
kailixu a0a7c05faf fix: if not exists logic for topic/stream/table 2024-04-23 18:42:05 +08:00
Yihao Deng 7ddfe085f1 refactor code 2024-04-23 10:26:56 +00:00
Haojun Liao 0c7373509e fix(stream): add task update trans conflict level. 2024-04-23 18:07:00 +08:00
Benguang Zhao 10e9d79201 refact: rename STrans redoActionPos to actionPos 2024-04-23 16:44:05 +08:00
wangjiaming0909 2c0624a8ae fix create tsma transaction 2024-04-22 13:21:32 +08:00
wangmm0220 1695824c73 fix:merge from 3.0 2024-04-19 13:52:57 +08:00
wangmm0220 42467c0e00 opti:raw data from tmq 2024-04-19 13:48:17 +08:00
Hongze Cheng fc5c84422e
Merge pull request #25256 from taosdata/feat/TD-24834
Feat/td 24834
2024-04-19 13:34:37 +08:00
kailixu a044308150 enh: error code optimization for encryption key 2024-04-19 10:36:09 +08:00
Haojun Liao 4802cd1ddf Merge branch '3.0' into fix/3_liaohj 2024-04-18 17:53:30 +08:00
Haojun Liao ddf98ae0c2 refactor: do some internal refactor. 2024-04-17 18:04:02 +08:00
dm chen 1196ea72da
Merge branch '3.0' into feat/TD-24834 2024-04-17 17:13:29 +08:00
kailixu 3bad06b76f enh: error log optimization for invalid dnode cfg 2024-04-17 16:59:43 +08:00
kailixu 384e650882 enh: show encryptions 2024-04-17 14:41:47 +08:00
Yihao Deng 04e78d0ce7 Merge branch 'feat/3.0' into feat/compress_3.0 2024-04-17 03:23:02 +00:00
kailixu 74afb8deae chore: solve conflicts 2024-04-17 10:52:34 +08:00
dapan1121 5936d3a1b0
Merge pull request #25300 from taosdata/draft/tsma_before_ci
feat: support tsma
2024-04-17 10:00:17 +08:00
Yihao Deng 6f9de676f0 Merge branch 'fix/compress_3.0' into feat/compress_3.0 2024-04-16 09:27:26 +00:00
Haojun Liao 5ae8b68b17 fix(stream): fix deadlock. 2024-04-16 15:37:51 +08:00
wangjiaming0909 92e91c2032 fix ci 2024-04-16 14:27:06 +08:00
wangjiaming0909 1978a06e6e merge with 3.0 2024-04-16 14:27:06 +08:00
wangjiaming0909 039939196a forbid tsma agg funcs with tag columns 2024-04-16 14:25:34 +08:00
wangjiaming0909 1b37ef03fb fix duplicate tsma funcs 2024-04-16 14:25:34 +08:00
wangjiaming0909 97498e1844 fix create tsma txn and fix fetch wrong stream progress 2024-04-16 14:25:34 +08:00
wangjiaming0909 de1c28d623 tsma avoid fetching tsma for no tsma tables 2024-04-16 14:25:34 +08:00
wangjiaming0909 f6200dd923 support long ctb names 2024-04-16 14:25:34 +08:00
wangjiaming0909 6ce0616ffd fix ci and TODOs 2024-04-16 14:25:34 +08:00
wangjiaming0909 e43580f71b fix ci 2024-04-16 14:25:20 +08:00
wangjiaming0909 2b594e02d2 fix tsma name too long 2024-04-16 14:25:20 +08:00
wangjiaming0909 7de0a34ae6 support maxTsmaCalcDelay, maxTsmaNum, skip_tsma 2024-04-16 14:25:01 +08:00
wangjiaming0909 3566cac206 add max tsma num opt 2024-04-16 14:23:26 +08:00
wangjiaming0909 a2cbbba24d find TODO 2024-04-16 14:23:26 +08:00
wangjiaming0909 d1101a0325 support filter out tsma res tbs when show stables/tables 2024-04-16 14:23:26 +08:00
wangjiaming0909 a8e00f7410 drop tb in transaction 2024-04-16 14:23:26 +08:00
wangjiaming0909 3d77e8432d support rm ttl tb 2024-04-16 14:23:26 +08:00
wangjiaming0909 1ef153de63 support drop ctb for tsma 2024-04-16 14:23:25 +08:00
wangjiaming0909 1a06dd684e support drop ctb 2024-04-16 14:23:25 +08:00
wangjiaming0909 94f2f6ae22 fix drop ctb 2024-04-16 14:23:25 +08:00
wangjiaming0909 98ca847eb8 add tests 2024-04-16 14:18:11 +08:00
wangjiaming0909 a75c67efc8 rebase with stream sub table name no group id 2024-04-16 14:18:10 +08:00
wangjiaming0909 c3e73d9168 fix recursive tsma 2024-04-16 14:18:10 +08:00
wangjiaming0909 d8200b2f63 fetch lastts vnode version before create tsma 2024-04-16 14:18:10 +08:00
wangjiaming0909 8e56d9a359 fix tsmas 2024-04-16 14:18:10 +08:00
wangjiaming0909 e947a2fb0d catalog cache get stream progress 2024-04-16 14:18:10 +08:00
wangjiaming0909 6e7dc4b7b4 normal table tsma and add tests 2024-04-16 14:17:12 +08:00
wangjiaming0909 70ca830378 support recursive tsma creation 2024-04-16 14:17:12 +08:00
Haojun Liao 810eb22eb2 fix(stream): generate the checkpoint id after checking the max checkpoint id from vnode. 2024-04-16 14:15:18 +08:00
wangjiaming0909 a438a77e78 rewrite tbname for partition by tbname 2024-04-16 14:14:40 +08:00
wangjiaming0909 895a4584e6 generate tsma plan 2024-04-16 14:14:39 +08:00
wangjiaming0909 4b6fb0ffc6 tsma optimization 2024-04-16 14:14:39 +08:00
wangjiaming0909 0fd66d7e8a tsma optimization 2024-04-16 14:14:39 +08:00
wangjiaming0909 ef47fd57d6 support tsma catalog cache 2024-04-16 14:14:34 +08:00
wangjiaming0909 f77cd43d26 ins_tsmas 2024-04-16 14:13:10 +08:00
wangjiaming0909 08fc9170f5 refine 2024-04-16 14:13:10 +08:00
wangjiaming0909 6324d1293a drop tsma 2024-04-16 14:13:10 +08:00
wangjiaming0909 8e2977d083 create tsma request 2024-04-16 14:13:10 +08:00
wangjiaming0909 5589cf0309 server handle tsma creation 2024-04-16 14:13:10 +08:00
dm chen aedec5ead7
Merge branch '3.0' into feat/TD-24834 2024-04-16 11:35:49 +08:00
kailixu a6fe9a861f sdb release for dnode 2024-04-16 08:34:41 +08:00
Haojun Liao 13bd296d58 Merge branch '3.0' into fix/3_liaohj 2024-04-15 18:53:48 +08:00
Haojun Liao 1ac192c069 fix(stream): keep the original tsdb scan version range. 2024-04-15 18:41:38 +08:00
Haojun Liao 87dfc1f931 fix(stream):fix error in unit test cases. 2024-04-15 18:40:51 +08:00
Yihao Deng ea9385912f Merge branch '3.0' into feat/compress_3.0 2024-04-15 09:06:30 +00:00
kailixu 545519bc3d enh: default encrypt algorightm for db 2024-04-15 16:29:49 +08:00
kailixu 123090e18a fix: solve conflicts 2024-04-15 16:12:15 +08:00
dm chen 4d660d89c0
Merge branch '3.0' into feat/TD-24834 2024-04-15 15:12:32 +08:00
Haojun Liao 665107ad3a enh(stream): add more info in meta table. 2024-04-15 14:23:37 +08:00
yihaoDeng 4948bd690d 3.0 merge compress 2024-04-15 11:38:44 +08:00
dmchen c2c1a41af5 revert tmp ci 2024-04-15 02:21:11 +00:00
Minglei Jin 4b3e3f9091 Merge branch '3.0' into enh/TD-28945-pk 2024-04-15 09:31:56 +08:00
Minglei Jin 356f668542 mnd: fix s3_chunksize & s3_keeplocal if zero 2024-04-11 16:26:39 +08:00
wangmm0220 f609a45dd2 Merge branch 'feat/TS-4243-3.0' of https://github.com/taosdata/TDengine into feat/TS-4243-tmq 2024-04-11 16:21:14 +08:00
wangmm0220 14531fbf7b fix:filter data error & add test case 2024-04-11 16:20:28 +08:00
Minglei Jin 6515d74fa2 Merge branch '3.0' into enh/TD-28945-pk 2024-04-11 16:02:01 +08:00
Minglei Jin 69a7db50b0 mnd: fix s3_keeplocal's format 2024-04-11 15:40:36 +08:00
54liuyao 1d42e927c6 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TS-4243-3.0 2024-04-11 15:35:42 +08:00
kailixu 3738ce9e10 chore: solve conflicts of sql.c 2024-04-11 11:05:58 +08:00
Minglei Jin 3d733370f0 mnd: fix mnode dump db info with arb 2024-04-11 10:48:54 +08:00
Haojun Liao fabb986aa8 fix(stream): fix stack overflow, caused by print epset. 2024-04-10 19:54:33 +08:00
dmchen 8875311f23 remove log output 2024-04-10 09:04:53 +00:00
yihaoDeng a02426fd2f Merge branch '3.0' into feature/compressData 2024-04-10 09:03:50 +00:00
Minglei Jin fe12f87c58 Merge branch 'feat/TS-4243-3.0' into enh/TD-28945-pk 2024-04-10 11:21:50 +08:00
Minglei Jin dcd9901d5f Merge branch '3.0' into feat/TS-4243-3.0 2024-04-10 11:18:19 +08:00
Minglei Jin 6eb014e32b Merge branch 'feat/TS-4243-3.0' into enh/TD-28945-pk 2024-04-09 19:11:46 +08:00
dmchen 17907ff8b9 tmp ci 2024-04-09 08:33:38 +00:00
Minglei Jin 4d08390d56 cos/multi-writing: fix chunsize's default value setting 2024-04-09 10:06:34 +08:00
Shungang Li 16e0fc44e2 fix: arb reply to set-assigned no matter what error 2024-04-08 19:56:22 +08:00
54liuyao 53265e9e09 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/ly-TS-4243-3.0 2024-04-08 17:24:09 +08:00
Minglei Jin 23d0037c03 cos/multi-write: fix var name from pCfg to pNewCfg 2024-04-08 11:02:28 +08:00
Minglei Jin a407f76165 Merge branch '3.0' into enh/TD-28945 2024-04-08 10:55:47 +08:00
Minglei Jin d5e9169769 cos/multi-write: dnode part including mnode/vnode/tsdb 2024-04-08 10:31:49 +08:00
Benguang Zhao 2fa55f04e1 enh: check validity of commit actions of trans 2024-04-07 15:26:21 +08:00
Benguang Zhao ccc7a0bf08 enh: skip trans context switch in error logging 2024-04-07 15:26:20 +08:00
Benguang Zhao ac6846d76c enh: check validity of parallel actions of trans 2024-04-07 15:26:18 +08:00
kailixu b4c8375cb9 chore: solve conflicts 2024-04-07 14:53:05 +08:00
kailixu 91cefc3c60 chore: restore code change 2024-04-07 10:34:25 +08:00
Hongze Cheng 5440471e07
Merge pull request #25257 from taosdata/ENH/TS-4595-3.0
enh: not to touch meta data during balance vgroup leader
2024-04-03 18:50:23 +08:00
54liuyao 537395e845 Merge branch 'feat/TS-4243-3.0' of https://github.com/taosdata/TDengine into feat/ly-TS-4243-3.0 2024-04-03 09:54:10 +08:00
Benguang Zhao 018d388278 enh: not to write confirm after balance vgroup leader 2024-04-02 18:20:26 +08:00
Hongze Cheng 6c886d1e4a
Merge pull request #25160 from taosdata/ENH/TS-4595-3.0
enh: support changeless transaction of tasks
2024-04-02 16:45:35 +08:00
dmchen d06bfd9cea free and log 2024-04-02 02:30:56 +00:00
dapan1121 eb50334baf
Merge pull request #25234 from taosdata/fix/TD-28032
fix:cases error
2024-04-02 10:17:04 +08:00
54liuyao 204c5acefe Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/ly-TS-4243-3.0 2024-04-02 09:10:52 +08:00
yihaoDeng cb27761e66 Merge branch '3.0' into feature/compressData 2024-04-01 13:14:37 +00:00
wangmm0220 174b0a104e fix:case error 2024-04-01 19:59:30 +08:00
dmchen 0a4556984c merge 2024-04-01 09:19:29 +00:00
kailixu c4aba0ac37 feat: encryption key optimize and test case adjust 2024-04-01 16:14:55 +08:00
yihaoDeng 53ecfe511a Merge branch '3.0' into feature/compressData 2024-04-01 08:04:16 +00:00
Haojun Liao c6294200ea
Merge pull request #25211 from taosdata/fix/TD-28032
fix:same subtable same partition by leads to same table name in stream
2024-04-01 15:49:47 +08:00
kailixu 717c4b3d9c chore: restore codes 2024-04-01 14:01:09 +08:00
kailixu 6eaa99bb2d feat: encryption algorithm 2024-04-01 13:58:13 +08:00
kailixu 9e4d692d6b feat: support encryption 2024-04-01 00:49:25 +08:00
yihaoDeng 17b2310df3 fix ci error 2024-03-31 13:57:18 +00:00
yihaoDeng 9e11fe45a9 fix ci error 2024-03-31 00:08:23 +00:00
yihaoDeng aa5ccf2b0b Merge branch '3.0' into feature/compressData 2024-03-30 09:57:23 +00:00
yihaoDeng 0cce8df6b5 Merge branch '3.0' into feature/compressData 2024-03-30 02:00:24 +00:00
kailixu 8dce61b68f chore: merge TD-29280-3.0 2024-03-29 11:39:46 +08:00
kailixu 9d59fb53f4 feat: support create encrypt key 2024-03-29 11:37:40 +08:00
dmchen b9deb71fc5 basic function 2024-03-29 02:48:49 +00:00
factosea 9ddc0b51cb merge 2024-03-29 10:37:59 +08:00
kailixu f99d193335 feat: user config dnode procedure 2024-03-29 10:25:19 +08:00
kailixu 4e54dc09c5 enh: dnode online judgement 2024-03-28 16:59:00 +08:00
kailixu a3398f791e enh: dnodes status optimization 2024-03-28 16:17:35 +08:00
wangmm0220 8e2a2414c0 fix:same subtable same partition by leads to same table name in stream 2024-03-28 13:48:46 +08:00
kailixu 64e32e5c85 chore: merge 3.0 2024-03-28 08:23:43 +08:00
kailixu d64594932b feat: support database encryption 2024-03-27 20:03:38 +08:00
wangmm0220 4722f8be87 fix:write schema error if schema ver is 1 more than origin version 2024-03-27 15:17:49 +08:00
wangmm0220 f4fed29739 fix:write schema error if schema ver is 1 more than origin version 2024-03-27 15:04:37 +08:00
Haojun Liao 0bfd606e5c
Merge pull request #25193 from taosdata/fix/3_liaohj
fix(stream): acquire the stream task in exec buffer if not in mnode store.
2024-03-27 13:17:14 +08:00
Haojun Liao e776cde461 fix(stream):fix unrelease stream obj. 2024-03-27 09:02:21 +08:00
Haojun Liao f3c306d582 fix(stream): add some comments. 2024-03-26 23:28:20 +08:00
Haojun Liao 3c7fe5fd01 fix(stream): check null ptr. 2024-03-26 23:27:38 +08:00
yihaoDeng 18986c0ced refactor code 2024-03-26 12:44:53 +00:00
kailixu 374ef4593c feat: encryptions/encrypt_key grammar 2024-03-26 19:56:15 +08:00
Haojun Liao 46280bfee9 fix(stream): add some comments. 2024-03-26 19:40:47 +08:00
Haojun Liao 530e0133b9 fix(stream): acquire the stream task in exec buffer if not in mnode store. 2024-03-26 19:39:58 +08:00
yihaoDeng 02e0e45183 refactor code 2024-03-26 08:50:21 +00:00
yihaoDeng 0bb9e1195d refactor code 2024-03-25 13:48:24 +00:00
Shungang Li 44ce5b951d fix: arb group leak 2024-03-25 18:38:04 +08:00
54liuyao a02535c3ab Merge branch 'feat/TS-4243-3.0' of https://github.com/taosdata/TDengine into feat/ly-TS-4243-3.0 2024-03-25 11:15:21 +08:00
Benguang Zhao 02528eaa48 enh: not to touch meta data during balance vgroup leader 2024-03-22 16:24:13 +08:00
Benguang Zhao 85ccba0fab enh: support changeless transaction of tasks 2024-03-22 15:37:53 +08:00
Hongze Cheng 537fa8558b
Merge pull request #25155 from taosdata/fix/TD-29190
fix: arb send set assigned req
2024-03-22 14:11:48 +08:00
Shungang Li 2821e706a5 fix: arb send set assigned req 2024-03-22 12:59:07 +08:00
Hongze Cheng 6f174fdb7a
Merge pull request #25126 from taosdata/fix/TD-29180
fix: arb alter database check
2024-03-22 09:54:08 +08:00
Shungang Li be54767897 fix: arb show null in show arbgroups 2024-03-21 18:13:25 +08:00
Hongze Cheng 9429c9d04c
Merge pull request #25048 from taosdata/enh/TS-4531-3.0
enh: logs and show grants
2024-03-21 11:03:28 +08:00
54liuyao a60f390cdc stream primary key 2024-03-21 10:50:07 +08:00
Haojun Liao 109fd34b38
Merge pull request #25141 from taosdata/fix/3_liaohj
fix(stream): adjust conflict level when creating stream.
2024-03-20 23:02:21 +08:00
Haojun Liao a9ba534f48 fix(stream): adjust conflict level when creating stream. 2024-03-20 18:31:57 +08:00
Benguang Zhao b4eb22c7a4 enh: add logging info for alter vnode hash range action 2024-03-20 16:26:52 +08:00
Shungang Li 701ac8b865 fix: arb alter database check 2024-03-20 11:05:57 +08:00
Cary Xu 861528fb6c
Merge branch '3.0' into enh/TS-4531-3.0 2024-03-19 17:03:41 +08:00
Hongze Cheng a9c1bcc91c
Merge pull request #25097 from taosdata/feat/TD-25880
feat: support 2 replica with arbitrator
2024-03-19 16:44:07 +08:00
Shungang Li 4185962c43 fix: arb unit test 2024-03-19 14:26:11 +08:00
kailixu 3da55a48ca enh: code optimization 2024-03-19 11:03:30 +08:00
Shungang Li 7f3b49bde8 enh: arb adjust version code 2024-03-19 09:38:05 +08:00
Shungang Li d0df927dfa feat: arb add version in sarbgroup 2024-03-19 09:31:05 +08:00
Shungang Li fc7575279c fix: arb unit test 2024-03-19 09:30:51 +08:00
Shungang Li 3a656c3595 feat: support 2 replica with arbitrator 2024-03-19 09:30:35 +08:00
kailixu 7df12ffe50 fix: update machine id 2024-03-19 08:40:48 +08:00
wangmm0220 4810053142 opti:tmq 2024-03-18 21:43:22 +08:00
wangmm0220 0ccad9d5de Merge branch '3.0' of https://github.com/taosdata/TDengine into mark/tmq-opti 2024-03-18 21:23:58 +08:00
kailixu 0b15e3415d enh: machine id persistence 2024-03-18 18:06:18 +08:00
yihaoDeng 3964f01793 fix invalid read 2024-03-18 07:23:55 +00:00
wangmm0220 5624efff4e opti:tmq 2024-03-18 14:31:40 +08:00
Haojun Liao 29d9e8a9f9
Merge pull request #25105 from taosdata/fix/3_liaohj
fix(stream): fix stream task retrieve reallocate error
2024-03-15 21:44:21 +08:00
Haojun Liao a576be6ae5 fix(stream): set the correct rows info for stream tasks when retreiving task info. 2024-03-15 15:19:20 +08:00
yihaoDeng bdbe9b042c Merge branch 'feature/compressData' of https://github.com/taosdata/TDengine into feature/compressData 2024-03-14 12:20:13 +00:00
factosea c6adba9bfc fix: merge error 2024-03-14 19:56:19 +08:00
facetosea 6678a65dc4 merge ts-4243 2024-03-14 19:06:34 +08:00