Commit Graph

12713 Commits

Author SHA1 Message Date
Haojun Liao 2ca663ce66
Merge pull request #23593 from taosdata/feat/TD-21898
stream event window
2023-11-15 14:18:07 +08:00
dapan1121 9457cf0b46
Merge pull request #23702 from taosdata/merge/m23
merge: from main to 3.0
2023-11-15 13:54:21 +08:00
wangmm0220 8a9ded764d fix:add finish history msg to snode 2023-11-15 11:50:14 +08:00
dapan1121 dfb3feb5dc Merge remote-tracking branch 'origin/main' into merge/m23 2023-11-15 11:39:18 +08:00
wade zhang d800d59bf0
Merge pull request #23693 from taosdata/FIX/TD-27303-3.0
TD-27303
2023-11-15 11:22:47 +08:00
Hongze Cheng ed6be3b8c5
Merge pull request #23695 from taosdata/fix/TD-27313
fix(cos/list): free object array in exception
2023-11-15 11:09:38 +08:00
dmchen 46b5f8631c partial retry 2023-11-15 10:26:01 +08:00
dmchen 85729babf8 retry in outside 2023-11-15 10:25:29 +08:00
dmchen f93d569552 redo 2023-11-15 10:24:59 +08:00
dmchen 20e5702183 revert 2023-11-15 10:24:15 +08:00
dmchen 481c5981d6 fix/transaction-retry 2023-11-15 10:23:46 +08:00
dmchen 1e50b11374 TD-27311 2023-11-15 01:31:51 +00:00
Haojun Liao 3294395617
Merge pull request #23686 from taosdata/fix/3_liaohj
fix(stream): send msg by using epset extract from mnode
2023-11-14 22:11:46 +08:00
Minglei Jin 7f65e92b81 tsdb/retention: not allow migrate backward 2023-11-14 19:27:18 +08:00
dmchen d8277d5505 TD-27303 2023-11-14 19:18:06 +08:00
yihaoDeng f4d6cf7c74 Merge branch '3.0' into enh/refactorBackend 2023-11-14 18:12:48 +08:00
Haojun Liao 61552e30d9 fix(stream): send msg by using epset extract from mnode, instead of cached epset in streamObj. 2023-11-14 17:13:40 +08:00
Haojun Liao b390ee859c fix(stream): send msg by using epset extract from mnode, instead of cached epset in streamObj. 2023-11-14 17:04:54 +08:00
Hongze Cheng f7e63ad1ca
Merge pull request #23680 from taosdata/fix/TD-27273
fix(tsdb/merge): skip merge if data file cannot be written
2023-11-14 16:08:12 +08:00
Minglei Jin cb3fe4d6de fix(tsdb/merge): skip merge if data file cannot be written 2023-11-14 14:15:02 +08:00
Haojun Liao 436c7871a3
Merge pull request #23673 from taosdata/fix/3_liaohj
fix(stream): fix deadlock and do some internal refactor.
2023-11-14 11:26:54 +08:00
wade zhang 9167a07e89
Merge pull request #23657 from taosdata/enh/TD-27210
enh: add humanStr convert func
2023-11-14 10:04:54 +08:00
wade zhang 2cbce6c442
Merge pull request #23578 from taosdata/FIX/TD-27171-3.0
enh: improve user error of redistribute vgroup
2023-11-14 10:04:33 +08:00
Haojun Liao f99e22b91f fix(stream): fix deadlock. 2023-11-13 23:56:42 +08:00
Haojun Liao cfa7c19dd5
Merge pull request #23667 from taosdata/fix/liaohj
fix(stream): fix deadlock.
2023-11-13 22:15:06 +08:00
wangmm0220 56381dea90 fix:conflict from 3.0 2023-11-13 18:42:59 +08:00
wangmm0220 1cbe568be7 fix:add logic when snode restart 2023-11-13 18:39:42 +08:00
Haojun Liao aad8a2eb87 fix(stream): fix deadlock. 2023-11-13 18:20:30 +08:00
Minglei Jin 6e583de80c fix(config/block-size): remove invalid range (-1, 1024) 2023-11-13 17:46:09 +08:00
Minglei Jin acd816a364 fix(tsdb/retention): move fset destruction out of for loop 2023-11-13 16:59:26 +08:00
Shungang Li a96e21aabd enh: refactor dynamic config 2023-11-13 16:28:42 +08:00
Shungang Li 06c4aa431f enh: add humanStr convert func 2023-11-13 16:28:38 +08:00
liuyao 37c102a115 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898 2023-11-13 16:06:17 +08:00
yihaoDeng de7f2a2d1a Merge branch '3.0' into enh/refactorBackend 2023-11-13 11:11:28 +08:00
wade zhang 05d7274d98
Merge pull request #23639 from taosdata/fix/TS-4249-main
TS-4249
2023-11-13 10:03:18 +08:00
wade zhang 8e5de50050
Merge pull request #23641 from taosdata/FIX/TS-4249-3.0
TS-4249
2023-11-13 10:03:03 +08:00
wangmm0220 6a44bd54ac fix:load task in snode 2023-11-13 09:12:15 +08:00
dapan1121 a51df86e43
Merge pull request #23636 from taosdata/enh/TD-25601-3.0
enh: support delete msg for rsma
2023-11-13 08:47:42 +08:00
Haojun Liao 9ee9174608 other: merge 3.0 2023-11-11 15:48:31 +08:00
Haojun Liao 3bacd7516e fix(stream): extact stream nodes list if not initialized. 2023-11-11 15:40:35 +08:00
Haojun Liao 15430f4d50 refactor: 2023-11-11 15:40:33 +08:00
Haojun Liao 5fcef5bd89 refactor:add some logs. 2023-11-11 15:40:32 +08:00
Haojun Liao 8925c721e5 fix(stream): adjust critical section. 2023-11-11 15:40:16 +08:00
Haojun Liao 5937bdddf5 refactor:disable test. 2023-11-11 15:40:12 +08:00
Haojun Liao cb0d244d5a fix(stream): release lock. 2023-11-11 15:40:11 +08:00
Haojun Liao af08a189c1 fix(stream): disable concurrently restart stream tasks. 2023-11-11 15:40:10 +08:00
Haojun Liao 4d9b422874 fix(stream): check for the repeatedly sent checkpoint-source msg. 2023-11-11 15:40:10 +08:00
Haojun Liao 45ab92a02d fix(stream): remove invalid free. 2023-11-11 15:39:55 +08:00
Haojun Liao 77d6fd5394 refactor: do some internal refactor. 2023-11-11 15:39:09 +08:00
Haojun Liao 608c72e901 refactor(stream): create sim env for stream processing. 2023-11-11 15:39:08 +08:00
Cary Xu 1c2e9c18d5
Update tqSink.c 2023-11-10 22:01:28 +08:00
kailixu 3707857c12 chore: remove obsolete code 2023-11-10 18:43:23 +08:00
kailixu 42e4e2b7a4 fix: macro define 2023-11-10 18:27:42 +08:00
kailixu 9017e2ed68 chore: code optimization 2023-11-10 18:11:06 +08:00
kailixu c04fb6d543 enh: logic optimization 2023-11-10 17:23:17 +08:00
kailixu bc44659826 fix: buffer overflow 2023-11-10 17:14:57 +08:00
Haojun Liao 438c303b0d other: merge main. 2023-11-10 17:05:36 +08:00
dmchen f69a98da9e login 2023-11-10 16:56:18 +08:00
dmchen ae1347fe5a login 2023-11-10 08:53:29 +00:00
dmchen 7fec818194 password 2023-11-10 16:47:01 +08:00
dmchen fc8b16a5f3 password 2023-11-10 08:43:24 +00:00
kailixu 11c0427b22 enh: test case to delete mutiple tables 2023-11-10 16:41:41 +08:00
dmchen 65870ae117 TS-4249 2023-11-10 16:29:59 +08:00
Haojun Liao 08a9244230 fix(stream): extact stream nodes list if not initialized. 2023-11-10 16:24:20 +08:00
dmchen 22d6204fa9 TS-4249 2023-11-10 08:23:09 +00:00
kailixu d5d8568bad fix: skip delete msg affects 0 row 2023-11-10 15:30:49 +08:00
Haojun Liao d0307e5876 refactor: 2023-11-10 15:30:21 +08:00
kailixu b1bca4e1e2 fix: batch delete logic 2023-11-10 15:12:10 +08:00
kailixu 5fae10bc76 enh: error code when build delete req 2023-11-10 15:09:01 +08:00
kailixu 2a14a10d0d Merge branch '3.0' into enh/TD-25601-3.0 2023-11-10 14:45:45 +08:00
kailixu 674e878ffa enh: rsma support delete 2023-11-10 14:44:29 +08:00
Haojun Liao 0b36081158 refactor:add some logs. 2023-11-10 14:36:18 +08:00
wangmm0220 8a05bad899 fix:snode error 2023-11-10 14:14:22 +08:00
Haojun Liao 5824caa8f5
Merge pull request #23631 from taosdata/fix/liaohj
multiple fix
2023-11-10 13:09:40 +08:00
Minglei Jin 32528ab9cd fix(tsdb/reader-writer): fix pgnoEnd calc 2023-11-10 12:44:09 +08:00
wade zhang 6bea2fe36a
Merge pull request #23625 from taosdata/fix/TD-27243-main
fix/TD-27243
2023-11-10 11:06:00 +08:00
wade zhang b5b15f36f2
Merge pull request #23627 from taosdata/FIX/TD-27243-3.0
fix/TD-27243
2023-11-10 11:05:33 +08:00
liuyao 6e9866b1ab Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898 2023-11-10 10:33:21 +08:00
Haojun Liao 233777b6ac fix(stream): adjust critical section. 2023-11-10 10:26:45 +08:00
wade zhang bc866ed28f
Merge pull request #23623 from taosdata/FIX/TD-27230-3.0
fix: remove vnode obj from hash at first when dropping an offline vnode
2023-11-10 09:50:10 +08:00
Haojun Liao d8ab8d2d03 refactor:disable test. 2023-11-10 09:46:20 +08:00
Haojun Liao ed49294e9b fix(stream): release lock. 2023-11-10 09:35:41 +08:00
Haojun Liao 9978667c48 fix(stream): disable concurrently restart stream tasks. 2023-11-10 09:24:08 +08:00
liuyao 6d2d5823dc Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898 2023-11-10 09:24:05 +08:00
yihaoDeng 3e2314b09b Merge branch '3.0' into enh/refactorBackend 2023-11-10 09:22:16 +08:00
kailixu ee6e68a71e enh: rsma support delete 2023-11-10 07:02:46 +08:00
Haojun Liao 730434ed82 fix(stream): check for the repeatedly sent checkpoint-source msg. 2023-11-09 23:26:09 +08:00
kailixu 7288b0fc77 enh: rsma delete error code 2023-11-09 20:16:29 +08:00
kailixu ff3621f382 enh: rsma delete logic 2023-11-09 20:09:39 +08:00
Hongze Cheng ec3685db94
Merge pull request #23600 from taosdata/fix/TD-27206
fix(vnode/cos): fix error printing to avoid buffer overflow
2023-11-09 06:06:54 -06:00
kailixu 572eb691fb enh: support delete msg for rsma 2023-11-09 19:51:01 +08:00
Haojun Liao e6f3d4edc7
Merge pull request #23611 from taosdata/fix/TD-27216-3
change chkpid gen way
2023-11-09 18:55:17 +08:00
dapan1121 4f67629ea1
Merge pull request #23621 from taosdata/fix/TS-4122
correct colid in blockinfo
2023-11-09 18:09:09 +08:00
dmchen 2fbf0a532d fix/TD-27243 2023-11-09 18:02:06 +08:00
yihaoDeng 757425bff8 Merge branch '3.0' into enh/refactorBackend 2023-11-09 17:58:49 +08:00
dmchen 65bebb0912 fix/TD-27243 2023-11-09 09:51:35 +00:00
Minglei Jin d3cf6a4340 tsdb/file: new nlevel field for remove 2023-11-09 17:44:24 +08:00
Hongze Cheng b1fbdfcdc9
Merge pull request #23617 from taosdata/fix/little_typo
fix: code typo
2023-11-09 03:35:31 -06:00
Benguang Zhao 73f1c55a47 fix: remove vnode obj from hash 2023-11-09 17:24:02 +08:00
Yihao Deng 0453991cdf
Merge branch '3.0' into fix/TD-27216-3 2023-11-09 17:12:56 +08:00
wade zhang c0c665d785
Merge pull request #23614 from taosdata/FIX/TD-27230-3.0
fix: close vnode in the failed mode properly in vmCloseVnode
2023-11-09 16:32:20 +08:00
wangjiaming0909 a6600ab23a correct colid in blockinfo 2023-11-09 15:41:01 +08:00
Minglei Jin 386c25a99a tsdb/retention: remove file when ref's clear 2023-11-09 15:24:19 +08:00
kailixu 9cf154543f chore: merge 3.0 2023-11-09 15:09:30 +08:00
kailixu aa3ba74f6e chore: code optimization 2023-11-09 15:03:14 +08:00
dapan1121 8314cb6013
Merge pull request #23494 from taosdata/enh/TD-23769-3.0x
enh: checkpoint for rsma
2023-11-09 14:51:37 +08:00
kailixu 74cddda24b Merge branch '3.0' into enh/TD-25601-3.0 2023-11-09 14:37:13 +08:00
Hongze Cheng e60f69a7ed fix: code typo 2023-11-09 14:20:27 +08:00
yihaoDeng f74edc7618 Merge branch '3.0' into enh/refactorBackend 2023-11-09 06:14:08 +00:00
Minglei Jin 398771da5b Merge branch '3.0' into fix/TD-27206 2023-11-09 14:06:15 +08:00
liuyao e56a3e8a1e Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898 2023-11-09 13:59:39 +08:00
yihaoDeng 15b73354f8 change chkpid gen way 2023-11-09 13:59:21 +08:00
yihaoDeng ef726fee53 change chkpid gen way 2023-11-09 13:58:36 +08:00
Benguang Zhao b80770dea8 fix: close vnode in the failed mode properly in vmCloseVnode 2023-11-09 13:05:52 +08:00
kailixu 1a950afdb8 enh: test case for rsma snapshot 2023-11-09 12:09:27 +08:00
Haojun Liao 257ab4f270
Merge pull request #23526 from taosdata/feat/TD-26060
feat:checkpoint backup function
2023-11-09 11:46:28 +08:00
kailixu 349e190120 enh: rsma result 2023-11-09 11:23:50 +08:00
kailixu 3495efaac7 enh: rsma exception process 2023-11-09 10:49:40 +08:00
Minglei Jin 5ac66679db config/s3blocksize: move range check from global to mnode 2023-11-09 10:17:46 +08:00
Haojun Liao 62f34c757e fix(stream): remove invalid free. 2023-11-09 10:10:37 +08:00
yihaoDeng 98a2ca6bfd change chkpid gen way 2023-11-09 10:07:24 +08:00
yihaoDeng 17ea6f39c1 change chkp gen way 2023-11-09 09:55:09 +08:00
Minglei Jin 1bb10bb862 vnode/cos: check get object block size optionally 2023-11-09 09:32:13 +08:00
yihaoDeng 06f196b71d change check out seq 2023-11-09 09:08:41 +08:00
kailixu 501d5a7acc Merge branch '3.0' into enh/TD-23769-3.0x 2023-11-08 20:47:15 +08:00
kailixu 72ecb0431c enh: rsma checkpoint 2023-11-08 20:45:44 +08:00
Minglei Jin 5ccdde4495 vnode/cos: error on incomplete fetching 2023-11-08 20:43:52 +08:00
yihaoDeng 0f98f4daa5 change check out seq 2023-11-08 20:29:37 +08:00
yihaoDeng 08e3448498 add seq 2023-11-08 19:54:57 +08:00
yihaoDeng 3abf0ae4b2 Merge branch 'feat/TD-26060' into enh/refactorBackend 2023-11-08 17:31:16 +08:00
liuyao a8b415ed35 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898 2023-11-08 17:26:00 +08:00
Minglei Jin 128353a861 vnode/cos: fix get object handler mem 2023-11-08 16:04:24 +08:00
Minglei Jin e5bbcf76f1 vnode/cos: fix get object block callback 2023-11-08 15:57:56 +08:00
Haojun Liao 99dbbe61d7 refactor(stream): do some internal refactor. 2023-11-08 15:20:47 +08:00
Minglei Jin a1e692a796 fix(vnode/cos): fix error printing to avoid buffer overflow 2023-11-08 15:18:55 +08:00
wangjiaming0909 3e850df3c2 fix: last(ts2), ts2, ts caused data err 2023-11-08 14:43:11 +08:00
Minglei Jin 3f125bc6bf vnode/cos: make err msg buffer big enough for detailed msg 2023-11-08 14:30:30 +08:00
liuyao 340fb3e727 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898 2023-11-08 14:16:59 +08:00
Haojun Liao 658fafd03c refactor: do some internal refactor. 2023-11-08 14:02:08 +08:00
Minglei Jin 15e1e4cd2c dnode/node_mgmt: cmake define for use_s3 2023-11-08 14:00:10 +08:00
wangjiaming0909 fc6c4fba90 feat: cache scan for select last(c), ts/c 2023-11-08 13:39:28 +08:00
Haojun Liao 809dd064a7 refactor(stream): create sim env for stream processing. 2023-11-08 11:04:16 +08:00
Minglei Jin 8bb65119a4 dnode: fix dnode s3 init 2023-11-08 10:52:23 +08:00
Haojun Liao 17bd6badec refactor(stream): do checkpoint for each task. 2023-11-08 10:47:54 +08:00
yihaoDeng 7ada7f34ac fix:merge from 3.0 2023-11-08 10:45:15 +08:00
kailixu d1106c51dc enh: rsma code optimization 2023-11-08 09:54:03 +08:00
Minglei Jin 764f8d2e45 fix(vnode/s3): move init & cleanup to dnode 2023-11-08 09:03:19 +08:00
kailixu b9f389a49f Merge branch '3.0' into enh/TD-23769-3.0x 2023-11-08 08:36:35 +08:00
kailixu f2d24306b1 enh: rsma tasks share one checkpoint and fix memory leak 2023-11-08 08:35:52 +08:00
Haojun Liao 666b8c531b
Merge pull request #23548 from taosdata/fix/liaohj
refactor: do some internal refactor.
2023-11-08 08:08:36 +08:00