Commit Graph

4433 Commits

Author SHA1 Message Date
kailixu d281bc70b0 feat: remove hb of grantInfo 2024-02-04 16:46:24 +08:00
kailixu 3ebc26e1fb feat: support uniq grant 2024-02-04 16:33:43 +08:00
kailixu 3a08926319 feat: support uniq grant 2024-02-03 17:32:02 +08:00
kailixu 231cf000da Merge branch 'feat/TD-27463-3.0a' into feat/TD-27463-3.0 2024-02-02 00:07:15 +08:00
kailixu 67425fce1e feat: support uniq grant 2024-02-01 22:57:56 +08:00
kailixu adee720128 feat: support uniq grant 2024-02-01 17:48:29 +08:00
Haojun Liao 0fe9c05c5f
Merge pull request #24704 from taosdata/fix/3_liaohj
fix(stream): take ver snapshot for all vgroups
2024-02-01 17:07:36 +08:00
Haojun Liao 88f246b988 fix(stream): fix syntax error on windows, and add null ptr check for pTrans obj. 2024-02-01 15:08:06 +08:00
dmchen 907e06ad4d clusterid by taosd 2024-02-01 04:52:54 +00:00
Haojun Liao cb2ea4a721 fix(stream): take ver snapshot for all vgroups before launching stream with fill-history option opened. 2024-02-01 11:37:57 +08:00
wangmm0220 a9fcc67321 fix:conflicts from 3.0 2024-02-01 11:13:03 +08:00
wade zhang eeba6a24ad
Merge pull request #24686 from taosdata/feat/TD-27463-3.0
feat: support uniq grant
2024-02-01 09:47:14 +08:00
54liuyao 0afed5263e add mid operator retrive 2024-01-31 18:09:13 +08:00
kailixu 1e9c963e02 feat: support uniq grant 2024-01-31 17:22:57 +08:00
kailixu a860e9039d feat: support uniq grant 2024-01-31 13:52:03 +08:00
kailixu 4ffc4017bd feat: support uniq grant 2024-01-31 13:02:17 +08:00
kailixu ac5fa32867 feat: support uniq grant 2024-01-31 12:36:58 +08:00
dmchen 5cf8687fd7 fix/TD-28519 2024-01-31 04:23:28 +00:00
kailixu f50867831b feat: support uniq grant 2024-01-31 10:43:31 +08:00
kailixu 18ece50f86 feat: support uniq grant 2024-01-31 10:02:44 +08:00
kailixu 41072348b9 Merge branch '3.0' into feat/TD-27463-3.0 2024-01-31 10:02:12 +08:00
kailixu a11410378f feat: support uniq grant 2024-01-31 09:47:10 +08:00
kailixu 93c0890f68 feat: support uniq grant 2024-01-31 09:13:10 +08:00
wade zhang 17e74e76e6
Merge pull request #24679 from taosdata/fix/TD-28503-3.0
fix/TD-28503
2024-01-31 09:11:36 +08:00
kailixu 2b1a0cdbfe feat: support uniq grant 2024-01-31 08:53:45 +08:00
kailixu 5fd10d4049 feat: support uniq grant 2024-01-31 00:40:47 +08:00
Haojun Liao 556baed25d other: merge 3.0 2024-01-30 18:35:59 +08:00
Haojun Liao 086943ea5c
Merge pull request #24610 from taosdata/fix/TD-28446
fix:[TD-28446] modify trans confilct in subscribe
2024-01-30 17:49:05 +08:00
Haojun Liao 4c22e03c1b
Merge pull request #24642 from taosdata/feat/TD-28247
feat:[TD-28247]add grant for subscribe and stream
2024-01-30 17:48:05 +08:00
dmchen 917a6eb5a7 fix/TD-28503 2024-01-30 09:47:20 +00:00
Haojun Liao efbc7e1402 fix(stream): fix memory leak. 2024-01-30 15:35:01 +08:00
Haojun Liao 584b7f236f
Merge pull request #24665 from taosdata/fix/3_liaohj
refactor: do some internal refactor.
2024-01-30 10:38:19 +08:00
Haojun Liao 11c9c7d936 refactor: do some internal refactor. 2024-01-30 09:17:02 +08:00
Haojun Liao 45891babd3
Merge pull request #24655 from taosdata/fix/3_liaohj
refactor: do some internal refactor.
2024-01-30 09:15:10 +08:00
wangmm0220 51b7cd99d6 feat:[TD-28247]add grant for subscribe and stream 2024-01-29 14:28:48 +08:00
Haojun Liao b714c70434 refactor: do some internal refactor. 2024-01-29 13:46:33 +08:00
Haojun Liao f4f01e4bf4
Merge pull request #24654 from taosdata/fix/3_liaohj
feat(stream): drop orphan tasks.
2024-01-29 13:10:47 +08:00
Haojun Liao 9087a0d9d0 feat(stream): drop orphan tasks. 2024-01-29 11:03:50 +08:00
kailixu 80b1ad77d6 feat: support uniq grant 2024-01-28 21:24:30 +08:00
kailixu e0d61c40f5 feat: support uniq grant 2024-01-26 19:06:56 +08:00
Haojun Liao bfbd61a02f
Merge pull request #24634 from taosdata/fix/3_liaohj
refactor: do some internal refactor.
2024-01-26 18:08:54 +08:00
wangmm0220 35e2b681c7 fix:conflicts from 3.0 2024-01-26 16:32:40 +08:00
Haojun Liao ac08f659c3 refactor: remove invalid procedure in fill-history. 2024-01-26 16:20:43 +08:00
Haojun Liao 50b59ad936 fix(stream): add null ptr check. 2024-01-26 16:08:01 +08:00
wangmm0220 ce2a3e4be2 fix:test case error 2024-01-26 15:35:29 +08:00
wangmm0220 bd2bef2428 fix:add test case 2024-01-26 15:05:31 +08:00
Haojun Liao 649d26ce72 fix(stream): seek to right place to start wal read. 2024-01-26 14:14:04 +08:00
Haojun Liao 49aff4571b fix(stream): fix memory leak. 2024-01-26 11:33:07 +08:00
Haojun Liao 9b3b03caab refactor: do some internal refactor. 2024-01-26 10:22:16 +08:00
Haojun Liao bc7fe1fe6a refactor: do some internal refactor. 2024-01-26 10:08:20 +08:00
Haojun Liao bd1d1cddaf refactor: do some internal refactor. 2024-01-26 10:03:54 +08:00
Haojun Liao db117a3ac7
Merge pull request #24628 from taosdata/fix/3_liaohj
refactor: do some internal refactor.
2024-01-26 09:09:44 +08:00
wangmm0220 474514ab66 fix:test case error 2024-01-25 17:29:55 +08:00
Haojun Liao 43c035678f refactor: do some internal refactor. 2024-01-25 16:55:05 +08:00
Haojun Liao d4bab8c09b refactor: do some internal refactor. 2024-01-25 16:53:30 +08:00
Haojun Liao 834f08a2e0
Merge pull request #24552 from taosdata/fix/3_liaohj
fix(stream): do checkpoint after fill-history task completed.
2024-01-25 16:53:11 +08:00
wangmm0220 2798ff824c feat:[TD-28247]add grant for subscribe and stream 2024-01-25 16:07:09 +08:00
Hongze Cheng 9d9306a03b
Merge pull request #24612 from taosdata/fix/TD-28437-3.0
fix/TD-28437
2024-01-25 10:01:29 +08:00
kailixu 4d345b819a feat: support uniq grant 2024-01-24 19:08:19 +08:00
dmchen d9af07de6f new table structure 2024-01-24 09:44:44 +00:00
Haojun Liao dc1ea9f9a1 fix(stream): clear htask info when unregistering the task. 2024-01-24 16:23:47 +08:00
kailixu e13e61f4d5 Merge branch '3.0' into feat/TD-27463-3.0 2024-01-24 14:26:17 +08:00
Haojun Liao 8a7e38ad15 fix(stream): fix checkpoint failure check. 2024-01-24 13:10:53 +08:00
dmchen 262bb4cf12 fix/TD-28437 2024-01-24 02:30:03 +00:00
wangmm0220 416c87b5b7 fix:[TD-28446] modify trans confilct in subscribe 2024-01-23 18:48:19 +08:00
Haojun Liao 0cd84aa587 fix(stream): gen checkpoint for single task. 2024-01-23 17:51:50 +08:00
Yihao Deng 2479df3b1e sort epset 2024-01-23 06:42:42 +00:00
Yihao Deng 62e6b5ca31 sort epset 2024-01-23 06:23:34 +00:00
kailixu 486e3b7479 feat: support uniq grant 2024-01-22 18:18:01 +08:00
kailixu dbd3c53182 feat: support uniq grant 2024-01-22 13:20:15 +08:00
kailixu 5208829f23 Merge branch '3.0' into feat/TD-27463-3.0 2024-01-22 13:20:00 +08:00
Haojun Liao db474626e6 fix(stream): fix memory leak. 2024-01-22 11:49:16 +08:00
Haojun Liao 2cc584ff44 fix(stream): fix error in check vgId. 2024-01-22 11:05:42 +08:00
Yihao Deng a20845ec69 refactor retry 2024-01-22 01:04:06 +00:00
Haojun Liao 4a5ab10b3d fix(stream): fix memory leak. 2024-01-19 20:28:43 +08:00
kailixu b7ea583f3a feat: support uniq grant 2024-01-19 17:01:19 +08:00
Haojun Liao d973f66cea fix(stream): do checkpoint after fill-history task completed. 2024-01-19 16:18:02 +08:00
Yihao Deng c56ddc1ba9 refactor retry 2024-01-19 07:52:32 +00:00
kailixu 5d6703c3ef feat: support uniq grant 2024-01-19 14:59:02 +08:00
Yihao Deng 6c732a14a3 refactor retry 2024-01-19 06:20:16 +00:00
kailixu 99c493dc5c feat: support uniq grant 2024-01-18 19:40:41 +08:00
wangmm0220 7246fedfef Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/ly_multi_marks 2024-01-18 19:08:35 +08:00
kailixu 1daa224651 feat: support uniq grant 2024-01-18 17:49:11 +08:00
Haojun Liao 996e2939a9 refactor: do some internal refactor. 2024-01-18 15:58:46 +08:00
Haojun Liao 76e6c453e7 enh(stream): send msg to mnode when the transferring state completed. 2024-01-18 15:43:36 +08:00
kailixu 76558da849 feat: support uniq grant 2024-01-18 15:23:38 +08:00
Haojun Liao f8d0c52483 fix(stream): remove this unused drop history task msg and corresponding functions. 2024-01-18 14:32:48 +08:00
kailixu bf0205b54d Merge branch '3.0' into feat/TD-27463-3.0 2024-01-17 11:29:47 +08:00
kailixu 95cb004f80 feat: support uniq active code 2024-01-17 11:24:48 +08:00
Haojun Liao 3d98fc6a67 other: merge 3.0 2024-01-16 18:29:33 +08:00
Haojun Liao 0280f129bd fix(stream):add some logs. 2024-01-16 18:21:29 +08:00
Haojun Liao 882b916940 fix(stream): adjust stream trans conflict check. 2024-01-16 16:11:04 +08:00
Haojun Liao 8ede6d87ce refactor: do some internal refactor. 2024-01-16 15:40:40 +08:00
Hongze Cheng c40a87ab0e
Merge pull request #24319 from taosdata/ENH/TD-28135-3.0
enh: use learner in redistribute vgroup
2024-01-16 15:04:52 +08:00
Yihao Deng 7a09ba2630 fix pause/resume error 2024-01-15 11:56:38 +00:00
Haojun Liao 1296700092
Merge pull request #24433 from taosdata/fix/TD-28188
fix:[TD-28188]the epset of snode is error because epset is not initil…
2024-01-15 17:05:11 +08:00
wangmm0220 2ab54a1335 fix:conflicts from 3.0 2024-01-15 16:54:52 +08:00
kailixu 414e15a810 chore: merge 3.0 2024-01-15 10:42:45 +08:00
Haojun Liao 59ee690301
Merge pull request #24450 from taosdata/fix/3_liaohj
fix(stream): set error code for return.
2024-01-12 16:04:14 +08:00
Haojun Liao bc7434e2b5 fix(stream): set error code for return. 2024-01-12 14:49:16 +08:00
Haojun Liao ea0ea09b0f
Merge pull request #24409 from taosdata/opt/optMsgOnMnode
opt msg on mnd
2024-01-12 09:36:37 +08:00
Haojun Liao fe839527f3
Merge pull request #24435 from taosdata/fix/TD-28202
fix:[TD-28202]move tq timer to write thread in mnode
2024-01-12 09:35:45 +08:00
kailixu ddefc5f46a chore: merge 3.0 2024-01-11 20:05:23 +08:00
wangmm0220 d3659db2ff fix:[TD-28202]move tq timer to write thread in mnode 2024-01-11 19:22:54 +08:00
wangmm0220 89ca3418af fix:[TD-28188]the epset of snode is error because epset is not initilized 2024-01-11 17:38:15 +08:00
Haojun Liao 9703018f56 fix(stream): add checkpoint status check. 2024-01-11 16:47:51 +08:00
Haojun Liao 5f7ce21530 refactor: do some internal refactor. 2024-01-11 11:59:29 +08:00
Haojun Liao 58694c67dd refactor: do some internal refactor. 2024-01-11 11:50:52 +08:00
Yihao Deng b5e5167b8f split sync/status channel 2024-01-10 09:57:08 +00:00
Yihao Deng 2537adb728 opt msg on mnode 2024-01-10 06:00:44 +00:00
yihaoDeng 9dbddeed16 opt msg on mnd 2024-01-10 10:03:38 +08:00
Haojun Liao 9d0d0d9ddc Merge branch '3.0' into fix/3_liaohj 2024-01-10 09:57:46 +08:00
Yihao Deng 220cef4a61 opt msg on mnode 2024-01-09 11:02:10 +00:00
Yihao Deng 1eee7b44e0 fix crash found on 3.1 2024-01-08 07:31:35 +00:00
Haojun Liao f7ab55fb71
Merge pull request #24342 from taosdata/fix/TD-28155
fix:[TD-28155] set consumer lost if all current topic is 0
2024-01-08 11:39:16 +08:00
wangmm0220 f2a1d24ab1 fix:[TD-28155] set consumer lost if all current topic is 0 2024-01-05 19:28:40 +08:00
dmchen 8ddff2eecb fix/TD-28073 2024-01-05 07:02:16 +00:00
wade zhang a4f68411ed
Merge pull request #24332 from taosdata/ENH/TD-25112-3.0
enh: use learner in split vgroup
2024-01-05 14:26:27 +08:00
kailixu 1169fe357a feat: uniq grant 2024-01-05 00:53:38 +08:00
wangmm0220 bd64a78094 fix:[TD-28155] set consumer lost if all current topic is 0 2024-01-04 18:53:37 +08:00
dm chen 39f2e75a9e
Merge branch '3.0' into feat/TD-26529-3.0 2024-01-04 15:46:23 +08:00
Benguang Zhao b85f36bcea enh: allow to drop an empty dnode, no matter online or not 2024-01-04 12:00:49 +08:00
Benguang Zhao f4ad4ea998 enh: use learner in split vgroup 2024-01-04 10:01:05 +08:00
Haojun Liao 3fea717373 fix(stream): discard the orphan tasks. 2024-01-03 19:28:49 +08:00
Haojun Liao b06ccc0ca7 fix(stream): cleanup the checkpoint trans & task info in execInfo 2024-01-03 19:18:06 +08:00
Haojun Liao 185fa75376 enh(stream): add task into timer to be idle during exec when the corresponding output queue is full. 2024-01-03 17:59:42 +08:00
Haojun Liao 284ef7d085 fix(stream): remove the related checkpoint trans when trying to drop stream. 2024-01-03 14:44:04 +08:00
Benguang Zhao de5f9b351f enh: use learner in redistribute vgroup 2024-01-03 11:49:05 +08:00
Haojun Liao e7a0044502 Merge branch '3.0' into fix/3_liaohj 2024-01-02 13:02:55 +08:00
Haojun Liao 59642c674d
Merge pull request #24254 from taosdata/fix/TS-3491-3.0
fix:[TS-4391] rebalance cnt always 1 if msg lost
2024-01-02 10:34:41 +08:00
Haojun Liao 7abeb5a27a fix(stream): update the stream error code. 2023-12-29 17:44:10 +08:00
wangmm0220 d158ca74d8 fix:[TS-4391] rebalance cnt always 1 if msg lost 2023-12-29 17:22:27 +08:00
wangmm0220 c83989754f fix:[TS-4391] rebalance cnt always 1 if msg lost 2023-12-29 14:09:49 +08:00
wangmm0220 b58a23df49 fix:[TS-4391] rebalance cnt always 1 if msg lost 2023-12-29 13:57:13 +08:00
wangmm0220 10e86fc733 fix:[TS-4391] rebalance cnt always 1 if msg lost 2023-12-27 19:25:08 +08:00
54liuyao ccf861dec8 Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/3_liaohj 2023-12-26 18:36:18 +08:00
wade zhang 1a215daefa
Merge pull request #24176 from taosdata/FIX/TD-27916-3.0
enh: demarcate top and bottom halves of task trans execution
2023-12-26 18:00:41 +08:00
Haojun Liao b74e98b25c fix(stream): set the correct split timestamp for session/state window. 2023-12-26 14:17:46 +08:00
Haojun Liao 62cfcefbb0 refactor: remove stream-scan-history event for stream task. 2023-12-26 00:34:04 +08:00
Benguang Zhao 7edfbf8023 fix: set commit log for mndAddCompactDetailToTran 2023-12-25 09:47:17 +08:00
Benguang Zhao 4f29500f74 fix: set commit log for mndDropSubByTopic 2023-12-25 09:46:55 +08:00
Haojun Liao 0877e0bfad other: merge 3.0 2023-12-25 09:13:31 +08:00
Haojun Liao b175a4b7b3 refactor(stream): async stop tasks, and do some internal refactor. 2023-12-22 17:56:16 +08:00
Benguang Zhao 2de6d6c81d enh: add TSDB_CODE_MND_TRANS_CTX_SWITCH 2023-12-22 16:06:59 +08:00
wangmm0220 902504b39b fix:partical func parameters for middle interval[checkStreamSTable1.sim] 2023-12-22 15:28:02 +08:00
Haojun Liao c9475060de fix(stream): fix race condition. 2023-12-22 09:34:49 +08:00
Haojun Liao 0fab9a1827 other: fix syntax error. 2023-12-22 00:29:49 +08:00
kailixu 3005ab1953 chore: more code 2023-12-21 19:45:09 +08:00
Haojun Liao 84583580e2 fix(stream): transfer the checkpoint trans id. 2023-12-21 19:12:49 +08:00
kailixu 47fedce263 chore: more code 2023-12-21 12:11:00 +08:00