Commit Graph

383 Commits

Author SHA1 Message Date
wangmm0220 f90fd21142 fix:[TS-4592]merge conflicts 2024-07-11 15:04:07 +08:00
wangmm0220 b28437aaba feat:[TS-4592] clear lost status for consumer 2024-07-10 18:42:20 +08:00
wangmm0220 3236907467 Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/TD-30915 2024-07-09 18:35:41 +08:00
wangmm0220 2176fa3b1a fix:[TD-30883]send hb before close in tmq 2024-07-08 15:49:00 +08:00
wangmm0220 2ce9d05f75 fix:[TD-30915]tmq exit elegantly 2024-07-08 15:33:04 +08:00
wangmm0220 e14d11c78a fix:[TD-30915]tmq exit elegantly 2024-07-08 14:28:27 +08:00
wangmm0220 322c0633aa fix:[TD-30915]send hb before close in tmq 2024-07-08 10:46:14 +08:00
wangmm0220 fc544705fe fix:[TD-30915]tmq exit elegantly 2024-07-08 09:12:50 +08:00
wangmm0220 304460f452 fix:[TD-30725] fix potential memory leaks 2024-07-01 10:49:24 +08:00
dapan1121 18019bcd44
Merge pull request #26310 from taosdata/fix/TD-30704-3.0
fix:[TD-30704] null pointer error if exception occurs
2024-06-27 10:57:14 +08:00
Hongze Cheng b761bd2e38 enh: port main change to 3.0 2024-06-26 10:32:15 +08:00
wangmm0220 173446e84e fix:[TD-30704] null pointer error if exception occurs 2024-06-25 13:59:56 +08:00
wangmm0220 0e473952c4 fix:[TD-28412] change offset from earliest/-1 to earliest/0 to avoid tmqParamsTest.py error 2024-06-06 14:18:21 +08:00
wangmm0220 61475a0a7b docs:[TD-30393]add api document for tmq 2024-06-04 17:24:10 +08:00
wangmm0220 cebb168133 Merge branch '3.0' of https://github.com/taosdata/TDengine into doc/TD-30393 2024-06-04 14:28:34 +08:00
wangmm0220 61e6b25da6 fix:add api document for tmq 2024-06-04 14:27:46 +08:00
dapan1121 c2394eaec8
Merge pull request #25956 from taosdata/fix/TD-30306
fix:[TD-30306]error in converity scan
2024-06-04 09:15:37 +08:00
dapan1121 8a4070f06c
Merge pull request #25966 from taosdata/fix/TD-30323-3.0
fix:[TD-30323]tmq close error if consumer is cleared
2024-06-03 19:02:59 +08:00
wangmm0220 5217131f50 fix:[TD-30306]error in converity scan 2024-06-03 16:48:44 +08:00
wangmm0220 d85d3aa70e fix:[TD-30306]error in converity scan 2024-06-02 22:06:52 +08:00
wangmm0220 1a6a0d3107 fix:[TD-30323]tmq close error if consumer is cleared 2024-05-29 16:04:37 +08:00
wangmm0220 7182e0948e fix:[TD-30306]error in converity scan 2024-05-29 10:49:36 +08:00
54liuyao a2255ca355 add tmq param 2024-05-28 18:34:37 +08:00
54liuyao 7fc2e8cc26 batch meta 2024-05-28 10:17:20 +08:00
54liuyao d33b2521fd adj res type 2024-05-24 11:42:08 +08:00
54liuyao be82e4acd2 add log 2024-05-24 11:25:30 +08:00
54liuyao 441a150d66 optimize tmq snapshot meta 2024-05-23 17:35:54 +08:00
wangmm0220 07a0d21ff0 fix:[TS-4716]wait too long if change system time 2024-05-17 23:39:17 +08:00
wangmm0220 b0cdf887b4 fix:[TS-4716]wait too long if change system time 2024-05-17 14:27:09 +08:00
factosea e1ae87bbf5 use tsem2 2024-05-15 14:57:14 +08:00
yihaoDeng 07291a7ebc fix:[TS-4718]pMsg->data is null 2024-04-29 01:19:53 +08:00
wangmm0220 4c87857153 fix:[TS-4718]pMsg->data is null 2024-04-25 19:49:01 +08:00
wangmm0220 20cedc3339 enh:[TD-29758]optimize log in tmq 2024-04-24 10:02:58 +08:00
dapan1121 312ca43b9f
Merge pull request #25399 from taosdata/opti/TS-4658
opti:add local thread error msg array
2024-04-19 18:23:39 +08:00
wangmm0220 16065e2a2d fix:move err msg to tmq interface 2024-04-19 16:36:11 +08:00
wangmm0220 42467c0e00 opti:raw data from tmq 2024-04-19 13:48:17 +08:00
wangmm0220 529ca1d1c1 opti:add local thread error msg array 2024-04-18 13:56:43 +08:00
wangmm0220 ca8153fb98 fix:filter data error & add test case 2024-04-12 09:49:08 +08:00
wangmm0220 da6eda6912 Merge branch 'feat/TS-4243-3.0' of https://github.com/taosdata/TDengine into feat/TS-4243-tmq 2024-04-09 13:44:09 +08:00
wangmm0220 71292f45ef fix:data compatibility in tmq 2024-04-02 23:59:23 +08:00
wangmm0220 912cb09839 Merge branch 'feat/TS-4243-3.0' of https://github.com/taosdata/TDengine into feat/TS-4243-tmq 2024-03-22 18:22:13 +08:00
wangmm0220 f1853ced26 feat:[TS-4243] add logic for primark key in tmq 2024-03-22 17:48:59 +08:00
wangmm0220 4dfc531e6c opti:subscribe logic 2024-03-12 19:42:26 +08:00
wangmm0220 bb80866395 fix:memory leak 2024-03-08 14:49:48 +08:00
dapan1121 74f4cc9d2a
Merge pull request #24921 from taosdata/mark/tmq-3.0
fix:[TD-28869]get error in askEp because consumer is dropped when uns…
2024-03-04 09:27:47 +08:00
wangmm0220 e17832e27e fix:[TD-28869]get error in askEp because consumer is dropped when unsubscribe 2024-02-29 14:38:09 +08:00
wangmm0220 eec6b66877 fix:[TD-28869]get error in askEp because consumer is dropped when unsubscribe topic 2024-02-28 17:05:11 +08:00
Haojun Liao 6bc12c8728 refactor: do some internal refactor. 2024-02-27 16:27:59 +08:00
dapan1121 794d4a931c
Merge pull request #24820 from taosdata/mark/3.0
fix:add excluded msg for meta in tmq
2024-02-23 09:41:39 +08:00
wangmm0220 c2c49a4b22 fix:change datablock to old version for compatibility 2024-02-22 19:01:58 +08:00
wangmm0220 604ae220f3 fix:change datablock to old version for compatibility 2024-02-22 17:48:33 +08:00
wangmm0220 6e13e4aa63 fix:add excluded msg for meta in tmq 2024-02-22 10:58:32 +08:00
wangmm0220 77e2500a81 fix:conflicts from 3.0 2024-02-19 18:46:31 +08:00
wangmm0220 478e1a67ae fix:[TD-28590]add logic for consume excluded 2024-02-06 18:14:06 +08:00
wangmm0220 871ebfa7ba Merge branch '3.0' of https://github.com/taosdata/TDengine into mark/3.0 2024-02-06 14:02:46 +08:00
wangmm0220 5796f411e4 Merge branch 'mark/3.0' of https://github.com/taosdata/TDengine into mark/3.0 2024-02-05 17:08:05 +08:00
wangmm0220 a656d75ca7 opti:consume data excluded from some source 2024-02-05 17:07:50 +08:00
wangmm0220 d369289ea2 fix:[TD-28514] memory leak 2024-02-01 16:34:05 +08:00
wangmm0220 bd2bef2428 fix:add test case 2024-01-26 15:05:31 +08:00
wangmm0220 2798ff824c feat:[TD-28247]add grant for subscribe and stream 2024-01-25 16:07:09 +08:00
wangmm0220 1b85adaa3a opti:[TD-28118] raw block data for tmq 2024-01-18 14:17:08 +08:00
wangmm0220 d5d1dd9127 opti:[TD-28118] raw block data for tmq 2024-01-17 20:08:26 +08:00
wangmm0220 d3659db2ff fix:[TD-28202]move tq timer to write thread in mnode 2024-01-11 19:22:54 +08:00
wangmm0220 53ce344b36 fix:set error msg if build consumer error 2023-12-28 17:09:52 +08:00
wangmm0220 e1eda752e7 fix:[TS-4242] tmq status is always RECOVER 2023-11-23 20:44:10 +08:00
yihaoDeng 55e66eac3c fix:print log if assert & check epoch when update epoch 2023-10-31 20:47:08 +08:00
wangmm0220 e92460105c fix:print log if assert & check epoch when update epoch 2023-10-31 15:36:32 +08:00
wangmm0220 770c88200f fix:print log if assert & check epoch when update epoch 2023-10-30 09:19:31 +08:00
wangmm0220 473142fab7 fix:conflicts from 3.0 2023-10-16 11:35:56 +08:00
Haojun Liao cdd480d186
Merge pull request #23249 from taosdata/feat/TD-26052
fix:core dump if tmq is null
2023-10-13 16:50:48 +08:00
wangmm0220 9cfb15d4f4 fix:core dump if tmq is null 2023-10-13 14:04:00 +08:00
Haojun Liao eb4449999f other: merge 3.0 2023-10-12 10:33:48 +08:00
wangmm0220 33045e63ae feat:[TD-26056] add replay logic 2023-10-09 17:35:40 +08:00
wangmm0220 5f7b6f19ba feat:[TD-26056] add replay logic 2023-10-08 19:05:59 +08:00
wangmm0220 3f2d890560 feat:[TD-26056] add replay logic 2023-10-08 16:06:15 +08:00
wangmm0220 9c470e9297 opti:set default offset to latest in subscription & return error if use snapshot when consume column 2023-10-07 15:25:24 +08:00
Haojun Liao 68c329e1f7
Merge pull request #23015 from taosdata/mark/tmq-3.0
fix:add interface tmq_get_connect to get TAOS from tmq
2023-09-22 14:02:19 +08:00
wangmm0220 63a6aacc18 fix:add interface tmq_get_connect to get TAOS from tmq 2023-09-22 11:44:37 +08:00
wangmm0220 70b5509217 fix:enable split if there are topics 2023-09-21 18:16:05 +08:00
wangmm0220 06afd0bd33 fix:add interface tmq_get_connect to get TAOS from tmq 2023-09-21 15:13:38 +08:00
wangmm0220 7869b693f2 add test case for tmq in vnode transform & fix core in race condition for pTq->pExecStore 2023-09-18 14:09:28 +08:00
wangmm0220 ef81299494 fix:heap use after free 2023-09-14 13:41:14 +08:00
wangmm0220 a833d5d769 fix:need update epset if unsubscribe topic and topicNumGet is 0 at the same time 2023-09-14 10:39:22 +08:00
wangmm0220 f729150497 fix:opti poll callbak logic & send epoch as -1 to get epset if vnode transformed 2023-09-13 18:32:45 +08:00
wangmm0220 d707f69a6c opti:ask ep logic in tmq 2023-09-13 09:52:24 +08:00
wangmm0220 f4ec83025d opti:optimize code logic & fix python test case error 2023-09-06 19:46:17 +08:00
wangmm0220 629de12bb1 fix:do not return error if commit nothing 2023-09-06 18:29:28 +08:00
wangmm0220 cc62961337 fix:heap use after free of pParamSet since the first commitCb is called before send another commit message 2023-09-06 14:45:07 +08:00
wangmm0220 897fd5b8b5 fix:tmq close error because of same committed offset 2023-09-06 10:15:41 +08:00
wangmm0220 53c4f4a147 opti:commit logic 2023-09-05 10:35:05 +08:00
wangmm0220 9a2da3adee fix:set vg status idle if reveive poll callback 2023-09-04 18:31:07 +08:00
wangmm0220 90e938e48f fix:set vg status idle if reveive poll callback 2023-09-04 16:53:12 +08:00
wangmm0220 f0fbe08e1d fix:core dump if tmq is null 2023-09-01 16:45:46 +08:00
wangmm0220 b8f041f5ea fix:use vgstatus before if rebalance 2023-09-01 10:05:46 +08:00
wangmm0220 ac6d031e62 fix:do not send unsubscribe msg to taosd if subscribe failed 2023-08-21 17:56:35 +08:00
wangmm0220 78fd70202c fix:offset error in tmq & add test cases 2023-08-10 16:18:53 +08:00
wade zhang bae028d65c
Merge pull request #22230 from taosdata/mark/tmq
fix:semaphore always wait in tmq commit logic
2023-07-31 09:10:13 +08:00
wangmm0220 6e673072cd fix:conflicts 2023-07-28 14:57:13 +08:00
Haojun Liao 3d403dca5a other: merge main. 2023-07-27 16:23:41 +08:00
wangmm0220 75eacd56f1 fix:add log 2023-07-27 15:58:32 +08:00