wangmm0220
|
7b22d37f12
|
fix:lost data when consumer db
|
2023-08-11 17:25:43 +08:00 |
|
wangmm0220
|
25e32bbf7c
|
fix:offset error in tmq & add test cases
|
2023-08-11 14:25:12 +08:00 |
Haojun Liao
|
74834aea11
|
enh(stream): prepare hb to mnode from stream meta.
|
2023-07-28 13:07:16 +08:00 |
|
Haojun Liao
|
d29f835a63
|
fix(stream): set the correct step2 scan time window range.
|
2023-07-25 15:09:22 +08:00 |
Haojun Liao
|
b2a905bd91
|
Merge branch '3.0' into enh/triggerCheckPoint2
|
2023-07-17 11:50:12 +08:00 |
yihaoDeng
|
e18c9ea672
|
add checkpoint
|
2023-07-15 04:26:34 +00:00 |
|
yihaoDeng
|
3c4631ef1f
|
add checkpoint
|
2023-07-14 10:06:24 +00:00 |
|
Haojun Liao
|
3ffdbe923d
|
other: merge 3.0
|
2023-07-11 09:12:57 +08:00 |
|
wangmm0220
|
0928bd5510
|
fix:send rsp offset to client if unregister push mgr
|
2023-07-06 19:35:48 +08:00 |
|
Haojun Liao
|
d7101f7109
|
enh(stream): support dispatch checkpoint msg.
|
2023-07-06 18:26:22 +08:00 |
|
Haojun Liao
|
f4a3567935
|
other: merge 3.0
|
2023-07-06 11:24:30 +08:00 |
|
yihaoDeng
|
f2b96fb4b3
|
add checkpoint
|
2023-06-27 12:28:28 +00:00 |
|
Haojun Liao
|
64365666b7
|
fix(stream): update the info, and do some internal refactor.
|
2023-06-16 16:04:43 +08:00 |
|
Haojun Liao
|
74e0138f72
|
Merge branch '3.0' into refact/fillhistory
|
2023-06-15 15:25:00 +08:00 |
|
wangmm0220
|
22776e60d5
|
fix:control memory size if consumer group is too much
|
2023-06-15 14:51:04 +08:00 |
|
Haojun Liao
|
b44447e6f3
|
enh(stream): support restore from disk.
|
2023-06-14 10:19:03 +08:00 |
|
wangmm0220
|
8a81278024
|
fix:load pHandle if necessary wher tq restore
|
2023-06-13 15:14:11 +08:00 |
|
Haojun Liao
|
d45aa7ef84
|
Merge pull request #21555 from taosdata/fix/liaohj_main
other: merge main into 3.0.
|
2023-06-02 13:11:12 +08:00 |
|
Haojun Liao
|
5301c5756a
|
other: merge main into 3.0.
|
2023-06-01 09:29:18 +08:00 |
|
wangmm0220
|
78db3520a6
|
fix:conflict
|
2023-05-29 14:57:03 +08:00 |
|
wangmm0220
|
50487255b3
|
fix:put poll to push manager if wal not exist when offset is latest
|
2023-05-26 19:02:40 +08:00 |
|
wangmm0220
|
8537e4e80e
|
feat:add tag filter for stable subscribe
|
2023-05-24 18:26:55 +08:00 |
|
yihaoDeng
|
9380b22394
|
merge 3.0
|
2023-05-18 05:46:38 +00:00 |
|
Haojun Liao
|
a4d9210b07
|
fix(tmq): add filter for taosX poll rsp.
|
2023-05-17 16:40:44 +08:00 |
|
Haojun Liao
|
041ffa91bd
|
other: merge main.
|
2023-05-17 15:42:15 +08:00 |
|
Haojun Liao
|
366cd1871a
|
Merge pull request #21314 from taosdata/fix/liaohj_main
fix(stream):extract delete msg from wal.
|
2023-05-17 14:52:49 +08:00 |
|
wangmm0220
|
c52a4ea4f0
|
fix:merge from 3.0
|
2023-05-17 01:11:55 +08:00 |
|
wangmm0220
|
90099ea1c0
|
fix:compile error in windows
|
2023-05-16 18:41:35 +08:00 |
|
wangmm0220
|
e6860cada8
|
fix:compile error in windows
|
2023-05-16 18:35:10 +08:00 |
|
Haojun Liao
|
5e16db4e19
|
fix(stream):extract delete msg from wal.
|
2023-05-16 08:54:03 +08:00 |
|
wangmm0220
|
36454c73ed
|
fix:add lock to pHandle for safety
|
2023-05-15 18:38:14 +08:00 |
|
Haojun Liao
|
8e15c64499
|
refactor: do some internal refactor.
|
2023-05-13 23:22:36 +08:00 |
|
Haojun Liao
|
170c603995
|
other: merge 3.0
|
2023-05-13 20:16:55 +08:00 |
|
Haojun Liao
|
236926b9ee
|
other: merge enh/rocksdbstate
|
2023-05-13 19:49:28 +08:00 |
|
Haojun Liao
|
1975e94501
|
Merge branch 'main' into enh/rocksdbSstate
|
2023-05-13 19:41:03 +08:00 |
|
Haojun Liao
|
40ffe0cd83
|
fix(tmq): check handle status before close sub.
|
2023-05-13 16:45:21 +08:00 |
|
Haojun Liao
|
b383651d8b
|
fix(tmq): fix the invalid write and set the flag when closing taosx sub.
|
2023-05-13 16:17:26 +08:00 |
|
Haojun Liao
|
5b2ef2a675
|
other: merge main and remove invalid return data for poll.
|
2023-05-13 02:31:39 +08:00 |
|
Haojun Liao
|
7ef16e1922
|
other: merge main.
|
2023-05-12 11:49:53 +08:00 |
|
wangmm0220
|
cd105381a9
|
fix:[TD-24111]avoid exec pHandle task in multi query thread
|
2023-05-12 11:41:59 +08:00 |
|
wangmm0220
|
d85f0f56d5
|
fix:[TD-24111]avoid exec pHandle task in multi query thread
|
2023-05-12 10:51:13 +08:00 |
|
yihaoDeng
|
5708fcb5cb
|
Merge branch 'enh/3.0' into enh/rocksdbSstateMerge
|
2023-05-10 08:02:16 +00:00 |
|
wangmm0220
|
587f750c94
|
fix:[TD-24058]send poll result to client if no data 5 times to avoid lost data
|
2023-05-09 17:42:11 +08:00 |
|
Haojun Liao
|
9392c03b7f
|
fix(stream): add some logs.
|
2023-05-06 19:05:55 +08:00 |
|
wangmm0220
|
cce868d140
|
fix:offset encode assert error
|
2023-04-28 09:45:16 +08:00 |
|
wangmm0220
|
1ee1b0422c
|
fix:change push mgr from SArray to Hash
|
2023-04-27 23:44:27 +08:00 |
|
wangmm0220
|
8677b56a4f
|
fix:assert error in tqProcessSubmitReqForSubscribe if put pHandle to array twice
|
2023-04-27 15:44:44 +08:00 |
|
wangmm0220
|
77e03bfd78
|
opti:change push mgr to consume msg for subscribe
|
2023-04-23 20:14:49 +08:00 |
|
Haojun Liao
|
3dbe208712
|
enh(tmq): fix memory error and add retrieve wal info as required.
|
2023-04-22 15:34:46 +08:00 |
|
Haojun Liao
|
8fac91e265
|
refactor: do some internal refactor.
|
2023-04-21 09:38:51 +08:00 |
|
Haojun Liao
|
5e6c06e253
|
fix(stream): fix the race condition during create new stream tasks.
|
2023-04-20 23:21:18 +08:00 |
|
Haojun Liao
|
f9801ba9c5
|
enh(stream): stop stream asap.
|
2023-04-20 18:58:07 +08:00 |
|
Haojun Liao
|
c654f1145d
|
enh(stream): add new msg for seek, and do some internal refactor.
|
2023-04-20 10:59:16 +08:00 |
|
Haojun Liao
|
1350af5267
|
fix(stream): set the correct initial checkpoint version to restore the operators state and add check for the initial destination tables.
|
2023-04-16 22:48:22 +08:00 |
|
Haojun Liao
|
70b45a4cf0
|
fix(stream): all data should be extracted from wal.
|
2023-04-13 23:22:09 +08:00 |
|
Haojun Liao
|
f083697dba
|
refactor(tq): do some internal refactor.
|
2023-04-11 19:04:33 +08:00 |
|
Haojun Liao
|
a4ba5401f9
|
enh(stream): set the start version of all operators.
|
2023-04-11 10:01:36 +08:00 |
|
Haojun Liao
|
7419c0bfe9
|
enh(stream): the stream will start after vnode restore being completed.
|
2023-04-10 16:56:14 +08:00 |
|
Haojun Liao
|
f5b52749c2
|
refactor: do some internal refactor.
|
2023-04-09 01:39:09 +08:00 |
|
wangmm0220
|
9f5e435140
|
fix:conflict from main
|
2023-03-25 11:49:37 +08:00 |
|
Haojun Liao
|
8f6ac6d771
|
fix(tmq): wait for 2mins when subscribe topics.
|
2023-03-24 15:36:42 +08:00 |
|
wangmm0220
|
bf78f63e22
|
fix:send data batch if consume wal where subscribe db
|
2023-03-24 10:10:52 +08:00 |
|
Haojun Liao
|
c3acab2070
|
fix(tmq): do some internal refactor.
|
2023-03-21 19:38:34 +08:00 |
|
Haojun Liao
|
18b121c69c
|
fix(tmq): fix the invalid write and do some internal refactor.
|
2023-03-21 13:45:43 +08:00 |
|
Haojun Liao
|
731a2138df
|
fix(tmq): fix error in tmq.
|
2023-03-13 17:08:17 +08:00 |
|
Haojun Liao
|
7f2aae69d4
|
fix(tmq): fix error in taosx
|
2023-03-13 01:54:29 +08:00 |
|
Haojun Liao
|
691cb08e88
|
refactor: remove some unused attributes.
|
2023-03-10 09:23:03 +08:00 |
|
Haojun Liao
|
03aa391859
|
fix(tmq): add lock before close the tsdbreader.
|
2023-03-09 23:03:51 +08:00 |
|
Haojun Liao
|
d54ae0c840
|
fix(tmq): free reader after check the reader status.
|
2023-03-07 17:49:20 +08:00 |
|
wangmm0220
|
c638564179
|
fix:confilcts from main
|
2023-02-26 23:09:57 +08:00 |
|
wangmm0220
|
54a546931c
|
fix:optimize version logic in tmq and remove useless code
|
2023-02-24 19:22:08 +08:00 |
Liu Jicong
|
9eaf8b561f
|
fix compile
|
2023-01-03 13:35:49 +08:00 |
|
Haojun Liao
|
723efba79b
|
Merge branch '3.0' into refact/submit_req
|
2022-12-26 13:25:25 +08:00 |
|
Liu Jicong
|
0d56da7508
|
fix: skip msg
|
2022-12-23 19:04:39 +08:00 |
|
Liu Jicong
|
74a253eac4
|
refactor
|
2022-12-08 13:34:42 +08:00 |
|
Liu Jicong
|
b133a56219
|
refactor: support submitreq2
|
2022-12-07 15:19:34 +08:00 |
|
Liu Jicong
|
619bbdfd82
|
refactor: support submitreq2
|
2022-12-06 05:58:28 +08:00 |
|
Liu Jicong
|
efde22f081
|
fix: memory leak
|
2022-11-15 11:59:29 +08:00 |
|
Liu Jicong
|
4b5807c7f0
|
fix(tmq): set precision
|
2022-10-26 15:54:00 +08:00 |
|
Liu Jicong
|
75e5e490fd
|
refactor(stream): recover and fill history
|
2022-10-26 00:31:00 +08:00 |
|
Liu Jicong
|
ca2012a521
|
refactor: tmq commit
|
2022-10-18 16:56:07 +08:00 |
|
Liu Jicong
|
73662b3058
|
refactor: table sink
|
2022-10-17 14:48:56 +08:00 |
|
Liu Jicong
|
fab0adde99
|
fix memory error
|
2022-09-28 23:06:45 +08:00 |
|
Liu Jicong
|
0e8aaf4c9e
|
feat(tmq): push optimization
|
2022-09-28 10:38:49 +08:00 |
|
Liu Jicong
|
1fe4ab2341
|
feat(taox): support auto create sub table
|
2022-09-01 11:45:00 +08:00 |
|
Liu Jicong
|
e9d1733e8c
|
fix tbname
|
2022-08-31 14:37:18 +08:00 |
|
Liu Jicong
|
c4dcc994fb
|
remove queue scan
|
2022-08-31 11:35:25 +08:00 |
|
wangmm0220
|
bf3231ab9f
|
fix: cols num error in tmq for query
|
2022-08-29 17:30:50 +08:00 |
|
wangmm0220
|
c7bf08d5af
|
feat: get snapshot data for taosX
|
2022-08-24 17:42:33 +08:00 |
|
wangmm0220
|
d2727b6252
|
feat:merge from 3.0
|
2022-08-18 10:45:20 +08:00 |
|
Liu Jicong
|
357b21cfeb
|
refactor(tmq): use tdb to store check info
|
2022-08-17 13:58:56 +08:00 |
|
wangmm0220
|
78c9f245b1
|
fix:conflicts from 3.0
|
2022-08-16 15:18:11 +08:00 |
|
Liu Jicong
|
bb0ce39511
|
refactor(stream): add stream meta
|
2022-08-08 15:05:54 +08:00 |
|
wangmm0220
|
f28155714e
|
fix:confilcts from 3.0
|
2022-08-06 12:31:15 +08:00 |
|
wangmm0220
|
45e7597df3
|
feat:get data from snapshot for taosx
|
2022-08-05 21:12:18 +08:00 |
|
wangmm0220
|
c3cd858a63
|
feat:add snapshot for tmq in stable and db
|
2022-08-04 15:01:59 +08:00 |
|
Liu Jicong
|
d43eec5d16
|
enh(stream): directly dispatch
|
2022-08-02 22:23:33 +08:00 |
|
Liu Jicong
|
b084dd8ee6
|
feat(tq): transport snapshot
|
2022-08-01 19:12:37 +08:00 |
Shengliang Guan
|
5b654779ba
|
Merge pull request #15372 from taosdata/fix/tsim
test: regression case
|
2022-07-25 15:23:41 +08:00 |
|
Liu Jicong
|
e1046c7a98
|
fix: memory leak
|
2022-07-22 18:11:29 +08:00 |