Haojun Liao
|
366cd1871a
|
Merge pull request #21314 from taosdata/fix/liaohj_main
fix(stream):extract delete msg from wal.
|
2023-05-17 14:52:49 +08:00 |
wangmm0220
|
c52a4ea4f0
|
fix:merge from 3.0
|
2023-05-17 01:11:55 +08:00 |
|
wangmm0220
|
90099ea1c0
|
fix:compile error in windows
|
2023-05-16 18:41:35 +08:00 |
|
wangmm0220
|
e6860cada8
|
fix:compile error in windows
|
2023-05-16 18:35:10 +08:00 |
Haojun Liao
|
5e16db4e19
|
fix(stream):extract delete msg from wal.
|
2023-05-16 08:54:03 +08:00 |
|
wangmm0220
|
36454c73ed
|
fix:add lock to pHandle for safety
|
2023-05-15 18:38:14 +08:00 |
|
Haojun Liao
|
8e15c64499
|
refactor: do some internal refactor.
|
2023-05-13 23:22:36 +08:00 |
|
Haojun Liao
|
170c603995
|
other: merge 3.0
|
2023-05-13 20:16:55 +08:00 |
|
Haojun Liao
|
236926b9ee
|
other: merge enh/rocksdbstate
|
2023-05-13 19:49:28 +08:00 |
|
Haojun Liao
|
1975e94501
|
Merge branch 'main' into enh/rocksdbSstate
|
2023-05-13 19:41:03 +08:00 |
|
Haojun Liao
|
40ffe0cd83
|
fix(tmq): check handle status before close sub.
|
2023-05-13 16:45:21 +08:00 |
|
Haojun Liao
|
b383651d8b
|
fix(tmq): fix the invalid write and set the flag when closing taosx sub.
|
2023-05-13 16:17:26 +08:00 |
|
Haojun Liao
|
5b2ef2a675
|
other: merge main and remove invalid return data for poll.
|
2023-05-13 02:31:39 +08:00 |
|
Haojun Liao
|
7ef16e1922
|
other: merge main.
|
2023-05-12 11:49:53 +08:00 |
|
wangmm0220
|
cd105381a9
|
fix:[TD-24111]avoid exec pHandle task in multi query thread
|
2023-05-12 11:41:59 +08:00 |
|
wangmm0220
|
d85f0f56d5
|
fix:[TD-24111]avoid exec pHandle task in multi query thread
|
2023-05-12 10:51:13 +08:00 |
yihaoDeng
|
5708fcb5cb
|
Merge branch 'enh/3.0' into enh/rocksdbSstateMerge
|
2023-05-10 08:02:16 +00:00 |
|
wangmm0220
|
587f750c94
|
fix:[TD-24058]send poll result to client if no data 5 times to avoid lost data
|
2023-05-09 17:42:11 +08:00 |
|
Haojun Liao
|
9392c03b7f
|
fix(stream): add some logs.
|
2023-05-06 19:05:55 +08:00 |
|
wangmm0220
|
cce868d140
|
fix:offset encode assert error
|
2023-04-28 09:45:16 +08:00 |
|
wangmm0220
|
1ee1b0422c
|
fix:change push mgr from SArray to Hash
|
2023-04-27 23:44:27 +08:00 |
|
wangmm0220
|
8677b56a4f
|
fix:assert error in tqProcessSubmitReqForSubscribe if put pHandle to array twice
|
2023-04-27 15:44:44 +08:00 |
|
wangmm0220
|
77e03bfd78
|
opti:change push mgr to consume msg for subscribe
|
2023-04-23 20:14:49 +08:00 |
|
Haojun Liao
|
3dbe208712
|
enh(tmq): fix memory error and add retrieve wal info as required.
|
2023-04-22 15:34:46 +08:00 |
|
Haojun Liao
|
8fac91e265
|
refactor: do some internal refactor.
|
2023-04-21 09:38:51 +08:00 |
|
Haojun Liao
|
5e6c06e253
|
fix(stream): fix the race condition during create new stream tasks.
|
2023-04-20 23:21:18 +08:00 |
|
Haojun Liao
|
f9801ba9c5
|
enh(stream): stop stream asap.
|
2023-04-20 18:58:07 +08:00 |
|
Haojun Liao
|
c654f1145d
|
enh(stream): add new msg for seek, and do some internal refactor.
|
2023-04-20 10:59:16 +08:00 |
|
Haojun Liao
|
1350af5267
|
fix(stream): set the correct initial checkpoint version to restore the operators state and add check for the initial destination tables.
|
2023-04-16 22:48:22 +08:00 |
|
Haojun Liao
|
70b45a4cf0
|
fix(stream): all data should be extracted from wal.
|
2023-04-13 23:22:09 +08:00 |
|
Haojun Liao
|
f083697dba
|
refactor(tq): do some internal refactor.
|
2023-04-11 19:04:33 +08:00 |
|
Haojun Liao
|
a4ba5401f9
|
enh(stream): set the start version of all operators.
|
2023-04-11 10:01:36 +08:00 |
|
Haojun Liao
|
7419c0bfe9
|
enh(stream): the stream will start after vnode restore being completed.
|
2023-04-10 16:56:14 +08:00 |
|
Haojun Liao
|
f5b52749c2
|
refactor: do some internal refactor.
|
2023-04-09 01:39:09 +08:00 |
|
wangmm0220
|
9f5e435140
|
fix:conflict from main
|
2023-03-25 11:49:37 +08:00 |
|
Haojun Liao
|
8f6ac6d771
|
fix(tmq): wait for 2mins when subscribe topics.
|
2023-03-24 15:36:42 +08:00 |
|
wangmm0220
|
bf78f63e22
|
fix:send data batch if consume wal where subscribe db
|
2023-03-24 10:10:52 +08:00 |
|
Haojun Liao
|
c3acab2070
|
fix(tmq): do some internal refactor.
|
2023-03-21 19:38:34 +08:00 |
|
Haojun Liao
|
18b121c69c
|
fix(tmq): fix the invalid write and do some internal refactor.
|
2023-03-21 13:45:43 +08:00 |
|
Haojun Liao
|
731a2138df
|
fix(tmq): fix error in tmq.
|
2023-03-13 17:08:17 +08:00 |
|
Haojun Liao
|
7f2aae69d4
|
fix(tmq): fix error in taosx
|
2023-03-13 01:54:29 +08:00 |
|
Haojun Liao
|
691cb08e88
|
refactor: remove some unused attributes.
|
2023-03-10 09:23:03 +08:00 |
|
Haojun Liao
|
03aa391859
|
fix(tmq): add lock before close the tsdbreader.
|
2023-03-09 23:03:51 +08:00 |
|
Haojun Liao
|
d54ae0c840
|
fix(tmq): free reader after check the reader status.
|
2023-03-07 17:49:20 +08:00 |
|
wangmm0220
|
c638564179
|
fix:confilcts from main
|
2023-02-26 23:09:57 +08:00 |
|
wangmm0220
|
54a546931c
|
fix:optimize version logic in tmq and remove useless code
|
2023-02-24 19:22:08 +08:00 |
Liu Jicong
|
9eaf8b561f
|
fix compile
|
2023-01-03 13:35:49 +08:00 |
|
Haojun Liao
|
723efba79b
|
Merge branch '3.0' into refact/submit_req
|
2022-12-26 13:25:25 +08:00 |
|
Liu Jicong
|
0d56da7508
|
fix: skip msg
|
2022-12-23 19:04:39 +08:00 |
|
Liu Jicong
|
74a253eac4
|
refactor
|
2022-12-08 13:34:42 +08:00 |
|
Liu Jicong
|
b133a56219
|
refactor: support submitreq2
|
2022-12-07 15:19:34 +08:00 |
|
Liu Jicong
|
619bbdfd82
|
refactor: support submitreq2
|
2022-12-06 05:58:28 +08:00 |
|
Liu Jicong
|
efde22f081
|
fix: memory leak
|
2022-11-15 11:59:29 +08:00 |
|
Liu Jicong
|
4b5807c7f0
|
fix(tmq): set precision
|
2022-10-26 15:54:00 +08:00 |
|
Liu Jicong
|
75e5e490fd
|
refactor(stream): recover and fill history
|
2022-10-26 00:31:00 +08:00 |
|
Liu Jicong
|
ca2012a521
|
refactor: tmq commit
|
2022-10-18 16:56:07 +08:00 |
|
Liu Jicong
|
73662b3058
|
refactor: table sink
|
2022-10-17 14:48:56 +08:00 |
|
Liu Jicong
|
fab0adde99
|
fix memory error
|
2022-09-28 23:06:45 +08:00 |
|
Liu Jicong
|
0e8aaf4c9e
|
feat(tmq): push optimization
|
2022-09-28 10:38:49 +08:00 |
|
Liu Jicong
|
1fe4ab2341
|
feat(taox): support auto create sub table
|
2022-09-01 11:45:00 +08:00 |
|
Liu Jicong
|
e9d1733e8c
|
fix tbname
|
2022-08-31 14:37:18 +08:00 |
|
Liu Jicong
|
c4dcc994fb
|
remove queue scan
|
2022-08-31 11:35:25 +08:00 |
|
wangmm0220
|
bf3231ab9f
|
fix: cols num error in tmq for query
|
2022-08-29 17:30:50 +08:00 |
|
wangmm0220
|
c7bf08d5af
|
feat: get snapshot data for taosX
|
2022-08-24 17:42:33 +08:00 |
|
wangmm0220
|
d2727b6252
|
feat:merge from 3.0
|
2022-08-18 10:45:20 +08:00 |
|
Liu Jicong
|
357b21cfeb
|
refactor(tmq): use tdb to store check info
|
2022-08-17 13:58:56 +08:00 |
|
wangmm0220
|
78c9f245b1
|
fix:conflicts from 3.0
|
2022-08-16 15:18:11 +08:00 |
|
Liu Jicong
|
bb0ce39511
|
refactor(stream): add stream meta
|
2022-08-08 15:05:54 +08:00 |
|
wangmm0220
|
f28155714e
|
fix:confilcts from 3.0
|
2022-08-06 12:31:15 +08:00 |
|
wangmm0220
|
45e7597df3
|
feat:get data from snapshot for taosx
|
2022-08-05 21:12:18 +08:00 |
|
wangmm0220
|
c3cd858a63
|
feat:add snapshot for tmq in stable and db
|
2022-08-04 15:01:59 +08:00 |
|
Liu Jicong
|
d43eec5d16
|
enh(stream): directly dispatch
|
2022-08-02 22:23:33 +08:00 |
|
Liu Jicong
|
b084dd8ee6
|
feat(tq): transport snapshot
|
2022-08-01 19:12:37 +08:00 |
Shengliang Guan
|
5b654779ba
|
Merge pull request #15372 from taosdata/fix/tsim
test: regression case
|
2022-07-25 15:23:41 +08:00 |
|
Liu Jicong
|
e1046c7a98
|
fix: memory leak
|
2022-07-22 18:11:29 +08:00 |
|
Liu Jicong
|
2441ec22bd
|
feat(tmq): check alter for ntb
|
2022-07-22 16:05:28 +08:00 |
|
Liu Jicong
|
b49c61cfb4
|
merge 3.0
|
2022-07-21 20:44:08 +08:00 |
|
Liu Jicong
|
eaf11ca1ac
|
refactor(tmq): disable parallel
|
2022-07-21 20:15:52 +08:00 |
|
Haojun Liao
|
c2d588a118
|
other:merge 3.0
|
2022-07-21 11:29:34 +08:00 |
|
Haojun Liao
|
ee34c3bb3e
|
fix(query): add query involved column info
|
2022-07-21 11:20:30 +08:00 |
|
Liu Jicong
|
fb52cfa816
|
fix(stream): memory error
|
2022-07-20 19:31:56 +08:00 |
|
Haojun Liao
|
cd2eaf0152
|
fix(query): set the output column number for subscribe.
|
2022-07-19 16:01:28 +08:00 |
|
Liu Jicong
|
500553d581
|
refactor: add debug log
|
2022-07-18 11:41:56 +08:00 |
|
Liu Jicong
|
d637ffe22c
|
refactor(tmq): prepare only needed
|
2022-07-12 14:10:22 +08:00 |
|
Liu Jicong
|
9189f886a9
|
feat(tmq): support consume from tsdb then wal
|
2022-07-10 16:34:45 +08:00 |
|
Liu Jicong
|
2225411edc
|
refactor(stream)
|
2022-07-10 13:57:17 +08:00 |
|
Liu Jicong
|
3cd5a35054
|
refactor(stream): internal refactor
|
2022-07-08 17:48:34 +08:00 |
|
Liu Jicong
|
866e4c4be0
|
refactor(stream): internal refactor
|
2022-07-07 17:56:52 +08:00 |
|
Liu Jicong
|
4a648d711f
|
feat(wal): support filter
|
2022-07-07 13:56:47 +08:00 |
|
Liu Jicong
|
1ec57798d2
|
ci: remove unstable case
|
2022-07-07 11:45:28 +08:00 |
|
Liu Jicong
|
52d09b4173
|
refactor(wal)
|
2022-07-01 14:39:21 +08:00 |
|
Liu Jicong
|
4695dc2dae
|
feat(tmq): add snapshot test
|
2022-06-30 14:41:50 +08:00 |
|
Liu Jicong
|
c2955a807b
|
feat(tmq): offset support snapshot
|
2022-06-29 21:04:51 +08:00 |
|
Liu Jicong
|
4ed47a0296
|
feat(tmq): scan tsdb as snapshot
|
2022-06-23 13:35:24 +08:00 |
|
Liu Jicong
|
3f6ce2da73
|
feat(tmq): support topic with meta
|
2022-06-21 15:18:09 +08:00 |
|
Liu Jicong
|
601e454a24
|
enh(tmq): put offset store into vnode
|
2022-06-14 13:58:40 +08:00 |
|
Liu Jicong
|
d3cf004164
|
fix(tmq): false cache
|
2022-06-10 18:04:03 +08:00 |
|
Liu Jicong
|
2677a3c8d9
|
refactor(stream)
|
2022-06-06 20:15:36 +08:00 |
|
Liu Jicong
|
f3b680f630
|
refactor(tmq): push mode
|
2022-06-01 22:22:14 +08:00 |
|
Liu Jicong
|
135836c729
|
fix(tmq): tq deserialize msg
|
2022-06-01 19:57:03 +08:00 |