Shengliang Guan
|
56f2e49764
|
refactor: adjust logs
|
2022-08-02 17:12:07 +08:00 |
|
Shengliang Guan
|
bd31c9da5a
|
Merge pull request #15657 from taosdata/fix/dnode
fix: write snapshot after apply queue is empty
|
2022-08-01 20:13:08 +08:00 |
Liu Jicong
|
b084dd8ee6
|
feat(tq): transport snapshot
|
2022-08-01 19:12:37 +08:00 |
|
Shengliang Guan
|
99f29f6455
|
refactor: adjust log
|
2022-08-01 17:23:52 +08:00 |
|
Liu Jicong
|
bb6fabcc11
|
refactor(stream): use vnode meta
|
2022-07-30 20:20:12 +08:00 |
|
Liu Jicong
|
6d67b17113
|
enh(wal): add lock to guarantee read behaviour
|
2022-07-30 16:35:49 +08:00 |
|
Liu Jicong
|
a9d11b58ad
|
enh(stream): recover
|
2022-07-28 16:19:50 +08:00 |
|
Liu Jicong
|
00acf4520c
|
refactor(stream): remove option
|
2022-07-27 16:49:03 +08:00 |
wangmm0220
|
915d3c4203
|
fix:conflicts from 3.0
|
2022-07-26 17:47:10 +08:00 |
|
wangmm0220
|
ba1962cacf
|
feat:add tmq get data interface
|
2022-07-26 17:43:22 +08:00 |
|
Liu Jicong
|
c2164dd8aa
|
fix(wal): snapshot end with no deleting
|
2022-07-26 14:13:03 +08:00 |
|
Liu Jicong
|
222e925644
|
feat(wal): ref
|
2022-07-25 16:40:19 +08:00 |
|
Shengliang Guan
|
5b654779ba
|
Merge pull request #15372 from taosdata/fix/tsim
test: regression case
|
2022-07-25 15:23:41 +08:00 |
|
Liu Jicong
|
072fe10013
|
Merge pull request #15361 from taosdata/feature/tq
fix(tmq): correctly set reader status
|
2022-07-23 20:40:14 +08:00 |
|
Liu Jicong
|
095f6aa4e0
|
fix(tmq): correctly set reader status
|
2022-07-23 20:07:16 +08:00 |
plum-lihui
|
19acda27b2
|
test: add comment for tq
|
2022-07-23 13:32:25 +08:00 |
|
Liu Jicong
|
e1046c7a98
|
fix: memory leak
|
2022-07-22 18:11:29 +08:00 |
|
Liu Jicong
|
2441ec22bd
|
feat(tmq): check alter for ntb
|
2022-07-22 16:05:28 +08:00 |
|
Liu Jicong
|
b1f3428c05
|
refactor(stream): do not merge output
|
2022-07-22 10:43:49 +08:00 |
|
Liu Jicong
|
b49c61cfb4
|
merge 3.0
|
2022-07-21 20:44:08 +08:00 |
Haojun Liao
|
8a2fb51129
|
Merge pull request #15230 from taosdata/feature/3_liaohj
fix(query): add query involved column info
|
2022-07-21 20:29:25 +08:00 |
|
Liu Jicong
|
eaf11ca1ac
|
refactor(tmq): disable parallel
|
2022-07-21 20:15:52 +08:00 |
Haojun Liao
|
c2d588a118
|
other:merge 3.0
|
2022-07-21 11:29:34 +08:00 |
|
Haojun Liao
|
ee34c3bb3e
|
fix(query): add query involved column info
|
2022-07-21 11:20:30 +08:00 |
Cary Xu
|
65871c2d73
|
Merge branch '3.0' into feature/TD-11274-3.0
|
2022-07-21 09:44:20 +08:00 |
|
Cary Xu
|
0f5983ad88
|
fix: merge dup rows in client
|
2022-07-20 20:30:54 +08:00 |
|
Liu Jicong
|
fb52cfa816
|
fix(stream): memory error
|
2022-07-20 19:31:56 +08:00 |
|
Liu Jicong
|
b74560537c
|
fix(stream): check task exist
|
2022-07-20 16:25:20 +08:00 |
|
Haojun Liao
|
282630a394
|
Merge branch '3.0' into feature/3_liaohj
|
2022-07-19 17:42:45 +08:00 |
|
Haojun Liao
|
cd2eaf0152
|
fix(query): set the output column number for subscribe.
|
2022-07-19 16:01:28 +08:00 |
54liuyao
|
8e41fc912b
|
feat(stream): add num of children
|
2022-07-19 14:17:53 +08:00 |
|
Liu Jicong
|
500553d581
|
refactor: add debug log
|
2022-07-18 11:41:56 +08:00 |
|
Liu Jicong
|
d75e9b8f6a
|
merge from 3.0
|
2022-07-14 15:35:00 +08:00 |
|
Liu Jicong
|
9ea0ad57ec
|
refactor(stream): destroy stream task
|
2022-07-14 15:32:21 +08:00 |
|
wangmm0220
|
cd051d40c3
|
fix:confilct from 3.0
|
2022-07-13 16:03:39 +08:00 |
|
Shengliang Guan
|
148e3a5f97
|
Merge pull request #14818 from taosdata/fix/mnode
enh: adjust vnode fetch queue number
|
2022-07-12 20:43:05 +08:00 |
|
Shengliang Guan
|
dad12c24fb
|
refactor: comment out to avoid crash of tmqShow.py
|
2022-07-12 19:56:38 +08:00 |
|
Liu Jicong
|
0fccdace56
|
fix(tmq): reset offset
|
2022-07-12 16:39:05 +08:00 |
|
Liu Jicong
|
7cf99d5359
|
refactor(tmq): prepare only needed
|
2022-07-12 15:11:14 +08:00 |
|
Liu Jicong
|
d637ffe22c
|
refactor(tmq): prepare only needed
|
2022-07-12 14:10:22 +08:00 |
|
wangmm0220
|
f9d5c809c9
|
fix:conflict from 3.0
|
2022-07-11 19:06:36 +08:00 |
|
Liu Jicong
|
c6052fadba
|
feat(wal): add append interface
|
2022-07-11 16:22:51 +08:00 |
|
wangmm0220
|
0a193cf811
|
feat:get meta ok
|
2022-07-11 16:12:07 +08:00 |
|
Liu Jicong
|
219d966b25
|
fix(wal): read after rolling
|
2022-07-10 21:02:25 +08:00 |
|
Liu Jicong
|
9189f886a9
|
feat(tmq): support consume from tsdb then wal
|
2022-07-10 16:34:45 +08:00 |
|
Liu Jicong
|
bafa54778a
|
refactor(stream)
|
2022-07-10 14:10:39 +08:00 |
|
Liu Jicong
|
2225411edc
|
refactor(stream)
|
2022-07-10 13:57:17 +08:00 |
|
Liu Jicong
|
e9077c036f
|
merge from 3.0
|
2022-07-10 11:24:37 +08:00 |
|
Liu Jicong
|
a2107992e2
|
refactor(stream)
|
2022-07-10 11:18:15 +08:00 |
|
Shengliang Guan
|
c53a84b733
|
Merge remote-tracking branch 'origin/3.0' into fix/valgrind
|
2022-07-09 20:13:26 +08:00 |
|
Liu Jicong
|
0fd4f3b519
|
fix(tmq): invalid free
|
2022-07-08 23:05:32 +08:00 |
|
Liu Jicong
|
8d01ae00cb
|
fix(tmq): offset
|
2022-07-08 21:37:15 +08:00 |
|
Liu Jicong
|
a9e75c87aa
|
refactor(stream): internal refactor
|
2022-07-08 19:30:40 +08:00 |
|
Shengliang Guan
|
a5e8ddbc56
|
refactor: adjust logs
|
2022-07-08 18:00:19 +08:00 |
|
Liu Jicong
|
3cd5a35054
|
refactor(stream): internal refactor
|
2022-07-08 17:48:34 +08:00 |
|
Liu Jicong
|
866e4c4be0
|
refactor(stream): internal refactor
|
2022-07-07 17:56:52 +08:00 |
|
Liu Jicong
|
1ec57798d2
|
ci: remove unstable case
|
2022-07-07 11:45:28 +08:00 |
|
Liu Jicong
|
1e7d9ada19
|
fix(stream): clean up timer
|
2022-07-07 10:55:22 +08:00 |
|
Liu Jicong
|
db23b07ae1
|
merge from 3.0
|
2022-07-06 21:12:46 +08:00 |
|
Liu Jicong
|
8c5dbde918
|
refactor(stream): stream reader created in scanner
|
2022-07-06 14:20:07 +08:00 |
Hongze Cheng
|
ddb198de23
|
Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/tsdb_refact
|
2022-07-04 03:42:50 +00:00 |
|
Liu Jicong
|
31bbef82d1
|
fix(tmq): seek snapshot offset
|
2022-07-02 20:18:40 +08:00 |
|
Liu Jicong
|
4a2b266612
|
feat(stream): support ignore expired flag
|
2022-07-02 10:59:29 +08:00 |
|
Liu Jicong
|
52d09b4173
|
refactor(wal)
|
2022-07-01 14:39:21 +08:00 |
|
Liu Jicong
|
7a65589525
|
feat(wal): add api to check log existance
|
2022-07-01 10:15:05 +08:00 |
|
Liu Jicong
|
4f107908db
|
fix(tmq): reset window
|
2022-06-30 19:51:48 +08:00 |
|
Liu Jicong
|
94f07836d6
|
fix(tmq): set scan rsp offset correctly
|
2022-06-30 17:25:19 +08:00 |
|
Liu Jicong
|
4695dc2dae
|
feat(tmq): add snapshot test
|
2022-06-30 14:41:50 +08:00 |
|
Liu Jicong
|
94c3eb29d2
|
fix(tmq): rsp error offset
|
2022-06-29 23:25:04 +08:00 |
|
Liu Jicong
|
e74187248b
|
fix(tmq): offset
|
2022-06-29 22:29:02 +08:00 |
|
Liu Jicong
|
0f0fe6276a
|
merge from 3.0
|
2022-06-29 21:33:10 +08:00 |
|
Liu Jicong
|
c2955a807b
|
feat(tmq): offset support snapshot
|
2022-06-29 21:04:51 +08:00 |
|
Haojun Liao
|
4a59e1300b
|
other: merge 3.0.
|
2022-06-28 15:22:32 +08:00 |
|
WANG MINGMING
|
f0b50add27
|
Merge pull request #14184 from taosdata/feature/TD-13041
feat:sort table group if needed & optimize partition by tag
|
2022-06-25 09:41:30 +08:00 |
|
Liu Jicong
|
f53521cb8c
|
test(stream): partition by tbname
|
2022-06-24 16:50:11 +08:00 |
|
wangmm0220
|
0d9ed6d60a
|
fix:merge from 3.0
|
2022-06-24 13:51:33 +08:00 |
|
Liu Jicong
|
323ee6b1b0
|
enh(tmq): add demo for tmq_get_raw_meta
|
2022-06-23 17:26:52 +08:00 |
|
Liu Jicong
|
14048a5e4c
|
fix(tmq): read repeat data after reading snapshot
|
2022-06-23 17:09:06 +08:00 |
|
Liu Jicong
|
71bda7e658
|
feat(tmq): add with meta config
|
2022-06-23 15:56:54 +08:00 |
|
Liu Jicong
|
2af4a4d250
|
merge from 3.0
|
2022-06-23 14:15:33 +08:00 |
|
Liu Jicong
|
4ed47a0296
|
feat(tmq): scan tsdb as snapshot
|
2022-06-23 13:35:24 +08:00 |
|
Liu Jicong
|
14a488c92c
|
feat(stream): stream support multiple type input
|
2022-06-22 21:21:39 +08:00 |
|
Liu Jicong
|
fb596625d3
|
feat(stream): support retrieve
|
2022-06-22 19:12:31 +08:00 |
|
Liu Jicong
|
3f6ce2da73
|
feat(tmq): support topic with meta
|
2022-06-21 15:18:09 +08:00 |
|
Liu Jicong
|
c409760f75
|
feat(stream): drop stream
|
2022-06-21 11:32:36 +08:00 |
|
Liu Jicong
|
450675f672
|
feat(stream): support snode
|
2022-06-20 20:18:34 +08:00 |
|
Liu Jicong
|
53ef66961a
|
feat(stream): support snode
|
2022-06-20 14:29:18 +08:00 |
|
Hongze Cheng
|
21ea4e3a0b
|
more work
|
2022-06-20 02:38:08 +00:00 |
|
Liu Jicong
|
d7660484cc
|
fix(tmq): performance issue
|
2022-06-17 15:10:00 +08:00 |
|
Liu Jicong
|
18993d50e5
|
refactor(tmq): offset storage
|
2022-06-17 13:16:46 +08:00 |
|
Liu Jicong
|
79494364ae
|
refactor(tmq): offset storage
|
2022-06-16 22:00:33 +08:00 |
|
Liu Jicong
|
5572abe1b4
|
feat(stream): drop task
|
2022-06-15 21:41:59 +08:00 |
|
Liu Jicong
|
8eb08fa0d4
|
feat(stream): trigger mode add max delay
|
2022-06-15 16:11:20 +08:00 |
|
Liu Jicong
|
5881ef2690
|
refactor: convert datablock to submit block
|
2022-06-14 15:08:37 +08:00 |
|
Liu Jicong
|
601e454a24
|
enh(tmq): put offset store into vnode
|
2022-06-14 13:58:40 +08:00 |
|
Liu Jicong
|
0ef33c05bc
|
enh(tmq): avoid uninitialized memory
|
2022-06-11 21:36:15 +08:00 |
|
Liu Jicong
|
6f4f6c14fa
|
enh(tmq): add log
|
2022-06-11 14:02:48 +08:00 |
|
Liu Jicong
|
73b8f02ac7
|
fix(stream): set child id
|
2022-06-10 12:00:38 +08:00 |
|
Liu Jicong
|
9e4b3adc7c
|
fix(stream): msg dispatch
|
2022-06-09 11:45:06 +08:00 |
|
Liu Jicong
|
cbbf5f5d4d
|
refactor(stream)
|
2022-06-07 21:35:49 +08:00 |
|
Liu Jicong
|
858868d76a
|
refactor(stream): distributed execution
|
2022-06-07 10:54:18 +08:00 |
|
Liu Jicong
|
1b26da1bae
|
refactor(stream): distributed execution
|
2022-06-06 22:18:50 +08:00 |
|
Liu Jicong
|
2677a3c8d9
|
refactor(stream)
|
2022-06-06 20:15:36 +08:00 |
|
Liu Jicong
|
f2048b00cb
|
fix(tmq): subscribe stb
|
2022-06-02 11:01:05 +08:00 |
|
Liu Jicong
|
e1fd4a6640
|
feat(tmq): get_db api
|
2022-06-02 10:18:11 +08:00 |
|
Liu Jicong
|
f3b680f630
|
refactor(tmq): push mode
|
2022-06-01 22:22:14 +08:00 |
|
Liu Jicong
|
135836c729
|
fix(tmq): tq deserialize msg
|
2022-06-01 19:57:03 +08:00 |
|
Liu Jicong
|
e1a5000e50
|
refactor(tmq): tq sink and push
|
2022-06-01 17:26:15 +08:00 |
|
Liu Jicong
|
98f62165ae
|
refactor(tmq): tq meta
|
2022-06-01 13:37:33 +08:00 |
|
Liu Jicong
|
66899bd8d0
|
fix(tmq): auto unsubscribe when consumer close
|
2022-06-01 10:27:41 +08:00 |
|
Liu Jicong
|
4169eb559a
|
fix(tmq): skip log
|
2022-05-31 17:02:43 +08:00 |
|
Liu Jicong
|
451d19f986
|
feat(tmq): create topic new grammar
|
2022-05-31 16:20:40 +08:00 |
|
Liu Jicong
|
2248bc4207
|
Merge branch '3.0' into feature/topic_grammar
|
2022-05-30 23:31:22 +08:00 |
|
Liu Jicong
|
1aa97bc117
|
fix(tmq): update tq for auto create table
|
2022-05-28 19:48:17 +08:00 |
|
Liu Jicong
|
05a0774b6d
|
feat(tmq): add sub type
|
2022-05-27 14:06:28 +08:00 |
|
Haojun Liao
|
d87bb5f3fa
|
refactor(query): set the block groupId for stream block.
|
2022-05-27 10:03:45 +08:00 |
|
Liu Jicong
|
d3a2e98d60
|
fix(stream): double free
|
2022-05-26 20:52:27 +08:00 |
|
Liu Jicong
|
a0f3138888
|
fix(stream): tb name error
|
2022-05-26 11:16:35 +08:00 |
|
Liu Jicong
|
a9c54ae701
|
enh(tmq): support restart
|
2022-05-25 17:22:13 +08:00 |
|
Liu Jicong
|
2de2eafaa8
|
feat(tmq): use tdb as persistent storage
|
2022-05-24 20:35:37 +08:00 |
|
Liu Jicong
|
0ad9c4cebd
|
fix: init once
|
2022-05-23 20:58:40 +08:00 |
|
Liu Jicong
|
3629958b43
|
feat(tmq): serializer and deserializer for tq exec
|
2022-05-23 20:31:35 +08:00 |
|
Liu Jicong
|
930b850035
|
refacotr: remove tq meta store
|
2022-05-23 19:51:40 +08:00 |
|
Liu Jicong
|
a393dee9d2
|
refactor(stream)
|
2022-05-23 16:51:12 +08:00 |
|
Liu Jicong
|
30671eaadf
|
fix(tmq): skip dropped table for db subscription
|
2022-05-22 20:35:57 +08:00 |
|
Liu Jicong
|
8e3701df01
|
fix(tmq): memory leak
|
2022-05-21 21:36:26 +08:00 |
|
Liu Jicong
|
d8479d7a0d
|
merge from 3.0
|
2022-05-20 18:55:40 +08:00 |
|
Liu Jicong
|
7391a756f6
|
refactor(stream)
|
2022-05-20 18:53:21 +08:00 |
yihaoDeng
|
afda7c637b
|
fix: tq mem leak
|
2022-05-20 15:58:25 +08:00 |
|
Liu Jicong
|
71984b4268
|
refactor(stream): exec
|
2022-05-20 05:43:36 +08:00 |
|
Liu Jicong
|
2174b5e48e
|
enh(tq): update tb uid when droping table
|
2022-05-19 16:46:12 +08:00 |
|
Liu Jicong
|
2f9c63ae3f
|
enh(tq): update tb uid when droping table
|
2022-05-19 15:37:30 +08:00 |
|
Liu Jicong
|
2216438c72
|
fix(stream): skip update tb uid for db topic
|
2022-05-19 10:26:42 +08:00 |
|
Liu Jicong
|
a696ed583a
|
test(stream): _wstartts should be reverse quoted
|
2022-05-18 21:23:06 +08:00 |
|
Liu Jicong
|
4e640b6d67
|
enh(tmq): update tb list for existing topic
|
2022-05-18 16:27:50 +08:00 |
|
Liu Jicong
|
8ceae5854d
|
fix(tmq): fix memory leak
|
2022-05-17 17:01:07 +08:00 |
|
Liu Jicong
|
2aec989bd7
|
enh(tmq): add drop msg to vnode
|
2022-05-17 05:13:27 +08:00 |
|
Liu Jicong
|
a2ee1c0bf6
|
enh(tmq): add drop msg to vnode
|
2022-05-17 04:29:17 +08:00 |
|
Liu Jicong
|
b3fea32a7e
|
refactor(stream)
|
2022-05-16 22:43:04 +08:00 |
|
Liu Jicong
|
f77f910264
|
refactor(stream)
|
2022-05-16 02:11:47 +08:00 |
|
Cary Xu
|
069ce051f0
|
feat: move sma module from tsdb to vnode
|
2022-05-15 20:17:20 +08:00 |
|
Liu Jicong
|
a6015d2f39
|
refactor(stream)
|
2022-05-15 08:14:23 +08:00 |
|
Liu Jicong
|
d7e34a6642
|
fix(tmq): set config
|
2022-05-13 18:39:37 +08:00 |
liuyao
|
426200a71b
|
Merge pull request #12384 from taosdata/feature/TD-15379
feat(stream): stream reprocess window
|
2022-05-13 09:19:22 +08:00 |
|
Liu Jicong
|
acea83e535
|
fix(wal): wal read error
|
2022-05-13 01:22:29 +08:00 |
|
54liuyao
|
42f27e99d0
|
steam reprocess window
|
2022-05-12 22:15:13 +08:00 |
|
Liu Jicong
|
88d1ea6222
|
Merge pull request #12378 from taosdata/feature/tq
feat(tmq): add config msg.with.table.name
|
2022-05-12 17:00:13 +08:00 |
|
Liu Jicong
|
06853043bd
|
feat(tmq): add config msg.with.table.name
|
2022-05-12 14:57:58 +08:00 |
|
Liu Jicong
|
f1d15f15cf
|
Merge pull request #12366 from taosdata/feature/tq
feat(tmq): support get tb name
|
2022-05-12 12:07:36 +08:00 |
|
Liu Jicong
|
7ab2e76c35
|
feat(tmq): support get tb name
|
2022-05-12 11:31:56 +08:00 |