Commit Graph

360 Commits

Author SHA1 Message Date
Liu Jicong 7c9d57bd89 refactor(stream): unify sink and dispatch 2022-08-05 20:16:47 +08:00
Liu Jicong 6f8683de7e enh(tmq): retry consumer close 2022-08-04 20:37:02 +08:00
Liu Jicong 031414001d fix schedule 2022-08-04 17:46:13 +08:00
Liu Jicong e64e41679e fix schedule 2022-08-04 17:00:45 +08:00
Liu Jicong d6cc88ed4b refactor(stream): exec scheduler 2022-08-04 16:19:53 +08:00
wangmm0220 c3cd858a63 feat:add snapshot for tmq in stable and db 2022-08-04 15:01:59 +08:00
Liu Jicong c089d3ba08 merge 3.0 2022-08-02 22:53:49 +08:00
Liu Jicong d43eec5d16 enh(stream): directly dispatch 2022-08-02 22:23:33 +08:00
Shengliang Guan 56f2e49764 refactor: adjust logs 2022-08-02 17:12:07 +08:00
Shengliang Guan bd31c9da5a
Merge pull request #15657 from taosdata/fix/dnode
fix: write snapshot after apply queue is empty
2022-08-01 20:13:08 +08:00
Liu Jicong b084dd8ee6 feat(tq): transport snapshot 2022-08-01 19:12:37 +08:00
Shengliang Guan 99f29f6455 refactor: adjust log 2022-08-01 17:23:52 +08:00
Liu Jicong bb6fabcc11 refactor(stream): use vnode meta 2022-07-30 20:20:12 +08:00
Liu Jicong 6d67b17113 enh(wal): add lock to guarantee read behaviour 2022-07-30 16:35:49 +08:00
Liu Jicong a9d11b58ad enh(stream): recover 2022-07-28 16:19:50 +08:00
Liu Jicong 00acf4520c refactor(stream): remove option 2022-07-27 16:49:03 +08:00
wangmm0220 915d3c4203 fix:conflicts from 3.0 2022-07-26 17:47:10 +08:00
wangmm0220 ba1962cacf feat:add tmq get data interface 2022-07-26 17:43:22 +08:00
Liu Jicong c2164dd8aa fix(wal): snapshot end with no deleting 2022-07-26 14:13:03 +08:00
Liu Jicong 222e925644 feat(wal): ref 2022-07-25 16:40:19 +08:00
Shengliang Guan 5b654779ba Merge pull request #15372 from taosdata/fix/tsim
test: regression case
2022-07-25 15:23:41 +08:00
Liu Jicong 072fe10013
Merge pull request #15361 from taosdata/feature/tq
fix(tmq): correctly set reader status
2022-07-23 20:40:14 +08:00
Liu Jicong 095f6aa4e0 fix(tmq): correctly set reader status 2022-07-23 20:07:16 +08:00
plum-lihui 19acda27b2 test: add comment for tq 2022-07-23 13:32:25 +08:00
Liu Jicong e1046c7a98 fix: memory leak 2022-07-22 18:11:29 +08:00
Liu Jicong 2441ec22bd feat(tmq): check alter for ntb 2022-07-22 16:05:28 +08:00
Liu Jicong b1f3428c05 refactor(stream): do not merge output 2022-07-22 10:43:49 +08:00
Liu Jicong b49c61cfb4 merge 3.0 2022-07-21 20:44:08 +08:00
Haojun Liao 8a2fb51129
Merge pull request #15230 from taosdata/feature/3_liaohj
fix(query): add query involved column info
2022-07-21 20:29:25 +08:00
Liu Jicong eaf11ca1ac refactor(tmq): disable parallel 2022-07-21 20:15:52 +08:00
Haojun Liao c2d588a118 other:merge 3.0 2022-07-21 11:29:34 +08:00
Haojun Liao ee34c3bb3e fix(query): add query involved column info 2022-07-21 11:20:30 +08:00
Cary Xu 65871c2d73 Merge branch '3.0' into feature/TD-11274-3.0 2022-07-21 09:44:20 +08:00
Cary Xu 0f5983ad88 fix: merge dup rows in client 2022-07-20 20:30:54 +08:00
Liu Jicong fb52cfa816 fix(stream): memory error 2022-07-20 19:31:56 +08:00
Liu Jicong b74560537c fix(stream): check task exist 2022-07-20 16:25:20 +08:00
Haojun Liao 282630a394 Merge branch '3.0' into feature/3_liaohj 2022-07-19 17:42:45 +08:00
Haojun Liao cd2eaf0152 fix(query): set the output column number for subscribe. 2022-07-19 16:01:28 +08:00
54liuyao 8e41fc912b feat(stream): add num of children 2022-07-19 14:17:53 +08:00
Liu Jicong 500553d581 refactor: add debug log 2022-07-18 11:41:56 +08:00
Liu Jicong d75e9b8f6a merge from 3.0 2022-07-14 15:35:00 +08:00
Liu Jicong 9ea0ad57ec refactor(stream): destroy stream task 2022-07-14 15:32:21 +08:00
wangmm0220 cd051d40c3 fix:confilct from 3.0 2022-07-13 16:03:39 +08:00
Shengliang Guan 148e3a5f97
Merge pull request #14818 from taosdata/fix/mnode
enh: adjust vnode fetch queue number
2022-07-12 20:43:05 +08:00
Shengliang Guan dad12c24fb refactor: comment out to avoid crash of tmqShow.py 2022-07-12 19:56:38 +08:00
Liu Jicong 0fccdace56 fix(tmq): reset offset 2022-07-12 16:39:05 +08:00
Liu Jicong 7cf99d5359 refactor(tmq): prepare only needed 2022-07-12 15:11:14 +08:00
Liu Jicong d637ffe22c refactor(tmq): prepare only needed 2022-07-12 14:10:22 +08:00
wangmm0220 f9d5c809c9 fix:conflict from 3.0 2022-07-11 19:06:36 +08:00
Liu Jicong c6052fadba feat(wal): add append interface 2022-07-11 16:22:51 +08:00
wangmm0220 0a193cf811 feat:get meta ok 2022-07-11 16:12:07 +08:00
Liu Jicong 219d966b25 fix(wal): read after rolling 2022-07-10 21:02:25 +08:00
Liu Jicong 9189f886a9 feat(tmq): support consume from tsdb then wal 2022-07-10 16:34:45 +08:00
Liu Jicong bafa54778a refactor(stream) 2022-07-10 14:10:39 +08:00
Liu Jicong 2225411edc refactor(stream) 2022-07-10 13:57:17 +08:00
Liu Jicong e9077c036f merge from 3.0 2022-07-10 11:24:37 +08:00
Liu Jicong a2107992e2 refactor(stream) 2022-07-10 11:18:15 +08:00
Shengliang Guan c53a84b733 Merge remote-tracking branch 'origin/3.0' into fix/valgrind 2022-07-09 20:13:26 +08:00
Liu Jicong 0fd4f3b519 fix(tmq): invalid free 2022-07-08 23:05:32 +08:00
Liu Jicong 8d01ae00cb fix(tmq): offset 2022-07-08 21:37:15 +08:00
Liu Jicong a9e75c87aa refactor(stream): internal refactor 2022-07-08 19:30:40 +08:00
Shengliang Guan a5e8ddbc56 refactor: adjust logs 2022-07-08 18:00:19 +08:00
Liu Jicong 3cd5a35054 refactor(stream): internal refactor 2022-07-08 17:48:34 +08:00
Liu Jicong 866e4c4be0 refactor(stream): internal refactor 2022-07-07 17:56:52 +08:00
Liu Jicong 1ec57798d2 ci: remove unstable case 2022-07-07 11:45:28 +08:00
Liu Jicong 1e7d9ada19 fix(stream): clean up timer 2022-07-07 10:55:22 +08:00
Liu Jicong db23b07ae1 merge from 3.0 2022-07-06 21:12:46 +08:00
Liu Jicong 8c5dbde918 refactor(stream): stream reader created in scanner 2022-07-06 14:20:07 +08:00
Hongze Cheng ddb198de23 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/tsdb_refact 2022-07-04 03:42:50 +00:00
Liu Jicong 31bbef82d1 fix(tmq): seek snapshot offset 2022-07-02 20:18:40 +08:00
Liu Jicong 4a2b266612 feat(stream): support ignore expired flag 2022-07-02 10:59:29 +08:00
Liu Jicong 52d09b4173 refactor(wal) 2022-07-01 14:39:21 +08:00
Liu Jicong 7a65589525 feat(wal): add api to check log existance 2022-07-01 10:15:05 +08:00
Liu Jicong 4f107908db fix(tmq): reset window 2022-06-30 19:51:48 +08:00
Liu Jicong 94f07836d6 fix(tmq): set scan rsp offset correctly 2022-06-30 17:25:19 +08:00
Liu Jicong 4695dc2dae feat(tmq): add snapshot test 2022-06-30 14:41:50 +08:00
Liu Jicong 94c3eb29d2 fix(tmq): rsp error offset 2022-06-29 23:25:04 +08:00
Liu Jicong e74187248b fix(tmq): offset 2022-06-29 22:29:02 +08:00
Liu Jicong 0f0fe6276a merge from 3.0 2022-06-29 21:33:10 +08:00
Liu Jicong c2955a807b feat(tmq): offset support snapshot 2022-06-29 21:04:51 +08:00
Haojun Liao 4a59e1300b other: merge 3.0. 2022-06-28 15:22:32 +08:00
WANG MINGMING f0b50add27
Merge pull request #14184 from taosdata/feature/TD-13041
feat:sort table group if needed & optimize partition by tag
2022-06-25 09:41:30 +08:00
Liu Jicong f53521cb8c test(stream): partition by tbname 2022-06-24 16:50:11 +08:00
wangmm0220 0d9ed6d60a fix:merge from 3.0 2022-06-24 13:51:33 +08:00
Liu Jicong 323ee6b1b0 enh(tmq): add demo for tmq_get_raw_meta 2022-06-23 17:26:52 +08:00
Liu Jicong 14048a5e4c fix(tmq): read repeat data after reading snapshot 2022-06-23 17:09:06 +08:00
Liu Jicong 71bda7e658 feat(tmq): add with meta config 2022-06-23 15:56:54 +08:00
Liu Jicong 2af4a4d250 merge from 3.0 2022-06-23 14:15:33 +08:00
Liu Jicong 4ed47a0296 feat(tmq): scan tsdb as snapshot 2022-06-23 13:35:24 +08:00
Liu Jicong 14a488c92c feat(stream): stream support multiple type input 2022-06-22 21:21:39 +08:00
Liu Jicong fb596625d3 feat(stream): support retrieve 2022-06-22 19:12:31 +08:00
Liu Jicong 3f6ce2da73 feat(tmq): support topic with meta 2022-06-21 15:18:09 +08:00
Liu Jicong c409760f75 feat(stream): drop stream 2022-06-21 11:32:36 +08:00
Liu Jicong 450675f672 feat(stream): support snode 2022-06-20 20:18:34 +08:00
Liu Jicong 53ef66961a feat(stream): support snode 2022-06-20 14:29:18 +08:00
Hongze Cheng 21ea4e3a0b more work 2022-06-20 02:38:08 +00:00
Liu Jicong d7660484cc fix(tmq): performance issue 2022-06-17 15:10:00 +08:00
Liu Jicong 18993d50e5 refactor(tmq): offset storage 2022-06-17 13:16:46 +08:00
Liu Jicong 79494364ae refactor(tmq): offset storage 2022-06-16 22:00:33 +08:00
Liu Jicong 5572abe1b4 feat(stream): drop task 2022-06-15 21:41:59 +08:00