Commit Graph

272 Commits

Author SHA1 Message Date
Liu Jicong 4ed47a0296 feat(tmq): scan tsdb as snapshot 2022-06-23 13:35:24 +08:00
Liu Jicong 14a488c92c feat(stream): stream support multiple type input 2022-06-22 21:21:39 +08:00
Liu Jicong fb596625d3 feat(stream): support retrieve 2022-06-22 19:12:31 +08:00
Liu Jicong 3f6ce2da73 feat(tmq): support topic with meta 2022-06-21 15:18:09 +08:00
Liu Jicong c409760f75 feat(stream): drop stream 2022-06-21 11:32:36 +08:00
Liu Jicong 450675f672 feat(stream): support snode 2022-06-20 20:18:34 +08:00
Liu Jicong 53ef66961a feat(stream): support snode 2022-06-20 14:29:18 +08:00
Hongze Cheng 21ea4e3a0b more work 2022-06-20 02:38:08 +00:00
Liu Jicong d7660484cc fix(tmq): performance issue 2022-06-17 15:10:00 +08:00
Liu Jicong 18993d50e5 refactor(tmq): offset storage 2022-06-17 13:16:46 +08:00
Liu Jicong 79494364ae refactor(tmq): offset storage 2022-06-16 22:00:33 +08:00
Liu Jicong 5572abe1b4 feat(stream): drop task 2022-06-15 21:41:59 +08:00
Liu Jicong 8eb08fa0d4 feat(stream): trigger mode add max delay 2022-06-15 16:11:20 +08:00
Liu Jicong 5881ef2690 refactor: convert datablock to submit block 2022-06-14 15:08:37 +08:00
Liu Jicong 601e454a24 enh(tmq): put offset store into vnode 2022-06-14 13:58:40 +08:00
Liu Jicong 0ef33c05bc enh(tmq): avoid uninitialized memory 2022-06-11 21:36:15 +08:00
Liu Jicong 6f4f6c14fa enh(tmq): add log 2022-06-11 14:02:48 +08:00
Liu Jicong 73b8f02ac7 fix(stream): set child id 2022-06-10 12:00:38 +08:00
Liu Jicong 9e4b3adc7c fix(stream): msg dispatch 2022-06-09 11:45:06 +08:00
Liu Jicong cbbf5f5d4d refactor(stream) 2022-06-07 21:35:49 +08:00
Liu Jicong 858868d76a refactor(stream): distributed execution 2022-06-07 10:54:18 +08:00
Liu Jicong 1b26da1bae refactor(stream): distributed execution 2022-06-06 22:18:50 +08:00
Liu Jicong 2677a3c8d9 refactor(stream) 2022-06-06 20:15:36 +08:00
Liu Jicong f2048b00cb fix(tmq): subscribe stb 2022-06-02 11:01:05 +08:00
Liu Jicong e1fd4a6640 feat(tmq): get_db api 2022-06-02 10:18:11 +08:00
Liu Jicong f3b680f630 refactor(tmq): push mode 2022-06-01 22:22:14 +08:00
Liu Jicong 135836c729 fix(tmq): tq deserialize msg 2022-06-01 19:57:03 +08:00
Liu Jicong e1a5000e50 refactor(tmq): tq sink and push 2022-06-01 17:26:15 +08:00
Liu Jicong 98f62165ae refactor(tmq): tq meta 2022-06-01 13:37:33 +08:00
Liu Jicong 66899bd8d0 fix(tmq): auto unsubscribe when consumer close 2022-06-01 10:27:41 +08:00
Liu Jicong 4169eb559a fix(tmq): skip log 2022-05-31 17:02:43 +08:00
Liu Jicong 451d19f986 feat(tmq): create topic new grammar 2022-05-31 16:20:40 +08:00
Liu Jicong 2248bc4207 Merge branch '3.0' into feature/topic_grammar 2022-05-30 23:31:22 +08:00
Liu Jicong 1aa97bc117 fix(tmq): update tq for auto create table 2022-05-28 19:48:17 +08:00
Liu Jicong 05a0774b6d feat(tmq): add sub type 2022-05-27 14:06:28 +08:00
Haojun Liao d87bb5f3fa refactor(query): set the block groupId for stream block. 2022-05-27 10:03:45 +08:00
Liu Jicong d3a2e98d60 fix(stream): double free 2022-05-26 20:52:27 +08:00
Liu Jicong a0f3138888 fix(stream): tb name error 2022-05-26 11:16:35 +08:00
Liu Jicong a9c54ae701 enh(tmq): support restart 2022-05-25 17:22:13 +08:00
Liu Jicong 2de2eafaa8 feat(tmq): use tdb as persistent storage 2022-05-24 20:35:37 +08:00
Liu Jicong 0ad9c4cebd fix: init once 2022-05-23 20:58:40 +08:00
Liu Jicong 3629958b43 feat(tmq): serializer and deserializer for tq exec 2022-05-23 20:31:35 +08:00
Liu Jicong 930b850035 refacotr: remove tq meta store 2022-05-23 19:51:40 +08:00
Liu Jicong a393dee9d2 refactor(stream) 2022-05-23 16:51:12 +08:00
Liu Jicong 30671eaadf fix(tmq): skip dropped table for db subscription 2022-05-22 20:35:57 +08:00
Liu Jicong 8e3701df01 fix(tmq): memory leak 2022-05-21 21:36:26 +08:00
Liu Jicong d8479d7a0d merge from 3.0 2022-05-20 18:55:40 +08:00
Liu Jicong 7391a756f6 refactor(stream) 2022-05-20 18:53:21 +08:00
yihaoDeng afda7c637b fix: tq mem leak 2022-05-20 15:58:25 +08:00
Liu Jicong 71984b4268 refactor(stream): exec 2022-05-20 05:43:36 +08:00
Liu Jicong 2174b5e48e enh(tq): update tb uid when droping table 2022-05-19 16:46:12 +08:00
Liu Jicong 2f9c63ae3f enh(tq): update tb uid when droping table 2022-05-19 15:37:30 +08:00
Liu Jicong 2216438c72 fix(stream): skip update tb uid for db topic 2022-05-19 10:26:42 +08:00
Liu Jicong a696ed583a test(stream): _wstartts should be reverse quoted 2022-05-18 21:23:06 +08:00
Liu Jicong 4e640b6d67 enh(tmq): update tb list for existing topic 2022-05-18 16:27:50 +08:00
Liu Jicong 8ceae5854d fix(tmq): fix memory leak 2022-05-17 17:01:07 +08:00
Liu Jicong 2aec989bd7 enh(tmq): add drop msg to vnode 2022-05-17 05:13:27 +08:00
Liu Jicong a2ee1c0bf6 enh(tmq): add drop msg to vnode 2022-05-17 04:29:17 +08:00
Liu Jicong b3fea32a7e refactor(stream) 2022-05-16 22:43:04 +08:00
Liu Jicong f77f910264 refactor(stream) 2022-05-16 02:11:47 +08:00
Cary Xu 069ce051f0 feat: move sma module from tsdb to vnode 2022-05-15 20:17:20 +08:00
Liu Jicong a6015d2f39 refactor(stream) 2022-05-15 08:14:23 +08:00
Liu Jicong d7e34a6642 fix(tmq): set config 2022-05-13 18:39:37 +08:00
liuyao 426200a71b
Merge pull request #12384 from taosdata/feature/TD-15379
feat(stream): stream reprocess window
2022-05-13 09:19:22 +08:00
Liu Jicong acea83e535 fix(wal): wal read error 2022-05-13 01:22:29 +08:00
54liuyao 42f27e99d0 steam reprocess window 2022-05-12 22:15:13 +08:00
Liu Jicong 88d1ea6222
Merge pull request #12378 from taosdata/feature/tq
feat(tmq): add config msg.with.table.name
2022-05-12 17:00:13 +08:00
Liu Jicong 06853043bd feat(tmq): add config msg.with.table.name 2022-05-12 14:57:58 +08:00
Liu Jicong f1d15f15cf
Merge pull request #12366 from taosdata/feature/tq
feat(tmq): support get tb name
2022-05-12 12:07:36 +08:00
Liu Jicong 7ab2e76c35 feat(tmq): support get tb name 2022-05-12 11:31:56 +08:00
Hongze Cheng 97e74a811f
Merge pull request #12338 from taosdata/feature/data_format
fix: database options
2022-05-11 16:57:33 +08:00
Liu Jicong 714dd4f497 enh(tmq): only read committed log 2022-05-11 14:42:20 +08:00
Hongze Cheng ac27d62f33 refact data code 2022-05-11 02:29:53 +00:00
Liu Jicong 951d102a99
Merge pull request #12313 from taosdata/feature/tq
feat(tmq): change default config
2022-05-10 18:09:37 +08:00
Liu Jicong a6b258a45f feat(tmq): change default config 2022-05-10 17:12:11 +08:00
Shengliang Guan 5f33d88cb2 refactor: remove rpc client in executor and scanoperator 2022-05-09 17:03:44 +08:00
Shengliang Guan 0dfac36f5e Merge remote-tracking branch 'origin/3.0' into feature/dnode 2022-05-09 16:40:16 +08:00
Liu Jicong 68b9424f8a test(stream): more stream case 2022-05-08 11:58:19 +08:00
Liu Jicong d17b478e96 feat(stream): auto create ctb 2022-05-08 02:37:23 +08:00
Liu Jicong 3ed1ab6acb enh(stream): auto create ctb 2022-05-07 23:19:05 +08:00
Shengliang Guan 963813b5e6 Merge remote-tracking branch 'origin/3.0' into feature/dnode 2022-05-07 20:19:54 +08:00
Shengliang Guan c8865f3a05 refactor: remove rpc client in executor and scanoperator 2022-05-07 20:19:40 +08:00
Hongze Cheng 323ce214b6 refact encode APIs 2022-05-07 10:03:06 +00:00
Haojun Liao 2b803d8b93 enh(query): set uid for the result datablock of stream scanner when handling the submit block. 2022-05-06 23:40:26 +08:00
Liu Jicong a5706ea7e5 feat(stream): insert data 2022-05-05 18:57:09 +08:00
Liu Jicong de939d589f fix: memory error 2022-04-29 20:11:58 +08:00
Liu Jicong 3ae3fd65e8 fix: memory error 2022-04-28 16:31:35 +08:00
Liu Jicong 7b892a0f28 fix: client memory leak 2022-04-26 21:50:36 +08:00
Liu Jicong 84b19fbea2
Merge pull request #11908 from taosdata/feature/tq
enh(tmq): use sem_timewait to reduce busy loop
2022-04-26 19:47:23 +08:00
Liu Jicong 9723145c1d enh(tmq): use sem_timewait to reduce busy loop 2022-04-26 19:21:31 +08:00
Hongze Cheng 42c6f01980 refact vnode includes 2022-04-26 11:04:26 +00:00
Cary Xu d1b07a1abf merge 3.0 2022-04-25 21:14:01 +08:00
Cary Xu ad9101d3de feat: rollup sma data gen 2022-04-25 21:08:11 +08:00
Liu Jicong 609b21647b fix: msg with schema 2022-04-25 15:40:25 +08:00
Liu Jicong 575f64197d enh(wal): skip read for specific msg 2022-04-24 16:51:32 +08:00
Liu Jicong aade540f05 remove unused msg 2022-04-22 21:02:21 +08:00
Liu Jicong 581b71cf13 merge from 3.0 2022-04-22 19:54:04 +08:00
Liu Jicong 32e9887664 feat(tmq): add push mode 2022-04-22 19:47:00 +08:00
Liu Jicong d51336384f feat(tmq): add db subscribe 2022-04-22 10:55:17 +08:00
Liu Jicong 2dcb014511 feat(tmq): add db subscribe 2022-04-21 16:37:55 +08:00