Commit Graph

252 Commits

Author SHA1 Message Date
Liu Jicong 83f5e5eedc fix(stream): fix no executor stream task 2022-06-09 09:56:45 +08:00
Liu Jicong b1226e5d06 feat(tmq): support err2str 2022-06-08 19:07:07 +08:00
Liu Jicong 65900c32c3 enh(stream): use same name rule with schemaless 2022-06-07 15:40:11 +08:00
Liu Jicong e1fd4a6640 feat(tmq): get_db api 2022-06-02 10:18:11 +08:00
Liu Jicong 66899bd8d0 fix(tmq): auto unsubscribe when consumer close 2022-06-01 10:27:41 +08:00
Liu Jicong 8e3701df01 fix(tmq): memory leak 2022-05-21 21:36:26 +08:00
Liu Jicong 2174b5e48e enh(tq): update tb uid when droping table 2022-05-19 16:46:12 +08:00
Liu Jicong 4e640b6d67 enh(tmq): update tb list for existing topic 2022-05-18 16:27:50 +08:00
Liu Jicong 9e71d03d37 enh(tmq): commit when consumer_close called 2022-05-18 15:31:05 +08:00
Liu Jicong 56f760e13a merge from 3.0 2022-05-17 23:03:07 +08:00
Liu Jicong 3f0e89cabd feat(tmq): refine commit offset api 2022-05-17 22:16:26 +08:00
Shengliang Guan 7ad96ac276 enh: control the memory of the rpc queue 2022-05-14 11:53:46 +08:00
Liu Jicong d7e34a6642 fix(tmq): set config 2022-05-13 18:39:37 +08:00
Liu Jicong 06853043bd feat(tmq): add config msg.with.table.name 2022-05-12 14:57:58 +08:00
Liu Jicong 7ab2e76c35 feat(tmq): support get tb name 2022-05-12 11:31:56 +08:00
Liu Jicong 15dd272154 enh(tmq): do not show closed consumer 2022-05-11 02:58:17 +08:00
Liu Jicong ac460915d6 fix(tmq): show 2022-05-10 23:47:44 +08:00
Liu Jicong a6b258a45f feat(tmq): change default config 2022-05-10 17:12:11 +08:00
Liu Jicong 661fbd2e46 enh(stream): improve topic show 2022-05-09 16:35:59 +08:00
Hongze Cheng 323ce214b6 refact encode APIs 2022-05-07 10:03:06 +00:00
Liu Jicong 4402833a82 fix: memory error 2022-04-29 16:35:59 +08:00
Liu Jicong f542785687 remove case 2022-04-29 15:09:38 +08:00
Liu Jicong 5c36e4e519 fix: subscrption api 2022-04-29 14:34:30 +08:00
Liu Jicong 375814c0ca fix 2022-04-28 17:03:25 +08:00
Liu Jicong 9063e480f1 use sql to create stream instead of api 2022-04-28 16:44:32 +08:00
Liu Jicong d998e3e804 fix: create stream 2022-04-28 14:20:32 +08:00
Liu Jicong 19ec7bcafc enh: more info in perf schema 2022-04-27 15:16:57 +08:00
Liu Jicong 7b892a0f28 fix: client memory leak 2022-04-26 21:50:36 +08:00
Liu Jicong 9723145c1d enh(tmq): use sem_timewait to reduce busy loop 2022-04-26 19:21:31 +08:00
Liu Jicong a5a10f7068 feat: tmq support show 2022-04-26 17:08:42 +08:00
Liu Jicong f2f6fb494c remove ep status and cnt 2022-04-26 14:48:24 +08:00
Liu Jicong a14b8dcc99 enh(tmq): delayed task 2022-04-26 14:32:37 +08:00
Liu Jicong 9c510c9071 enh(tmq): retry ask ep 2022-04-25 21:48:52 +08:00
Liu Jicong 609b21647b fix: msg with schema 2022-04-25 15:40:25 +08:00
Liu Jicong 06a370c8de enh(tmq): remove topic out of db 2022-04-25 10:42:17 +08:00
Liu Jicong 575f64197d enh(wal): skip read for specific msg 2022-04-24 16:51:32 +08:00
Liu Jicong 581b71cf13 merge from 3.0 2022-04-22 19:54:04 +08:00
Liu Jicong 32e9887664 feat(tmq): add push mode 2022-04-22 19:47:00 +08:00
Liu Jicong af1b5138e6
Merge pull request #11736 from taosdata/feature/tq
feat(tmq): add db subscribe
2022-04-22 11:29:46 +08:00
Liu Jicong d51336384f feat(tmq): add db subscribe 2022-04-22 10:55:17 +08:00
Liu Jicong 29c7cbf433
Merge pull request #11702 from taosdata/feature/tq
refactor(tmq)
2022-04-21 11:23:36 +08:00
Liu Jicong 8b1e51d910 refactor(tmq): refine api 2022-04-21 10:52:10 +08:00
dapan1121 3f880627fd
Merge pull request #11700 from taosdata/feature/qnode5
Feature/qnode5
2022-04-21 10:34:38 +08:00
Liu Jicong d75ab9b3ff refactor 2022-04-20 21:36:55 +08:00
Liu Jicong b7bf0fe10b refactor(tmq): subscribe and rebalance process 2022-04-19 17:02:49 +08:00
dapan1121 49e0ecdb9b Merge remote-tracking branch 'origin/3.0' into feature/qnode4 2022-04-18 13:34:04 +08:00
dapan1121 0270499496 Merge remote-tracking branch 'origin/3.0' into feature/qnode4 2022-04-18 13:25:45 +08:00
dapan1121 c8fe5bc88b stmt 2022-04-18 10:19:15 +08:00
Liu Jicong 90b1527e5f merge from 3.0 2022-04-14 15:25:43 +08:00
Ganlin Zhao 4eb20bda19
Merge pull request #11478 from taosdata/feature/TD-14243
feat(query): add today()/today() + duration in insert clause
2022-04-14 15:01:26 +08:00
Liu Jicong 7adb395b85 enh: add connection type for tmq 2022-04-14 14:42:51 +08:00
Ganlin Zhao b355e2b3c8 feat(query): add today()/today() + duration in insert clause
TD-14243
2022-04-14 12:53:59 +08:00
Liu Jicong 0fe0d6fc77 fix: fix tmq result parse 2022-04-13 20:37:51 +08:00
Liu Jicong 03d7201d47 feat: support tmq msg parse 2022-04-13 16:00:30 +08:00
Liu Jicong cf33a822b9 fix type convert 2022-04-12 13:39:52 +08:00
Liu Jicong ad9731bd6f merge from 3.0 2022-04-12 11:00:09 +08:00
Liu Jicong bc6a466b36 refactor TAOS_RES process 2022-04-12 10:45:34 +08:00
Liu Jicong 8641cfe22b change test 2022-04-09 10:29:07 +08:00
Liu Jicong 6df2fae1a2 fix compile 2022-04-08 15:26:02 +08:00
Liu Jicong a60185adc8 add more log 2022-04-07 14:11:16 +08:00
Liu Jicong 798c3a9f82 add more log 2022-04-02 23:03:12 +08:00
Liu Jicong e4404dc8e7 add more log 2022-04-02 21:02:58 +08:00
Liu Jicong 8e2d121b3a temp 2022-04-02 19:59:25 +08:00
Liu Jicong adf8bd5e82 add log 2022-04-01 21:30:06 +08:00
Liu Jicong 9ebdee326f fix txn 2022-04-01 18:13:46 +08:00
Liu Jicong e916f83fd7 temp 2022-04-01 09:57:55 +08:00
Liu Jicong 3e5da8bedb fix 2022-03-31 15:52:54 +08:00
Liu Jicong 459ec6ed71 tmq optimize offset handling 2022-03-30 14:06:02 +08:00
Liu Jicong 4fd6f59092 stream set multi input 2022-03-29 15:24:25 +08:00
Liu Jicong a3b4de6631 stream support sma 2022-03-28 14:40:22 +08:00
Liu Jicong e0f192046c multiple level stream schedule 2022-03-28 11:47:39 +08:00
Liu Jicong a00a42759e fix 2022-03-26 20:33:08 +08:00
Liu Jicong 06285a252e refactor tmq container 2022-03-26 20:12:45 +08:00
afwerar 222db126bc [TD-13758]<fix>: redefine memory api. 2022-03-26 00:29:53 +08:00
Liu Jicong 4cf88c35da modify stream task 2022-03-24 16:18:08 +08:00
Liu Jicong af67c49f0e
Merge branch '3.0' into feature/tq 2022-03-22 19:25:55 +08:00
Liu Jicong d3104e78ec stream task exec 2022-03-22 18:00:03 +08:00
Xiaoyu Wang ef125eaa40 merge 3.0 2022-03-22 04:29:54 -04:00
Liu Jicong b08c3120bf fix memory error 2022-03-21 23:36:21 +08:00
Liu Jicong 8a20b2fe50 fix memory error 2022-03-21 21:42:37 +08:00
Haojun Liao afcc2219a3 [td-13039] fix compiler error. 2022-03-21 18:43:19 +08:00
Haojun Liao 1c1c95edee [td-13039] merge 3.0 2022-03-21 18:34:42 +08:00
Liu Jicong 70cddceb60 assign task to vg 2022-03-21 16:35:27 +08:00
Xiaoyu Wang 9ca80596e4 merge 3.0 2022-03-21 02:00:30 -04:00
Liu Jicong d13bb57d9a tmq test using sql 2022-03-21 13:50:16 +08:00
Xiaoyu Wang c2b4ec91ff tmq plan implement 2022-03-18 05:44:08 -04:00
Liu Jicong 1c40afc67c add tmq_get_row 2022-03-17 17:55:13 +08:00
Xiaoyu Wang f8f7aabfd9 TD-13597 create/drop topic, alter database, drop index, drop qnode statement implement 2022-03-16 02:08:59 -04:00
Liu Jicong 7b6346c1fc
Merge pull request #10762 from taosdata/feature/tq
add stream scheduler
2022-03-15 20:12:37 +08:00
Liu Jicong bd60e92f29 add stream scheduler 2022-03-15 20:04:19 +08:00
Xiaoyu Wang c2aebb25bf TD-13675 create sma index parser implement 2022-03-15 06:44:38 -04:00
Xiaoyu Wang abb55e4a87 Merge remote-tracking branch 'origin/3.0' into feature/3.0_query_integrate_wxy 2022-03-10 20:19:58 -05:00
Liu Jicong 94bc3a6e52
Merge pull request #10680 from taosdata/feature/tq
add mnode stream
2022-03-10 17:22:36 +08:00
Liu Jicong e766f3fad4 add mnode stream 2022-03-10 17:15:45 +08:00
afwerar 651b3971c0 [TD-13766]<fix>: redefine sleep api. 2022-03-10 11:56:11 +08:00
Xiaoyu Wang 066c39d571 TD-13747 merge 3.0 2022-03-09 21:35:24 -05:00
Liu Jicong 255d795442 add tq push 2022-03-08 17:22:21 +08:00
Xiaoyu Wang 6cc87452cf Merge remote-tracking branch 'origin/3.0' into feature/3.0_query_integrate_wxy 2022-03-07 21:56:17 -05:00
Liu Jicong 4d9cc5997a subscribe key used stack mem 2022-03-07 17:56:19 +08:00
Xiaoyu Wang b3d0283048 TD-13747 merge 3.0 2022-03-06 22:31:34 -05:00
Liu Jicong 7510a0e7a5 remove createRequest in poll 2022-03-04 18:00:26 +08:00
Liu Jicong 01cac6b06e fix multiple polling 2022-03-04 17:14:26 +08:00
Liu Jicong 0f7829c08e fix multiple polling 2022-03-04 17:08:46 +08:00
Haojun Liao 92da01a8ba [td-13039] refactor. 2022-03-04 13:25:39 +08:00
Liu Jicong bc360c0752 perf test 2022-03-03 11:41:49 +08:00
Xiaoyu Wang 213793be49 TD-13747 merge 3.0 2022-03-02 04:24:59 -05:00
Liu Jicong b7788aca04 fix 2022-03-02 16:22:43 +08:00
Liu Jicong a68153ae92 merge from 3.0 2022-03-01 18:00:50 +08:00
Liu Jicong 4d0b896670 merge from 3.0 2022-03-01 17:58:02 +08:00
Liu Jicong b5f5400d30 fix 2022-03-01 17:49:14 +08:00
Liu Jicong 82c141ede8 merge from 3.0 2022-03-01 15:56:11 +08:00
Liu Jicong 2cb89fe8c1 Merge branch '3.0' into feature/tq 2022-03-01 15:49:26 +08:00
Liu Jicong 21e5ddbb8d refactor tmq msg handle 2022-02-28 20:46:23 +08:00
Xiaoyu Wang 768e05939c TD-13747 New SQL model integration 2022-02-28 04:02:43 -05:00
Shengliang Guan 9d091e90fd remove tnote 2022-02-23 21:22:43 +08:00
Liu Jicong 302463f635 set default offset config 2022-02-23 16:13:23 +08:00
Liu Jicong 48283e42e9 new offset management 2022-02-23 16:04:06 +08:00
Liu Jicong 7ee6657cf7 extract convert to set msg 2022-02-21 10:48:23 +08:00
Liu Jicong 8305f7e4ab Merge branch '3.0' into feature/tq 2022-02-18 15:30:07 +08:00
Liu Jicong a22047ecf7 add reset offset 2022-02-18 15:29:45 +08:00
Yihao Deng 07d5c9232d
Merge branch '3.0' into feature/trans_impl 2022-02-17 20:32:43 +08:00
yihaoDeng 878401c19a fix query crash on super table 2022-02-17 19:38:37 +08:00
Liu Jicong 7bbca5e4b5 add tmq reset offset 2022-02-17 19:07:39 +08:00
Liu Jicong 2541d19124 use full name to create topic 2022-02-16 21:22:07 +08:00
Shengliang Guan f53ea71579
Merge pull request #10289 from taosdata/feature/privilege
test for create topic
2022-02-16 20:29:45 +08:00
Shengliang Guan 43de12b5fa test for create topic 2022-02-16 20:18:18 +08:00
Liu Jicong 9cb9cb686a add eager rebalance back 2022-02-16 18:12:05 +08:00
Liu Jicong 0aa8d9ef5d fix typo 2022-02-16 15:59:43 +08:00
Liu Jicong 2ef7bf1c8b merge from 3.0 2022-02-16 14:43:52 +08:00
Liu Jicong d0a61176a3 add auto commit 2022-02-16 14:36:19 +08:00
Shengliang Guan 88b569e658
Merge pull request #10276 from taosdata/feature/privilege
serialize drop topic req
2022-02-16 13:36:20 +08:00
Shengliang Guan 353feec145 serialize topic msg 2022-02-16 10:50:47 +08:00
Shengliang Guan abd6b98ba4 serialize create topic req 2022-02-16 10:34:29 +08:00
Shuduo Sang 8d435a043a Merge branch '3.0' into feature/3.0_liaohj 2022-02-15 07:50:07 +00:00
Liu Jicong 684558f9d9 add perf test 2022-02-15 15:33:36 +08:00
Haojun Liao 71fc95cc49 [td-11818] merge 3.0 2022-02-15 15:00:06 +08:00
Liu Jicong 29bc056abf refactor tq 2022-02-14 13:35:04 +08:00
Haojun Liao 1ae36227e4 [td-11818] refactor. 2022-02-13 14:34:00 +08:00
Liu Jicong 5d6066319a improvement 2022-02-12 14:19:12 +08:00
Liu Jicong f51295a23c seperate rebalance msg from set conn msg 2022-02-12 11:28:22 +08:00
Liu Jicong f0d7d1b323 mq rebalance 2022-02-11 18:09:25 +08:00
Liu Jicong 432f8bfd6b rewrite rebalance 2022-02-10 11:22:50 +08:00
Liu Jicong 573aad5cc1 fix uninitialized 2022-02-03 19:47:27 +08:00
Liu Jicong 174378ad2b add demo for tmq 2022-01-29 09:56:05 +08:00
Liu Jicong 3534852812 improve mq consume 2022-01-29 04:49:06 +08:00
Liu Jicong a1d143384a fix mem leak 2022-01-28 19:59:16 +08:00
Liu Jicong ee783080f3 fix mem leak 2022-01-28 19:22:48 +08:00
Liu Jicong 8f24333d7d fix mem leak 2022-01-28 19:10:18 +08:00
Liu Jicong 19892cfaf7 fix double free 2022-01-28 18:58:22 +08:00
Liu Jicong 108fd4cfc3 fix mem leak 2022-01-28 18:39:34 +08:00