Commit Graph

199 Commits

Author SHA1 Message Date
Liu Jicong 951d102a99
Merge pull request #12313 from taosdata/feature/tq
feat(tmq): change default config
2022-05-10 18:09:37 +08:00
Liu Jicong a6b258a45f feat(tmq): change default config 2022-05-10 17:12:11 +08:00
Shengliang Guan 5f33d88cb2 refactor: remove rpc client in executor and scanoperator 2022-05-09 17:03:44 +08:00
Shengliang Guan 0dfac36f5e Merge remote-tracking branch 'origin/3.0' into feature/dnode 2022-05-09 16:40:16 +08:00
Liu Jicong 68b9424f8a test(stream): more stream case 2022-05-08 11:58:19 +08:00
Liu Jicong d17b478e96 feat(stream): auto create ctb 2022-05-08 02:37:23 +08:00
Liu Jicong 3ed1ab6acb enh(stream): auto create ctb 2022-05-07 23:19:05 +08:00
Shengliang Guan 963813b5e6 Merge remote-tracking branch 'origin/3.0' into feature/dnode 2022-05-07 20:19:54 +08:00
Shengliang Guan c8865f3a05 refactor: remove rpc client in executor and scanoperator 2022-05-07 20:19:40 +08:00
Hongze Cheng 323ce214b6 refact encode APIs 2022-05-07 10:03:06 +00:00
Haojun Liao 2b803d8b93 enh(query): set uid for the result datablock of stream scanner when handling the submit block. 2022-05-06 23:40:26 +08:00
Liu Jicong a5706ea7e5 feat(stream): insert data 2022-05-05 18:57:09 +08:00
Liu Jicong de939d589f fix: memory error 2022-04-29 20:11:58 +08:00
Liu Jicong 3ae3fd65e8 fix: memory error 2022-04-28 16:31:35 +08:00
Liu Jicong 7b892a0f28 fix: client memory leak 2022-04-26 21:50:36 +08:00
Liu Jicong 84b19fbea2
Merge pull request #11908 from taosdata/feature/tq
enh(tmq): use sem_timewait to reduce busy loop
2022-04-26 19:47:23 +08:00
Liu Jicong 9723145c1d enh(tmq): use sem_timewait to reduce busy loop 2022-04-26 19:21:31 +08:00
Hongze Cheng 42c6f01980 refact vnode includes 2022-04-26 11:04:26 +00:00
Cary Xu d1b07a1abf merge 3.0 2022-04-25 21:14:01 +08:00
Cary Xu ad9101d3de feat: rollup sma data gen 2022-04-25 21:08:11 +08:00
Liu Jicong 609b21647b fix: msg with schema 2022-04-25 15:40:25 +08:00
Liu Jicong 575f64197d enh(wal): skip read for specific msg 2022-04-24 16:51:32 +08:00
Liu Jicong aade540f05 remove unused msg 2022-04-22 21:02:21 +08:00
Liu Jicong 581b71cf13 merge from 3.0 2022-04-22 19:54:04 +08:00
Liu Jicong 32e9887664 feat(tmq): add push mode 2022-04-22 19:47:00 +08:00
Liu Jicong d51336384f feat(tmq): add db subscribe 2022-04-22 10:55:17 +08:00
Liu Jicong 2dcb014511 feat(tmq): add db subscribe 2022-04-21 16:37:55 +08:00
Liu Jicong ce6459a9f8 fix(tmq): rebalance 2022-04-21 01:47:29 +08:00
Liu Jicong d75ab9b3ff refactor 2022-04-20 21:36:55 +08:00
Hongze Cheng fe368d0ffe refact vnode 2022-04-16 08:03:19 +00:00
Hongze Cheng 2ad1f30fae refact 2022-04-16 07:50:05 +00:00
Liu Jicong 69cb4b5c99 refactor(tmq): persist ast in topic 2022-04-14 20:34:42 +08:00
Hongze Cheng bb6806b59e refact vnode 2022-04-14 02:25:49 +00:00
Cary Xu 4473d23633
Merge pull request #11465 from taosdata/feature/TD-11463-3.0
feat: add version for tsma expired window updating
2022-04-14 09:01:43 +08:00
Liu Jicong 932493f490 Merge branch '3.0' into feature/tq 2022-04-13 20:46:07 +08:00
Liu Jicong 0fe0d6fc77 fix: fix tmq result parse 2022-04-13 20:37:51 +08:00
Cary Xu 744a198906 add version for tsma expired window updating 2022-04-13 20:02:11 +08:00
Liu Jicong 9f1c7968e4
Merge pull request #11452 from taosdata/feature/tq
feat: support tmq msg parse
2022-04-13 16:35:24 +08:00
Cary Xu f9d162bae2 tsma use TDB 2022-04-13 16:02:55 +08:00
Liu Jicong 03d7201d47 feat: support tmq msg parse 2022-04-13 16:00:30 +08:00
Liu Jicong 5189643909 extract compressed col data format 2022-04-09 16:44:31 +08:00
Liu Jicong 8641cfe22b change test 2022-04-09 10:29:07 +08:00
Liu Jicong 0480cb68e2 merge from 3.0 2022-04-08 17:14:34 +08:00
Liu Jicong 471522d9b9 add log 2022-04-08 16:43:01 +08:00
Liu Jicong 6df2fae1a2 fix compile 2022-04-08 15:26:02 +08:00
Hongze Cheng 742b2918ff refact more 2022-04-08 06:49:07 +00:00
Hongze Cheng 94bcbf6bac refact more 2022-04-08 06:41:42 +00:00
Liu Jicong 4d26b416a5
Merge pull request #11294 from taosdata/feature/tq
add unsubscribe
2022-04-07 20:19:54 +08:00
Liu Jicong d5fb11d239 add unsubscribe 2022-04-07 18:20:54 +08:00
Cary Xu c3b5f435b0 tsma integration with stream computing 2022-04-07 17:13:55 +08:00
Liu Jicong 0cbfc79b90 add multi topic test 2022-04-07 16:27:35 +08:00
Liu Jicong a60185adc8 add more log 2022-04-07 14:11:16 +08:00
Liu Jicong 9ebdee326f fix txn 2022-04-01 18:13:46 +08:00
Liu Jicong e916f83fd7 temp 2022-04-01 09:57:55 +08:00
Liu Jicong b45f7cef2e fix 2022-03-31 16:04:23 +08:00
Liu Jicong 3e5da8bedb fix 2022-03-31 15:52:54 +08:00
Liu Jicong a9ad7ebd10 merge from 3.0 2022-03-29 18:58:15 +08:00
Liu Jicong c2971618a1
Merge branch '3.0' into feature/shm 2022-03-29 17:29:20 +08:00
Shengliang Guan d76a0c9b6d shm 2022-03-29 17:15:48 +08:00
Liu Jicong 09bef18578 add case 2022-03-29 17:13:10 +08:00
Liu Jicong a5386ee102 refact stream shuffle dispatch 2022-03-28 20:31:05 +08:00
Liu Jicong 9a08ac3c5f stream support sma 2022-03-28 14:55:15 +08:00
Liu Jicong a3b4de6631 stream support sma 2022-03-28 14:40:22 +08:00
Liu Jicong 90e4cab2af fix stream serialization 2022-03-28 14:16:58 +08:00
Liu Jicong e0f192046c multiple level stream schedule 2022-03-28 11:47:39 +08:00
Liu Jicong 25344869a9 merge from 3.0 2022-03-26 14:52:39 +08:00
Liu Jicong 564236f230 refactor stream 2022-03-26 14:50:26 +08:00
afwerar 222db126bc [TD-13758]<fix>: redefine memory api. 2022-03-26 00:29:53 +08:00
Liu Jicong 59a4eec186 stream extract to module 2022-03-25 20:19:09 +08:00
Liu Jicong 4cf88c35da modify stream task 2022-03-24 16:18:08 +08:00
Liu Jicong b0ebd174c1 add stream sink 2022-03-24 11:34:43 +08:00
Liu Jicong 58122d07d7 add stream trigger 2022-03-23 17:00:21 +08:00
Liu Jicong d1363d9cb2 task running 2022-03-23 14:47:24 +08:00
Liu Jicong 93347bec42 put next level info into task 2022-03-23 10:44:32 +08:00
Liu Jicong d3104e78ec stream task exec 2022-03-22 18:00:03 +08:00
Liu Jicong f72930eef6
Merge pull request #10880 from taosdata/feature/tq
fix memory error
2022-03-21 23:49:10 +08:00
Liu Jicong b08c3120bf fix memory error 2022-03-21 23:36:21 +08:00
Liu Jicong a36cfba9b9
Merge pull request #10879 from taosdata/feature/tq
Feature/tq
2022-03-21 21:54:30 +08:00
Liu Jicong 8a20b2fe50 fix memory error 2022-03-21 21:42:37 +08:00
Haojun Liao fcb058cee4 [td-13039] support scan ssdatablock. 2022-03-21 16:15:51 +08:00
Liu Jicong cc0c0293ea vnode process task exec 2022-03-18 17:55:39 +08:00
Liu Jicong 1c40afc67c add tmq_get_row 2022-03-17 17:55:13 +08:00
Liu Jicong 913e8d70d8 define stream token 2022-03-09 19:51:08 +08:00
Liu Jicong 255d795442 add tq push 2022-03-08 17:22:21 +08:00
Liu Jicong 402a5e3b61 add scheduler 2022-03-07 16:30:28 +08:00
Liu Jicong b7788aca04 fix 2022-03-02 16:22:43 +08:00
Liu Jicong b5f5400d30 fix 2022-03-01 17:49:14 +08:00
Liu Jicong 82c141ede8 merge from 3.0 2022-03-01 15:56:11 +08:00
Liu Jicong 21e5ddbb8d refactor tmq msg handle 2022-02-28 20:46:23 +08:00
Liu Jicong 48283e42e9 new offset management 2022-02-23 16:04:06 +08:00
Liu Jicong 7bbca5e4b5 add tmq reset offset 2022-02-17 19:07:39 +08:00
Shengliang Guan 5e0a6d9661
Merge pull request #10285 from taosdata/feature/privilege
serialize msg
2022-02-16 17:59:34 +08:00
Shengliang Guan 246311d4fc minor changes 2022-02-16 15:27:19 +08:00
Liu Jicong 2ef7bf1c8b merge from 3.0 2022-02-16 14:43:52 +08:00
Liu Jicong d0a61176a3 add auto commit 2022-02-16 14:36:19 +08:00
Liu Jicong f36f1a8216 temporary remove multi topic consume 2022-02-15 14:57:42 +08:00
Liu Jicong a038c46607 refactor tq meta store 2022-02-15 10:11:34 +08:00
Liu Jicong 4f81a33889 extract tqRead out of tq 2022-02-14 14:11:32 +08:00
Liu Jicong 29bc056abf refactor tq 2022-02-14 13:35:04 +08:00
Liu Jicong 4ad2604107
Merge pull request #10229 from taosdata/feature/tq
improvement
2022-02-12 14:28:28 +08:00