Commit Graph

275 Commits

Author SHA1 Message Date
54liuyao f66eded1e1 fix(stream): state window, error result after deleting data 2022-11-08 14:40:44 +08:00
Shengliang Guan 7a5be43d14
Merge pull request #17954 from taosdata/feature/stream
fix(stream): delete tb should be checked in write thread
2022-11-08 13:50:15 +08:00
Liu Jicong bc469f7f7b fix(stream): delete tb should be checked in write thread 2022-11-08 11:30:29 +08:00
Minglei Jin 1a4cf6964b fix: add post commit to tq & stream 2022-11-07 20:34:23 +08:00
Liu Jicong 2fbc8e6306 refactor(stream): stream deploy and state transfer 2022-11-03 13:22:23 +08:00
Liu Jicong 5e253cc8ea refactor(stream): fill history 2022-11-01 11:56:14 +08:00
Liu Jicong 2e640c38a2 refactor: stream and tmq message 2022-10-31 18:37:28 +08:00
54liuyao 7d8a282258 fix(stream):tqBuildDeleteReq error 2022-10-28 11:19:26 +08:00
Liu Jicong 8d8fd2b2bc refactor(stream): recover and fill history 2022-10-26 10:20:33 +08:00
Liu Jicong 52b4b510a8 merge 3.0 2022-10-26 09:18:29 +08:00
Liu Jicong 75e5e490fd refactor(stream): recover and fill history 2022-10-26 00:31:00 +08:00
54liuyao 5cee271cbc fix(stream): stream state invalid cur 2022-10-24 13:28:13 +08:00
Liu Jicong f49d91ac1a fix(stream): decode bloom filter 2022-10-21 17:22:31 +08:00
Liu Jicong 5571ebee0f
Merge pull request #17542 from taosdata/feature/stream
enh(stream): internal optimize
2022-10-21 14:31:42 +08:00
54liuyao d9beaeb3a3 fix(stream):session window max_delay crash 2022-10-21 11:49:45 +08:00
Liu Jicong 26d4af6968 fix: memory leak 2022-10-21 11:42:30 +08:00
Liu Jicong e0b5b9263e refactor: remove unused code 2022-10-21 10:42:24 +08:00
Liu Jicong 035e6b13c8 enh(stream): internal optimize 2022-10-21 10:29:05 +08:00
54liuyao 86a858e04d fix(stream): coverity scan 2022-10-20 11:41:20 +08:00
54liuyao 368f5134c5 feat(stream):optimize state window disc buff 2022-10-20 09:04:51 +08:00
Hongze Cheng eb7de2e571
Merge pull request #17443 from taosdata/fix/commit_txn
fix: commit txn
2022-10-19 13:15:15 +08:00
54liuyao 7f16081e29 feat(stream): stream task and meta 2022-10-19 10:49:42 +08:00
Hongze Cheng efa9f19d18 make it compile 2022-10-19 09:12:37 +08:00
Hongze Cheng 71a2db6cf2 Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/commit_txn 2022-10-19 09:10:36 +08:00
Minglei Jin 82132cdfdd meta: new metaFinishCommit api & rollback parameter with metaOpen 2022-10-18 18:34:39 +08:00
54liuyao 8efd7e8763 feat(stream):replace disk buff 2022-10-18 18:13:47 +08:00
Liu Jicong bf2d8540d3
Merge pull request #17355 from taosdata/feature/stream
fix(stream): memory leak
2022-10-14 17:24:24 +08:00
Liu Jicong a57a305035 fix(stream): memory leak 2022-10-14 14:43:22 +08:00
54liuyao d5a410b90e fix(stream):Defects Tracking, delete log 2022-10-14 14:29:25 +08:00
Hongze Cheng 5b6e928d65 Merge branch '3.0' of https://github.com/taosdata/TDengine into refact/code_format 2022-10-13 14:25:51 +08:00
Hongze Cheng 63d9b85631 more code format 2022-10-13 13:59:18 +08:00
Liu Jicong d507678b35 refactor(stream): set state buffer size 2022-10-13 11:18:02 +08:00
Liu Jicong db6b0503a1 refactor(stream): change state table name 2022-10-12 14:34:04 +08:00
Liu Jicong eafe8666f7 merge 3.0 2022-10-09 17:00:18 +08:00
Liu Jicong 2f9aeeb5fc feat(stream): support define table name 2022-10-09 16:54:27 +08:00
54liuyao 9c170ecfa8 fix(stream): filter error occurred when data was modified 2022-10-09 14:52:39 +08:00
54liuyao f569355d06 fix(stream):memory leak 2022-10-08 11:04:36 +08:00
Zhiqiang Wang d05b134a48
os: Mac package (#17201)
* os: Mac package

* os: Mac package

* os: Mac package

* os: Mac package

* os: Mac package

* os: Mac package

* os: Mac package

* os: Mac package

* os: Mac package

* os: Mac package

* os: Mac package

* os: Mac package
2022-10-08 10:12:17 +08:00
54liuyao 46c99915bc feat(stream): distribute interval disc buff 2022-09-30 10:01:51 +08:00
Cary Xu 9e49eb03e4 fix: coverity scan for sma 2022-09-28 18:54:39 +08:00
54liuyao 747297bd28 feat(stream): stream fill 2022-09-27 18:11:44 +08:00
Liu Jicong 72fba5a8ce fix(stream): check delete uid 2022-09-21 11:54:44 +08:00
54liuyao 97ca09689c Merge branch 'feature/stream' into feature/TD-18820 2022-09-19 19:31:41 +08:00
Liu Jicong 86c0fb56e0 enhance stream backend for sma 2022-09-19 17:27:25 +08:00
54liuyao 955838d1f6 feat(stream): optimize disc buff 2022-09-19 17:13:13 +08:00
Liu Jicong 4c6a8bbc95 feat(stream): stream state support tuple 2022-09-14 16:50:42 +08:00
Liu Jicong b8a7c8b2aa feat(stream): support hash suffix and prefix 2022-09-13 15:21:26 +08:00
54liuyao 1f5d9a38e7 feat(stream):change single interval disc buff and interval delete 2022-09-07 14:48:14 +08:00
Liu Jicong d653da7971 feat(stream): support delete data 2022-09-02 15:46:41 +08:00
54liuyao 83e62c3849 feat(stream):stream partition by column 2022-09-01 15:05:24 +08:00
Minglei Jin 04e5c75bba fix: cleanup memory with streamLoadTasks 2022-08-26 14:51:30 +08:00
Liu Jicong 24261cc90b refactor(stream): refine stream backend interface 2022-08-24 15:53:29 +08:00
Liu Jicong d7b804e02e fix stream load task 2022-08-24 10:42:34 +08:00
Liu Jicong c296dd0a63 fix compile 2022-08-24 01:48:00 +08:00
Liu Jicong 2d628491b2 feat(stream): support tdb state backend 2022-08-23 19:30:04 +08:00
Liu Jicong 2b092f6551 fix(query): memory leak 2022-08-18 18:39:21 +08:00
Liu Jicong 963287798d refactor(mnode): drop stream task 2022-08-17 23:18:39 +08:00
Liu Jicong 853e6e2988 refactor(mnode): drop stream task 2022-08-17 19:19:58 +08:00
Liu Jicong 357b21cfeb refactor(tmq): use tdb to store check info 2022-08-17 13:58:56 +08:00
Liu Jicong 2ced6c280c enh(stream): reduce table scan 2022-08-16 12:11:56 +08:00
54liuyao 44123ec8f0 feat(stream):optimzie stream interval 2022-08-11 10:20:42 +08:00
Liu Jicong 51aa9413d7
Merge pull request #15937 from taosdata/feature/stream
enh(tmq): speed up consumer recover
2022-08-10 17:19:36 +08:00
Haojun Liao 6250c1b157
Merge pull request #15851 from taosdata/feature/3.0_query_optimize
ehn(query): optimize the query performance.
2022-08-10 16:51:46 +08:00
Liu Jicong e5e82f0cf2 merge 3.0 2022-08-10 16:31:23 +08:00
Liu Jicong 18f6fb6123 enh(tmq): speed up consumer recover 2022-08-10 16:04:03 +08:00
Liu Jicong a62950b441
Merge pull request #15920 from taosdata/feature/stream
enh(stream): recover process
2022-08-09 23:35:03 +08:00
Liu Jicong fc225a580d enh(stream): recover process 2022-08-09 21:37:21 +08:00
54liuyao 41e2538ade scalable bloom filter encode & decode 2022-08-09 16:54:59 +08:00
Liu Jicong d9a4ea305d fix(stream): memory error 2022-08-09 14:11:41 +08:00
Haojun Liao b9c6e0cdf9 refactor: stream invoke previous APIs. 2022-08-09 13:55:51 +08:00
Haojun Liao a2a1da06dd other:merge 3.0 2022-08-09 13:45:44 +08:00
Xiaoyu Wang 07ef00e89f merge 3.0 2022-08-09 11:36:08 +08:00
Liu Jicong ad032a0a90 enh(stream): stream recover 2022-08-09 10:36:27 +08:00
Liu Jicong e30b74ad5a fix(stream): memory leak 2022-08-08 18:53:49 +08:00
Liu Jicong c411b9aebb fix(stream): memory leak 2022-08-08 18:09:36 +08:00
Haojun Liao 4d8842c21f other:merge 3.0 2022-08-08 16:37:37 +08:00
Liu Jicong bb0ce39511 refactor(stream): add stream meta 2022-08-08 15:05:54 +08:00
Liu Jicong 43026ac31d refactor(stream) 2022-08-08 11:29:50 +08:00
54liuyao 214d3609b2 fix(stream):set num of stream session child 2022-08-06 15:14:11 +08:00
Liu Jicong 7c9d57bd89 refactor(stream): unify sink and dispatch 2022-08-05 20:16:47 +08:00
Haojun Liao 0e4748771a enh(query): support combine multi datablock to pass to upstream operators 2022-08-05 14:10:45 +08:00
Liu Jicong 6f8683de7e enh(tmq): retry consumer close 2022-08-04 20:37:02 +08:00
Liu Jicong 031414001d fix schedule 2022-08-04 17:46:13 +08:00
Liu Jicong e64e41679e fix schedule 2022-08-04 17:00:45 +08:00
Liu Jicong d6cc88ed4b refactor(stream): exec scheduler 2022-08-04 16:19:53 +08:00
Liu Jicong e345023dfd enh(stream): keep thread from blocking 2022-08-03 15:31:10 +08:00
Liu Jicong c089d3ba08 merge 3.0 2022-08-02 22:53:49 +08:00
Liu Jicong d43eec5d16 enh(stream): directly dispatch 2022-08-02 22:23:33 +08:00
Shengliang Guan 56f2e49764 refactor: adjust logs 2022-08-02 17:12:07 +08:00
54liuyao b3d104349f feat(stream):optimize stream update scan 2022-08-01 17:09:46 +08:00
Liu Jicong 6c250e75cd fix(stream): forbid histogram in stream 2022-07-29 21:28:18 +08:00
Liu Jicong a9d11b58ad enh(stream): recover 2022-07-28 16:19:50 +08:00
Liu Jicong 904ec81bf9 fix(stream): concurrency dispatch 2022-07-27 21:02:21 +08:00
Liu Jicong ba0c1b3689 refactor(stream) 2022-07-27 20:11:03 +08:00
Liu Jicong 5e1bbe0e7e refactor(sma): remove option 2022-07-27 16:55:23 +08:00
Liu Jicong 00acf4520c refactor(stream): remove option 2022-07-27 16:49:03 +08:00
Liu Jicong 57f9d8b0b0 fix(stream): dispatch 2022-07-27 11:44:01 +08:00
Liu Jicong 3fa5791889 fix(stream): dispatch 2022-07-27 10:52:25 +08:00
jiajingbin 8833a8bdfb fix: fix bug for TD-17801 2022-07-25 21:39:12 +08:00
54liuyao b28553395f feat(stream): adjust stream scan 2022-07-22 20:13:37 +08:00