Commit Graph

2410 Commits

Author SHA1 Message Date
yihaoDeng 0e4445b3b5 add backend 2023-03-28 15:09:58 +00:00
yihaoDeng 0d11430be1 tqadd backend 2023-03-28 14:31:11 +00:00
yihaoDeng 86fe216921 add backend 2023-03-28 11:23:24 +00:00
yihaoDeng ca5f813c5e add backend 2023-03-28 09:27:42 +00:00
yihaoDeng 1c21d67570 add backend 2023-03-28 06:24:16 +00:00
yihaoDeng 47cb4339f0 add backend 2023-03-28 02:27:20 +00:00
yihaoDeng e1046015ae add backend 2023-03-28 02:25:11 +00:00
yihaoDeng 47bd13a7b1 add backend 2023-03-27 13:25:06 +00:00
yihaoDeng 5a8c46b733 add backend 2023-03-27 08:34:12 +00:00
yihaoDeng 011c791b89 add backend 2023-03-27 08:25:40 +00:00
54liuyao cf2d169f75 feat:coverity scan 2023-03-27 16:17:49 +08:00
yihaoDeng f0df728a0e add backend 2023-03-27 08:08:43 +00:00
yihaoDeng a3a0d9c81f add backend 2023-03-27 07:42:11 +00:00
yihaoDeng 0690604a49 add backend 2023-03-27 02:20:49 +00:00
yihaoDeng 2cc2e5d522 add backend 2023-03-27 01:39:00 +00:00
yihaoDeng 874b6916aa add backend 2023-03-26 12:06:06 +00:00
yihaoDeng ffd272597c add backend 2023-03-26 06:32:10 +00:00
yihaoDeng 78f22d71b9 add backend 2023-03-26 05:54:07 +00:00
yihaoDeng fe5fe72e63 add backend 2023-03-26 05:50:18 +00:00
yihaoDeng c3d7f888e9 add backend 2023-03-26 05:46:48 +00:00
yihaoDeng b9531fc9a7 add backend 2023-03-25 06:46:19 +00:00
yihaoDeng 8e409f81ae add backend 2023-03-25 06:43:17 +00:00
yihaoDeng b17f99de47 add backend 2023-03-23 12:49:33 +00:00
yihaoDeng 981466a0c7 failed to read from 2023-03-22 14:35:24 +00:00
yihaoDeng 40535b5ede add backend 2023-03-22 13:34:19 +00:00
yihaoDeng b701198dbb add backend 2023-03-22 13:19:56 +00:00
dapan1121 5b02af6a91 fix: merge main to 3.0 2023-03-22 16:08:16 +08:00
yihaoDeng 43e16c865a add backend 2023-03-22 01:16:49 +00:00
yihaoDeng 7e33e70a66 add backend 2023-03-21 14:00:51 +00:00
yihaoDeng 764a81298f add backend 2023-03-21 13:21:36 +00:00
yihaoDeng 914d391845 fix tag filter 2023-03-21 12:28:16 +00:00
yihaoDeng 2d37aeabdc add backend 2023-03-20 15:33:18 +00:00
yihaoDeng 05a205d3b8 add backend 2023-03-20 02:00:31 +00:00
yihaoDeng e04de7f6df add backend 2023-03-18 07:37:54 +00:00
yihaoDeng 8039702c14 add backend 2023-03-18 07:36:55 +00:00
54liuyao 2185464836 fix:scan of fill history ended prematurely 2023-03-18 13:38:33 +08:00
yihaoDeng e2646734ad enh: add queue limit 2023-03-15 12:01:16 +00:00
yihaoDeng ef092c1cce enh: add queue limit 2023-03-15 11:54:36 +00:00
Shengliang Guan 08601f4b83
Merge pull request #20451 from taosdata/fix/TD-23134
fix: fix coverity scan
2023-03-15 14:10:18 +08:00
54liuyao 25732f7c3c fix:source task needs to wait & stream state window does not handle null 2023-03-15 13:15:17 +08:00
54liuyao 96db1192ae fix: fix coverity scan 2023-03-15 09:03:05 +08:00
54liuyao 0cd871010f fix:fix fill history bug 2023-03-07 13:34:26 +08:00
yihaoDeng 1cb6e49c79 change default config 2023-03-02 13:04:49 +08:00
Xiaoyu Wang 5856a39827
Merge pull request #20123 from taosdata/fix/3.0_merge_main
merge main
2023-02-25 10:01:26 +08:00
Haojun Liao 22aa03307c fix(query): fix syntax errors on centos. 2023-02-24 11:38:54 +08:00
Xiaoyu Wang 1ab144609e merge main 2023-02-23 14:58:22 +08:00
54liuyao 1d58f85a54 feat:coverity scan 2023-02-22 10:10:04 +08:00
Xiaoyu Wang c597de099f merge main 2023-02-20 13:41:27 +08:00
Haojun Liao 751c1cb5d2 refactor:do some internal refactor. 2023-02-20 10:12:27 +08:00
54liuyao 2270fed9f7 fix:add limit for stream batch 2023-02-18 11:57:24 +08:00
Liu Jicong 2a4708d82a fix: save fill history state 2023-02-16 17:01:09 +08:00
Haojun Liao c9ce01c878 Merge branch 'main' into feature/3_liaohj 2023-02-13 17:09:27 +08:00
Liu Jicong 7a4c8f30db reset default cfg 2023-02-13 10:54:13 +08:00
Liu Jicong 0cd6bd3d86 Merge branch 'main' into enh/stream_buffer_param 2023-02-13 09:48:02 +08:00
Liu Jicong 1114fef337 add cfg 2023-02-13 09:47:30 +08:00
Haojun Liao a7fdc4bae3 other: merge 3.0 2023-02-10 19:20:24 +08:00
Liu Jicong c8acfc4d54 fix: stream meta 2023-02-10 10:48:26 +08:00
Xiaoyu Wang b2e60da1cf merge main 2023-02-10 10:34:55 +08:00
Xiaoyu Wang 09925437e3 merge main 2023-02-08 09:51:52 +08:00
Minglei Jin f4a60a4364 fix(stream/state): switch tdb rollback on to restore from journals 2023-02-07 15:11:22 +08:00
Xiaoyu Wang 5d499e52f9 merge main 2023-02-03 17:13:11 +08:00
Haojun Liao ab8c977417 other: merge main. 2023-02-02 14:00:36 +08:00
Minglei Jin df30b51a75 fix(stream): use tdb page replacement with stream state 2023-02-01 17:59:39 +08:00
Liu Jicong 98906bb272 remove assert 2023-01-29 15:24:31 +08:00
Xiaoyu Wang 24157e78d6 merge main 2023-01-28 17:52:58 +08:00
Liu Jicong 51866dadbe Merge branch 'fix/task_db' into enh/stream_buffer_param 2023-01-28 11:24:46 +08:00
Liu Jicong 089bc74055 Merge branch 'main' into enh/stream_buffer_param 2023-01-28 11:24:25 +08:00
Liu Jicong 0c6f6d3a42 fix: task db 2023-01-28 10:59:09 +08:00
54liuyao e03deeaed8 feat:add stream delete mark 2023-01-17 16:21:51 +08:00
Haojun Liao 07cf336fa0 refactor: add an array list api. 2023-01-17 09:43:33 +08:00
Minglei Jin a2e35ce13b streamState/tdb: use NULL for tdbBegin's heap source 2023-01-12 11:26:13 +08:00
54liuyao d5ade95b31 feat(stream):user define tag 2023-01-10 10:13:56 +08:00
Shengliang Guan 398161eb5f Merge branch 'main' into merge/mainto3.0_0108 2023-01-09 10:00:53 +08:00
Liu Jicong 65e7dbda0c enh: enlarge state buffer size 2023-01-06 17:37:45 +08:00
Xiaoyu Wang fdde287ca9 merge main 2023-01-04 11:43:20 +08:00
Benguang Zhao 4031dc1af4 Merge branch main into FIX/TD-21043-main 2023-01-02 16:41:46 +08:00
Benguang Zhao 3edde0eadf fix: tdbAbort on metaClose or streamMetaClose instead of tdbTxnClose 2023-01-01 21:07:32 +08:00
Shengliang Guan 3a11c62243
Merge pull request #19290 from taosdata/feature/stream_main
fix: reset stream status when load from disk
2022-12-30 19:44:09 +08:00
Liu Jicong 095c6d39ca reset param 2022-12-30 17:30:02 +08:00
Liu Jicong 4601e67e67 fix: reset stream status when load from disk 2022-12-30 16:59:48 +08:00
Shengliang Guan 85eba36190
Merge pull request #19257 from taosdata/refactor/stream_dispatch_main
refactor: stream dispatch
2022-12-30 10:18:29 +08:00
Shengliang Guan fad687161b
Merge pull request #19255 from taosdata/enh/stream_drop_when_scan
enh: optimize drop when scan exec
2022-12-29 17:17:59 +08:00
Shengliang Guan 25e9d94f5b
Merge pull request #19244 from taosdata/feature/stream_main
enh: put func state into tdb
2022-12-29 17:17:29 +08:00
Liu Jicong bfb92457fa refactor: stream dispatch 2022-12-29 16:24:30 +08:00
Liu Jicong 66b9fa01f7 enh: optimize drop when scan exec 2022-12-29 15:51:12 +08:00
Liu Jicong 7721353b6b enh: put func state into tdb 2022-12-29 12:39:07 +08:00
Benguang Zhao d307413c36 Merge branch 'main' into FIX/TD-21043-main 2022-12-29 10:03:17 +08:00
Shengliang Guan 2bbf2f3ab1 Merge branch '3.0' into merge/mainto3.0_1229 2022-12-29 09:36:52 +08:00
Shengliang Guan d09011def8
Merge pull request #19190 from taosdata/feature/stream_main
fix memory leak
2022-12-28 17:46:30 +08:00
Shengliang Guan 78c14a2c88 Merge remote-tracking branch 'origin/3.0' into merge/mainto3.0_1228 2022-12-28 14:59:02 +08:00
Benguang Zhao 6fc47beb71 enh: streamMetaCommit in sync with vnodeCommit 2022-12-28 14:34:23 +08:00
Shengliang Guan d342ebcd77
Merge pull request #18720 from taosdata/refact/submit_req
Refact/submit req
2022-12-28 10:29:00 +08:00
Liu Jicong bbab03274a fix memory leak 2022-12-27 18:02:43 +08:00
Liu Jicong dcb71e4af1 refactor: stream dispatch 2022-12-27 15:17:43 +08:00
Liu Jicong 39eb62d80d enh: set scan limit 2022-12-27 14:52:41 +08:00
Liu Jicong 5826e40aa7 enh: drop stream eagerly 2022-12-27 11:20:35 +08:00
54liuyao 70ffbabcbf fix:remove assert 2022-12-26 10:15:14 +08:00
Xiaoyu Wang 0c269c317b merge 3.0 2022-12-23 17:50:05 +08:00
Liu Jicong b1bd24d15a enh: scan exec set limit 2022-12-23 16:35:40 +08:00
Liu Jicong 69d410591f refactor: add debug log 2022-12-22 17:14:17 +08:00
Liu Jicong 2a7de0cd46 refactor: remove assert 2022-12-21 13:54:14 +08:00
Haojun Liao 48f7fc5c3d
Merge branch '3.0' into refact/submit_req 2022-12-12 18:11:17 +08:00
Shengliang Guan 50b66df39f fix: control rpc qitem memory 2022-12-10 14:02:57 +08:00
Liu Jicong ecbc09663f enh: tolerate exec error 2022-12-09 09:35:53 +08:00
Liu Jicong 74a253eac4 refactor 2022-12-08 13:34:42 +08:00
Shengliang Guan 6d94afe48f
Revert "refact: adjust some assert cases" 2022-12-07 21:51:17 +08:00
Shengliang Guan d5126d469a refact: replcase ASSERT with tAssert 2022-12-07 18:42:48 +08:00
Shengliang Guan f69a188f7e refact: replcase ASSERT with tAssert 2022-12-07 18:37:40 +08:00
Liu Jicong b133a56219 refactor: support submitreq2 2022-12-07 15:19:34 +08:00
Shengliang Guan c45001744f
Merge pull request #18674 from taosdata/feat/async_commit
feat: async commit
2022-12-04 22:31:04 +08:00
Alex Duan 213b97b79a feat(api): taos_affected_rows64 add and modfiy tmsg.h 2022-12-02 23:20:19 +08:00
Minglei Jin 6cb65f336d Merge branch 'v3.0' into feat/async_commit 2022-12-02 14:49:58 +08:00
Shengliang Guan a366696478
Merge pull request #18596 from taosdata/feature/stream
refactor(stream): distributed checkpoint
2022-12-02 07:51:10 +08:00
Liu Jicong 3424b184d3 refactor(stream): distributed checkpoint 2022-12-02 03:48:45 +08:00
Hongze Cheng 3fc30c991e Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/async_commit 2022-12-01 18:59:21 +08:00
Haojun Liao 124fb5fc50 refactor: do some internal refactor. 2022-11-30 17:52:12 +08:00
Hongze Cheng df7c07a541 Merge branch 'fix/tdb-async-commit' of https://github.com/taosdata/TDengine into feat/async_commit 2022-11-30 16:48:09 +08:00
Liu Jicong 548684e5ac fix(stream): delete multiple row 2022-11-29 23:39:58 +08:00
Minglei Jin 2c771153ef fix(streamState): use new txn related api 2022-11-28 16:27:20 +08:00
Minglei Jin 506554b5d2 Merge branch 'v3.0' into fix/tdb-async-commit 2022-11-28 16:20:48 +08:00
Haojun Liao 6e81e8cc73 refactor: do some internal refactor. 2022-11-28 12:32:40 +08:00
Liu Jicong 48894c8bdb enh(stream): new api for stream queue 2022-11-25 18:03:40 +08:00
Minglei Jin ada76477fc fix: free stream state cursor 2022-11-21 11:54:25 +08:00
54liuyao 3e29f19782 fix:stream state abnormal failure 2022-11-20 10:32:25 +08:00
Liu Jicong 9a603e5663 enh(stream): put user defined tb name into stream state 2022-11-18 17:21:50 +08:00
Minglei Jin 78335f83d2 tdb/api: migrate txn related api changes of meta, sma, tq, and stream meta/state 2022-11-17 20:02:13 +08:00
Liu Jicong 5161eca70f fix(stream): stop scan when no output 2022-11-17 10:30:05 +08:00
Liu Jicong 015c00aaca fix(stream): timer refer stream task 2022-11-16 11:16:32 +08:00
Liu Jicong a9bf05bc01 refactor: stream meta ref count 2022-11-15 19:11:42 +08:00
Liu Jicong aa9e935854 enh(stream): set path max length to 1024 2022-11-14 14:46:50 +08:00
54liuyao 7ea790021f fix:avoid duplicate results 2022-11-11 16:18:54 +08:00
Liu Jicong 64f22d560c refactor(stream): drop stream task 2022-11-10 16:36:49 +08:00
Haojun Liao 015f1a1df8 other: merge 3.0 2022-11-09 19:17:45 +08:00
Haojun Liao b48752686e refactor: do some internal refactor. 2022-11-09 13:45:46 +08:00
54liuyao f66eded1e1 fix(stream): state window, error result after deleting data 2022-11-08 14:40:44 +08:00
Shengliang Guan 7a5be43d14
Merge pull request #17954 from taosdata/feature/stream
fix(stream): delete tb should be checked in write thread
2022-11-08 13:50:15 +08:00
Liu Jicong bc469f7f7b fix(stream): delete tb should be checked in write thread 2022-11-08 11:30:29 +08:00
Minglei Jin 1a4cf6964b fix: add post commit to tq & stream 2022-11-07 20:34:23 +08:00
Liu Jicong 2fbc8e6306 refactor(stream): stream deploy and state transfer 2022-11-03 13:22:23 +08:00
Liu Jicong 5e253cc8ea refactor(stream): fill history 2022-11-01 11:56:14 +08:00
Liu Jicong 2e640c38a2 refactor: stream and tmq message 2022-10-31 18:37:28 +08:00
54liuyao 7d8a282258 fix(stream):tqBuildDeleteReq error 2022-10-28 11:19:26 +08:00
Liu Jicong 8d8fd2b2bc refactor(stream): recover and fill history 2022-10-26 10:20:33 +08:00
Liu Jicong 52b4b510a8 merge 3.0 2022-10-26 09:18:29 +08:00
Liu Jicong 75e5e490fd refactor(stream): recover and fill history 2022-10-26 00:31:00 +08:00
54liuyao 5cee271cbc fix(stream): stream state invalid cur 2022-10-24 13:28:13 +08:00
Liu Jicong f49d91ac1a fix(stream): decode bloom filter 2022-10-21 17:22:31 +08:00
Liu Jicong 5571ebee0f
Merge pull request #17542 from taosdata/feature/stream
enh(stream): internal optimize
2022-10-21 14:31:42 +08:00
54liuyao d9beaeb3a3 fix(stream):session window max_delay crash 2022-10-21 11:49:45 +08:00
Liu Jicong 26d4af6968 fix: memory leak 2022-10-21 11:42:30 +08:00
Liu Jicong e0b5b9263e refactor: remove unused code 2022-10-21 10:42:24 +08:00
Liu Jicong 035e6b13c8 enh(stream): internal optimize 2022-10-21 10:29:05 +08:00
54liuyao 86a858e04d fix(stream): coverity scan 2022-10-20 11:41:20 +08:00
54liuyao 368f5134c5 feat(stream):optimize state window disc buff 2022-10-20 09:04:51 +08:00
Hongze Cheng eb7de2e571
Merge pull request #17443 from taosdata/fix/commit_txn
fix: commit txn
2022-10-19 13:15:15 +08:00
54liuyao 7f16081e29 feat(stream): stream task and meta 2022-10-19 10:49:42 +08:00
Hongze Cheng efa9f19d18 make it compile 2022-10-19 09:12:37 +08:00
Hongze Cheng 71a2db6cf2 Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/commit_txn 2022-10-19 09:10:36 +08:00
Minglei Jin 82132cdfdd meta: new metaFinishCommit api & rollback parameter with metaOpen 2022-10-18 18:34:39 +08:00
54liuyao 8efd7e8763 feat(stream):replace disk buff 2022-10-18 18:13:47 +08:00
Liu Jicong bf2d8540d3
Merge pull request #17355 from taosdata/feature/stream
fix(stream): memory leak
2022-10-14 17:24:24 +08:00
Liu Jicong a57a305035 fix(stream): memory leak 2022-10-14 14:43:22 +08:00
54liuyao d5a410b90e fix(stream):Defects Tracking, delete log 2022-10-14 14:29:25 +08:00
Hongze Cheng 5b6e928d65 Merge branch '3.0' of https://github.com/taosdata/TDengine into refact/code_format 2022-10-13 14:25:51 +08:00
Hongze Cheng 63d9b85631 more code format 2022-10-13 13:59:18 +08:00
Liu Jicong d507678b35 refactor(stream): set state buffer size 2022-10-13 11:18:02 +08:00
Liu Jicong db6b0503a1 refactor(stream): change state table name 2022-10-12 14:34:04 +08:00
Liu Jicong eafe8666f7 merge 3.0 2022-10-09 17:00:18 +08:00
Liu Jicong 2f9aeeb5fc feat(stream): support define table name 2022-10-09 16:54:27 +08:00
54liuyao 9c170ecfa8 fix(stream): filter error occurred when data was modified 2022-10-09 14:52:39 +08:00
54liuyao f569355d06 fix(stream):memory leak 2022-10-08 11:04:36 +08:00
Zhiqiang Wang d05b134a48
os: Mac package (#17201)
* os: Mac package

* os: Mac package

* os: Mac package

* os: Mac package

* os: Mac package

* os: Mac package

* os: Mac package

* os: Mac package

* os: Mac package

* os: Mac package

* os: Mac package

* os: Mac package
2022-10-08 10:12:17 +08:00
54liuyao 46c99915bc feat(stream): distribute interval disc buff 2022-09-30 10:01:51 +08:00
Cary Xu 9e49eb03e4 fix: coverity scan for sma 2022-09-28 18:54:39 +08:00
54liuyao 747297bd28 feat(stream): stream fill 2022-09-27 18:11:44 +08:00
Liu Jicong 72fba5a8ce fix(stream): check delete uid 2022-09-21 11:54:44 +08:00
54liuyao 97ca09689c Merge branch 'feature/stream' into feature/TD-18820 2022-09-19 19:31:41 +08:00
Liu Jicong 86c0fb56e0 enhance stream backend for sma 2022-09-19 17:27:25 +08:00
54liuyao 955838d1f6 feat(stream): optimize disc buff 2022-09-19 17:13:13 +08:00
Liu Jicong 4c6a8bbc95 feat(stream): stream state support tuple 2022-09-14 16:50:42 +08:00
Liu Jicong b8a7c8b2aa feat(stream): support hash suffix and prefix 2022-09-13 15:21:26 +08:00
54liuyao 1f5d9a38e7 feat(stream):change single interval disc buff and interval delete 2022-09-07 14:48:14 +08:00
Liu Jicong d653da7971 feat(stream): support delete data 2022-09-02 15:46:41 +08:00
54liuyao 83e62c3849 feat(stream):stream partition by column 2022-09-01 15:05:24 +08:00
Minglei Jin 04e5c75bba fix: cleanup memory with streamLoadTasks 2022-08-26 14:51:30 +08:00
Liu Jicong 24261cc90b refactor(stream): refine stream backend interface 2022-08-24 15:53:29 +08:00
Liu Jicong d7b804e02e fix stream load task 2022-08-24 10:42:34 +08:00
Liu Jicong c296dd0a63 fix compile 2022-08-24 01:48:00 +08:00
Liu Jicong 2d628491b2 feat(stream): support tdb state backend 2022-08-23 19:30:04 +08:00
Liu Jicong 2b092f6551 fix(query): memory leak 2022-08-18 18:39:21 +08:00
Liu Jicong 963287798d refactor(mnode): drop stream task 2022-08-17 23:18:39 +08:00
Liu Jicong 853e6e2988 refactor(mnode): drop stream task 2022-08-17 19:19:58 +08:00
Liu Jicong 357b21cfeb refactor(tmq): use tdb to store check info 2022-08-17 13:58:56 +08:00
Liu Jicong 2ced6c280c enh(stream): reduce table scan 2022-08-16 12:11:56 +08:00
54liuyao 44123ec8f0 feat(stream):optimzie stream interval 2022-08-11 10:20:42 +08:00
Liu Jicong 51aa9413d7
Merge pull request #15937 from taosdata/feature/stream
enh(tmq): speed up consumer recover
2022-08-10 17:19:36 +08:00
Haojun Liao 6250c1b157
Merge pull request #15851 from taosdata/feature/3.0_query_optimize
ehn(query): optimize the query performance.
2022-08-10 16:51:46 +08:00
Liu Jicong e5e82f0cf2 merge 3.0 2022-08-10 16:31:23 +08:00
Liu Jicong 18f6fb6123 enh(tmq): speed up consumer recover 2022-08-10 16:04:03 +08:00
Liu Jicong a62950b441
Merge pull request #15920 from taosdata/feature/stream
enh(stream): recover process
2022-08-09 23:35:03 +08:00
Liu Jicong fc225a580d enh(stream): recover process 2022-08-09 21:37:21 +08:00
54liuyao 41e2538ade scalable bloom filter encode & decode 2022-08-09 16:54:59 +08:00
Liu Jicong d9a4ea305d fix(stream): memory error 2022-08-09 14:11:41 +08:00
Haojun Liao b9c6e0cdf9 refactor: stream invoke previous APIs. 2022-08-09 13:55:51 +08:00
Haojun Liao a2a1da06dd other:merge 3.0 2022-08-09 13:45:44 +08:00
Xiaoyu Wang 07ef00e89f merge 3.0 2022-08-09 11:36:08 +08:00
Liu Jicong ad032a0a90 enh(stream): stream recover 2022-08-09 10:36:27 +08:00
Liu Jicong e30b74ad5a fix(stream): memory leak 2022-08-08 18:53:49 +08:00
Liu Jicong c411b9aebb fix(stream): memory leak 2022-08-08 18:09:36 +08:00
Haojun Liao 4d8842c21f other:merge 3.0 2022-08-08 16:37:37 +08:00
Liu Jicong bb0ce39511 refactor(stream): add stream meta 2022-08-08 15:05:54 +08:00
Liu Jicong 43026ac31d refactor(stream) 2022-08-08 11:29:50 +08:00
54liuyao 214d3609b2 fix(stream):set num of stream session child 2022-08-06 15:14:11 +08:00
Liu Jicong 7c9d57bd89 refactor(stream): unify sink and dispatch 2022-08-05 20:16:47 +08:00
Haojun Liao 0e4748771a enh(query): support combine multi datablock to pass to upstream operators 2022-08-05 14:10:45 +08:00
Liu Jicong 6f8683de7e enh(tmq): retry consumer close 2022-08-04 20:37:02 +08:00
Liu Jicong 031414001d fix schedule 2022-08-04 17:46:13 +08:00
Liu Jicong e64e41679e fix schedule 2022-08-04 17:00:45 +08:00
Liu Jicong d6cc88ed4b refactor(stream): exec scheduler 2022-08-04 16:19:53 +08:00
Liu Jicong e345023dfd enh(stream): keep thread from blocking 2022-08-03 15:31:10 +08:00
Liu Jicong c089d3ba08 merge 3.0 2022-08-02 22:53:49 +08:00
Liu Jicong d43eec5d16 enh(stream): directly dispatch 2022-08-02 22:23:33 +08:00
Shengliang Guan 56f2e49764 refactor: adjust logs 2022-08-02 17:12:07 +08:00
54liuyao b3d104349f feat(stream):optimize stream update scan 2022-08-01 17:09:46 +08:00
Liu Jicong 6c250e75cd fix(stream): forbid histogram in stream 2022-07-29 21:28:18 +08:00
Liu Jicong a9d11b58ad enh(stream): recover 2022-07-28 16:19:50 +08:00
Liu Jicong 904ec81bf9 fix(stream): concurrency dispatch 2022-07-27 21:02:21 +08:00
Liu Jicong ba0c1b3689 refactor(stream) 2022-07-27 20:11:03 +08:00
Liu Jicong 5e1bbe0e7e refactor(sma): remove option 2022-07-27 16:55:23 +08:00
Liu Jicong 00acf4520c refactor(stream): remove option 2022-07-27 16:49:03 +08:00
Liu Jicong 57f9d8b0b0 fix(stream): dispatch 2022-07-27 11:44:01 +08:00
Liu Jicong 3fa5791889 fix(stream): dispatch 2022-07-27 10:52:25 +08:00
jiajingbin 8833a8bdfb fix: fix bug for TD-17801 2022-07-25 21:39:12 +08:00
54liuyao b28553395f feat(stream): adjust stream scan 2022-07-22 20:13:37 +08:00
Liu Jicong b1f3428c05 refactor(stream): do not merge output 2022-07-22 10:43:49 +08:00
Liu Jicong 81d8d2b937 feat(stream): add version in stream block 2022-07-21 17:27:44 +08:00
54liuyao f5a326dbf4 feat(stream): optimize update data check 2022-07-21 15:16:57 +08:00
Liu Jicong edaec52bca refactor: add debug flag 2022-07-19 19:59:07 +08:00
Liu Jicong 414673db57
Merge branch '3.0' into feature/stream 2022-07-19 19:46:36 +08:00
Liu Jicong 24bc71568e refactor(stream): batch optimization for submit msg 2022-07-19 18:29:12 +08:00
jiacy-jcy 5200a48107 fix: update 2022-07-19 16:54:19 +08:00
Liu Jicong bc1af6deaf refactor(stream): batch optimization for submit msg 2022-07-19 15:52:08 +08:00
54liuyao 8e41fc912b feat(stream): add num of children 2022-07-19 14:17:53 +08:00
Liu Jicong b6f55fa09e refactor(stream): batch optimization for submit msg 2022-07-18 21:32:40 +08:00
Liu Jicong 053786e6b4 fix(stream): data exec 2022-07-18 15:50:36 +08:00
Liu Jicong 500553d581 refactor: add debug log 2022-07-18 11:41:56 +08:00
Liu Jicong 280ed4f65d feat(stream): pipelined exec for recovering 2022-07-15 21:29:53 +08:00
Liu Jicong 9394e3380f feat(stream): recover from failure 2022-07-15 17:58:53 +08:00
Liu Jicong d75e9b8f6a merge from 3.0 2022-07-14 15:35:00 +08:00
Liu Jicong 9ea0ad57ec refactor(stream): destroy stream task 2022-07-14 15:32:21 +08:00
Haojun Liao b23e08db85
Merge pull request #14893 from taosdata/feature/3_liaohj
fix(query): set correct fill output column index and fix some memory leaks
2022-07-14 14:25:24 +08:00
Haojun Liao 75aca0b031 fix(query): set correct fill output column index, fix some memory leak, and do some internal refactor, 2022-07-14 13:53:23 +08:00
54liuyao 13519f8fd9 feat(stream): interval offset 2022-07-14 11:24:24 +08:00
Liu Jicong a717042acf refactor(stream): simple batch 2022-07-13 17:24:36 +08:00
Liu Jicong eb49ec97ae Merge branch 'fix/dnode' into feature/stream 2022-07-13 16:38:32 +08:00
Liu Jicong 8a6e4b877a refactor(stream): simple batch 2022-07-13 16:37:33 +08:00
Shengliang Guan c2aebfa322 enh: add stream queue to vnode 2022-07-13 16:26:22 +08:00
Liu Jicong 8e3f5135a6 fix(tsdb): close fd 2022-07-12 17:28:14 +08:00
Liu Jicong d637ffe22c refactor(tmq): prepare only needed 2022-07-12 14:10:22 +08:00
Liu Jicong 9fd5ec9020 fix(wal): rollback 2022-07-11 13:38:50 +08:00
Liu Jicong 8c5dbde918 refactor(stream): stream reader created in scanner 2022-07-06 14:20:07 +08:00
Liu Jicong 52d09b4173 refactor(wal) 2022-07-01 14:39:21 +08:00
Liu Jicong 0f0fe6276a merge from 3.0 2022-06-29 21:33:10 +08:00
Liu Jicong c2955a807b feat(tmq): offset support snapshot 2022-06-29 21:04:51 +08:00
Liu Jicong 58803fafcf fix(query): check datablock should check output flag 2022-06-28 16:05:00 +08:00
Liu Jicong 383e7a495b fix(query): enable output check 2022-06-28 13:45:50 +08:00
54liuyao 10e90ce973 feat(stream): auto pull data 2022-06-25 16:44:14 +08:00
Liu Jicong 90121ae439 fix(tmq): check stb existence when subscribing stb 2022-06-25 15:26:29 +08:00
Liu Jicong 81ed902d7f fix(stream): stream rsp to retrieve msg if data is empty 2022-06-25 14:03:06 +08:00
Liu Jicong 5040cb9541 enh(query): window included in serialized retrieve table rsp 2022-06-25 10:43:19 +08:00
Liu Jicong 0964b07229 fix(stream): support none type in submit msg 2022-06-24 21:44:53 +08:00
Liu Jicong f53521cb8c test(stream): partition by tbname 2022-06-24 16:50:11 +08:00
Liu Jicong f2f5d68f3b fix(stream): memory leak 2022-06-23 22:05:00 +08:00
Liu Jicong bd64bebb63
Merge branch '3.0' into feature/3_liaohj 2022-06-23 16:00:17 +08:00
Liu Jicong 4ed47a0296 feat(tmq): scan tsdb as snapshot 2022-06-23 13:35:24 +08:00
Haojun Liao 2d31d3cb43 other: merge 3.0 2022-06-23 10:37:07 +08:00
Liu Jicong 14a488c92c feat(stream): stream support multiple type input 2022-06-22 21:21:39 +08:00
Haojun Liao ed8002f903 fix(query): fix syntax error. 2022-06-22 20:34:24 +08:00
Haojun Liao bf0caa2038 Merge branch '3.0' into feature/3_liaohj 2022-06-22 20:32:02 +08:00
Liu Jicong fb596625d3 feat(stream): support retrieve 2022-06-22 19:12:31 +08:00
Haojun Liao 5c1e7f3114 Merge branch '3.0' into feature/3_liaohj 2022-06-22 17:23:57 +08:00
Haojun Liao 14ddf539e0 refactor(query): do some internal refactor. 2022-06-22 17:21:04 +08:00
Liu Jicong 3f6ce2da73 feat(tmq): support topic with meta 2022-06-21 15:18:09 +08:00
Liu Jicong c409760f75 feat(stream): drop stream 2022-06-21 11:32:36 +08:00
Liu Jicong 450675f672 feat(stream): support snode 2022-06-20 20:18:34 +08:00
Liu Jicong 53ef66961a feat(stream): support snode 2022-06-20 14:29:18 +08:00
Liu Jicong 342a1ae42d fix(stream): build ctb name 2022-06-17 21:00:10 +08:00
Liu Jicong 8eb08fa0d4 feat(stream): trigger mode add max delay 2022-06-15 16:11:20 +08:00
Liu Jicong 0ef33c05bc enh(tmq): avoid uninitialized memory 2022-06-11 21:36:15 +08:00
Liu Jicong 767b768e51 fix(stream): fix shuffle vg id not initialized 2022-06-11 15:20:59 +08:00
Liu Jicong 73b8f02ac7 fix(stream): set child id 2022-06-10 12:00:38 +08:00
Liu Jicong 0e1328ae7f fix(stream): set child id 2022-06-10 10:24:56 +08:00
Liu Jicong 9e4b3adc7c fix(stream): msg dispatch 2022-06-09 11:45:06 +08:00
Liu Jicong 83f5e5eedc fix(stream): fix no executor stream task 2022-06-09 09:56:45 +08:00
Liu Jicong cbbf5f5d4d refactor(stream) 2022-06-07 21:35:49 +08:00
Liu Jicong 46bea47b62 enh(stream): direct sink if not dispatch 2022-06-07 19:58:06 +08:00
Liu Jicong 94d7cbe622 feat(stream): snode process stream msg 2022-06-07 16:24:50 +08:00
Liu Jicong 65900c32c3 enh(stream): use same name rule with schemaless 2022-06-07 15:40:11 +08:00
Liu Jicong 1a84d07188 fix(stream): msg deserialize 2022-06-07 11:36:40 +08:00
Liu Jicong 858868d76a refactor(stream): distributed execution 2022-06-07 10:54:18 +08:00
Liu Jicong 1b26da1bae refactor(stream): distributed execution 2022-06-06 22:18:50 +08:00
Liu Jicong 2677a3c8d9 refactor(stream) 2022-06-06 20:15:36 +08:00
Liu Jicong e1a5000e50 refactor(tmq): tq sink and push 2022-06-01 17:26:15 +08:00
54liuyao 870f24a0c9 feat(stream):adjust bloom filter 2022-05-31 17:15:43 +08:00
54liuyao 901ff9bf18 feat(sma):files factor 2022-05-31 16:14:56 +08:00
Cary Xu f2b4cca23d fix: init buffer to avoid invalid write 2022-05-29 01:10:32 +08:00
Liu Jicong c47827527a
Merge pull request #13167 from taosdata/feature/tq
fix(tmq): update tq for auto create table
2022-05-28 20:01:15 +08:00
Liu Jicong 1aa97bc117 fix(tmq): update tq for auto create table 2022-05-28 19:48:17 +08:00
54liuyao aa20cfedcd feat(stream): watermark and trigger 2022-05-28 18:19:36 +08:00
Haojun Liao d87bb5f3fa refactor(query): set the block groupId for stream block. 2022-05-27 10:03:45 +08:00
Liu Jicong d5d8581bcf refactor(stream): remove out-of-date msg 2022-05-26 21:45:59 +08:00
Liu Jicong d3a2e98d60 fix(stream): double free 2022-05-26 20:52:27 +08:00
Liu Jicong a0f3138888 fix(stream): tb name error 2022-05-26 11:16:35 +08:00
Liu Jicong 86c9446a84 fix(stream): handle null data 2022-05-25 19:37:52 +08:00
Liu Jicong 79e97271ca fix(stream): memory error 2022-05-25 18:43:25 +08:00
54liuyao 0778bf8857 stream session operator 2022-05-25 09:05:03 +08:00
Liu Jicong a393dee9d2 refactor(stream) 2022-05-23 16:51:12 +08:00
54liuyao 42fcb433dc fix(stream):adjust bloom filter 2022-05-23 11:30:22 +08:00
Liu Jicong fc9c22b89c fix(stream): array init error 2022-05-21 17:35:14 +08:00
Liu Jicong 7391a756f6 refactor(stream) 2022-05-20 18:53:21 +08:00
Liu Jicong 71984b4268 refactor(stream): exec 2022-05-20 05:43:36 +08:00
Shengliang Guan 0623514ed1 Merge remote-tracking branch 'origin/3.0' into fix/mnode 2022-05-17 16:12:53 +08:00
Shengliang Guan 36fe62fbd2 refactor: make more object global 2022-05-16 23:23:49 +08:00
Liu Jicong b3fea32a7e refactor(stream) 2022-05-16 22:43:04 +08:00
Shengliang Guan 81e89ec7b6 Merge remote-tracking branch 'origin/3.0' into fix/mnode 2022-05-16 20:13:02 +08:00
Shengliang Guan fc94b71c80 refactor: adjust SRpcMsg 2022-05-16 15:17:11 +08:00
Liu Jicong f77f910264 refactor(stream) 2022-05-16 02:11:47 +08:00
Liu Jicong a6015d2f39 refactor(stream) 2022-05-15 08:14:23 +08:00
54liuyao 4b564b2ebd add stream ci 2022-05-13 15:37:31 +08:00
54liuyao 42f27e99d0 steam reprocess window 2022-05-12 22:15:13 +08:00
Liu Jicong d17b478e96 feat(stream): auto create ctb 2022-05-08 02:37:23 +08:00
Liu Jicong db3cbbf22d fix(query): column match 2022-05-08 00:21:17 +08:00
Liu Jicong 3ed1ab6acb enh(stream): auto create ctb 2022-05-07 23:19:05 +08:00
Hongze Cheng a06bf6e5ca
Merge pull request #12206 from taosdata/feature/vnode_refact1
refact: vnode
2022-05-07 19:05:25 +08:00
54liuyao 599ea89a53 stream scan 2022-05-07 18:10:45 +08:00
Hongze Cheng 323ce214b6 refact encode APIs 2022-05-07 10:03:06 +00:00
Liu Jicong a5706ea7e5 feat(stream): insert data 2022-05-05 18:57:09 +08:00
Liu Jicong de939d589f fix: memory error 2022-04-29 20:11:58 +08:00
liuyao a9c159db7a
Merge pull request #12012 from taosdata/feature/TD-15111
add unit test
2022-04-28 16:54:00 +08:00
Liu Jicong ca61066b32
Merge pull request #12006 from taosdata/feature/tq
enh(tmq): add rebalance global lock
2022-04-28 16:27:51 +08:00
54liuyao 564f2f188f add unit test 2022-04-28 16:13:34 +08:00
Liu Jicong 131a1c13c5 fix show 2022-04-28 15:53:12 +08:00
root fde3f3f68f stream update 2022-04-28 13:32:11 +08:00
afwerar 2662a3b69d [TD-13254]<fix>: make 3.0 grant. 2022-04-10 19:08:16 +08:00
Liu Jicong e163197573 merge from 3.0 2022-03-31 15:55:34 +08:00
Liu Jicong 3e5da8bedb fix 2022-03-31 15:52:54 +08:00
Haojun Liao 387cfe8d45 [td-13039] fix bug in stream interval query. 2022-03-30 19:38:30 +08:00
Liu Jicong 4fd6f59092 stream set multi input 2022-03-29 15:24:25 +08:00
yihaoDeng fbf15d45c0 handle execept 2022-03-29 12:26:01 +08:00
Liu Jicong a5386ee102 refact stream shuffle dispatch 2022-03-28 20:31:05 +08:00
Liu Jicong 71fabef903 stream add shuffle dispatcher 2022-03-28 17:30:32 +08:00
Liu Jicong b27fa6c8e3 stream add shuffle dispatcher 2022-03-28 17:22:18 +08:00
Liu Jicong a3b4de6631 stream support sma 2022-03-28 14:40:22 +08:00
Liu Jicong 90e4cab2af fix stream serialization 2022-03-28 14:16:58 +08:00
Liu Jicong e0f192046c multiple level stream schedule 2022-03-28 11:47:39 +08:00
Liu Jicong 25344869a9 merge from 3.0 2022-03-26 14:52:39 +08:00
Liu Jicong 564236f230 refactor stream 2022-03-26 14:50:26 +08:00
afwerar 222db126bc [TD-13758]<fix>: redefine memory api. 2022-03-26 00:29:53 +08:00
Liu Jicong 03b2162309 refactor stream 2022-03-25 21:03:12 +08:00
Liu Jicong 59a4eec186 stream extract to module 2022-03-25 20:19:09 +08:00