Commit Graph

350 Commits

Author SHA1 Message Date
Xiaoyu Wang 5d499e52f9 merge main 2023-02-03 17:13:11 +08:00
Haojun Liao ab8c977417 other: merge main. 2023-02-02 14:00:36 +08:00
Minglei Jin df30b51a75 fix(stream): use tdb page replacement with stream state 2023-02-01 17:59:39 +08:00
Liu Jicong 98906bb272 remove assert 2023-01-29 15:24:31 +08:00
Xiaoyu Wang 24157e78d6 merge main 2023-01-28 17:52:58 +08:00
Liu Jicong 51866dadbe Merge branch 'fix/task_db' into enh/stream_buffer_param 2023-01-28 11:24:46 +08:00
Liu Jicong 089bc74055 Merge branch 'main' into enh/stream_buffer_param 2023-01-28 11:24:25 +08:00
Liu Jicong 0c6f6d3a42 fix: task db 2023-01-28 10:59:09 +08:00
54liuyao e03deeaed8 feat:add stream delete mark 2023-01-17 16:21:51 +08:00
Haojun Liao 07cf336fa0 refactor: add an array list api. 2023-01-17 09:43:33 +08:00
Minglei Jin a2e35ce13b streamState/tdb: use NULL for tdbBegin's heap source 2023-01-12 11:26:13 +08:00
54liuyao d5ade95b31 feat(stream):user define tag 2023-01-10 10:13:56 +08:00
Shengliang Guan 398161eb5f Merge branch 'main' into merge/mainto3.0_0108 2023-01-09 10:00:53 +08:00
Liu Jicong 65e7dbda0c enh: enlarge state buffer size 2023-01-06 17:37:45 +08:00
Xiaoyu Wang fdde287ca9 merge main 2023-01-04 11:43:20 +08:00
Benguang Zhao 4031dc1af4 Merge branch main into FIX/TD-21043-main 2023-01-02 16:41:46 +08:00
Benguang Zhao 3edde0eadf fix: tdbAbort on metaClose or streamMetaClose instead of tdbTxnClose 2023-01-01 21:07:32 +08:00
Shengliang Guan 3a11c62243
Merge pull request #19290 from taosdata/feature/stream_main
fix: reset stream status when load from disk
2022-12-30 19:44:09 +08:00
Liu Jicong 095c6d39ca reset param 2022-12-30 17:30:02 +08:00
Liu Jicong 4601e67e67 fix: reset stream status when load from disk 2022-12-30 16:59:48 +08:00
Shengliang Guan 85eba36190
Merge pull request #19257 from taosdata/refactor/stream_dispatch_main
refactor: stream dispatch
2022-12-30 10:18:29 +08:00
Shengliang Guan fad687161b
Merge pull request #19255 from taosdata/enh/stream_drop_when_scan
enh: optimize drop when scan exec
2022-12-29 17:17:59 +08:00
Shengliang Guan 25e9d94f5b
Merge pull request #19244 from taosdata/feature/stream_main
enh: put func state into tdb
2022-12-29 17:17:29 +08:00
Liu Jicong bfb92457fa refactor: stream dispatch 2022-12-29 16:24:30 +08:00
Liu Jicong 66b9fa01f7 enh: optimize drop when scan exec 2022-12-29 15:51:12 +08:00
Liu Jicong 7721353b6b enh: put func state into tdb 2022-12-29 12:39:07 +08:00
Benguang Zhao d307413c36 Merge branch 'main' into FIX/TD-21043-main 2022-12-29 10:03:17 +08:00
Shengliang Guan 2bbf2f3ab1 Merge branch '3.0' into merge/mainto3.0_1229 2022-12-29 09:36:52 +08:00
Shengliang Guan d09011def8
Merge pull request #19190 from taosdata/feature/stream_main
fix memory leak
2022-12-28 17:46:30 +08:00
Shengliang Guan 78c14a2c88 Merge remote-tracking branch 'origin/3.0' into merge/mainto3.0_1228 2022-12-28 14:59:02 +08:00
Benguang Zhao 6fc47beb71 enh: streamMetaCommit in sync with vnodeCommit 2022-12-28 14:34:23 +08:00
Shengliang Guan d342ebcd77
Merge pull request #18720 from taosdata/refact/submit_req
Refact/submit req
2022-12-28 10:29:00 +08:00
Liu Jicong bbab03274a fix memory leak 2022-12-27 18:02:43 +08:00
Liu Jicong dcb71e4af1 refactor: stream dispatch 2022-12-27 15:17:43 +08:00
Liu Jicong 39eb62d80d enh: set scan limit 2022-12-27 14:52:41 +08:00
Liu Jicong 5826e40aa7 enh: drop stream eagerly 2022-12-27 11:20:35 +08:00
54liuyao 70ffbabcbf fix:remove assert 2022-12-26 10:15:14 +08:00
Xiaoyu Wang 0c269c317b merge 3.0 2022-12-23 17:50:05 +08:00
Liu Jicong b1bd24d15a enh: scan exec set limit 2022-12-23 16:35:40 +08:00
Liu Jicong 69d410591f refactor: add debug log 2022-12-22 17:14:17 +08:00
Liu Jicong 2a7de0cd46 refactor: remove assert 2022-12-21 13:54:14 +08:00
Haojun Liao 48f7fc5c3d
Merge branch '3.0' into refact/submit_req 2022-12-12 18:11:17 +08:00
Shengliang Guan 50b66df39f fix: control rpc qitem memory 2022-12-10 14:02:57 +08:00
Liu Jicong ecbc09663f enh: tolerate exec error 2022-12-09 09:35:53 +08:00
Liu Jicong 74a253eac4 refactor 2022-12-08 13:34:42 +08:00
Shengliang Guan 6d94afe48f
Revert "refact: adjust some assert cases" 2022-12-07 21:51:17 +08:00
Shengliang Guan d5126d469a refact: replcase ASSERT with tAssert 2022-12-07 18:42:48 +08:00
Shengliang Guan f69a188f7e refact: replcase ASSERT with tAssert 2022-12-07 18:37:40 +08:00
Liu Jicong b133a56219 refactor: support submitreq2 2022-12-07 15:19:34 +08:00
Shengliang Guan c45001744f
Merge pull request #18674 from taosdata/feat/async_commit
feat: async commit
2022-12-04 22:31:04 +08:00
Alex Duan 213b97b79a feat(api): taos_affected_rows64 add and modfiy tmsg.h 2022-12-02 23:20:19 +08:00
Minglei Jin 6cb65f336d Merge branch 'v3.0' into feat/async_commit 2022-12-02 14:49:58 +08:00
Shengliang Guan a366696478
Merge pull request #18596 from taosdata/feature/stream
refactor(stream): distributed checkpoint
2022-12-02 07:51:10 +08:00
Liu Jicong 3424b184d3 refactor(stream): distributed checkpoint 2022-12-02 03:48:45 +08:00
Hongze Cheng 3fc30c991e Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/async_commit 2022-12-01 18:59:21 +08:00
Haojun Liao 124fb5fc50 refactor: do some internal refactor. 2022-11-30 17:52:12 +08:00
Hongze Cheng df7c07a541 Merge branch 'fix/tdb-async-commit' of https://github.com/taosdata/TDengine into feat/async_commit 2022-11-30 16:48:09 +08:00
Liu Jicong 548684e5ac fix(stream): delete multiple row 2022-11-29 23:39:58 +08:00
Minglei Jin 2c771153ef fix(streamState): use new txn related api 2022-11-28 16:27:20 +08:00
Minglei Jin 506554b5d2 Merge branch 'v3.0' into fix/tdb-async-commit 2022-11-28 16:20:48 +08:00
Haojun Liao 6e81e8cc73 refactor: do some internal refactor. 2022-11-28 12:32:40 +08:00
Liu Jicong 48894c8bdb enh(stream): new api for stream queue 2022-11-25 18:03:40 +08:00
Minglei Jin ada76477fc fix: free stream state cursor 2022-11-21 11:54:25 +08:00
54liuyao 3e29f19782 fix:stream state abnormal failure 2022-11-20 10:32:25 +08:00
Liu Jicong 9a603e5663 enh(stream): put user defined tb name into stream state 2022-11-18 17:21:50 +08:00
Minglei Jin 78335f83d2 tdb/api: migrate txn related api changes of meta, sma, tq, and stream meta/state 2022-11-17 20:02:13 +08:00
Liu Jicong 5161eca70f fix(stream): stop scan when no output 2022-11-17 10:30:05 +08:00
Liu Jicong 015c00aaca fix(stream): timer refer stream task 2022-11-16 11:16:32 +08:00
Liu Jicong a9bf05bc01 refactor: stream meta ref count 2022-11-15 19:11:42 +08:00
Liu Jicong aa9e935854 enh(stream): set path max length to 1024 2022-11-14 14:46:50 +08:00
54liuyao 7ea790021f fix:avoid duplicate results 2022-11-11 16:18:54 +08:00
Liu Jicong 64f22d560c refactor(stream): drop stream task 2022-11-10 16:36:49 +08:00
Haojun Liao 015f1a1df8 other: merge 3.0 2022-11-09 19:17:45 +08:00
Haojun Liao b48752686e refactor: do some internal refactor. 2022-11-09 13:45:46 +08:00
54liuyao f66eded1e1 fix(stream): state window, error result after deleting data 2022-11-08 14:40:44 +08:00
Shengliang Guan 7a5be43d14
Merge pull request #17954 from taosdata/feature/stream
fix(stream): delete tb should be checked in write thread
2022-11-08 13:50:15 +08:00
Liu Jicong bc469f7f7b fix(stream): delete tb should be checked in write thread 2022-11-08 11:30:29 +08:00
Minglei Jin 1a4cf6964b fix: add post commit to tq & stream 2022-11-07 20:34:23 +08:00
Liu Jicong 2fbc8e6306 refactor(stream): stream deploy and state transfer 2022-11-03 13:22:23 +08:00
Liu Jicong 5e253cc8ea refactor(stream): fill history 2022-11-01 11:56:14 +08:00
Liu Jicong 2e640c38a2 refactor: stream and tmq message 2022-10-31 18:37:28 +08:00
54liuyao 7d8a282258 fix(stream):tqBuildDeleteReq error 2022-10-28 11:19:26 +08:00
Liu Jicong 8d8fd2b2bc refactor(stream): recover and fill history 2022-10-26 10:20:33 +08:00
Liu Jicong 52b4b510a8 merge 3.0 2022-10-26 09:18:29 +08:00
Liu Jicong 75e5e490fd refactor(stream): recover and fill history 2022-10-26 00:31:00 +08:00
54liuyao 5cee271cbc fix(stream): stream state invalid cur 2022-10-24 13:28:13 +08:00
Liu Jicong f49d91ac1a fix(stream): decode bloom filter 2022-10-21 17:22:31 +08:00
Liu Jicong 5571ebee0f
Merge pull request #17542 from taosdata/feature/stream
enh(stream): internal optimize
2022-10-21 14:31:42 +08:00
54liuyao d9beaeb3a3 fix(stream):session window max_delay crash 2022-10-21 11:49:45 +08:00
Liu Jicong 26d4af6968 fix: memory leak 2022-10-21 11:42:30 +08:00
Liu Jicong e0b5b9263e refactor: remove unused code 2022-10-21 10:42:24 +08:00
Liu Jicong 035e6b13c8 enh(stream): internal optimize 2022-10-21 10:29:05 +08:00
54liuyao 86a858e04d fix(stream): coverity scan 2022-10-20 11:41:20 +08:00
54liuyao 368f5134c5 feat(stream):optimize state window disc buff 2022-10-20 09:04:51 +08:00
Hongze Cheng eb7de2e571
Merge pull request #17443 from taosdata/fix/commit_txn
fix: commit txn
2022-10-19 13:15:15 +08:00
54liuyao 7f16081e29 feat(stream): stream task and meta 2022-10-19 10:49:42 +08:00
Hongze Cheng efa9f19d18 make it compile 2022-10-19 09:12:37 +08:00
Hongze Cheng 71a2db6cf2 Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/commit_txn 2022-10-19 09:10:36 +08:00
Minglei Jin 82132cdfdd meta: new metaFinishCommit api & rollback parameter with metaOpen 2022-10-18 18:34:39 +08:00
54liuyao 8efd7e8763 feat(stream):replace disk buff 2022-10-18 18:13:47 +08:00