Commit Graph

703 Commits

Author SHA1 Message Date
yihaoDeng 22afdaa6a4 change write opt 2023-04-19 14:15:17 +00:00
yihaoDeng 10e44c63e1 change write opt 2023-04-19 13:12:53 +00:00
yihaoDeng 5efa5f6b9f change write opt 2023-04-19 13:01:13 +00:00
54liuyao 5b7ccc42ca inc sleep time 2023-04-19 13:38:30 +08:00
liuyao ae117bd7c3 fill state 2023-04-19 09:15:12 +08:00
Haojun Liao 9f16802451 fix(stream): set the initial value. 2023-04-18 16:42:40 +08:00
Haojun Liao 76becf59b7
Merge pull request #20947 from taosdata/feature/3_liaohj
fix(stream): set the correct initial checkpoint versions.
2023-04-18 11:26:48 +08:00
liuyao 5460eaf29a memory leak 2023-04-18 09:50:13 +08:00
yihaoDeng 47bf2374db fix compile error 2023-04-17 15:19:33 +00:00
yihaoDeng fc6d9afa19 fix compile error 2023-04-17 15:01:47 +00:00
yihaoDeng 6f6fd3e147 fix compile error 2023-04-17 15:01:41 +00:00
Haojun Liao 930b267a75 fix(stream): set the correct start offset for stream task. 2023-04-17 22:59:00 +08:00
liuyao 27d14f742d fix:stream memory leak 2023-04-17 17:27:02 +08:00
liuyao afc8e5cea7 fix asan bug 2023-04-17 11:48:08 +08:00
Haojun Liao ac137b4b33 refactor: do some internal refactor. 2023-04-17 09:46:58 +08:00
Haojun Liao 10b3fd9426 other: merge main. 2023-04-17 09:19:48 +08:00
Haojun Liao dc78233f86 Merge branch 'enh/rocksRevert' of github.com:taosdata/tdengine into enh/rocksRevert 2023-04-15 09:36:15 +08:00
Haojun Liao 04e042f21d Merge branch 'feature/3_liaohj' into enh/rocksRevert 2023-04-15 09:35:43 +08:00
Haojun Liao a3b02a80c0 fix(stream): update the version when open stream tasks. 2023-04-15 00:10:08 +08:00
Haojun Liao 3aa6897738 refactor: increase the buffer size 2023-04-14 22:56:11 +08:00
Haojun Liao e05d61456a fix(stream): disable the status check. 2023-04-14 22:45:22 +08:00
yihaoDeng 964db517dc Merge branch 'enh/rocksRevert' of https://github.com/taosdata/TDengine into enh/rocksRevert 2023-04-14 14:06:13 +00:00
yihaoDeng 80f348de1d fix recover 2023-04-14 14:05:59 +00:00
Haojun Liao d420734971 Merge remote-tracking branch 'origin/enh/rocksRevert' into enh/rocksRevert 2023-04-14 18:03:19 +08:00
Haojun Liao d0c706ac7c ehn(stream): increase the capacity of input queue to be 2000 items. 2023-04-14 18:02:41 +08:00
Haojun Liao ab4b08a4b5 Merge branch 'feature/3_liaohj' into enh/rocksRevert 2023-04-14 17:44:50 +08:00
Haojun Liao e0cb8aa534 fix(stream): don't the initial task status and do some internal refactor. 2023-04-14 17:43:37 +08:00
yihaoDeng efa7b48c1b Merge branch 'enh/rocksRevert' of https://github.com/taosdata/TDengine into enh/rocksRevert 2023-04-14 09:40:25 +00:00
yihaoDeng 4c70cfdfad startGroupTableMe 2023-04-14 09:36:08 +00:00
liuyao b8ac811f20 fix bug 2023-04-14 17:35:17 +08:00
Haojun Liao eb0e1f848a fix(stream): remove unused tqreader, do some internal refactor, set the meta value for streamtask. 2023-04-14 12:00:09 +08:00
Haojun Liao 5850a3ab01 Merge remote-tracking branch 'origin/enh/rocksRevert' into enh/rocksRevert 2023-04-14 10:37:17 +08:00
Haojun Liao b57c813681 other: merge feature/3_liaohj 2023-04-14 10:36:54 +08:00
yihaoDeng 1b25523153 Merge branch 'enh/rocksRevert' of https://github.com/taosdata/TDengine into enh/rocksRevert 2023-04-14 02:11:07 +00:00
yihaoDeng c0ebdb92d3 startGroupTableMe 2023-04-14 02:10:33 +00:00
Haojun Liao f8b672f09f other: merge main. 2023-04-14 09:07:18 +08:00
Haojun Liao 4d83118ff7 fix(stream): fix memory leak. 2023-04-13 23:49:14 +08:00
Haojun Liao 70b45a4cf0 fix(stream): all data should be extracted from wal. 2023-04-13 23:22:09 +08:00
yihaoDeng 36eef2fdef refactor code 2023-04-13 09:57:04 +00:00
liuyao 34bf638f19 fix bug 2023-04-13 16:21:57 +08:00
liuyao 9be89ce00a delete expired check point 2023-04-12 17:33:58 +08:00
yihaoDeng 4625dd98f0 fix write crash 2023-04-12 07:39:54 +00:00
yihaoDeng d0246a80cf Merge branch 'enh/rocksRevert' of https://github.com/taosdata/TDengine into enh/rocksRevert 2023-04-12 05:50:22 +00:00
yihaoDeng 7e4eefcde1 fix write crash 2023-04-12 05:50:01 +00:00
liuyao 819154e1fc use delete_mark to drop check point 2023-04-12 13:47:54 +08:00
yihaoDeng ed4aaade8c add backend 2023-04-12 03:03:51 +00:00
yihaoDeng 7db12bb317 fix invalid free 2023-04-11 14:21:16 +00:00
yihaoDeng a8ffb82370 fix invalid free 2023-04-11 14:13:35 +00:00
yihaoDeng 29d80b1c76 fix invalid free 2023-04-11 14:04:39 +00:00
yihaoDeng a3836b2363 fix invalid free 2023-04-11 12:52:03 +00:00
yihaoDeng 743ed82daa fix invalid free 2023-04-11 11:55:47 +00:00
Haojun Liao 5ab54481f0 refactor: do some internal refactor. 2023-04-11 19:24:34 +08:00
yihaoDeng b24b91886a Merge branch 'dev3' into enh/rocksRevert 2023-04-11 10:59:00 +00:00
yihaoDeng ff8cb09f63 refactor backend 2023-04-11 10:47:15 +00:00
Xiaoyu Wang 4c04b155d5 merge main 2023-04-11 15:56:28 +08:00
Haojun Liao 18479d8115 refactor: do some internall refactor. 2023-04-11 15:42:24 +08:00
liuyao 95d81604c7 feat:encode&&decode stream scan op 2023-04-11 14:34:31 +08:00
Haojun Liao 15cceb5a5a refactor: do some internal refactors. 2023-04-11 11:53:10 +08:00
liuyao 74da3c05bc feat:set check point id 2023-04-11 10:33:10 +08:00
Haojun Liao a4ba5401f9 enh(stream): set the start version of all operators. 2023-04-11 10:01:36 +08:00
Haojun Liao 7419c0bfe9 enh(stream): the stream will start after vnode restore being completed. 2023-04-10 16:56:14 +08:00
yihaoDeng eab6f84b9b Merge branch 'enh/rocksRevert' of https://github.com/taosdata/TDengine into enh/rocksRevert 2023-04-10 04:52:15 +00:00
yihaoDeng 1416da1967 opt write snapshot 2023-04-10 04:51:00 +00:00
Haojun Liao f5b52749c2 refactor: do some internal refactor. 2023-04-09 01:39:09 +08:00
liuyao fe9ca49d3f feat:optimize get patitionby name 2023-04-07 18:47:57 +08:00
liuyao 955f8f9f07 feat:optimize get patitionby name 2023-04-07 18:45:09 +08:00
yihaoDeng 1e3569367a opt write snapshot 2023-04-07 07:38:02 +00:00
yihaoDeng c082536242 opt write snapshot 2023-04-07 07:26:15 +00:00
liuyao 1f63859e21 feat:add buff swap 2023-04-07 12:50:59 +08:00
liuyao ad16487180 feat:add checkpoint 2023-04-06 18:26:47 +08:00
liuyao 0716a4aee8 feat:add check point 2023-04-06 16:45:22 +08:00
54liuyao 1892b806b5 feat:add stream state buff 2023-04-04 17:09:35 +08:00
54liuyao 429b5cd646 feat:add stream file state 2023-04-04 17:09:35 +08:00
Haojun Liao bd4c33d1c2 fix(tmq):fix the invalid read. 2023-04-04 15:57:50 +08:00
yihaoDeng 628bb62c8a add backpressure 2023-04-04 07:20:05 +00:00
Xiaoyu Wang e9d7a099cc merge main 2023-04-04 14:50:58 +08:00
Haojun Liao d48be5c0ce refactor: do some internal refactor. 2023-04-03 18:23:35 +08:00
Haojun Liao a3ac8b647c refactor: do some internal refactor. 2023-04-03 18:20:35 +08:00
Haojun Liao 482c319bee refactor: do some internal refactor. 2023-04-03 18:07:28 +08:00
Haojun Liao 3ef7d43dae refactor: do some internal refactor. 2023-04-03 17:47:48 +08:00
yihaoDeng 6ee0180217 fix invalid read/write error 2023-04-03 03:32:01 +00:00
yihaoDeng 7f4d0a17e6 add backend 2023-03-30 06:09:40 +00:00
yihaoDeng c3a8ecd9c2 reset version 2023-03-30 03:56:01 +00:00
yihaoDeng 009d5099b4 reset version 2023-03-30 01:53:26 +00:00
yihaoDeng 8387f04476 reset version 2023-03-30 01:53:13 +00:00
yihaoDeng 03f80fbe36 add backend 2023-03-29 07:28:34 +00:00
yihaoDeng 50b094ab5d add backend 2023-03-29 07:26:11 +00:00
yihaoDeng 2ca072344e add backend 2023-03-29 06:56:14 +00:00
yihaoDeng e3002f1872 add backend 2023-03-29 06:17:38 +00:00
yihaoDeng 1cf96cdbf1 add backend 2023-03-29 04:18:16 +00:00
yihaoDeng e6e9828d5a add backend 2023-03-29 03:26:59 +00:00
yihaoDeng ae54e994ca add backend 2023-03-29 01:27:39 +00:00
yihaoDeng 1e597503bc add backend 2023-03-28 15:16:06 +00:00
yihaoDeng 0e4445b3b5 add backend 2023-03-28 15:09:58 +00:00
yihaoDeng 0d11430be1 tqadd backend 2023-03-28 14:31:11 +00:00
yihaoDeng 86fe216921 add backend 2023-03-28 11:23:24 +00:00
yihaoDeng ca5f813c5e add backend 2023-03-28 09:27:42 +00:00
yihaoDeng 1c21d67570 add backend 2023-03-28 06:24:16 +00:00
yihaoDeng 47cb4339f0 add backend 2023-03-28 02:27:20 +00:00
yihaoDeng e1046015ae add backend 2023-03-28 02:25:11 +00:00
yihaoDeng 47bd13a7b1 add backend 2023-03-27 13:25:06 +00:00
yihaoDeng 5a8c46b733 add backend 2023-03-27 08:34:12 +00:00
yihaoDeng 011c791b89 add backend 2023-03-27 08:25:40 +00:00
54liuyao cf2d169f75 feat:coverity scan 2023-03-27 16:17:49 +08:00
yihaoDeng f0df728a0e add backend 2023-03-27 08:08:43 +00:00
yihaoDeng a3a0d9c81f add backend 2023-03-27 07:42:11 +00:00
yihaoDeng 0690604a49 add backend 2023-03-27 02:20:49 +00:00
yihaoDeng 2cc2e5d522 add backend 2023-03-27 01:39:00 +00:00
yihaoDeng 874b6916aa add backend 2023-03-26 12:06:06 +00:00
yihaoDeng ffd272597c add backend 2023-03-26 06:32:10 +00:00
yihaoDeng 78f22d71b9 add backend 2023-03-26 05:54:07 +00:00
yihaoDeng fe5fe72e63 add backend 2023-03-26 05:50:18 +00:00
yihaoDeng c3d7f888e9 add backend 2023-03-26 05:46:48 +00:00
yihaoDeng b9531fc9a7 add backend 2023-03-25 06:46:19 +00:00
yihaoDeng 8e409f81ae add backend 2023-03-25 06:43:17 +00:00
yihaoDeng b17f99de47 add backend 2023-03-23 12:49:33 +00:00
yihaoDeng 981466a0c7 failed to read from 2023-03-22 14:35:24 +00:00
yihaoDeng 40535b5ede add backend 2023-03-22 13:34:19 +00:00
yihaoDeng b701198dbb add backend 2023-03-22 13:19:56 +00:00
dapan1121 5b02af6a91 fix: merge main to 3.0 2023-03-22 16:08:16 +08:00
yihaoDeng 43e16c865a add backend 2023-03-22 01:16:49 +00:00
yihaoDeng 7e33e70a66 add backend 2023-03-21 14:00:51 +00:00
yihaoDeng 764a81298f add backend 2023-03-21 13:21:36 +00:00
yihaoDeng 914d391845 fix tag filter 2023-03-21 12:28:16 +00:00
yihaoDeng 2d37aeabdc add backend 2023-03-20 15:33:18 +00:00
yihaoDeng 05a205d3b8 add backend 2023-03-20 02:00:31 +00:00
yihaoDeng e04de7f6df add backend 2023-03-18 07:37:54 +00:00
yihaoDeng 8039702c14 add backend 2023-03-18 07:36:55 +00:00
54liuyao 2185464836 fix:scan of fill history ended prematurely 2023-03-18 13:38:33 +08:00
yihaoDeng e2646734ad enh: add queue limit 2023-03-15 12:01:16 +00:00
yihaoDeng ef092c1cce enh: add queue limit 2023-03-15 11:54:36 +00:00
Shengliang Guan 08601f4b83
Merge pull request #20451 from taosdata/fix/TD-23134
fix: fix coverity scan
2023-03-15 14:10:18 +08:00
54liuyao 25732f7c3c fix:source task needs to wait & stream state window does not handle null 2023-03-15 13:15:17 +08:00
54liuyao 96db1192ae fix: fix coverity scan 2023-03-15 09:03:05 +08:00
54liuyao 0cd871010f fix:fix fill history bug 2023-03-07 13:34:26 +08:00
yihaoDeng 1cb6e49c79 change default config 2023-03-02 13:04:49 +08:00
Xiaoyu Wang 5856a39827
Merge pull request #20123 from taosdata/fix/3.0_merge_main
merge main
2023-02-25 10:01:26 +08:00
Haojun Liao 22aa03307c fix(query): fix syntax errors on centos. 2023-02-24 11:38:54 +08:00
Xiaoyu Wang 1ab144609e merge main 2023-02-23 14:58:22 +08:00
54liuyao 1d58f85a54 feat:coverity scan 2023-02-22 10:10:04 +08:00
Xiaoyu Wang c597de099f merge main 2023-02-20 13:41:27 +08:00
Haojun Liao 751c1cb5d2 refactor:do some internal refactor. 2023-02-20 10:12:27 +08:00
54liuyao 2270fed9f7 fix:add limit for stream batch 2023-02-18 11:57:24 +08:00
Liu Jicong 2a4708d82a fix: save fill history state 2023-02-16 17:01:09 +08:00
Haojun Liao c9ce01c878 Merge branch 'main' into feature/3_liaohj 2023-02-13 17:09:27 +08:00
Liu Jicong 7a4c8f30db reset default cfg 2023-02-13 10:54:13 +08:00
Liu Jicong 0cd6bd3d86 Merge branch 'main' into enh/stream_buffer_param 2023-02-13 09:48:02 +08:00
Liu Jicong 1114fef337 add cfg 2023-02-13 09:47:30 +08:00
Haojun Liao a7fdc4bae3 other: merge 3.0 2023-02-10 19:20:24 +08:00
Liu Jicong c8acfc4d54 fix: stream meta 2023-02-10 10:48:26 +08:00
Xiaoyu Wang b2e60da1cf merge main 2023-02-10 10:34:55 +08:00
Xiaoyu Wang 09925437e3 merge main 2023-02-08 09:51:52 +08:00
Minglei Jin f4a60a4364 fix(stream/state): switch tdb rollback on to restore from journals 2023-02-07 15:11:22 +08:00
Xiaoyu Wang 5d499e52f9 merge main 2023-02-03 17:13:11 +08:00
Haojun Liao ab8c977417 other: merge main. 2023-02-02 14:00:36 +08:00
Minglei Jin df30b51a75 fix(stream): use tdb page replacement with stream state 2023-02-01 17:59:39 +08:00
Liu Jicong 98906bb272 remove assert 2023-01-29 15:24:31 +08:00
Xiaoyu Wang 24157e78d6 merge main 2023-01-28 17:52:58 +08:00
Liu Jicong 51866dadbe Merge branch 'fix/task_db' into enh/stream_buffer_param 2023-01-28 11:24:46 +08:00
Liu Jicong 089bc74055 Merge branch 'main' into enh/stream_buffer_param 2023-01-28 11:24:25 +08:00
Liu Jicong 0c6f6d3a42 fix: task db 2023-01-28 10:59:09 +08:00
54liuyao e03deeaed8 feat:add stream delete mark 2023-01-17 16:21:51 +08:00
Haojun Liao 07cf336fa0 refactor: add an array list api. 2023-01-17 09:43:33 +08:00
Minglei Jin a2e35ce13b streamState/tdb: use NULL for tdbBegin's heap source 2023-01-12 11:26:13 +08:00
54liuyao d5ade95b31 feat(stream):user define tag 2023-01-10 10:13:56 +08:00
Shengliang Guan 398161eb5f Merge branch 'main' into merge/mainto3.0_0108 2023-01-09 10:00:53 +08:00
Liu Jicong 65e7dbda0c enh: enlarge state buffer size 2023-01-06 17:37:45 +08:00
Xiaoyu Wang fdde287ca9 merge main 2023-01-04 11:43:20 +08:00
Benguang Zhao 4031dc1af4 Merge branch main into FIX/TD-21043-main 2023-01-02 16:41:46 +08:00
Benguang Zhao 3edde0eadf fix: tdbAbort on metaClose or streamMetaClose instead of tdbTxnClose 2023-01-01 21:07:32 +08:00
Shengliang Guan 3a11c62243
Merge pull request #19290 from taosdata/feature/stream_main
fix: reset stream status when load from disk
2022-12-30 19:44:09 +08:00
Liu Jicong 095c6d39ca reset param 2022-12-30 17:30:02 +08:00
Liu Jicong 4601e67e67 fix: reset stream status when load from disk 2022-12-30 16:59:48 +08:00
Shengliang Guan 85eba36190
Merge pull request #19257 from taosdata/refactor/stream_dispatch_main
refactor: stream dispatch
2022-12-30 10:18:29 +08:00
Shengliang Guan fad687161b
Merge pull request #19255 from taosdata/enh/stream_drop_when_scan
enh: optimize drop when scan exec
2022-12-29 17:17:59 +08:00
Shengliang Guan 25e9d94f5b
Merge pull request #19244 from taosdata/feature/stream_main
enh: put func state into tdb
2022-12-29 17:17:29 +08:00
Liu Jicong bfb92457fa refactor: stream dispatch 2022-12-29 16:24:30 +08:00
Liu Jicong 66b9fa01f7 enh: optimize drop when scan exec 2022-12-29 15:51:12 +08:00
Liu Jicong 7721353b6b enh: put func state into tdb 2022-12-29 12:39:07 +08:00
Benguang Zhao d307413c36 Merge branch 'main' into FIX/TD-21043-main 2022-12-29 10:03:17 +08:00
Shengliang Guan 2bbf2f3ab1 Merge branch '3.0' into merge/mainto3.0_1229 2022-12-29 09:36:52 +08:00
Shengliang Guan d09011def8
Merge pull request #19190 from taosdata/feature/stream_main
fix memory leak
2022-12-28 17:46:30 +08:00
Shengliang Guan 78c14a2c88 Merge remote-tracking branch 'origin/3.0' into merge/mainto3.0_1228 2022-12-28 14:59:02 +08:00
Benguang Zhao 6fc47beb71 enh: streamMetaCommit in sync with vnodeCommit 2022-12-28 14:34:23 +08:00
Shengliang Guan d342ebcd77
Merge pull request #18720 from taosdata/refact/submit_req
Refact/submit req
2022-12-28 10:29:00 +08:00
Liu Jicong bbab03274a fix memory leak 2022-12-27 18:02:43 +08:00
Liu Jicong dcb71e4af1 refactor: stream dispatch 2022-12-27 15:17:43 +08:00
Liu Jicong 39eb62d80d enh: set scan limit 2022-12-27 14:52:41 +08:00
Liu Jicong 5826e40aa7 enh: drop stream eagerly 2022-12-27 11:20:35 +08:00
54liuyao 70ffbabcbf fix:remove assert 2022-12-26 10:15:14 +08:00
Xiaoyu Wang 0c269c317b merge 3.0 2022-12-23 17:50:05 +08:00
Liu Jicong b1bd24d15a enh: scan exec set limit 2022-12-23 16:35:40 +08:00
Liu Jicong 69d410591f refactor: add debug log 2022-12-22 17:14:17 +08:00
Liu Jicong 2a7de0cd46 refactor: remove assert 2022-12-21 13:54:14 +08:00
Haojun Liao 48f7fc5c3d
Merge branch '3.0' into refact/submit_req 2022-12-12 18:11:17 +08:00
Shengliang Guan 50b66df39f fix: control rpc qitem memory 2022-12-10 14:02:57 +08:00
Liu Jicong ecbc09663f enh: tolerate exec error 2022-12-09 09:35:53 +08:00
Liu Jicong 74a253eac4 refactor 2022-12-08 13:34:42 +08:00
Shengliang Guan 6d94afe48f
Revert "refact: adjust some assert cases" 2022-12-07 21:51:17 +08:00
Shengliang Guan d5126d469a refact: replcase ASSERT with tAssert 2022-12-07 18:42:48 +08:00
Shengliang Guan f69a188f7e refact: replcase ASSERT with tAssert 2022-12-07 18:37:40 +08:00
Liu Jicong b133a56219 refactor: support submitreq2 2022-12-07 15:19:34 +08:00
Shengliang Guan c45001744f
Merge pull request #18674 from taosdata/feat/async_commit
feat: async commit
2022-12-04 22:31:04 +08:00
Alex Duan 213b97b79a feat(api): taos_affected_rows64 add and modfiy tmsg.h 2022-12-02 23:20:19 +08:00
Minglei Jin 6cb65f336d Merge branch 'v3.0' into feat/async_commit 2022-12-02 14:49:58 +08:00
Shengliang Guan a366696478
Merge pull request #18596 from taosdata/feature/stream
refactor(stream): distributed checkpoint
2022-12-02 07:51:10 +08:00
Liu Jicong 3424b184d3 refactor(stream): distributed checkpoint 2022-12-02 03:48:45 +08:00
Hongze Cheng 3fc30c991e Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/async_commit 2022-12-01 18:59:21 +08:00
Haojun Liao 124fb5fc50 refactor: do some internal refactor. 2022-11-30 17:52:12 +08:00
Hongze Cheng df7c07a541 Merge branch 'fix/tdb-async-commit' of https://github.com/taosdata/TDengine into feat/async_commit 2022-11-30 16:48:09 +08:00
Liu Jicong 548684e5ac fix(stream): delete multiple row 2022-11-29 23:39:58 +08:00
Minglei Jin 2c771153ef fix(streamState): use new txn related api 2022-11-28 16:27:20 +08:00
Minglei Jin 506554b5d2 Merge branch 'v3.0' into fix/tdb-async-commit 2022-11-28 16:20:48 +08:00
Haojun Liao 6e81e8cc73 refactor: do some internal refactor. 2022-11-28 12:32:40 +08:00
Liu Jicong 48894c8bdb enh(stream): new api for stream queue 2022-11-25 18:03:40 +08:00
Minglei Jin ada76477fc fix: free stream state cursor 2022-11-21 11:54:25 +08:00
54liuyao 3e29f19782 fix:stream state abnormal failure 2022-11-20 10:32:25 +08:00
Liu Jicong 9a603e5663 enh(stream): put user defined tb name into stream state 2022-11-18 17:21:50 +08:00
Minglei Jin 78335f83d2 tdb/api: migrate txn related api changes of meta, sma, tq, and stream meta/state 2022-11-17 20:02:13 +08:00
Liu Jicong 5161eca70f fix(stream): stop scan when no output 2022-11-17 10:30:05 +08:00
Liu Jicong 015c00aaca fix(stream): timer refer stream task 2022-11-16 11:16:32 +08:00
Liu Jicong a9bf05bc01 refactor: stream meta ref count 2022-11-15 19:11:42 +08:00
Liu Jicong aa9e935854 enh(stream): set path max length to 1024 2022-11-14 14:46:50 +08:00
54liuyao 7ea790021f fix:avoid duplicate results 2022-11-11 16:18:54 +08:00
Liu Jicong 64f22d560c refactor(stream): drop stream task 2022-11-10 16:36:49 +08:00
Haojun Liao 015f1a1df8 other: merge 3.0 2022-11-09 19:17:45 +08:00
Haojun Liao b48752686e refactor: do some internal refactor. 2022-11-09 13:45:46 +08:00
54liuyao f66eded1e1 fix(stream): state window, error result after deleting data 2022-11-08 14:40:44 +08:00
Shengliang Guan 7a5be43d14
Merge pull request #17954 from taosdata/feature/stream
fix(stream): delete tb should be checked in write thread
2022-11-08 13:50:15 +08:00
Liu Jicong bc469f7f7b fix(stream): delete tb should be checked in write thread 2022-11-08 11:30:29 +08:00
Minglei Jin 1a4cf6964b fix: add post commit to tq & stream 2022-11-07 20:34:23 +08:00
Liu Jicong 2fbc8e6306 refactor(stream): stream deploy and state transfer 2022-11-03 13:22:23 +08:00
Liu Jicong 5e253cc8ea refactor(stream): fill history 2022-11-01 11:56:14 +08:00
Liu Jicong 2e640c38a2 refactor: stream and tmq message 2022-10-31 18:37:28 +08:00
54liuyao 7d8a282258 fix(stream):tqBuildDeleteReq error 2022-10-28 11:19:26 +08:00
Liu Jicong 8d8fd2b2bc refactor(stream): recover and fill history 2022-10-26 10:20:33 +08:00
Liu Jicong 52b4b510a8 merge 3.0 2022-10-26 09:18:29 +08:00
Liu Jicong 75e5e490fd refactor(stream): recover and fill history 2022-10-26 00:31:00 +08:00
54liuyao 5cee271cbc fix(stream): stream state invalid cur 2022-10-24 13:28:13 +08:00
Liu Jicong f49d91ac1a fix(stream): decode bloom filter 2022-10-21 17:22:31 +08:00
Liu Jicong 5571ebee0f
Merge pull request #17542 from taosdata/feature/stream
enh(stream): internal optimize
2022-10-21 14:31:42 +08:00
54liuyao d9beaeb3a3 fix(stream):session window max_delay crash 2022-10-21 11:49:45 +08:00
Liu Jicong 26d4af6968 fix: memory leak 2022-10-21 11:42:30 +08:00
Liu Jicong e0b5b9263e refactor: remove unused code 2022-10-21 10:42:24 +08:00
Liu Jicong 035e6b13c8 enh(stream): internal optimize 2022-10-21 10:29:05 +08:00
54liuyao 86a858e04d fix(stream): coverity scan 2022-10-20 11:41:20 +08:00
54liuyao 368f5134c5 feat(stream):optimize state window disc buff 2022-10-20 09:04:51 +08:00
Hongze Cheng eb7de2e571
Merge pull request #17443 from taosdata/fix/commit_txn
fix: commit txn
2022-10-19 13:15:15 +08:00
54liuyao 7f16081e29 feat(stream): stream task and meta 2022-10-19 10:49:42 +08:00
Hongze Cheng efa9f19d18 make it compile 2022-10-19 09:12:37 +08:00
Hongze Cheng 71a2db6cf2 Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/commit_txn 2022-10-19 09:10:36 +08:00
Minglei Jin 82132cdfdd meta: new metaFinishCommit api & rollback parameter with metaOpen 2022-10-18 18:34:39 +08:00
54liuyao 8efd7e8763 feat(stream):replace disk buff 2022-10-18 18:13:47 +08:00
Liu Jicong bf2d8540d3
Merge pull request #17355 from taosdata/feature/stream
fix(stream): memory leak
2022-10-14 17:24:24 +08:00
Liu Jicong a57a305035 fix(stream): memory leak 2022-10-14 14:43:22 +08:00
54liuyao d5a410b90e fix(stream):Defects Tracking, delete log 2022-10-14 14:29:25 +08:00
Hongze Cheng 5b6e928d65 Merge branch '3.0' of https://github.com/taosdata/TDengine into refact/code_format 2022-10-13 14:25:51 +08:00
Hongze Cheng 63d9b85631 more code format 2022-10-13 13:59:18 +08:00
Liu Jicong d507678b35 refactor(stream): set state buffer size 2022-10-13 11:18:02 +08:00
Liu Jicong db6b0503a1 refactor(stream): change state table name 2022-10-12 14:34:04 +08:00
Liu Jicong eafe8666f7 merge 3.0 2022-10-09 17:00:18 +08:00
Liu Jicong 2f9aeeb5fc feat(stream): support define table name 2022-10-09 16:54:27 +08:00
54liuyao 9c170ecfa8 fix(stream): filter error occurred when data was modified 2022-10-09 14:52:39 +08:00
54liuyao f569355d06 fix(stream):memory leak 2022-10-08 11:04:36 +08:00
Zhiqiang Wang d05b134a48
os: Mac package (#17201)
* os: Mac package

* os: Mac package

* os: Mac package

* os: Mac package

* os: Mac package

* os: Mac package

* os: Mac package

* os: Mac package

* os: Mac package

* os: Mac package

* os: Mac package

* os: Mac package
2022-10-08 10:12:17 +08:00
54liuyao 46c99915bc feat(stream): distribute interval disc buff 2022-09-30 10:01:51 +08:00
Cary Xu 9e49eb03e4 fix: coverity scan for sma 2022-09-28 18:54:39 +08:00
54liuyao 747297bd28 feat(stream): stream fill 2022-09-27 18:11:44 +08:00
Liu Jicong 72fba5a8ce fix(stream): check delete uid 2022-09-21 11:54:44 +08:00
54liuyao 97ca09689c Merge branch 'feature/stream' into feature/TD-18820 2022-09-19 19:31:41 +08:00
Liu Jicong 86c0fb56e0 enhance stream backend for sma 2022-09-19 17:27:25 +08:00
54liuyao 955838d1f6 feat(stream): optimize disc buff 2022-09-19 17:13:13 +08:00
Liu Jicong 4c6a8bbc95 feat(stream): stream state support tuple 2022-09-14 16:50:42 +08:00
Liu Jicong b8a7c8b2aa feat(stream): support hash suffix and prefix 2022-09-13 15:21:26 +08:00
54liuyao 1f5d9a38e7 feat(stream):change single interval disc buff and interval delete 2022-09-07 14:48:14 +08:00
Liu Jicong d653da7971 feat(stream): support delete data 2022-09-02 15:46:41 +08:00
54liuyao 83e62c3849 feat(stream):stream partition by column 2022-09-01 15:05:24 +08:00
Minglei Jin 04e5c75bba fix: cleanup memory with streamLoadTasks 2022-08-26 14:51:30 +08:00
Liu Jicong 24261cc90b refactor(stream): refine stream backend interface 2022-08-24 15:53:29 +08:00
Liu Jicong d7b804e02e fix stream load task 2022-08-24 10:42:34 +08:00
Liu Jicong c296dd0a63 fix compile 2022-08-24 01:48:00 +08:00
Liu Jicong 2d628491b2 feat(stream): support tdb state backend 2022-08-23 19:30:04 +08:00
Liu Jicong 2b092f6551 fix(query): memory leak 2022-08-18 18:39:21 +08:00
Liu Jicong 963287798d refactor(mnode): drop stream task 2022-08-17 23:18:39 +08:00
Liu Jicong 853e6e2988 refactor(mnode): drop stream task 2022-08-17 19:19:58 +08:00
Liu Jicong 357b21cfeb refactor(tmq): use tdb to store check info 2022-08-17 13:58:56 +08:00
Liu Jicong 2ced6c280c enh(stream): reduce table scan 2022-08-16 12:11:56 +08:00
54liuyao 44123ec8f0 feat(stream):optimzie stream interval 2022-08-11 10:20:42 +08:00
Liu Jicong 51aa9413d7
Merge pull request #15937 from taosdata/feature/stream
enh(tmq): speed up consumer recover
2022-08-10 17:19:36 +08:00
Haojun Liao 6250c1b157
Merge pull request #15851 from taosdata/feature/3.0_query_optimize
ehn(query): optimize the query performance.
2022-08-10 16:51:46 +08:00
Liu Jicong e5e82f0cf2 merge 3.0 2022-08-10 16:31:23 +08:00
Liu Jicong 18f6fb6123 enh(tmq): speed up consumer recover 2022-08-10 16:04:03 +08:00
Liu Jicong a62950b441
Merge pull request #15920 from taosdata/feature/stream
enh(stream): recover process
2022-08-09 23:35:03 +08:00
Liu Jicong fc225a580d enh(stream): recover process 2022-08-09 21:37:21 +08:00
54liuyao 41e2538ade scalable bloom filter encode & decode 2022-08-09 16:54:59 +08:00
Liu Jicong d9a4ea305d fix(stream): memory error 2022-08-09 14:11:41 +08:00
Haojun Liao b9c6e0cdf9 refactor: stream invoke previous APIs. 2022-08-09 13:55:51 +08:00
Haojun Liao a2a1da06dd other:merge 3.0 2022-08-09 13:45:44 +08:00
Xiaoyu Wang 07ef00e89f merge 3.0 2022-08-09 11:36:08 +08:00
Liu Jicong ad032a0a90 enh(stream): stream recover 2022-08-09 10:36:27 +08:00