Commit Graph

304 Commits

Author SHA1 Message Date
liuyao 74ab689719 opt batch num 2023-05-05 08:59:07 +08:00
liuyao d8a1f15d10 fix resum bug 2023-05-04 09:28:06 +08:00
Haojun Liao 3c61932ecc refactor: do some internal refactor. 2023-05-01 19:28:54 +08:00
Haojun Liao b7c8346b44 other: merge other branch. 2023-04-28 13:06:47 +08:00
Haojun Liao f9a64cbcd6 other: add some logs. 2023-04-28 12:58:03 +08:00
jiajingbin ebf9a13fe7 inc batch num 2023-04-27 18:15:17 +08:00
liuyao 863d30e5a9 opt tq read 2023-04-26 18:58:19 +08:00
liuyao 2533b5c5c2 op stream 2023-04-26 17:00:33 +08:00
yihaoDeng 917b07348c Merge branch 'fix/rocksdbState' into enh/rocksRevert 2023-04-23 02:37:26 +00:00
Haojun Liao b6f4cac619 fix(stream): set the correct offset version. 2023-04-21 13:35:24 +08:00
Haojun Liao 5e6c06e253 fix(stream): fix the race condition during create new stream tasks. 2023-04-20 23:21:18 +08:00
Haojun Liao 8323ad8670 enh(stream): add more check to stop stream asap. 2023-04-20 17:29:08 +08:00
Haojun Liao 930b267a75 fix(stream): set the correct start offset for stream task. 2023-04-17 22:59:00 +08:00
Haojun Liao b57c813681 other: merge feature/3_liaohj 2023-04-14 10:36:54 +08:00
Haojun Liao 70b45a4cf0 fix(stream): all data should be extracted from wal. 2023-04-13 23:22:09 +08:00
Haojun Liao 5ab54481f0 refactor: do some internal refactor. 2023-04-11 19:24:34 +08:00
yihaoDeng b24b91886a Merge branch 'dev3' into enh/rocksRevert 2023-04-11 10:59:00 +00:00
Haojun Liao 18479d8115 refactor: do some internall refactor. 2023-04-11 15:42:24 +08:00
Haojun Liao 15cceb5a5a refactor: do some internal refactors. 2023-04-11 11:53:10 +08:00
liuyao 74da3c05bc feat:set check point id 2023-04-11 10:33:10 +08:00
Haojun Liao a4ba5401f9 enh(stream): set the start version of all operators. 2023-04-11 10:01:36 +08:00
Haojun Liao f5b52749c2 refactor: do some internal refactor. 2023-04-09 01:39:09 +08:00
liuyao 955f8f9f07 feat:optimize get patitionby name 2023-04-07 18:45:09 +08:00
yihaoDeng 628bb62c8a add backpressure 2023-04-04 07:20:05 +00:00
Haojun Liao 3ef7d43dae refactor: do some internal refactor. 2023-04-03 17:47:48 +08:00
54liuyao 2185464836 fix:scan of fill history ended prematurely 2023-03-18 13:38:33 +08:00
54liuyao 25732f7c3c fix:source task needs to wait & stream state window does not handle null 2023-03-15 13:15:17 +08:00
54liuyao 0cd871010f fix:fix fill history bug 2023-03-07 13:34:26 +08:00
54liuyao 1d58f85a54 feat:coverity scan 2023-02-22 10:10:04 +08:00
Xiaoyu Wang c597de099f merge main 2023-02-20 13:41:27 +08:00
54liuyao 2270fed9f7 fix:add limit for stream batch 2023-02-18 11:57:24 +08:00
Xiaoyu Wang fdde287ca9 merge main 2023-01-04 11:43:20 +08:00
Liu Jicong 66b9fa01f7 enh: optimize drop when scan exec 2022-12-29 15:51:12 +08:00
Shengliang Guan 78c14a2c88 Merge remote-tracking branch 'origin/3.0' into merge/mainto3.0_1228 2022-12-28 14:59:02 +08:00
Shengliang Guan d342ebcd77
Merge pull request #18720 from taosdata/refact/submit_req
Refact/submit req
2022-12-28 10:29:00 +08:00
Liu Jicong 39eb62d80d enh: set scan limit 2022-12-27 14:52:41 +08:00
Liu Jicong 5826e40aa7 enh: drop stream eagerly 2022-12-27 11:20:35 +08:00
Xiaoyu Wang 0c269c317b merge 3.0 2022-12-23 17:50:05 +08:00
Liu Jicong b1bd24d15a enh: scan exec set limit 2022-12-23 16:35:40 +08:00
Liu Jicong 69d410591f refactor: add debug log 2022-12-22 17:14:17 +08:00
Haojun Liao 48f7fc5c3d
Merge branch '3.0' into refact/submit_req 2022-12-12 18:11:17 +08:00
Shengliang Guan 50b66df39f fix: control rpc qitem memory 2022-12-10 14:02:57 +08:00
Liu Jicong ecbc09663f enh: tolerate exec error 2022-12-09 09:35:53 +08:00
Shengliang Guan 6d94afe48f
Revert "refact: adjust some assert cases" 2022-12-07 21:51:17 +08:00
Shengliang Guan d5126d469a refact: replcase ASSERT with tAssert 2022-12-07 18:42:48 +08:00
Shengliang Guan f69a188f7e refact: replcase ASSERT with tAssert 2022-12-07 18:37:40 +08:00
Liu Jicong b133a56219 refactor: support submitreq2 2022-12-07 15:19:34 +08:00
Liu Jicong 548684e5ac fix(stream): delete multiple row 2022-11-29 23:39:58 +08:00
Liu Jicong 5161eca70f fix(stream): stop scan when no output 2022-11-17 10:30:05 +08:00
Liu Jicong bc469f7f7b fix(stream): delete tb should be checked in write thread 2022-11-08 11:30:29 +08:00
Liu Jicong 2fbc8e6306 refactor(stream): stream deploy and state transfer 2022-11-03 13:22:23 +08:00
Liu Jicong 5e253cc8ea refactor(stream): fill history 2022-11-01 11:56:14 +08:00
Liu Jicong 75e5e490fd refactor(stream): recover and fill history 2022-10-26 00:31:00 +08:00
54liuyao 7f16081e29 feat(stream): stream task and meta 2022-10-19 10:49:42 +08:00
Liu Jicong 72fba5a8ce fix(stream): check delete uid 2022-09-21 11:54:44 +08:00
Liu Jicong c296dd0a63 fix compile 2022-08-24 01:48:00 +08:00
Liu Jicong 18f6fb6123 enh(tmq): speed up consumer recover 2022-08-10 16:04:03 +08:00
Liu Jicong fc225a580d enh(stream): recover process 2022-08-09 21:37:21 +08:00
Liu Jicong d9a4ea305d fix(stream): memory error 2022-08-09 14:11:41 +08:00
Liu Jicong ad032a0a90 enh(stream): stream recover 2022-08-09 10:36:27 +08:00
Liu Jicong c411b9aebb fix(stream): memory leak 2022-08-08 18:09:36 +08:00
Liu Jicong 7c9d57bd89 refactor(stream): unify sink and dispatch 2022-08-05 20:16:47 +08:00
Liu Jicong 031414001d fix schedule 2022-08-04 17:46:13 +08:00
Liu Jicong d6cc88ed4b refactor(stream): exec scheduler 2022-08-04 16:19:53 +08:00
Liu Jicong e345023dfd enh(stream): keep thread from blocking 2022-08-03 15:31:10 +08:00
Shengliang Guan 56f2e49764 refactor: adjust logs 2022-08-02 17:12:07 +08:00
Liu Jicong a9d11b58ad enh(stream): recover 2022-07-28 16:19:50 +08:00
Liu Jicong ba0c1b3689 refactor(stream) 2022-07-27 20:11:03 +08:00
Liu Jicong 5e1bbe0e7e refactor(sma): remove option 2022-07-27 16:55:23 +08:00
jiajingbin 8833a8bdfb fix: fix bug for TD-17801 2022-07-25 21:39:12 +08:00
Liu Jicong b1f3428c05 refactor(stream): do not merge output 2022-07-22 10:43:49 +08:00
Liu Jicong edaec52bca refactor: add debug flag 2022-07-19 19:59:07 +08:00
jiacy-jcy 5200a48107 fix: update 2022-07-19 16:54:19 +08:00
Liu Jicong b6f55fa09e refactor(stream): batch optimization for submit msg 2022-07-18 21:32:40 +08:00
Liu Jicong 053786e6b4 fix(stream): data exec 2022-07-18 15:50:36 +08:00
Liu Jicong 500553d581 refactor: add debug log 2022-07-18 11:41:56 +08:00
Liu Jicong 280ed4f65d feat(stream): pipelined exec for recovering 2022-07-15 21:29:53 +08:00
Liu Jicong 9394e3380f feat(stream): recover from failure 2022-07-15 17:58:53 +08:00
Liu Jicong d75e9b8f6a merge from 3.0 2022-07-14 15:35:00 +08:00
Liu Jicong 9ea0ad57ec refactor(stream): destroy stream task 2022-07-14 15:32:21 +08:00
Haojun Liao 75aca0b031 fix(query): set correct fill output column index, fix some memory leak, and do some internal refactor, 2022-07-14 13:53:23 +08:00
Liu Jicong a717042acf refactor(stream): simple batch 2022-07-13 17:24:36 +08:00
Liu Jicong 8a6e4b877a refactor(stream): simple batch 2022-07-13 16:37:33 +08:00
Liu Jicong 8e3f5135a6 fix(tsdb): close fd 2022-07-12 17:28:14 +08:00
Liu Jicong d637ffe22c refactor(tmq): prepare only needed 2022-07-12 14:10:22 +08:00
Liu Jicong 52d09b4173 refactor(wal) 2022-07-01 14:39:21 +08:00
Liu Jicong 0f0fe6276a merge from 3.0 2022-06-29 21:33:10 +08:00
Liu Jicong c2955a807b feat(tmq): offset support snapshot 2022-06-29 21:04:51 +08:00
Liu Jicong 383e7a495b fix(query): enable output check 2022-06-28 13:45:50 +08:00
54liuyao 10e90ce973 feat(stream): auto pull data 2022-06-25 16:44:14 +08:00
Liu Jicong 90121ae439 fix(tmq): check stb existence when subscribing stb 2022-06-25 15:26:29 +08:00
Liu Jicong 81ed902d7f fix(stream): stream rsp to retrieve msg if data is empty 2022-06-25 14:03:06 +08:00
Liu Jicong f2f5d68f3b fix(stream): memory leak 2022-06-23 22:05:00 +08:00
Liu Jicong 4ed47a0296 feat(tmq): scan tsdb as snapshot 2022-06-23 13:35:24 +08:00
Liu Jicong 14a488c92c feat(stream): stream support multiple type input 2022-06-22 21:21:39 +08:00
Liu Jicong fb596625d3 feat(stream): support retrieve 2022-06-22 19:12:31 +08:00
Liu Jicong 3f6ce2da73 feat(tmq): support topic with meta 2022-06-21 15:18:09 +08:00
Liu Jicong c409760f75 feat(stream): drop stream 2022-06-21 11:32:36 +08:00
Liu Jicong 450675f672 feat(stream): support snode 2022-06-20 20:18:34 +08:00
Liu Jicong 8eb08fa0d4 feat(stream): trigger mode add max delay 2022-06-15 16:11:20 +08:00
Liu Jicong 9e4b3adc7c fix(stream): msg dispatch 2022-06-09 11:45:06 +08:00
Liu Jicong 83f5e5eedc fix(stream): fix no executor stream task 2022-06-09 09:56:45 +08:00
Liu Jicong 858868d76a refactor(stream): distributed execution 2022-06-07 10:54:18 +08:00
Liu Jicong 2677a3c8d9 refactor(stream) 2022-06-06 20:15:36 +08:00