Commit Graph

266 Commits

Author SHA1 Message Date
liuyao 502efb3d01 op stream selectivity buff 2023-05-15 16:26:24 +08:00
yihaoDeng 9c0d2c87c6 Merge branch 'enh/3.0' into enh/rocksdbSstateMerge 2023-05-15 01:52:42 +00:00
Haojun Liao 8e15c64499 refactor: do some internal refactor. 2023-05-13 23:22:36 +08:00
Haojun Liao 236926b9ee other: merge enh/rocksdbstate 2023-05-13 19:49:28 +08:00
liuyao 8b7b804606 opt partition by tbname 2023-05-11 18:47:27 +08:00
yihaoDeng b91981af59 factor code 2023-05-11 10:09:09 +00:00
yihaoDeng 4e8f5f5d32 factor code 2023-05-11 09:58:53 +00:00
yihaoDeng afaee9c386 factor code 2023-05-11 09:51:01 +00:00
yihaoDeng 4715aacd41 factor code 2023-05-11 09:44:40 +00:00
yihaoDeng f652f71d68 factor code 2023-05-11 06:37:57 +00:00
Haojun Liao dbd79cc80c refactor: do some internal refactor. 2023-05-10 22:22:01 +08:00
yihaoDeng 55014aa003 Merge branch 'enh/rocksdbSstate' into enh/rocksdbSstateMerge 2023-05-09 08:58:51 +00:00
yihaoDeng 08c3a63341 Merge branch 'enh/standVer' into enh/rocksdbSstateMerge 2023-05-06 12:37:54 +00:00
Haojun Liao da6212bab0 other: merge main. 2023-05-06 12:51:38 +08:00
yihaoDeng d7e86aca05 fix case failure 2023-05-05 15:14:16 +00:00
Haojun Liao 8958aabe4b fix(stream): opt task scan performance. 2023-05-05 19:33:30 +08:00
yihaoDeng f7a7743af7 fix case failure 2023-05-05 08:32:33 +00:00
Haojun Liao 23c49594b7 other: merge main. 2023-05-04 16:41:53 +08:00
yihaoDeng c27d01a510 Merge branch 'enh/addTtlToStream' into enh/rocksdbSstateMerge 2023-05-04 08:22:31 +00:00
liuyao d8a1f15d10 fix resum bug 2023-05-04 09:28:06 +08:00
Haojun Liao 3c61932ecc refactor: do some internal refactor. 2023-05-01 19:28:54 +08:00
yihaoDeng dda1c8803c Merge branch 'enh/rocksdbSstate' into enh/rocksdbSstateMerge 2023-04-28 09:17:22 +00:00
yihaoDeng afc6023a8a merge rocksdb inst 2023-04-28 06:32:33 +00:00
yihaoDeng 36a4413bf1 merge rocksdb inst 2023-04-27 14:38:33 +00:00
Haojun Liao b7040ed15e enh(stream): support resume from the latest data, and do some internal refactor. 2023-04-27 15:07:54 +08:00
liuyao 863d30e5a9 opt tq read 2023-04-26 18:58:19 +08:00
yihaoDeng 81bd7661bd add ttl to stream state key 2023-04-24 14:20:01 +00:00
yihaoDeng ae3730c318 add ttl to stream state key 2023-04-23 13:29:18 +00:00
liuyao 641c707b37 pause&resume 2023-04-23 17:37:10 +08:00
54liuyao 5089528a02 feat:stream pause&resume 2023-04-23 15:08:51 +08:00
yihaoDeng 917b07348c Merge branch 'fix/rocksdbState' into enh/rocksRevert 2023-04-23 02:37:26 +00:00
Haojun Liao 5e6c06e253 fix(stream): fix the race condition during create new stream tasks. 2023-04-20 23:21:18 +08:00
yihaoDeng 3272d14e33 change write opt 2023-04-20 04:05:35 +00:00
Haojun Liao fb32ffd960 fix(stream): update the reference count value to be int32, insead of int8 2023-04-18 18:06:03 +08:00
Haojun Liao 1f3c8c3d80 fix(stream): update the ref type. 2023-04-18 17:15:31 +08:00
Haojun Liao ac137b4b33 refactor: do some internal refactor. 2023-04-17 09:46:58 +08:00
Haojun Liao be90d2c511 fix(stream): disable stream task when no tasks exist. 2023-04-16 23:07:54 +08:00
Haojun Liao d420734971 Merge remote-tracking branch 'origin/enh/rocksRevert' into enh/rocksRevert 2023-04-14 18:03:19 +08:00
Haojun Liao ab4b08a4b5 Merge branch 'feature/3_liaohj' into enh/rocksRevert 2023-04-14 17:44:50 +08:00
Haojun Liao e0cb8aa534 fix(stream): don't the initial task status and do some internal refactor. 2023-04-14 17:43:37 +08:00
liuyao b8ac811f20 fix bug 2023-04-14 17:35:17 +08:00
Haojun Liao eb0e1f848a fix(stream): remove unused tqreader, do some internal refactor, set the meta value for streamtask. 2023-04-14 12:00:09 +08:00
Haojun Liao 5850a3ab01 Merge remote-tracking branch 'origin/enh/rocksRevert' into enh/rocksRevert 2023-04-14 10:37:17 +08:00
Haojun Liao b57c813681 other: merge feature/3_liaohj 2023-04-14 10:36:54 +08:00
Haojun Liao 70b45a4cf0 fix(stream): all data should be extracted from wal. 2023-04-13 23:22:09 +08:00
liuyao 34bf638f19 fix bug 2023-04-13 16:21:57 +08:00
liuyao 9be89ce00a delete expired check point 2023-04-12 17:33:58 +08:00
yihaoDeng ed4aaade8c add backend 2023-04-12 03:03:51 +00:00
yihaoDeng a3836b2363 fix invalid free 2023-04-11 12:52:03 +00:00
Haojun Liao 5ab54481f0 refactor: do some internal refactor. 2023-04-11 19:24:34 +08:00
yihaoDeng b24b91886a Merge branch 'dev3' into enh/rocksRevert 2023-04-11 10:59:00 +00:00
yihaoDeng ff8cb09f63 refactor backend 2023-04-11 10:47:15 +00:00
Haojun Liao 18479d8115 refactor: do some internall refactor. 2023-04-11 15:42:24 +08:00
liuyao 95d81604c7 feat:encode&&decode stream scan op 2023-04-11 14:34:31 +08:00
Haojun Liao 15cceb5a5a refactor: do some internal refactors. 2023-04-11 11:53:10 +08:00
liuyao 74da3c05bc feat:set check point id 2023-04-11 10:33:10 +08:00
Haojun Liao a4ba5401f9 enh(stream): set the start version of all operators. 2023-04-11 10:01:36 +08:00
Haojun Liao 7419c0bfe9 enh(stream): the stream will start after vnode restore being completed. 2023-04-10 16:56:14 +08:00
Haojun Liao f5b52749c2 refactor: do some internal refactor. 2023-04-09 01:39:09 +08:00
liuyao fe9ca49d3f feat:optimize get patitionby name 2023-04-07 18:47:57 +08:00
liuyao 955f8f9f07 feat:optimize get patitionby name 2023-04-07 18:45:09 +08:00
yihaoDeng 1e3569367a opt write snapshot 2023-04-07 07:38:02 +00:00
yihaoDeng c082536242 opt write snapshot 2023-04-07 07:26:15 +00:00
liuyao 1f63859e21 feat:add buff swap 2023-04-07 12:50:59 +08:00
liuyao 0716a4aee8 feat:add check point 2023-04-06 16:45:22 +08:00
54liuyao 1892b806b5 feat:add stream state buff 2023-04-04 17:09:35 +08:00
54liuyao 429b5cd646 feat:add stream file state 2023-04-04 17:09:35 +08:00
yihaoDeng 628bb62c8a add backpressure 2023-04-04 07:20:05 +00:00
Haojun Liao a3ac8b647c refactor: do some internal refactor. 2023-04-03 18:20:35 +08:00
Haojun Liao 482c319bee refactor: do some internal refactor. 2023-04-03 18:07:28 +08:00
Haojun Liao 3ef7d43dae refactor: do some internal refactor. 2023-04-03 17:47:48 +08:00
Haojun Liao 9992942a7a
Merge pull request #20658 from taosdata/feat/TD-22418
feat:coverity scan
2023-03-29 10:44:53 +08:00
yihaoDeng 0d11430be1 tqadd backend 2023-03-28 14:31:11 +00:00
Haojun Liao 68f310dd48 refactor: do some internal refactor. 2023-03-28 15:05:10 +08:00
54liuyao cf2d169f75 feat:coverity scan 2023-03-27 16:17:49 +08:00
yihaoDeng a3a0d9c81f add backend 2023-03-27 07:42:11 +00:00
yihaoDeng 914d391845 fix tag filter 2023-03-21 12:28:16 +00:00
yihaoDeng 2d37aeabdc add backend 2023-03-20 15:33:18 +00:00
yihaoDeng 8039702c14 add backend 2023-03-18 07:36:55 +00:00
54liuyao 1d58f85a54 feat:coverity scan 2023-02-22 10:10:04 +08:00
Xiaoyu Wang c597de099f merge main 2023-02-20 13:41:27 +08:00
Liu Jicong 2a4708d82a fix: save fill history state 2023-02-16 17:01:09 +08:00
Xiaoyu Wang eb86f5ae71 merge main 2023-01-28 18:10:08 +08:00
Xiaoyu Wang 24157e78d6 merge main 2023-01-28 17:52:58 +08:00
54liuyao e03deeaed8 feat:add stream delete mark 2023-01-17 16:21:51 +08:00
Liu Jicong 9913ed1dd1 fix: concurrency issue 2023-01-12 14:28:34 +08:00
Liu Jicong ef12805c3b fix: concurrency issue 2023-01-12 14:15:29 +08:00
Liu Jicong bfb92457fa refactor: stream dispatch 2022-12-29 16:24:30 +08:00
Shengliang Guan d342ebcd77
Merge pull request #18720 from taosdata/refact/submit_req
Refact/submit req
2022-12-28 10:29:00 +08:00
Liu Jicong dcb71e4af1 refactor: stream dispatch 2022-12-27 15:17:43 +08:00
Xiaoyu Wang 0c269c317b merge 3.0 2022-12-23 17:50:05 +08:00
Liu Jicong 2a7de0cd46 refactor: remove assert 2022-12-21 13:54:14 +08:00
Liu Jicong 74a253eac4 refactor 2022-12-08 13:34:42 +08:00
Shengliang Guan 6d94afe48f
Revert "refact: adjust some assert cases" 2022-12-07 21:51:17 +08:00
Shengliang Guan d5126d469a refact: replcase ASSERT with tAssert 2022-12-07 18:42:48 +08:00
Liu Jicong b133a56219 refactor: support submitreq2 2022-12-07 15:19:34 +08:00
Minglei Jin 6cb65f336d Merge branch 'v3.0' into feat/async_commit 2022-12-02 14:49:58 +08:00
Liu Jicong 3424b184d3 refactor(stream): distributed checkpoint 2022-12-02 03:48:45 +08:00
Minglei Jin 506554b5d2 Merge branch 'v3.0' into fix/tdb-async-commit 2022-11-28 16:20:48 +08:00
Liu Jicong 48894c8bdb enh(stream): new api for stream queue 2022-11-25 18:03:40 +08:00