Commit Graph

364 Commits

Author SHA1 Message Date
Shengliang Guan 60bab9ae55 refact: post sem in vnode while sync timeout 2022-12-14 16:09:28 +08:00
Shengliang Guan 2b256542a5 refact: add vnode timer 2022-12-14 09:14:40 +08:00
Minglei Jin 5f2b393c0c meta/snapshot: use nil heap and abort tdb when rollback 2022-12-09 16:23:43 +08:00
Hongze Cheng 7b20c09f34 more code 2022-12-09 16:19:49 +08:00
Hongze Cheng 63cc4e27b1 more code 2022-12-09 15:50:22 +08:00
kailixu 6f377e3234 refact: tsma/rsma data format 2022-12-08 14:39:59 +08:00
Liu Jicong 74a253eac4 refactor 2022-12-08 13:34:42 +08:00
kailixu f9bd3580d4 chore: rsma refact 2022-12-08 00:49:23 +08:00
Liu Jicong b133a56219 refactor: support submitreq2 2022-12-07 15:19:34 +08:00
Hongze Cheng 899d7b0bcc Merge branch '3.0' of https://github.com/taosdata/TDengine into refact/submit_req 2022-12-06 14:37:22 +08:00
kailixu cb9aa7dcef chore: rsmaFS process 2022-12-06 01:59:24 +00:00
kailixu cf4ef434ee Merge branch '3.0' into feature/TD-19148-D 2022-12-05 06:56:27 +08:00
kailixu cf0995f749 feat: async commit for rsma 2022-12-04 20:26:58 +08:00
Minglei Jin a4adcbbe0d vnode/async-commit: adapter vnode-commit to use txn commit 2022-12-04 18:13:51 +08:00
kailixu 8bc95dcb10 Merge branch '3.0' into feature/TD-19148-D 2022-12-04 17:54:17 +08:00
Hongze Cheng 2a20347210 add more code 2022-12-04 15:14:04 +08:00
kailixu 3a59c5381c refact: tsma code optimization 2022-12-03 22:34:29 +08:00
kailixu 42b17760a2 refact: tsma result adaption 2022-12-03 20:06:55 +08:00
kailixu e918982a5a refact: rsma adaption for new SSubmitReq 2022-12-03 14:23:58 +08:00
kailixu d3a88ea517 refactor: row and submit msg of rsma/tsdb 2022-12-03 13:33:30 +08:00
Hongze Cheng e9356fa59d Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/async_commit 2022-12-02 16:28:53 +08:00
Hongze Cheng 129c692f3e more async commit 2022-12-02 15:44:24 +08:00
kailixu 9b4c881106 chore: rsma logic optimization 2022-12-01 21:43:42 +08:00
Hongze Cheng 3700f0dc8e more code 2022-12-01 16:19:21 +08:00
slzhou 6d86fb5b51 Merge branch 'enh/3.0_planner_optimize' into szhou/table-count-scan 2022-11-29 22:19:36 +08:00
Hongze Cheng 25ec924c91 more code 2022-11-29 17:29:49 +08:00
Hongze Cheng 0f8016995c more code 2022-11-28 13:41:06 +08:00
slzhou c2a7404b42 save work in case it losts 2022-11-25 23:00:14 +08:00
shenglian zhou 7f6ff39648 feat: table merge scan save work 2022-11-23 19:47:24 +08:00
Minglei Jin 35b9dc6b6c meta: use meta cache to get uid's version instead of fetching from tdb 2022-11-18 17:07:19 +08:00
Minglei Jin c17f8244be enh(tdb): new interface of meta prep async commit 2022-11-07 16:45:29 +08:00
Liu Jicong 2fbc8e6306 refactor(stream): stream deploy and state transfer 2022-11-03 13:22:23 +08:00
Minglei Jin 5ae5df1a17 Merge branch 'v3.0' into fix/long_query 2022-11-01 18:06:39 +08:00
Liu Jicong 8ca5f0bd9c Merge branch '3.0' into feature/stream 2022-11-01 13:20:20 +08:00
Liu Jicong 2e640c38a2 refactor: stream and tmq message 2022-10-31 18:37:28 +08:00
Haojun Liao 4b2fa43dae
Revert "fix(query): handle partition by in table scan operator" 2022-10-28 18:05:19 +08:00
Haojun Liao 5a971dd03a fix(query): handle partition by in table scan operator with limit/offset value. 2022-10-27 16:58:32 +08:00
Minglei Jin 7800b7731d Merge branch 'v3.0' into fix/long_query 2022-10-27 10:39:50 +08:00
Cary Xu 54526adcc3 fix: commit txn for rsma 2022-10-19 17:18:41 +08:00
Hongze Cheng 20b3e2168b Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/commit_txn 2022-10-19 11:56:15 +08:00
Cary Xu a6e3da8045 chore: code optimization for sma commit 2022-10-19 09:37:38 +08:00
Minglei Jin 82132cdfdd meta: new metaFinishCommit api & rollback parameter with metaOpen 2022-10-18 18:34:39 +08:00
Hongze Cheng 0706f2dea2 more code 2022-10-18 16:54:53 +08:00
Hongze Cheng b7342525c7 more code 2022-10-18 13:38:26 +08:00
Hongze Cheng c79fd325bd
Merge pull request #17299 from taosdata/fix/TD-19332
fix: use stable stats cache to get ctbNum
2022-10-12 10:02:21 +08:00
Cary Xu 02979f081d fix: support statistics of insert_req 2022-10-11 17:47:23 +08:00
Minglei Jin 25b279dd7a meta/cache: a new cache for stable's ctbNum 2022-10-11 17:00:49 +08:00
Cary Xu fe115ab02e fix: support statistics of insert_req 2022-10-10 18:20:53 +08:00
Minglei Jin 997dfb41d9 fix(meta): use rwlock to favor writers 2022-10-10 11:00:55 +08:00
Hongze Cheng 2015db5756 alter pages 2022-10-09 15:01:20 +08:00
yihaoDeng 5b4d0eaabe enh: opt tbname in 2022-09-29 11:07:32 +08:00
wangmm0220 414021a8e0 fix:error in auto create table for taosX 2022-09-15 19:23:12 +08:00
Hongze Cheng 44915af5e7 more code 2022-09-15 14:16:12 +08:00
Hongze Cheng 36d01e84a5 more code 2022-09-07 11:05:00 +08:00
Cary Xu 31fb2a31b6 enh: drop child tables support for rsma 2022-09-05 16:25:13 +08:00
Shengliang Guan 25df542a01
Merge pull request #16649 from taosdata/feature/3.0_interval_hash_optimize
refactor: rsma fetch trigger refactor and use ref to manage qtaskf
2022-09-04 18:16:58 +08:00
Cary Xu 18c3f19b6b Merge branch '3.0' into feature/3.0_interval_hash_optimize 2022-09-04 14:57:38 +08:00
Cary Xu f78c61aac6 refactor: rsma fetch trigger refactor and use ref to manage qtaskf 2022-09-04 14:54:33 +08:00
Haojun Liao d9d7c81872
Merge branch '3.0' into refact/tsdb_optimize 2022-09-03 10:14:48 +08:00
Liu Jicong d653da7971 feat(stream): support delete data 2022-09-02 15:46:41 +08:00
Hongze Cheng 5bbfc54504 Merge branch '3.0' of https://github.com/taosdata/TDengine into refact/tsdb_optimize 2022-08-26 10:08:12 +08:00
dapan1121 4ab25b856f Merge remote-tracking branch 'origin/3.0' into enh/updateTbMeta 2022-08-25 13:23:16 +08:00
Hongze Cheng b8a70bc5b0 Merge branch '3.0' of https://github.com/taosdata/TDengine into refact/tsdb_optimize 2022-08-25 10:05:50 +08:00
Hongze Cheng f95c0013ef more code 2022-08-24 17:29:28 +08:00
Cary Xu bd02bfe58d enh: assign specific threads for rsma 2022-08-24 10:57:06 +08:00
dapan1121 0ebd3281c5 enh: update table meta after creating table 2022-08-23 18:26:27 +08:00
Shengliang Guan 4bc8e086a8
Merge pull request #16262 from taosdata/feature/3.0_interval_hash_optimize
enh: rsma batch process and code optimization
2022-08-21 23:57:58 +08:00
Cary Xu 8b3b6a8962 enh: code optimization and memory leak 2022-08-21 01:07:21 +08:00
Cary Xu a9fcc12c33 enh: rsma batch process 2022-08-19 20:08:09 +08:00
Cary Xu 441ce21677 enh: rsma batch process 2022-08-19 17:19:50 +08:00
Hongze Cheng e9bb654a4a Merge branch '3.0' of https://github.com/taosdata/TDengine into refact/tsdb_last 2022-08-18 17:14:51 +08:00
Hongze Cheng 117bc90dad more snapshot 2022-08-18 15:29:42 +08:00
Cary Xu 69580893a7 other: merge 3.0 2022-08-17 20:20:02 +08:00
Hui Li 945e290023
Merge pull request #16177 from taosdata/feature/stream
refactor(tmq): use tdb to store check info
2022-08-17 15:14:04 +08:00
Liu Jicong 357b21cfeb refactor(tmq): use tdb to store check info 2022-08-17 13:58:56 +08:00
Cary Xu 0ade372145 Merge branch '3.0' into feature/3.0_interval_hash_optimize 2022-08-17 09:46:49 +08:00
Hongze Cheng 5d1cbb54c1 optimize 2022-08-16 06:22:55 +00:00
Cary Xu 313a546b85 other: merge 3.0 2022-08-15 16:25:39 +08:00
Liu Jicong b9c9ea5974
Merge pull request #16103 from taosdata/feature/stream
refactor(stream): remove unneccessary param in converting data
2022-08-15 13:26:46 +08:00
Liu Jicong 6f75e03a55 refactor(stream): remove unneccessary param in converting data 2022-08-15 11:06:53 +08:00
Cary Xu dab6c81769 enh: rsma batch process 2022-08-15 00:16:44 +08:00
Cary Xu 8c75274e13 Merge branch '3.0' into feature/3.0_interval_hash_optimize 2022-08-12 21:04:20 +08:00
Cary Xu ae7550eb86 enh: rsma exec in async mode 2022-08-12 21:00:48 +08:00
Shengliang Guan 353109cd53 fix: deadlock of vnode if its state changed 2022-08-12 17:25:08 +08:00
Shengliang Guan 4f90578270 fix: deadlock of vnode if its state changed 2022-08-12 16:32:11 +08:00
Liu Jicong c191f44b14 feat(stream): session window trigger delete 2022-08-11 12:01:20 +08:00
Liu Jicong 7f4b46e003 feat(stream): session window trigger delete 2022-08-10 21:26:05 +08:00
Liu Jicong e5e82f0cf2 merge 3.0 2022-08-10 16:31:23 +08:00
Liu Jicong 18f6fb6123 enh(tmq): speed up consumer recover 2022-08-10 16:04:03 +08:00
Minglei Jin d0416f312f fix: tdb use sys memory when snapshot writing 2022-08-09 19:07:07 +08:00
Cary Xu 0aac37a45c enh: rsma fetch logic optimization 2022-08-08 11:25:32 +08:00
Liu Jicong c089d3ba08 merge 3.0 2022-08-02 22:53:49 +08:00
Liu Jicong d43eec5d16 enh(stream): directly dispatch 2022-08-02 22:23:33 +08:00
Cary Xu 602d2aa377 other: rsma snapshot and misc update 2022-08-02 16:13:36 +08:00
Liu Jicong de582a924a
Merge pull request #15655 from taosdata/feature/stream
feat(tq): transport snapshot
2022-08-01 19:48:57 +08:00
Liu Jicong b084dd8ee6 feat(tq): transport snapshot 2022-08-01 19:12:37 +08:00
Liu Jicong 16bf52bf8f
Merge pull request #15611 from taosdata/feature/stream
refactor(stream): use vnode meta
2022-08-01 17:41:19 +08:00
Liu Jicong bb6fabcc11 refactor(stream): use vnode meta 2022-07-30 20:20:12 +08:00
Minglei Jin bd473f7eb0 fix: dismiss compiling issues 2022-07-30 19:26:10 +08:00
Cary Xu 466e7965ed feat: rsma1/rsma2 support replication 2022-07-30 00:38:11 +08:00
Shengliang Guan bc9a553db0 fix: the message cannot be processed until the vnode recovery is complete 2022-07-25 19:08:08 +08:00
Cary Xu 9b4a9d24d5 Merge branch '3.0' into feature/TD-11274-3.0 2022-07-22 20:39:23 +08:00
Cary Xu 00a9598ac8 enh: rsma level 2/3 submitReq msg use wal version 2022-07-22 20:39:13 +08:00
Liu Jicong 2441ec22bd feat(tmq): check alter for ntb 2022-07-22 16:05:28 +08:00
Liu Jicong eaf11ca1ac refactor(tmq): disable parallel 2022-07-21 20:15:52 +08:00
Liu Jicong fb52cfa816 fix(stream): memory error 2022-07-20 19:31:56 +08:00
Liu Jicong 414673db57
Merge branch '3.0' into feature/stream 2022-07-19 19:46:36 +08:00
Cary Xu a4493c9d97 Merge branch '3.0' into feature/TD-11274-3.0 2022-07-19 17:58:23 +08:00
Cary Xu afe1633256 feat: rsma snapshot 2022-07-19 17:57:59 +08:00
Hongze Cheng 706b081f70 fix: r/w concurrency 2022-07-19 08:30:49 +00:00
Liu Jicong 159f1c7bae fix(tmq): drop stb after subscribing database 2022-07-18 22:39:51 +08:00
Cary Xu 5ef9239c74
Merge pull request #14979 from taosdata/feature/grant-3.0
feat: support grant
2022-07-17 22:16:00 +08:00
Cary Xu 01604d6d1d Merge branch '3.0' into feature/TD-11274-3.0 2022-07-16 17:12:56 +08:00
Cary Xu 16750e1401 enh: rsma async commit support 2022-07-16 17:12:45 +08:00
Cary Xu ed34f490ca enh: async commit api for rsma 2022-07-15 16:06:41 +08:00
Cary Xu edfd4b5175 enh: rsma support async commit 2022-07-14 18:51:34 +08:00
Cary Xu 7438f1fed4 feat: read/create restrict when grant expired 2022-07-14 14:09:43 +08:00
Hongze Cheng 1e3fff30e7 more vnode snapshot 2022-07-12 12:16:40 +00:00
Cary Xu 6e4b8ed618 Merge branch '3.0' into feature/TD-11274-3.0 2022-07-11 21:04:31 +08:00
Cary Xu 82c4b62cdc enh: rsma code optimization and support drop 2022-07-11 19:44:49 +08:00
Hongze Cheng 9071c650a1 retention code 2022-07-11 08:17:03 +00:00
Hongze Cheng 668ca4a4fb Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/tsdb_snapshot 2022-07-10 01:51:45 +00:00
Cary Xu dd81770841 fix: rsma ref fix and add debug logs 2022-07-09 15:44:37 +08:00
Hongze Cheng 0901640ba2 make snapshot compile 2022-07-06 09:46:14 +00:00
Hongze Cheng 2b4696310a Merge branch 'feat/tsdb_refact' of https://github.com/taosdata/TDengine into feat/tsdb_snapshot 2022-07-06 05:26:23 +00:00
Minglei Jin fc20a61c85
Merge branch '3.0' into feat/tsdb_refact 2022-07-06 00:37:21 +08:00
Hongze Cheng 3def7a0ed8 Merge branch 'feat/tsdb_refact' of https://github.com/taosdata/TDengine into feat/tsdb_snapshot 2022-07-05 12:09:19 +00:00
Shengliang Guan 64b540bef5 refactor: adjust vnode propose msg 2022-07-05 20:04:17 +08:00
Hongze Cheng aa8f1604f0 more snapshot writer 2022-07-05 11:55:07 +00:00
Cary Xu eedaeda846 enh: rsma level 1/2 utilize separated version 2022-07-05 19:30:37 +08:00
Hongze Cheng b7e2b7398e more work 2022-07-04 13:07:13 +00:00
Hongze Cheng 032339949e more work 2022-07-04 12:24:34 +00:00
Hongze Cheng 5891d97a0d more work 2022-07-04 12:04:40 +00:00
Hongze Cheng 64b1400d7c Merge branch 'feat/tsdb_refact' of https://github.com/taosdata/TDengine into feat/tsdb_snapshot 2022-07-04 11:25:41 +00:00
Hongze Cheng 27b719febd refact some code 2022-07-04 11:24:54 +00:00
Hongze Cheng 56913abdbf more work 2022-07-04 10:55:01 +00:00
Hongze Cheng e34ad23c01 Merge branch 'feat/tsdb_refact' of https://github.com/taosdata/TDengine into feat/tsdb_snapshot 2022-07-04 08:31:25 +00:00
Hongze Cheng de60ec37b6 fix CI bug 2022-07-04 08:26:16 +00:00
Hongze Cheng eb888684e3 more refact 2022-07-04 06:47:41 +00:00
Hongze Cheng 38ca993452 make merge compile 2022-07-04 05:21:02 +00:00
Hongze Cheng ddb198de23 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/tsdb_refact 2022-07-04 03:42:50 +00:00
Cary Xu c41364d5cd refactor: rsma commit and recovery 2022-07-03 20:38:54 +08:00
Cary Xu 8b8d454eb5 Merge branch '3.0' into feature/TD-11274-3.0 2022-07-02 18:52:33 +08:00
afwerar b9a1c6744c os: add Mac compile support 2022-07-02 17:40:23 +08:00
Cary Xu a8a0aa9223 refactor: rsma commit and restore 2022-07-02 15:17:41 +08:00
Cary Xu 1aa45f73f4 feat: rsma recovery 2022-07-01 20:54:57 +08:00
Cary Xu efb2cd27c7 refactor: add tref to solve the timer not stopped problem 2022-06-29 21:32:06 +08:00
Haojun Liao 4a59e1300b other: merge 3.0. 2022-06-28 15:22:32 +08:00
Cary Xu 5be089b888 refactor: rsma restore 2022-06-28 14:11:44 +08:00
Cary Xu 0597f3b9cd refactor: rsma resource release 2022-06-26 18:44:49 +08:00