Commit Graph

1162 Commits

Author SHA1 Message Date
Haojun Liao fbc9e77004
Merge branch '3.0' into refact/submit_req 2022-12-26 10:26:17 +08:00
Hongze Cheng 8135efb541 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/vnode_compact 2022-12-26 09:28:00 +08:00
Shengliang Guan 664dcb6b4e Merge branch 'main' into merge/mainto3.0_1226 2022-12-26 09:26:54 +08:00
Shengliang Guan 028cc52846
Merge pull request #19116 from taosdata/feature/3_liaohj
refactor: do some internal refactor.
2022-12-26 09:12:35 +08:00
kailixu 73710da55f chore: rsma sync and assert 2022-12-25 21:54:09 +08:00
kailixu 6d01e18f31 chore: rsma fs and vnode commit optimization 2022-12-24 23:37:58 +08:00
kailixu 4f25c0f7d3 Merge branch '3.0' into feature/TD-19148-D 2022-12-24 00:59:35 +08:00
Benguang Zhao 5159d60f56 enh: vnodeCommit on consensus only 2022-12-23 20:16:32 +08:00
Liu Jicong 0d56da7508 fix: skip msg 2022-12-23 19:04:39 +08:00
Haojun Liao 224f5a72c2 refactor: do some internal refactor. 2022-12-23 17:45:12 +08:00
Minglei Jin e302cb320f fix(meta/malloc): use new aligned buffer pool malloc 2022-12-22 17:29:29 +08:00
Hongze Cheng 3278c11491 more code 2022-12-22 15:02:39 +08:00
Hongze Cheng a8eb32da9f more code 2022-12-21 14:36:12 +08:00
Hongze Cheng 1edb6d5b4d more code 2022-12-19 15:23:12 +08:00
Haojun Liao fdade6d6a3
Merge branch '3.0' into refact/submit_req 2022-12-19 11:24:00 +08:00
Shengliang Guan cb8cd5f733 Merge branch 'main' into fix/td-21029 2022-12-15 19:24:16 +08:00
Shengliang Guan 4db6b043c6 fix: reduce the frequency of retry in sync not ready case while alter db 2022-12-14 19:01:31 +08:00
Shengliang Guan 60bab9ae55 refact: post sem in vnode while sync timeout 2022-12-14 16:09:28 +08:00
Shengliang Guan 2b256542a5 refact: add vnode timer 2022-12-14 09:14:40 +08:00
Minglei Jin 5f2b393c0c meta/snapshot: use nil heap and abort tdb when rollback 2022-12-09 16:23:43 +08:00
Hongze Cheng 7b20c09f34 more code 2022-12-09 16:19:49 +08:00
Hongze Cheng 63cc4e27b1 more code 2022-12-09 15:50:22 +08:00
kailixu 12eed5d0eb chore: more code 2022-12-08 20:00:43 +08:00
kailixu 6f377e3234 refact: tsma/rsma data format 2022-12-08 14:39:59 +08:00
Liu Jicong 74a253eac4 refactor 2022-12-08 13:34:42 +08:00
kailixu f9bd3580d4 chore: rsma refact 2022-12-08 00:49:23 +08:00
Liu Jicong b133a56219 refactor: support submitreq2 2022-12-07 15:19:34 +08:00
Hongze Cheng f4f08b24d2 fix: wrong row sversion 2022-12-06 19:56:43 +08:00
Hongze Cheng 899d7b0bcc Merge branch '3.0' of https://github.com/taosdata/TDengine into refact/submit_req 2022-12-06 14:37:22 +08:00
kailixu cb9aa7dcef chore: rsmaFS process 2022-12-06 01:59:24 +00:00
Liu Jicong 619bbdfd82 refactor: support submitreq2 2022-12-06 05:58:28 +08:00
kailixu cf4ef434ee Merge branch '3.0' into feature/TD-19148-D 2022-12-05 06:56:27 +08:00
kailixu cf0995f749 feat: async commit for rsma 2022-12-04 20:26:58 +08:00
Minglei Jin a4adcbbe0d vnode/async-commit: adapter vnode-commit to use txn commit 2022-12-04 18:13:51 +08:00
kailixu 8bc95dcb10 Merge branch '3.0' into feature/TD-19148-D 2022-12-04 17:54:17 +08:00
Hongze Cheng 2a20347210 add more code 2022-12-04 15:14:04 +08:00
Hongze Cheng d977929c99 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/async_commit 2022-12-04 09:37:29 +08:00
kailixu 3a59c5381c refact: tsma code optimization 2022-12-03 22:34:29 +08:00
kailixu 42b17760a2 refact: tsma result adaption 2022-12-03 20:06:55 +08:00
kailixu e918982a5a refact: rsma adaption for new SSubmitReq 2022-12-03 14:23:58 +08:00
kailixu 184f0cf0f2 Merge branch 'refact/submit_req' into refact/TD-20895-3.0 2022-12-03 13:41:36 +08:00
kailixu d3a88ea517 refactor: row and submit msg of rsma/tsdb 2022-12-03 13:33:30 +08:00
Shengliang Guan f3e980de14 enh: remove TSDB_CODE_RPC_REDIRECT 2022-12-02 22:45:11 +08:00
Hongze Cheng e9356fa59d Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/async_commit 2022-12-02 16:28:53 +08:00
Hongze Cheng 129c692f3e more async commit 2022-12-02 15:44:24 +08:00
Hongze Cheng 2cfdf7bf62 finish more code 2022-12-02 14:24:23 +08:00
Xiaoyu Wang 85ea8bbbb3 Merge remote-tracking branch 'origin/3.0' into enh/3.0_planner_optimize 2022-12-02 14:04:50 +08:00
Hongze Cheng 4828a19e10 more code 2022-12-02 10:42:34 +08:00
kailixu da8a337c94 Merge branch '3.0' into feature/TD-19148-D 2022-12-01 21:44:00 +08:00
kailixu 9b4c881106 chore: rsma logic optimization 2022-12-01 21:43:42 +08:00
Hongze Cheng 3fc30c991e Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/async_commit 2022-12-01 18:59:21 +08:00
Hongze Cheng 6dcdafa486 more code 2022-12-01 17:00:33 +08:00
Hongze Cheng bd56fd2e09 Merge branch '3.0' of https://github.com/taosdata/TDengine into refact/submit_req 2022-12-01 16:52:12 +08:00
Hongze Cheng 69617030fa more code 2022-12-01 16:51:36 +08:00
Hongze Cheng 3700f0dc8e more code 2022-12-01 16:19:21 +08:00
Hongze Cheng 0525b4fa0d more code 2022-12-01 15:36:10 +08:00
Hongze Cheng 73f8dc6a5b more code 2022-12-01 14:24:10 +08:00
kailixu cd3bf027e6 chore: rsma log optimization 2022-12-01 11:46:09 +08:00
Hongze Cheng fc50d94156 more coe 2022-12-01 11:45:26 +08:00
Hongze Cheng f5270f6a0c adjust api 2022-11-30 10:30:03 +08:00
slzhou 6d86fb5b51 Merge branch 'enh/3.0_planner_optimize' into szhou/table-count-scan 2022-11-29 22:19:36 +08:00
Hongze Cheng 25ec924c91 more code 2022-11-29 17:29:49 +08:00
Minglei Jin 506554b5d2 Merge branch 'v3.0' into fix/tdb-async-commit 2022-11-28 16:20:48 +08:00
Benguang Zhao dc2dcea3de Merge branch 3.0 to FIX/TD-19334-3.0 2022-11-28 14:27:10 +08:00
Hongze Cheng 0f8016995c more code 2022-11-28 13:41:06 +08:00
slzhou c2a7404b42 save work in case it losts 2022-11-25 23:00:14 +08:00
Benguang Zhao 68f8ebac9d Merge branch 3.0 to FIX/TD-19334-3.0 2022-11-25 13:10:06 +08:00
Haojun Liao 9a208b2d09 other: merge 3.0 2022-11-24 17:08:15 +08:00
Shengliang Guan 335a572d86
Revert "Revert "enh: row optimize2"" 2022-11-24 10:12:25 +08:00
Hongze Cheng ffbb04d40a
Revert "enh: row optimize2" 2022-11-24 09:21:26 +08:00
shenglian zhou 7f6ff39648 feat: table merge scan save work 2022-11-23 19:47:24 +08:00
Hongze Cheng 390709e3c8 add interface 2022-11-22 12:37:47 +08:00
Minglei Jin 35b9dc6b6c meta: use meta cache to get uid's version instead of fetching from tdb 2022-11-18 17:07:19 +08:00
Minglei Jin 78335f83d2 tdb/api: migrate txn related api changes of meta, sma, tq, and stream meta/state 2022-11-17 20:02:13 +08:00
Benguang Zhao 051b73c1ed Merge branch 3.0 to FIX/TD-19334-3.0 2022-11-17 17:28:11 +08:00
Hongze Cheng a5725b506c more code 2022-11-16 17:22:09 +08:00
Hongze Cheng aaef32ca69 refact code for further code change 2022-11-16 10:27:05 +08:00
Haojun Liao ba5244d1b6 refactor: add tag filter results cache. 2022-11-15 16:06:29 +08:00
Liu Jicong efde22f081 fix: memory leak 2022-11-15 11:59:29 +08:00
Hongze Cheng 5b51f97a48 more optimize 2022-11-14 16:52:39 +08:00
dapan1121 14a1f4e373
Merge pull request #18074 from taosdata/fix/TD-20300
fix: fix query thread quit issue
2022-11-14 11:28:30 +08:00
dapan1121 56b33e9200 Merge remote-tracking branch 'origin/3.0' into fix/TD-20300 2022-11-11 18:57:12 +08:00
dapan1121 89c13efba8 fix: fix query thread quit issue 2022-11-11 17:13:55 +08:00
Hongze Cheng 6076bb0245 Merge branch '3.0' of https://github.com/taosdata/TDengine into perf/insert_optimize 2022-11-11 16:04:02 +08:00
Cary Xu d9faec5e9f enh: lock buf pool only for rsma vnode 2022-11-11 13:53:16 +08:00
stephenkgu 4a8196b520 fix: update stb stats cache when creating/dropping child tables 2022-11-11 10:36:27 +08:00
Hongze Cheng 86ed5e5674 more optimize 2022-11-09 16:02:04 +08:00
Shengliang Guan dfbb958128
Merge pull request #17929 from taosdata/perf/sma_optimize
perf: optimize sma calculation
2022-11-08 10:03:12 +08:00
Shengliang Guan 1f91eef038
Merge pull request #17932 from taosdata/fix/tdb-prep-async-commit
enh(tdb): new interface of meta prep async commit
2022-11-08 09:43:36 +08:00
Hongze Cheng d52b8966fc perf: optimize block data operation 2022-11-07 16:56:35 +08:00
Minglei Jin c17f8244be enh(tdb): new interface of meta prep async commit 2022-11-07 16:45:29 +08:00
Hongze Cheng 70f7e3e379 perf: optimize sma calculation 2022-11-07 15:42:53 +08:00
Benguang Zhao 5878c9a31a fix: impl ring log buffer 2022-11-07 14:27:22 +08:00
Haojun Liao e3d0bc6bf7 other: merge 3.0. 2022-11-06 11:37:21 +08:00
Haojun Liao 03f4918b3b refactor: do some internal refactor. 2022-11-04 18:46:48 +08:00
Shengliang Guan fc41f43c9d fix: deadlock while drop db 2022-11-04 16:15:37 +08:00
Liu Jicong 15ad147c40 Merge branch '3.0' into feature/stream 2022-11-03 13:37:59 +08:00
Liu Jicong 2fbc8e6306 refactor(stream): stream deploy and state transfer 2022-11-03 13:22:23 +08:00
Shengliang Guan 9de4bfb230
Merge pull request #17834 from taosdata/fix/liao_cov
fix(query): update the lastkey for each table during table scanning.
2022-11-03 09:29:55 +08:00
Haojun Liao fc20be8699 fix(query): get if the correct rows in last block exists, and set the correct flag to denote if the last blocks index have been loaded or not. 2022-11-02 22:27:23 +08:00
Minglei Jin 5ae5df1a17 Merge branch 'v3.0' into fix/long_query 2022-11-01 18:06:39 +08:00
Shengliang Guan ee63b49800 Merge remote-tracking branch 'origin/3.0' into fix/TD-20052 2022-11-01 17:11:27 +08:00
Minglei Jin ef606d3fd9 tsdb/read: first round long query for non-cache reading 2022-11-01 16:38:35 +08:00
Shengliang Guan d35028ae4a enh: refact sync callback func 2022-11-01 16:10:07 +08:00
Liu Jicong 8ca5f0bd9c Merge branch '3.0' into feature/stream 2022-11-01 13:20:20 +08:00
Liu Jicong 2e640c38a2 refactor: stream and tmq message 2022-10-31 18:37:28 +08:00
Haojun Liao 9b99c69785 fix(query): support partition by + limit push down. 2022-10-28 19:56:32 +08:00
Haojun Liao 4b2fa43dae
Revert "fix(query): handle partition by in table scan operator" 2022-10-28 18:05:19 +08:00
Haojun Liao a7ca29c627 other: merge 3.0 2022-10-27 18:04:28 +08:00
Haojun Liao 5a971dd03a fix(query): handle partition by in table scan operator with limit/offset value. 2022-10-27 16:58:32 +08:00
Minglei Jin eac3847532 fix: new reseek callback to separate tsdb & cache readers 2022-10-27 16:48:33 +08:00
Minglei Jin 7800b7731d Merge branch 'v3.0' into fix/long_query 2022-10-27 10:39:50 +08:00
Liu Jicong 78ff5f75e7
Merge pull request #17663 from taosdata/feature/stream
fix: memory leak
2022-10-26 17:09:43 +08:00
Liu Jicong 4b5807c7f0 fix(tmq): set precision 2022-10-26 15:54:00 +08:00
Liu Jicong b56e7a0f8c
Merge pull request #17650 from taosdata/feature/stream
refactor(stream): recover and fill history
2022-10-26 11:10:03 +08:00
Minglei Jin b52ad0f740 tsdb/cache: new separate dataf reader for last file reading 2022-10-26 08:58:38 +08:00
Liu Jicong 75e5e490fd refactor(stream): recover and fill history 2022-10-26 00:31:00 +08:00
Minglei Jin 441fe8119c Merge branch '3.0' into fix/TD-19468-2 2022-10-25 10:51:35 +08:00
Minglei Jin 89f7ad2920 fix: optimize tsdb cache loading speed 2022-10-25 10:36:30 +08:00
Shengliang Guan e86cdc8cde
Merge pull request #17381 from taosdata/feature/addIdxToSysTable
Feature/addIdxToSysTable
2022-10-23 14:38:37 +08:00
Shengliang Guan 780e4a489c
Merge pull request #17528 from taosdata/fix/TD-19682-D
fix: commit txn for rsma
2022-10-21 14:15:59 +08:00
Haojun Liao abff4fb1f2
Merge pull request #17336 from taosdata/feature/3_liaohj
other:merge 3.0, and support last query cache
2022-10-20 18:15:38 +08:00
yihaoDeng 66a3269c6b add pre check 2022-10-19 19:57:31 +08:00
yihaoDeng 12ec7d7193 add pre check 2022-10-19 17:54:06 +08:00
Cary Xu 54526adcc3 fix: commit txn for rsma 2022-10-19 17:18:41 +08:00
Hongze Cheng 20b3e2168b Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/commit_txn 2022-10-19 11:56:15 +08:00
Haojun Liao f7fdeecc44
Merge branch '3.0' into feature/3_liaohj 2022-10-19 11:23:55 +08:00
Cary Xu 39243cbb19 Merge branch '3.0' into fix/TD-19254-D 2022-10-19 09:37:55 +08:00
Cary Xu a6e3da8045 chore: code optimization for sma commit 2022-10-19 09:37:38 +08:00
Hongze Cheng 864111d85c Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/commit_txn 2022-10-19 09:02:01 +08:00
Liu Jicong 936c78f424
Merge pull request #17440 from taosdata/feature/stream
refactor: tmq commit
2022-10-18 23:47:26 +08:00
Hongze Cheng 74d025c783 Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/commit_txn 2022-10-18 22:47:12 +08:00
Minglei Jin 82132cdfdd meta: new metaFinishCommit api & rollback parameter with metaOpen 2022-10-18 18:34:39 +08:00
Liu Jicong ca2012a521 refactor: tmq commit 2022-10-18 16:56:07 +08:00
Hongze Cheng 0706f2dea2 more code 2022-10-18 16:54:53 +08:00
Hongze Cheng 1779c17375 more code 2022-10-18 16:22:06 +08:00
Cary Xu 0f5f0d7cfb chore: remove codes unused currently for sma 2022-10-18 15:42:28 +08:00
Hongze Cheng b7342525c7 more code 2022-10-18 13:38:26 +08:00
yihaoDeng 0c6ada5eea Merge branch 'n2' into new 2022-10-18 11:42:00 +08:00
Haojun Liao da9df99461 fix(query): opt last query. 2022-10-17 17:59:43 +08:00
Liu Jicong 73662b3058 refactor: table sink 2022-10-17 14:48:56 +08:00
yihaoDeng 681b973cae add index to ins_tables 2022-10-13 18:53:04 +08:00
Hongze Cheng c79fd325bd
Merge pull request #17299 from taosdata/fix/TD-19332
fix: use stable stats cache to get ctbNum
2022-10-12 10:02:21 +08:00
Cary Xu 02979f081d fix: support statistics of insert_req 2022-10-11 17:47:23 +08:00
Minglei Jin 25b279dd7a meta/cache: a new cache for stable's ctbNum 2022-10-11 17:00:49 +08:00
Cary Xu fe115ab02e fix: support statistics of insert_req 2022-10-10 18:20:53 +08:00
Minglei Jin 997dfb41d9 fix(meta): use rwlock to favor writers 2022-10-10 11:00:55 +08:00
Hongze Cheng 2015db5756 alter pages 2022-10-09 15:01:20 +08:00
Hongze Cheng ee56c50069 more code 2022-10-09 13:52:44 +08:00
Hongze Cheng 7754471aaa Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/stream_compression 2022-09-30 13:50:01 +08:00