Commit Graph

2143 Commits

Author SHA1 Message Date
wade zhang bc866ed28f
Merge pull request #23623 from taosdata/FIX/TD-27230-3.0
fix: remove vnode obj from hash at first when dropping an offline vnode
2023-11-10 09:50:10 +08:00
Hongze Cheng ec3685db94
Merge pull request #23600 from taosdata/fix/TD-27206
fix(vnode/cos): fix error printing to avoid buffer overflow
2023-11-09 06:06:54 -06:00
Benguang Zhao 73f1c55a47 fix: remove vnode obj from hash 2023-11-09 17:24:02 +08:00
Benguang Zhao b80770dea8 fix: close vnode in the failed mode properly in vmCloseVnode 2023-11-09 13:05:52 +08:00
Minglei Jin 15e1e4cd2c dnode/node_mgmt: cmake define for use_s3 2023-11-08 14:00:10 +08:00
Minglei Jin 8bb65119a4 dnode: fix dnode s3 init 2023-11-08 10:52:23 +08:00
Minglei Jin 764f8d2e45 fix(vnode/s3): move init & cleanup to dnode 2023-11-08 09:03:19 +08:00
xinsheng Ren da24384f0e
Merge branch '3.0' into fix/xsren/TD-22212/taosQueryParam3.0 2023-11-04 17:41:41 +08:00
dm chen 0371064acc
Merge branch '3.0' into feat/TD-26529-3.0 2023-11-03 10:20:54 +08:00
dapan1121 91df56fcf0 Merge remote-tracking branch 'origin/3.0' into feat/TD-25204 2023-10-31 18:44:54 +08:00
kailixu 4a5b4b51e2 chore: remove obsolete codes 2023-10-30 17:51:42 +08:00
kailixu c77153cb81 enh: use placeholder '-' for interval of 1st retention level 2023-10-30 14:02:31 +08:00
dapan1121 6f0b634f95 Merge remote-tracking branch 'origin/3.0' into feat/TD-25204 2023-10-30 10:24:16 +08:00
kailixu 22d6b95585 enh: dm init API 2023-10-29 21:13:18 +08:00
kailixu 3f65773222 enh: send grant to dnodes online and in async mode 2023-10-29 02:18:47 +08:00
kailixu 9ae83455e2 chore: code format 2023-10-27 09:48:13 +08:00
kailixu 96de7b0cf0 chore: update grant/dnode mgmt 2023-10-27 00:02:25 +08:00
facetosea 759a5d4bbf fix ctest 2023-10-26 21:06:08 +08:00
dmchen 8e007f199b format 2023-10-24 11:31:50 +00:00
dmchen 4c401c39fb atomic 2023-10-24 09:52:34 +00:00
dmchen ff46bdb17a ci memory leak test 2023-10-24 06:51:00 +00:00
dmchen b82cd97b80 memory leak and enable 2023-10-24 04:10:56 +00:00
dmchen 43cd604911 remove reference 2023-10-23 11:19:53 +00:00
dmchen dec257ff59 TD-26529 2023-10-23 08:59:54 +00:00
dapan1121 ab98f7623c Merge remote-tracking branch 'origin/3.0' into feat/TD-25204 2023-10-23 08:44:46 +08:00
Haojun Liao 9f9fae3b99
Merge pull request #23329 from taosdata/opt/addStatusSend
Opt/add status send
2023-10-20 09:52:12 +08:00
dapan1121 42f440b0fb Merge remote-tracking branch 'origin/3.0' into feat/TD-25204 2023-10-20 08:46:32 +08:00
Benguang Zhao 959f8105ee enh: require command to trigger repairing vnodes on replaced disks 2023-10-19 18:55:12 +08:00
yihaoDeng 0188289308 statusClientRpc 2023-10-19 14:07:54 +08:00
yihaoDeng b4b742b3fb add rpc sync read timeout 2023-10-19 11:35:29 +08:00
yihaoDeng 27b2d37bde add rpc sync read timeout 2023-10-19 11:27:31 +08:00
Benguang Zhao a95f6e6862 feat: support restore dnode with vnodes of replaced disks for primary dirs 2023-10-19 11:18:57 +08:00
Benguang Zhao 410ced8320 feat: use TLV format to encode data of snapshot info 2023-10-19 10:51:13 +08:00
yihaoDeng b9b62a9a00 add rpc sync read timeout 2023-10-19 10:38:45 +08:00
Shungang Li 5b69b584c3 enh: add log for deploy mnode 2023-10-18 16:58:58 +08:00
yihaoDeng ef27c87756 opt status send 2023-10-18 16:37:34 +08:00
yihaoDeng e62f3fa86a opt status send 2023-10-18 16:03:55 +08:00
dapan1121 a0699d758c Merge remote-tracking branch 'origin/3.0' into feat/TD-25204 2023-10-13 16:51:38 +08:00
Haojun Liao eb4449999f other: merge 3.0 2023-10-12 10:33:48 +08:00
kailixu f180a6e6f3 chore: remove macro for grant notify 2023-10-09 19:26:16 +08:00
dapan1121 d229492616 Merge remote-tracking branch 'origin/3.0' into feat/TD-25204 2023-10-09 18:34:08 +08:00
kailixu 5dd277248e fix: alter active code for different server 2023-10-09 17:16:56 +08:00
Haojun Liao ee6516f3c4 enh(stream): add trans to reset task status to avoid being frozen in checkpoint status due to doing checkpoint failure of partial tasks. 2023-10-09 10:13:53 +08:00
kailixu 88fdeca5cf enh: dnode notify logic 2023-10-05 22:31:25 +08:00
kailixu 086213a6c2 enh: dnode notify logic 2023-10-05 21:35:57 +08:00
Haojun Liao f2d8431619 fix(stream): enable new time range for stream task. 2023-09-28 18:26:52 +08:00
dapan1121 0a0f512023 feat: add view meta processing 2023-09-28 11:44:38 +08:00
dapan1121 1088b80a46
Merge pull request #23062 from taosdata/enh/TD-25879-3.0x
enh: update dnode module
2023-09-27 16:18:38 +08:00
kailixu e523d3d6a4 chore: remove obsolete codes 2023-09-26 14:34:42 +08:00
wade zhang f6134b42d7
Merge pull request #23036 from taosdata/feat/TS-4011-3.0
feat/TS-4011: adjust config 'keep_time_offset' level from dnode to db
2023-09-26 14:25:54 +08:00
kailixu 93bf7da254 chore: dm update 2023-09-26 13:22:38 +08:00
Ping Xiao 4f23ea2a8c enh: dmodule logic 2023-09-26 11:47:53 +08:00
wade zhang f2a7795cd6
Merge pull request #23037 from taosdata/enh/TS-3812-3.0
grant: enable update cluster info
2023-09-25 19:27:44 +08:00
kailixu 126a371170 chore: more code 2023-09-25 16:24:03 +08:00
kailixu 0632fb838a chore: code refactor 2023-09-25 16:17:57 +08:00
kailixu 68fb1b296f chore: code refactor 2023-09-25 16:16:12 +08:00
kailixu b0b4d782fc chore: code refactor 2023-09-25 15:57:54 +08:00
Alex Duan c9af9eb15b
Merge pull request #22915 from lx1zhong/3.0
add TSZ and ADT-FSE algorithm
2023-09-25 15:48:30 +08:00
Shungang Li 743a5b0640 feat: add db config item keep_time_offset 2023-09-25 15:46:08 +08:00
kailixu 4e0a5cb91a chore: macOS compile 2023-09-25 14:46:59 +08:00
kailixu 3083189f4d grant: enable update cluster info 2023-09-25 12:35:18 +08:00
kailixu 7b4ef6df96 fix: memory leak 2023-09-24 13:50:20 +08:00
kailixu c69b9e0197 chore: make jenkins happy 2023-09-24 09:45:19 +08:00
kailixu 986788d4fe enh: timeseries calculation 2023-09-24 09:14:52 +08:00
kailixu 8f828e052b enh: timeseries calculation optimization 2023-09-22 20:07:51 +08:00
dapan1121 a67b0c99fc feat: support create/drop view 2023-09-21 19:28:07 +08:00
dapan1121 b9d554275c Merge remote-tracking branch 'origin/3.0' into feat/TD-25204 2023-09-19 14:21:00 +08:00
dapan1121 14e8db289d feat: support view 2023-09-19 14:19:54 +08:00
Alex Duan 4a4e778a6a fix: remove depends from util to common 2023-09-19 10:46:52 +08:00
kailixu 6698861c8b chore: timeseries distribute 2023-09-19 08:29:51 +08:00
Alex Duan 570ac79a79
Merge branch 'taosdata:3.0' into 3.0 2023-09-18 14:28:00 +08:00
kailixu 8111c18cc4 chore: merge 3.0 2023-09-18 09:20:43 +08:00
kailixu 03aea454d7 chore: more code 2023-09-15 14:33:35 +08:00
lx1zhong 6da4088012 add TSZ and ADT-FSE algorithm 2023-09-15 14:30:23 +08:00
kailixu 449092c5dc enh: timeseries update optimize 2023-09-14 20:16:02 +08:00
yihaoDeng 250fed499f Merge branch 'enh/ipWhiteList' of https://github.com/taosdata/TDengine into enh/ipWhiteList 2023-09-14 18:49:17 +08:00
slzhou a15a41f396 Merge branch 'enh/ipWhiteList' of github.com:taosdata/TDengine into szhou/enh/ipWhiteList 2023-09-14 13:06:15 +08:00
slzhou 94236b8cee fix: pass some test 2023-09-14 13:05:58 +08:00
yihaoDeng da55d7e67e update test case 2023-09-14 09:25:23 +08:00
yihaoDeng c0a8f81176 update test case 2023-09-13 14:27:58 +08:00
yihaoDeng 7ce8f694dc Merge branch 'enh/dev3New' into enh/ipWhiteList 2023-09-12 15:54:06 +08:00
yihaoDeng 0a8b1ebe46 add rpc update interface 2023-09-11 21:02:50 +08:00
yihaoDeng 39d04ed15b add rpc update interface 2023-09-11 20:48:24 +08:00
yihaoDeng 05727359ca add rpc update interface 2023-09-11 15:02:35 +08:00
yihaoDeng 2a30e12547 add rpc update interface 2023-09-11 10:45:45 +08:00
yihaoDeng d121b564c0 add rpc update interface 2023-09-10 16:11:14 +08:00
yihaoDeng 25bc0b226b add rpc update interface 2023-09-10 14:09:36 +08:00
yihaoDeng 60d6a622e1 add rpc update interface 2023-09-07 20:47:10 +08:00
yihaoDeng 8c5fa3526a add rpc update interface 2023-09-07 16:10:07 +08:00
yihaoDeng 147de26eec add rpc update interface 2023-09-07 11:54:34 +08:00
yihaoDeng bc27d245b1 add rpc update interface 2023-09-06 21:54:31 +08:00
yihaoDeng ad5639df89 add rpc update interface 2023-09-06 21:36:16 +08:00
yihaoDeng ac8220012c add rpc update interface 2023-09-06 17:22:30 +08:00
dapan1121 ed9085281d
Merge pull request #22623 from taosdata/feat/TD-25964-3.0
feat: get cpu cores from quota
2023-09-06 16:03:33 +08:00
dmchen 231ba12f70 feat/TD-26127 2023-09-06 11:00:24 +08:00
yihaoDeng 5f78c27535 add enable white list 2023-09-01 15:11:25 +08:00
dapan1121 cc17848b78 fix: merge 3.0 to main 2023-09-01 13:24:47 +08:00
kailixu f4dd1895b2 Merge branch '3.0' into feat/TD-25964-3.0 2023-08-31 08:56:53 +08:00
Haojun Liao 24b1a050fc other: merge 3.0 2023-08-30 16:00:14 +08:00
kailixu eb7d2d495a chore: supports obtaining physical/virtual CPU cores 2023-08-30 15:21:03 +08:00
yihaoDeng 20b037d9cc Merge branch 'enh/3.0' into enh/triggerCheckPoint2 2023-08-28 10:46:00 +08:00
dmchen 06083e1eb9 init 2023-08-28 09:15:51 +08:00
dapan1121 e24498b0fd enh: add task notify 2023-08-25 14:59:34 +08:00
yihaoDeng 9310d138a6 Merge branch 'enh/3.0' into enh/triggerCheckPoint2 2023-08-24 17:30:35 +08:00
Haojun Liao 230d8c2d80 fix(stream): fix error in stream computing after vnode is transferred to other dnodes. 2023-08-23 17:50:44 +08:00
Shungang Li 458fd07976 enh: ttl split flush and drop table
config:
1. ttlFlushThreshold: maximum number of dirty items in memory
2. tsTtlBatchDropNum: number of tables dropped per batch
3. tsTrimVDbIntervalSec: interval of trimming db in all vgroups
2023-08-23 11:13:34 +08:00
Haojun Liao af80d94a88 refactor: do some internal refactor. 2023-08-22 15:43:50 +08:00
Haojun Liao cc8b2263cb fix(stream): fix error in heartbeat from vnode. 2023-08-22 13:37:38 +08:00
Haojun Liao def0877980 fix(stream): add timer to check stream task status. 2023-08-22 10:46:49 +08:00
dm chen dda51d8019
Merge branch '3.0' into feat/TD-22970 2023-08-21 10:50:45 +08:00
yihaoDeng 6fe649c458 Merge branch 'enh/3.0' into enh/triggerCheckPoint2 2023-08-21 09:12:40 +08:00
Minglei Jin 7b4bb72392 fix(vnode/destroy): delete objects 2023-08-18 16:38:26 +08:00
dmchen 4448e7d159 revert drop vnode 2023-08-17 11:57:17 +08:00
Haojun Liao ea6574b3c7 other: merge 3.0 2023-08-17 00:07:55 +08:00
dmchen d85d698074 drop vnode 2023-08-16 18:48:12 +08:00
wangmm0220 5c5721571f fix:set terrno = 0 to avoid affect next fetch msg 2023-08-16 17:45:18 +08:00
dm chen e020c4e8c5
Merge pull request #22456 from taosdata/3.0
merge 3.0 to feat/TD-22970
2023-08-16 16:49:43 +08:00
Haojun Liao ad9f3cbc43 other: merge main. 2023-08-16 09:14:10 +08:00
Haojun Liao 0d38f389ab refactor: do some internal refactor. 2023-08-13 16:25:35 +08:00
Haojun Liao f24b22000f enh(stream): stop stream task before redistribute vnodes. 2023-08-11 23:46:53 +08:00
Haojun Liao 9322f80343 fix(stream): register the rsp callback. 2023-08-11 13:31:50 +08:00
Haojun Liao 6a9826cf6e enh(stream): update the stream task epset. 2023-08-11 10:37:25 +08:00
dm chen dd271bca6d
Merge pull request #22394 from taosdata/3.0
merge 3.0 to feat/TD-22970
2023-08-10 14:14:22 +08:00
Minglei Jin 33967b243b
Merge branch '3.0' into fix/TD-25010-3 2023-08-10 12:14:01 +08:00
Haojun Liao f633c7fe2b other: merge 3.0. 2023-08-10 11:56:30 +08:00
Haojun Liao b658608541
Merge pull request #22388 from taosdata/fix/3_liaohj
other: merge main.
2023-08-10 11:43:02 +08:00
Hui Li 10f5d223bb
Merge pull request #22370 from taosdata/FIX/TD-25605-3.0
enh: check if disk space sufficient at primary dir with tfs
2023-08-09 18:32:07 +08:00
yihaoDeng cfb5247e30 change var name 2023-08-09 00:46:18 +00:00
Benguang Zhao e4d16e594c enh: check if disk space sufficient at primary dir with tfs 2023-08-08 17:53:11 +08:00
dm chen 70a598f072
Merge pull request #22355 from taosdata/3.0
merge 3.0 to TD-22970
2023-08-08 09:53:07 +08:00
Haojun Liao f8ee055641 other: merge 3.0 2023-08-08 00:19:08 +08:00
Minglei Jin fac7e521e9 s3/evict: fetch atime from stat file 2023-08-07 15:59:37 +08:00
wangmm0220 5daf38c0d5 fix:ref is not there 2023-08-07 11:29:54 +08:00
wangmm0220 9ecabb30f5 fix:ref is not there 2023-08-07 10:27:44 +08:00
wangmm0220 5f02e2ddfb fix:ref is not there 2023-08-07 09:31:29 +08:00
Haojun Liao 8a11a0418f other: merge 3.0 2023-08-07 09:19:26 +08:00
wangmm0220 d9a1695257 fix:add log 2023-08-04 18:07:44 +08:00
dm chen 5b03ab1705
Merge branch '3.0' into feat/TD-22970 2023-08-03 17:43:51 +08:00
kailixu ff39aadb34 fix: mac OS for community 2023-07-31 08:42:17 +08:00
Haojun Liao 8dfef8768a other: merge 3.0 2023-07-29 22:54:16 +08:00
kailixu 2deeed87ae fix: community for mac os 2023-07-29 13:18:17 +08:00
Haojun Liao 2a78cd2d23
Merge pull request #22215 from taosdata/fix/liaohj
other: merge main.
2023-07-28 13:06:17 +08:00
Shungang Li fb226c2cdb enh: check cluster ttlChangeOnWrite consistency 2023-07-27 16:49:56 +08:00
Haojun Liao b145771a1b other: merge 3.0 2023-07-27 16:38:57 +08:00
Haojun Liao 3d403dca5a other: merge main. 2023-07-27 16:23:41 +08:00
Haojun Liao 1c1bf63e1f other: merge 3.0 2023-07-25 18:17:11 +08:00
Haojun Liao 1e34f84f78 other: merge 3.0 2023-07-24 15:23:03 +08:00
kailixu 7946ce4994 chore: code optimization 2023-07-24 14:46:59 +08:00
kailixu cf59a6cff0 chore: set user for dm transport 2023-07-24 14:24:47 +08:00
Haojun Liao 16d7707b90 fix(stream): align the scan real time data for stream task. 2023-07-21 19:33:43 +08:00
dmchen 7d480cf3ac compatible old sync config 2023-07-21 10:31:53 +08:00
dapan1121 cbe03ef212
Merge pull request #22069 from taosdata/enh/TS-2288
enh: add scope for show xx variables
2023-07-19 18:01:11 +08:00
wangmm0220 5cb35f2fa6 feat:add committed & position & commite_offset interface 2023-07-19 17:29:39 +08:00
dm chen 141004bf77
Merge branch '3.0' into feat/TD-22970 2023-07-19 10:57:40 +08:00
liuyao fd02b9a71e
Merge branch '3.0' into enh/triggerCheckPoint2 2023-07-19 10:02:06 +08:00
wade zhang c3e5375f15
Merge pull request #22085 from taosdata/FEAT/TS-2699-3.0
feat: distribute vnode primary dirs among disks of level 0
2023-07-19 09:44:43 +08:00
Benguang Zhao 224f90761e fix: set wrapperCfg.diskPrimary in vmProcessAlterVnodeTypeReq 2023-07-18 16:57:52 +08:00
dmchen 3711fdd865 feat/TD-22970 2023-07-18 16:09:38 +08:00
Benguang Zhao 02f4613154 enh: report VND_INIT_FAILED on vnodes open failure in vmOpenVnodes 2023-07-18 15:44:51 +08:00
Benguang Zhao 6b6b7d8d8f enh: alloc disk of vnode primary dir in vmAllocPrimaryDisk 2023-07-18 11:32:23 +08:00
yihaoDeng b56e442478 Merge branch 'enh/dev33' into enh/triggerCheckPoint2 2023-07-17 11:41:38 +00:00
Ganlin Zhao 929db3d647 Merge branch '3.0' into enh/TS-2288 2023-07-17 16:09:07 +08:00
Haojun Liao b2a905bd91
Merge branch '3.0' into enh/triggerCheckPoint2 2023-07-17 11:50:12 +08:00
Benguang Zhao b21e603481 enh: add the field diskPrimary to vnodeGetPrimaryDir, and entries of vnodes.json 2023-07-17 11:48:48 +08:00
kailixu 0e6b982682 chore: more code 2023-07-17 09:19:24 +08:00
kailixu 3ab2ad20b4 chore: more check 2023-07-16 10:23:39 +08:00
kailixu 0bfc1cc920 chore: windows check 2023-07-16 10:13:17 +08:00
kailixu 918d3cca0c chore: more check 2023-07-16 07:13:53 +08:00
kailixu 9117888853 chore: more code 2023-07-14 19:19:46 +08:00
Haojun Liao eb7e6152ae refactor(stream): do some internal refactor. 2023-07-14 17:21:20 +08:00
Ganlin Zhao b402782784 add scope for information_schema.ins_dnode_variables 2023-07-14 15:56:29 +08:00
Markus Mayer 55ee9d6c25
Correct some typos in string literals (#22062) 2023-07-14 13:39:03 +08:00
kailixu 163adf1908 chore: dm monitor refactor 2023-07-14 13:27:19 +08:00
Haojun Liao e0ea0f2df4
Merge pull request #22020 from taosdata/fix/liaohj
other: merge main
2023-07-13 17:55:28 +08:00
Benguang Zhao b7e134af20 enh: remove unused code in vmProcessCreateVnodeReq 2023-07-12 17:58:30 +08:00
wangmm0220 cf64d4c9c5 fix:set get_assignment offset to first version of response block 2023-07-12 17:22:23 +08:00
Haojun Liao 3ffdbe923d other: merge 3.0 2023-07-11 09:12:57 +08:00
Haojun Liao 16ee72ab06 fix(stream): free msg after send checkpoint rsp. 2023-07-10 13:57:51 +08:00
dapan1121 977f28e750
Merge pull request #21984 from taosdata/fix/td-24871
fix: ask jemalloc to use background_threads to return vm to os
2023-07-10 10:16:07 +08:00
Haojun Liao 47877898d0 enh(stream): generate the checkpoint framework. 2023-07-07 16:07:52 +08:00
shenglian zhou 74d05af3ca fix: ask jemalloc to use background_threads to return vm to os 2023-07-07 08:34:19 +08:00
yihaoDeng 5e156aa0a9 add ver check 2023-07-06 06:43:07 +00:00
Haojun Liao f4a3567935 other: merge 3.0 2023-07-06 11:24:30 +08:00
yihaoDeng a630d1284c add version check in rpc 2023-07-06 02:03:31 +00:00
yihaoDeng af053ec75b add version check in rpc 2023-07-05 11:15:12 +00:00
yihaoDeng 79f01ad655 add version check in rpc 2023-07-05 08:16:25 +00:00
yihaoDeng 04ab8e19d0 Merge branch 'enh/dev30' into enh/triggerCheckPoint2 2023-06-25 19:58:45 +08:00
Haojun Liao ceb78fdad2
Merge branch '3.0' into refact/fillhistory 2023-06-24 18:53:48 +08:00
wade zhang e95b430e89
Merge pull request #21786 from taosdata/FIX/TD-24817-3.0
enh: make alter-hashrange atomic and idempotent
2023-06-21 13:29:04 +08:00
Benguang Zhao 424086e324 enh: restore vgroup id in vmOpenVnodes for vnodeAlterHashRange 2023-06-20 15:40:09 +08:00
Benguang Zhao e1d9e44fcd enh: add a field toVgId in vnodes.json for prepare alter-hashrange 2023-06-19 17:59:42 +08:00
Benguang Zhao 20a55c3412 fix: make vmProcessAlterHashRangeReq idempotent 2023-06-19 15:09:00 +08:00
yihaoDeng fd85a8495a Merge branch 'dev30' into enh/triggerCheckPoint2 2023-06-17 14:17:21 +08:00
wade zhang 72cdca8570
Merge pull request #21750 from taosdata/FIX/TD-24828-3.0
fix: return error from vmPutMsgToQueue while vnode-write is disabled
2023-06-16 16:59:56 +08:00
Haojun Liao 64365666b7 fix(stream): update the info, and do some internal refactor. 2023-06-16 16:04:43 +08:00
Benguang Zhao 8663148d6c fix: return error from vmPutMsgToQueue while vnode-write is disabled 2023-06-16 09:20:34 +08:00
Haojun Liao 74e0138f72 Merge branch '3.0' into refact/fillhistory 2023-06-15 15:25:00 +08:00
Haojun Liao 1b9eca5ce0 other: merge main. 2023-06-15 13:03:17 +08:00
dmchen 92a9d4b26e fix/TS-3524 2023-06-14 20:53:27 +08:00
Yihao Deng 7ded6fc7a2
Merge branch '3.0' into enh/triggerCheckPoint2 2023-06-14 16:30:38 +08:00