Commit Graph

12266 Commits

Author SHA1 Message Date
Haojun Liao cf6c255f22 refactor: do some internal refactor. 2023-09-22 22:50:21 +08:00
kailixu 8f828e052b enh: timeseries calculation optimization 2023-09-22 20:07:51 +08:00
Haojun Liao fcbd747afc fix(stream): fix race condition. 2023-09-22 19:35:12 +08:00
liuyao 0d983e28ef Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26174 2023-09-22 19:25:41 +08:00
Haojun Liao 5b12e276cf fix(stream): add msg identifier check. 2023-09-22 18:13:18 +08:00
wade zhang 849b05a09b
Merge pull request #22927 from taosdata/fix/TD-26189
s3/block_cache: new tsdb block cache
2023-09-22 16:15:07 +08:00
liuyao 4f8e6d7795 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26174 2023-09-22 15:00:52 +08:00
Haojun Liao 898aea5cfb refactor(stream): refactor send msg. 2023-09-22 14:52:18 +08:00
Minglei Jin 4c151f2031 tsdb/readerwriter: remove size with download 2023-09-22 14:06:06 +08:00
Haojun Liao 7e4410f094
Merge pull request #22992 from taosdata/feat/TD-26052
feat:support vnode split in tmq
2023-09-22 13:57:21 +08:00
Haojun Liao 7380151322 fix(stream): remove invalid node. 2023-09-22 11:45:46 +08:00
Haojun Liao 87ea745861 fix(stream): add some logs, and remove invalid assert. 2023-09-22 10:53:03 +08:00
Haojun Liao 198e6bb023 enh(stream): add stage info for streamt tasks. 2023-09-22 10:36:15 +08:00
Haojun Liao f7bcff862d fix(stream): add check info detailed information. 2023-09-22 10:23:56 +08:00
wangmm0220 19806cbcab fix:memory leak 2023-09-22 10:12:11 +08:00
wangmm0220 5555371fbc fix:memory leak 2023-09-22 10:04:53 +08:00
wangmm0220 86a4bfe28d fix:memory leak 2023-09-22 10:02:16 +08:00
liuyao dc2f7872f8 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26174 2023-09-22 09:41:15 +08:00
wangmm0220 803b17a2db fix:memory leak 2023-09-22 09:31:58 +08:00
Haojun Liao b1ba716299 refactor: do some internal refactor. 2023-09-22 09:24:36 +08:00
Haojun Liao b075b4438b fix(stream): handle dispatch checkpoint-trigger failure. 2023-09-21 23:15:18 +08:00
Haojun Liao 3c921ba66e
Merge pull request #23006 from taosdata/fix/3_liaohj
fix(tsdb): set the correct scaninfo to load the tomb data.
2023-09-21 22:13:16 +08:00
kailixu 3beb9c5c84 Merge branch '3.0' into enh/TS-3812-3.0 2023-09-21 19:38:27 +08:00
dapan1121 a67b0c99fc feat: support create/drop view 2023-09-21 19:28:07 +08:00
Cary Xu 1bbb812557
Merge branch '3.0' into enh/TS-3934-3.0 2023-09-21 17:32:51 +08:00
Haojun Liao f93df639c1 fix(tsdb): set the correct scaninfo to load the tomb data. 2023-09-21 17:32:21 +08:00
dapan1121 64da3f4ef9
Merge pull request #22978 from taosdata/szhou/show-db-table
enhance: show normal/child tables and show user/system databases
2023-09-21 16:55:26 +08:00
Minglei Jin ce1f866416 tsdb/reader: use pTsdb handle instead of pgsz to open file 2023-09-21 16:36:17 +08:00
kailixu 7445b9ff50 Merge branch '3.0' into enh/TS-3812-3.0 2023-09-21 16:25:06 +08:00
Haojun Liao 2efd155adf fix(stream): wait for the task checkpoint before stop. 2023-09-21 15:53:21 +08:00
Haojun Liao 0f97a21163 fix(tsdb): set the correct scaninfo to load the tomb data. 2023-09-21 15:21:01 +08:00
Haojun Liao e4073bd9a8 fix(stream): update logs. 2023-09-21 14:03:14 +08:00
Haojun Liao 09accc71d2 log(stream): update log. 2023-09-21 14:01:41 +08:00
Haojun Liao 17586af0ce refactor: do refactor the sink task. 2023-09-21 13:32:57 +08:00
kailixu e7dd0caeb9 Merge branch '3.0' into enh/TS-3934-3.0 2023-09-21 10:21:45 +08:00
liuyao 3b3c5d7cb8 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26174 2023-09-21 10:11:36 +08:00
wangmm0220 ce2fc8b319 fix:memory leak 2023-09-21 10:05:52 +08:00
kailixu 2b25982495 enh: user dropped notification 2023-09-21 09:53:45 +08:00
wangmm0220 f9c5aa01af fix:enable split if there are topics & fix memory leak 2023-09-21 09:20:34 +08:00
dapan1121 cc08a5ee87 fix: add query sql 2023-09-20 19:30:40 +08:00
Haojun Liao 92f18989df fix(stream): remove invalid cached task info in buffer. 2023-09-20 19:19:04 +08:00
wangmm0220 d3f54e678f feat:support vnode split in tmq 2023-09-20 18:27:43 +08:00
Haojun Liao 6633fb971b fix(stream): update logs. 2023-09-20 18:18:31 +08:00
Minglei Jin f206fa07d0 s3/put: use put2 2023-09-20 15:59:58 +08:00
Haojun Liao 2418f509ea fix(stream): avoid invalid read. 2023-09-20 15:47:09 +08:00
Haojun Liao 1d1d9a1b0b fix(stream): unlock when returning. 2023-09-20 15:45:15 +08:00
Haojun Liao c8ab761d2a fix(stream): return if failed. 2023-09-20 15:38:49 +08:00
Haojun Liao 2a781c509f fix(stream): add task status check. 2023-09-20 15:32:15 +08:00
Minglei Jin d155cfcf0f tsdb/readerwriter: use tsdb's s3 block cache to read file page 2023-09-20 15:24:54 +08:00
liuyao 1cebda368a session&state operator buff 2023-09-20 15:06:08 +08:00
dapan1121 6b87d97989 feat: support view in mnode 2023-09-20 15:01:03 +08:00
Haojun Liao af487c9048 fix(stream): fix obj. 2023-09-20 14:50:43 +08:00
Haojun Liao 361cde6497 fix(stream): fix deadlock caused by streamTaskHalt function. 2023-09-20 14:49:09 +08:00
Haojun Liao 55d4a9686c log(tsdb): remove some logs. 2023-09-20 13:18:42 +08:00
Haojun Liao 5e3a268b6d enh(stream): add info in log. 2023-09-20 13:15:50 +08:00
dm chen 4497a01168
Merge branch 'main' into feat/TD-26127-audit-sql 2023-09-20 11:13:34 +08:00
Haojun Liao 392aaeb592 log(stream): remove logs. 2023-09-20 10:49:18 +08:00
Haojun Liao b4419bda65 enh(stream): add node stage check. 2023-09-20 10:35:01 +08:00
Haojun Liao 779c0c5f19
Merge pull request #22970 from taosdata/fix/liaohj
fix(stream): keep the status entry in hash table, instead entry index.
2023-09-20 10:33:05 +08:00
slzhou ef1e91a6be Merge branch '3.0' of github.com:taosdata/TDengine into szhou/continue-coing 2023-09-20 08:44:15 +08:00
wangmm0220 2881a2504c fix:conflicts from 3.0 2023-09-19 18:39:40 +08:00
dmchen 1a7bffb079 ci break 2023-09-19 18:01:38 +08:00
Haojun Liao b99232fd7a fix(stream): limit the max scan times. 2023-09-19 17:45:28 +08:00
Haojun Liao 271e492188 refactor: update the log level. 2023-09-19 17:40:26 +08:00
wangmm0220 766652a88a fix:vnode tranform support in tmq 2023-09-19 17:27:19 +08:00
dmchen dbde1a4491 ci break 2023-09-19 14:40:48 +08:00
dm chen ee913cbfbc
Merge branch 'main' into feat/TD-26127-audit-sql 2023-09-19 14:39:20 +08:00
dapan1121 b9d554275c Merge remote-tracking branch 'origin/3.0' into feat/TD-25204 2023-09-19 14:21:00 +08:00
dapan1121 14e8db289d feat: support view 2023-09-19 14:19:54 +08:00
shenglian zhou a072fb6a2c Merge branch '2.0' of github.com:taosdata/TDengine into szhou/continue-coing 2023-09-19 14:03:16 +08:00
dmchen e36ff1282c revert dependency 2023-09-19 13:42:02 +08:00
wade zhang 7311e60f7f
Merge pull request #22963 from taosdata/fix/TS-4015
fix: set snapshot writer compression
2023-09-19 13:26:32 +08:00
wangmm0220 ad70dc178f fix:conflicts from 3.0 2023-09-19 11:56:52 +08:00
wangmm0220 edb42aa2aa fix:move from main to 3.0 2023-09-19 11:51:52 +08:00
Haojun Liao 1cfd34a6a9
Merge pull request #22955 from taosdata/fix/avoidConflictIdxNameMain
avoid first tag index conflict
2023-09-19 11:37:26 +08:00
slzhou c882f4ba08 fix: fix address sanitizer error 2023-09-19 11:31:20 +08:00
Alex Duan 4a4e778a6a fix: remove depends from util to common 2023-09-19 10:46:52 +08:00
Haojun Liao 5a6e50d523 fix(stream): keep the status entry in hash table, instead entry index. 2023-09-19 10:33:58 +08:00
Haojun Liao e76bab7122 fix(stream): not handle the check msg for follower tasks. 2023-09-19 09:43:14 +08:00
slzhou 900aacd428 fix: fix sanitizer error 2023-09-19 09:40:00 +08:00
kailixu 6698861c8b chore: timeseries distribute 2023-09-19 08:29:51 +08:00
Hongze Cheng b1797834c1 fix: set snapshot writer compression 2023-09-18 20:58:20 +08:00
Haojun Liao 1ca06e960f fix(stream): remove stream in buf. 2023-09-18 20:25:24 +08:00
wangmm0220 1e859084b7 fix:conflicts from 3.0 2023-09-18 19:57:33 +08:00
wangmm0220 4b74135350 fix:vnode tranform support in tmq 2023-09-18 19:47:28 +08:00
wangmm0220 59d8f7d10f fix:return in progress in drop consumer group 2023-09-18 17:55:00 +08:00
Haojun Liao 101161c52e
Merge pull request #22954 from taosdata/fix/TD-26323
fix:core in race condition for pTq->pExecStore & return if poll too l…
2023-09-18 17:41:01 +08:00
shenglian zhou 94a616fcc1 fix: save and continue 2023-09-18 16:59:07 +08:00
Haojun Liao c33ef4ce88 fix(stream): add null check 2023-09-18 15:14:51 +08:00
wangmm0220 49a193b328 fix:send delete subscribe info to vnode if drop consumer 2023-09-18 14:46:39 +08:00
wangmm0220 c3498fbfe8 fix:core in race condition for pTq->pExecStore & return if poll too long & fix test cases if submit empty 2023-09-18 14:35:07 +08:00
Alex Duan 570ac79a79
Merge branch 'taosdata:3.0' into 3.0 2023-09-18 14:28:00 +08:00
yihaoDeng 2c10163634 avoid first tag index conflict 2023-09-18 14:19:58 +08:00
wangmm0220 7869b693f2 add test case for tmq in vnode transform & fix core in race condition for pTq->pExecStore 2023-09-18 14:09:28 +08:00
Haojun Liao 82d3deb423
Merge pull request #22949 from taosdata/enh/disableIpWhiteListOnCommunity
disable white list on community
2023-09-18 13:41:08 +08:00
dmchen b473122dac break dependency 2023-09-18 12:29:08 +08:00
Haojun Liao 8aa34802f5
Merge pull request #22938 from taosdata/fix/TD-26323
fix:[TD-26323]add macro to control tmq assert & make subscribe transa…
2023-09-18 09:48:39 +08:00
Haojun Liao de04090f04
Merge pull request #22940 from taosdata/fix/avoidConflictOfIdxName
reduce the confliction of first tag index name
2023-09-18 09:47:58 +08:00
dm chen fda32dcc51
Merge branch 'main' into feat/TD-26127-audit-sql 2023-09-18 09:41:47 +08:00
dmchen c674e025e2 skip auto create tb 2023-09-18 09:29:51 +08:00
kailixu 8111c18cc4 chore: merge 3.0 2023-09-18 09:20:43 +08:00
Haojun Liao 8aa9960760
Merge pull request #22944 from taosdata/fix/liaohj
refactor: do some internal refactor, and fix some bugs.
2023-09-17 21:25:33 +08:00
Haojun Liao 3dfdda3283 fix(stream): fix error in decode stream task. 2023-09-17 18:07:26 +08:00
Haojun Liao 01144c58a7 fix(stream): fix stream task id error. 2023-09-17 01:19:59 +08:00
Haojun Liao 4846194bbb refactor: do some internal refactor, remove the related fill-history task by sending mesg to replay it in follower node. 2023-09-16 21:37:30 +08:00
Haojun Liao caa7542cea
Merge pull request #22913 from taosdata/fix/liaohj
fix(stream): fix error in drop task.
2023-09-16 21:36:38 +08:00
yihaoDeng d890ccbd3b disable white list on community 2023-09-15 20:27:41 +08:00
wangmm0220 8ebb6e202e fix:[TD-26323]add macro to control tmq assert & make subscribe transaction no conflicts 2023-09-15 19:26:55 +08:00
Haojun Liao 05e9f40834
Merge pull request #22828 from taosdata/enh/ipWhiteList
Enh/ip white list
2023-09-15 17:49:37 +08:00
Haojun Liao 91e3d70796 fix(stream): remove fill-history sink task. 2023-09-15 17:46:17 +08:00
yihaoDeng a66145a494 reduce the possible of first tag index name 2023-09-15 17:41:04 +08:00
Minglei Jin 0181bb24d3 tsdb/readerwriter: use PRId64 instead of lld 2023-09-15 16:40:04 +08:00
Alex Duan 47f2c38a56
Merge pull request #22910 from taosdata/fix/TS-3987
fix: delete data error
2023-09-15 16:19:29 +08:00
Minglei Jin 318281356b s3/block_cache: new tsdb block cache 2023-09-15 16:19:21 +08:00
kailixu 7f477b413a chore: more code 2023-09-15 14:35:57 +08:00
kailixu 03aea454d7 chore: more code 2023-09-15 14:33:35 +08:00
lx1zhong 6da4088012 add TSZ and ADT-FSE algorithm 2023-09-15 14:30:23 +08:00
wade zhang b123dd7df3
Merge pull request #22904 from taosdata/FIX/TD-26292-main
enh: ignore compact req during restoring
2023-09-15 11:05:18 +08:00
kailixu 6b95013ba0 chore: code refactor for mndDnode 2023-09-15 10:28:07 +08:00
yihaoDeng 79fe29c848 fix compile error 2023-09-15 10:10:23 +08:00
Haojun Liao 2bfd6e3355 refactor: do some internal refactor. 2023-09-15 09:25:22 +08:00
kailixu 8505fb2aea chore: code refactor for mndDnode 2023-09-15 08:49:45 +08:00
kailixu 1ddc935072 Merge branch '3.0' into enh/TS-3812-3.0 2023-09-15 08:39:32 +08:00
Haojun Liao 117de7ab7d fix(stream): fix error in drop task. 2023-09-15 00:51:13 +08:00
Haojun Liao 500fcad36c
Merge pull request #22892 from taosdata/fix/liaohj
refactor: do some internal refactor.
2023-09-15 00:46:46 +08:00
Haojun Liao 73c2782d78 fix(stream): update some logs. 2023-09-14 23:17:23 +08:00
Haojun Liao 5f55f489d8 fix(stream): fix memory leak. 2023-09-14 22:59:11 +08:00
Haojun Liao 303e8caf0c fix(stream): set the correct guard flag. 2023-09-14 22:44:16 +08:00
kailixu 449092c5dc enh: timeseries update optimize 2023-09-14 20:16:02 +08:00
Haojun Liao 27f626769e fix(stream): fix memory leak. 2023-09-14 19:33:05 +08:00
yihaoDeng 167be7c519 rm dup ip 2023-09-14 19:09:56 +08:00
yihaoDeng 250fed499f Merge branch 'enh/ipWhiteList' of https://github.com/taosdata/TDengine into enh/ipWhiteList 2023-09-14 18:49:17 +08:00
yihaoDeng 0e496ab0c5 Merge branch 'enh/ipWhiteList' of https://github.com/taosdata/TDengine into enh/ipWhiteList 2023-09-14 18:18:05 +08:00
yihaoDeng 2af180c763 Merge branch 'enh/ipWhiteList' of https://github.com/taosdata/TDengine into enh/ipWhiteList 2023-09-14 17:56:44 +08:00
yihaoDeng 02f5f4f017 Merge branch 'enh/ipWhiteList' of https://github.com/taosdata/TDengine into enh/ipWhiteList 2023-09-14 17:23:31 +08:00
Haojun Liao f2c3e0a6e8 fix(stream): disable follower send hb to mnode. and do some internal refactor. 2023-09-14 17:22:31 +08:00
Hongze Cheng 925cc8f55f fix: delete data error 2023-09-14 17:20:10 +08:00
yihaoDeng a7d4547a2d Merge branch 'enh/ipWhiteList' of https://github.com/taosdata/TDengine into enh/ipWhiteList 2023-09-14 17:01:06 +08:00
yihaoDeng 011aee7214 Merge branch 'enh/ipWhiteList' of https://github.com/taosdata/TDengine into enh/ipWhiteList 2023-09-14 16:56:47 +08:00
yihaoDeng 2d1d74d4e8 Merge branch 'enh/ipWhiteList' of https://github.com/taosdata/TDengine into enh/ipWhiteList 2023-09-14 16:52:23 +08:00
slzhou 972a6a133f Merge branch 'enh/ipWhiteList' of github.com:taosdata/TDengine into enh/ipWhiteList 2023-09-14 16:34:30 +08:00
slzhou 59020ff52d fix: for community version, use 0.0.0.0/0 as whitelist 2023-09-14 16:34:03 +08:00
wangmm0220 908cf88414 Merge branch 'mark/tmq-3.0' of https://github.com/taosdata/TDengine into feat/TD-26052 2023-09-14 16:18:43 +08:00
Benguang Zhao bbcbe460d4 enh: ignore compact req during restoring 2023-09-14 16:17:17 +08:00
Benguang Zhao 2886913fd8 enh: ignore compact req during restoring 2023-09-14 16:09:00 +08:00
yihaoDeng e36dc50828 Merge branch 'enh/ipWhiteList' of https://github.com/taosdata/TDengine into enh/ipWhiteList 2023-09-14 15:42:17 +08:00
yihaoDeng 2002ed8709 add more error code 2023-09-14 15:34:28 +08:00
slzhou 2a40113f13 fix: entprise version compilation 2023-09-14 14:44:09 +08:00
Haojun Liao fce5be0eb4 fix(stream): fix dead lock. 2023-09-14 14:09:05 +08:00
slzhou a15a41f396 Merge branch 'enh/ipWhiteList' of github.com:taosdata/TDengine into szhou/enh/ipWhiteList 2023-09-14 13:06:15 +08:00
slzhou 94236b8cee fix: pass some test 2023-09-14 13:05:58 +08:00
yihaoDeng aa1cc01064 update test case 2023-09-14 12:18:43 +08:00
yihaoDeng 903c628067 update test case 2023-09-14 12:18:04 +08:00
Haojun Liao fd6344b319 fix(tsdb): check return code. 2023-09-14 09:25:35 +08:00
yihaoDeng da55d7e67e update test case 2023-09-14 09:25:23 +08:00
Haojun Liao 9b70c0c457 fix:fix coverity issue and remove unnecessary files. 2023-09-14 09:06:10 +08:00
yihaoDeng 7ec31029e6 update test case 2023-09-14 08:45:55 +08:00
yihaoDeng e7815229ca update test case 2023-09-13 19:54:45 +08:00
wangmm0220 f729150497 fix:opti poll callbak logic & send epoch as -1 to get epset if vnode transformed 2023-09-13 18:32:45 +08:00
wangmm0220 39fb5f4334 fix:add vnode snaphot for tmq 2023-09-13 18:09:47 +08:00
dapan1121 270a7584f4 enh: prevent accessing ins_users&ins_user_privileges without sysinfo 2023-09-13 17:48:26 +08:00
yihaoDeng c0a8f81176 update test case 2023-09-13 14:27:58 +08:00
Haojun Liao 7305c8dbe1 refactor: do some internal refactor about the sched status set 2023-09-13 14:00:34 +08:00
wangmm0220 1dbd322fa0 fix:remove useless code 2023-09-13 11:42:09 +08:00
kailixu 53ed71959b enh: fetch cluster info for grant periodically 2023-09-13 11:30:04 +08:00
Yihao Deng fa302ac6b9
Merge branch '3.0' into enh/ipWhiteList 2023-09-13 10:14:08 +08:00
Haojun Liao 99477babca
Merge pull request #22872 from taosdata/fix/coverityScanDyh
fix coverity scan problem
2023-09-13 09:18:27 +08:00
Haojun Liao 09a15bf340 refactor: do some internal refactor. 2023-09-12 22:07:52 +08:00
Haojun Liao 60f5056ab7 other: merge 3.0 2023-09-12 22:00:40 +08:00
Haojun Liao f6a097d96f refactor: do some internal refactor. 2023-09-12 21:58:22 +08:00
Haojun Liao 4325a0a433
Merge pull request #22866 from taosdata/fix/3_liaohj
refactor: do  some internal refactor.
2023-09-12 21:56:44 +08:00
yihaoDeng 5468c717e9 Merge branch 'enh/ipWhiteList' of https://github.com/taosdata/TDengine into enh/ipWhiteList 2023-09-12 21:03:42 +08:00
yihaoDeng d6f4c40e54 fix mem leak 2023-09-12 21:03:35 +08:00
yihaoDeng 8fc33dd74d fix coverity scan problem 2023-09-12 18:52:16 +08:00
Haojun Liao e457d94ac6 refactor: do some internal refactor. 2023-09-12 18:09:02 +08:00
yihaoDeng 8e064cdd03 fix merge error 2023-09-12 16:41:14 +08:00
slzhou 65fe665939 fix: get user whitelist version from user object 2023-09-12 16:27:07 +08:00
slzhou a44d0bceb6 Merge branch 'szhou/enh/ipWhiteList' into enh/ipWhiteList 2023-09-12 16:21:29 +08:00
Haojun Liao 4d33387e80
Merge pull request #22814 from taosdata/fix/fixTransferCrash2
fix merge error
2023-09-12 16:10:07 +08:00
Haojun Liao 52931b530d
Merge pull request #22855 from taosdata/fix/3_liaohj
fix(stream):check error when vnode is closing.
2023-09-12 15:58:02 +08:00
dapan1121 ef7eb478e4
Merge pull request #22834 from taosdata/fix/TS-3945
fix: remove incorrect assert
2023-09-12 15:55:51 +08:00
yihaoDeng 7ce8f694dc Merge branch 'enh/dev3New' into enh/ipWhiteList 2023-09-12 15:54:06 +08:00
yihaoDeng 63c53b6a3a fix transfer crash 2023-09-12 15:03:13 +08:00
yihaoDeng ccb75a9c11 fix transfer crash 2023-09-12 14:46:56 +08:00
yihaoDeng 3e48f3639c fix transfer crash 2023-09-12 14:46:32 +08:00
shenglian zhou d5f1662bf5 enh: enterprise version and community version split 2023-09-12 14:35:01 +08:00
shenglian zhou 21dd7a82b0 Merge branch 'szhou/enh/ipWhiteList' of github.com:taosdata/TDengine into szhou/enh/ipWhiteList 2023-09-12 14:16:35 +08:00
shenglian zhou 53894f1182 enhance: add hb whitelist version and notify taosadapter 2023-09-12 14:15:03 +08:00
shenglian zhou 8db96a0085 enhance: update notification and get user whitelist api 2023-09-12 14:10:41 +08:00
shenglian zhou 64caae83fd enhance: add hb whitelist version and notify taosadapter 2023-09-12 14:10:41 +08:00
wade zhang f4e785788a
Merge pull request #22833 from taosdata/fix/TS-3943-3.m
fix: neighbor block overlap judgement
2023-09-12 11:51:03 +08:00
Haojun Liao 93159729f6 fix(stream):check error when vnode is closing. 2023-09-12 11:45:51 +08:00
Haojun Liao 025a2a3b50
Merge pull request #22846 from taosdata/fix/3_liaohj
fix(tsdb): check the schema before merge rows in buffer
2023-09-12 11:43:27 +08:00
yihaoDeng 4d16cfac05 add rpc update interface 2023-09-12 11:36:44 +08:00
yihaoDeng a902421f5b add user ip white ver 2023-09-12 11:33:32 +08:00
yihaoDeng f29880fee3 add rpc update interface 2023-09-12 11:31:06 +08:00
wade zhang a02f28640c
Merge pull request #22829 from taosdata/fix/TD-26210-main
fix/TD-26210
2023-09-12 11:01:12 +08:00
yihaoDeng 6ce85f5cae fix transfer crash 2023-09-12 10:44:56 +08:00
yihaoDeng d9eed32167 add rpc update interface 2023-09-12 09:54:13 +08:00
Haojun Liao f602aa965f fix(stream): fix coverity scan issues. 2023-09-12 09:16:18 +08:00
Haojun Liao a5b93aaf97 fix(tsdb): fix invalid read. 2023-09-11 23:55:34 +08:00
Haojun Liao e8f7146a2c fix(tsdb): check the schema before merge rows in buffer, and do some refactor. 2023-09-11 22:19:10 +08:00
Haojun Liao cd1f0ea414
Merge pull request #22826 from taosdata/fix/3_liaohj
fix(stream): set the correct start version for the step 2 stage in fill history.
2023-09-11 21:43:58 +08:00
yihaoDeng 9efa9eeff4 add rpc update interface 2023-09-11 21:29:50 +08:00
yihaoDeng 0a8b1ebe46 add rpc update interface 2023-09-11 21:02:50 +08:00
yihaoDeng 39d04ed15b add rpc update interface 2023-09-11 20:48:24 +08:00
shenglian zhou 9da204e5ff enhance: update notification and get user whitelist api 2023-09-11 17:04:35 +08:00
Haojun Liao 5ab739ae46 fix(stream): fix memory leak. 2023-09-11 15:29:12 +08:00
yihaoDeng d549a47cf5 add rpc update interface 2023-09-11 15:17:20 +08:00
dapan1121 5c21f1ca22 fix: remove incorrect assert 2023-09-11 15:16:22 +08:00
kailixu 78d136dffd fix: neighbor block overlap judgement 2023-09-11 15:10:39 +08:00
yihaoDeng 05727359ca add rpc update interface 2023-09-11 15:02:35 +08:00
dmchen a8e538a563 fix/TD-26210 2023-09-11 14:38:36 +08:00
Haojun Liao c729fc989f fix(stream): set the init start timestamp. 2023-09-11 13:49:43 +08:00
Haojun Liao 0980e021e5 fix(stream): set the correct start version for the step 2 stage in fill history. 2023-09-11 13:37:19 +08:00
yihaoDeng 2a30e12547 add rpc update interface 2023-09-11 10:45:45 +08:00
Haojun Liao 50ef500f51 refactor(stream): do sink module refactor. 2023-09-11 10:09:31 +08:00
shenglian zhou 569283f806 enhance: add hb whitelist version and notify taosadapter 2023-09-11 09:52:58 +08:00
yihaoDeng 30a60be214 add rpc update interface 2023-09-11 09:26:00 +08:00
Minglei Jin 443756c6ff fix(meta): null txn after abort 2023-09-11 08:55:30 +08:00
wade zhang ddc8c93a9c
Merge pull request #22767 from taosdata/mark/tmq
fix:send delete subscribe info to vnode if drop consumer
2023-09-10 22:17:26 +08:00
wade zhang 635d405867
Merge pull request #22800 from taosdata/fix/TS-3922-main
fix:[TS-3922] make SStreamObj->->currentTick aligned by 8
2023-09-10 22:17:07 +08:00
Haojun Liao 372747cc23
Merge pull request #22818 from taosdata/fix/3_liaohj
fix(stream): fix error in fill history and check quit status of vnode.
2023-09-10 20:47:06 +08:00
yihaoDeng 9781766009 add rpc update interface 2023-09-10 17:02:38 +08:00
yihaoDeng d121b564c0 add rpc update interface 2023-09-10 16:11:14 +08:00
yihaoDeng 25bc0b226b add rpc update interface 2023-09-10 14:09:36 +08:00
Haojun Liao 85a5c45098 fix(stream): limit the already processed data. 2023-09-10 00:01:25 +08:00
Haojun Liao 9a30573b8b fix(stream): disable scan wal when halt is set. 2023-09-09 16:12:08 +08:00
Haojun Liao aa8909b267 other: add some logs. 2023-09-09 15:18:54 +08:00
Haojun Liao 6f5c855a4b fix(stream): fix msg lost bug. 2023-09-09 15:08:36 +08:00
Haojun Liao 47fd144447 other: add some logs. 2023-09-09 11:19:51 +08:00
yihaoDeng af08289a06 Merge branch 'fix/mainNew' into fix/fixTransferCrash2 2023-09-08 19:58:21 +08:00
yihaoDeng a0494695de fix merge error 2023-09-08 19:48:06 +08:00
Haojun Liao b317c8ebff fix(stream): disable merge submit blocks. 2023-09-08 12:46:15 +08:00
yihaoDeng 56706193eb add rpc update interface 2023-09-08 11:49:12 +08:00
yihaoDeng 27e3ee8f1d add rpc update interface 2023-09-07 21:10:05 +08:00
yihaoDeng 60d6a622e1 add rpc update interface 2023-09-07 20:47:10 +08:00
wangmm0220 842bb5742a fix:[TS-3922]rollback because cases failed & avoid atomic_store_64 core if parameters not aligned by 8 2023-09-07 19:26:33 +08:00
Benguang Zhao 55a9668908 fix: next merger iter of tombs in loop of tsdbSnapWriteTombRecord 2023-09-07 17:26:30 +08:00
Benguang Zhao 2d5b18039d fix: next merger iter of tombs in loop of tsdbSnapWriteTombRecord 2023-09-07 17:14:50 +08:00
wade zhang 3ea51721b9
Merge pull request #22797 from taosdata/fix/TD-25218-main
Fix/TD-25218: adjust the error code returned when db does not exist
2023-09-07 16:13:53 +08:00
wade zhang d3f0c5ac3e
Merge pull request #22770 from taosdata/fix/TD-25445-main
fix/TD-25445: search memory in ttlMgrFindExpired
2023-09-07 16:13:32 +08:00
yihaoDeng 8c5fa3526a add rpc update interface 2023-09-07 16:10:07 +08:00
wangmm0220 c4898bffd8 fix:[TS-3922] make SStreamObj->->currentTick aligned by 8 2023-09-07 15:23:00 +08:00
Shungang Li 46af31539d fix: adjust the error code returned when db does not exist 2023-09-07 14:52:34 +08:00
yihaoDeng f4f97a67f5 add rpc update interface 2023-09-07 14:24:26 +08:00
yihaoDeng 147de26eec add rpc update interface 2023-09-07 11:54:34 +08:00
Haojun Liao 55ac835294 Merge branch 'main' into fix/3_liaohj 2023-09-07 11:47:25 +08:00
Haojun Liao b240e91c91 enh(stream): add token bucket to limit the rate of sink operation. 2023-09-07 09:58:48 +08:00
Shungang Li a6ba7e678f fix: search memory in ttlMgrFindExpired 2023-09-07 09:33:26 +08:00
Haojun Liao 0f909285c4
Merge pull request #22684 from taosdata/mark/tmq-3.0
fix:use vgstatus before if rebalance
2023-09-07 09:20:27 +08:00
yihaoDeng bc27d245b1 add rpc update interface 2023-09-06 21:54:31 +08:00
yihaoDeng ad5639df89 add rpc update interface 2023-09-06 21:36:16 +08:00
Haojun Liao 2b84e0b02e refactor: check if the put data into queue is success or failed. 2023-09-06 19:39:00 +08:00
Haojun Liao 8edf86b3bb fix(stream): add some logs. 2023-09-06 19:08:09 +08:00
Haojun Liao 5ba6a68e7a fix(stream): fix syntax error. 2023-09-06 19:00:39 +08:00
Haojun Liao a82027f492 enh(stream): pack multi-datablock into one submit message. 2023-09-06 18:58:47 +08:00
wade zhang e493f983ed
Merge pull request #22735 from taosdata/fix/TD-26133
fix: coverity scan
2023-09-06 18:45:23 +08:00
Haojun Liao f8a321695a
Merge pull request #22711 from taosdata/fix/TD-26069-1
fix rc
2023-09-06 17:58:33 +08:00
yihaoDeng ac8220012c add rpc update interface 2023-09-06 17:22:30 +08:00
Hongze Cheng 1d343fa57e more fix 2023-09-06 17:10:36 +08:00
Haojun Liao 926cc01cff refactor: do some internal refactor. 2023-09-06 16:48:43 +08:00
yihaoDeng b5d40d01bb add rpc update interface 2023-09-06 16:24:29 +08:00
dapan1121 ed9085281d
Merge pull request #22623 from taosdata/feat/TD-25964-3.0
feat: get cpu cores from quota
2023-09-06 16:03:33 +08:00
Hongze Cheng cd88c8ec31 fix: little test 2023-09-06 14:45:53 +08:00
Haojun Liao b382cba58c fix(stream): fix syntax error. 2023-09-06 14:37:58 +08:00
Haojun Liao 236b363996 fix(stream): fix syntax error. 2023-09-06 14:37:11 +08:00
Haojun Liao 8783ebcb02 enh(stream): add some logs and record the submit package performance. 2023-09-06 14:34:36 +08:00
Hongze Cheng a6743a31b5 Merge branch 'main' of https://github.com/taosdata/TDengine into fix/TD-26133 2023-09-06 14:12:21 +08:00
dapan1121 698b0b21f7
Merge pull request #22630 from taosdata/enh/TS-3812-3.0
enh: report time series by period and quantity
2023-09-06 13:38:24 +08:00
dapan1121 2bc8b3f7ee
Merge pull request #22625 from taosdata/enh/TD-23879-3.0
enh: allow altering options to the same value
2023-09-06 13:34:49 +08:00
Haojun Liao e607a0a5cb fix(stream): add some logs. 2023-09-06 11:39:07 +08:00
wangmm0220 f209e31582 fix:send delete subscribe info to vnode if drop consumer 2023-09-06 11:16:03 +08:00
dmchen 231ba12f70 feat/TD-26127 2023-09-06 11:00:24 +08:00
Haojun Liao c86eeb3938 fix(stream): add task status check when waiting for the table create. 2023-09-06 10:58:33 +08:00
yihaoDeng 393ef21348 add rpc update interface 2023-09-06 09:32:26 +08:00
yihaoDeng 6f6c517342 add rpc update interface 2023-09-05 21:00:01 +08:00
yihaoDeng e539eebaa2 add rpc update interface 2023-09-05 18:50:11 +08:00
wangmm0220 ef87b9c571 fix:conflicts from 3.0 2023-09-05 16:19:04 +08:00
wangmm0220 4e46ce4c03 fix:wait pHandle idle if vnode receives subscribe msg 2023-09-05 16:04:44 +08:00
wade zhang 0517358a02
Merge pull request #22717 from taosdata/fix/TD-22062
fix/TD-22062
2023-09-05 16:04:12 +08:00
Haojun Liao ac8f4f1558
Merge pull request #22736 from taosdata/fix/fixTransferCrash
fix invalid read
2023-09-05 15:42:03 +08:00
Haojun Liao 5dcbae3594
Merge pull request #22681 from taosdata/fix/3_liaohj
refactor: do some internal refactor.
2023-09-05 12:54:09 +08:00
yihaoDeng d0503a8a3f fix invalid read 2023-09-05 12:11:58 +08:00
yihaoDeng 6257bf1e10 add rpc update interface 2023-09-05 12:03:23 +08:00
Hongze Cheng 8dbdeccc8f fix: coverity scan 2023-09-05 11:41:36 +08:00
Alex Duan 00c5760927
Merge pull request #22730 from taosdata/fix/test_1x
test: add stream cases to 3.0
2023-09-05 11:21:35 +08:00
dapan1121 4a5bcb5c80
Merge pull request #22650 from taosdata/szhou/ip-whitelist
enhance: ip whitelist syntax
2023-09-05 11:00:55 +08:00
wade zhang 8f27724f1f
Merge pull request #22701 from taosdata/fix/test_1x
test: add stream cases to main
2023-09-05 10:57:38 +08:00
Haojun Liao 0441c7a870 Merge branch 'fix/3_liaohj' of github.com:taosdata/tdengine into fix/3_liaohj 2023-09-05 10:40:48 +08:00
Haojun Liao 5b3cb8ec42 fix(stream): fix memory leak. 2023-09-05 09:27:16 +08:00
Haojun Liao db8073dadd fix(stream): fix memory leak. 2023-09-04 23:13:57 +08:00
yihaoDeng 685bdea44a add rpc update interface 2023-09-04 21:15:46 +08:00
Haojun Liao 77eed06bcd
Merge branch '3.0' into fix/3_liaohj 2023-09-04 18:51:07 +08:00
dmchen 1a0480c834 fix/TD-22062 2023-09-04 17:14:29 +08:00
wangmm0220 90e938e48f fix:set vg status idle if reveive poll callback 2023-09-04 16:53:12 +08:00
Haojun Liao aeea699c9c Merge branch '3.0' into fix/3_liaohj 2023-09-04 15:53:39 +08:00
Haojun Liao ed22dd5f26 fix(stream): fix deadlock caused during merging branch. 2023-09-04 14:09:39 +08:00
Haojun Liao 375d0abea5 fix(stream): merge main. 2023-09-04 13:12:53 +08:00
Haojun Liao 21dab8ceab other: merge 3.0 2023-09-04 13:08:19 +08:00
yihaoDeng 03cddfa7ce fix rc 2023-09-04 10:33:01 +08:00
Haojun Liao d73de8ba1e fix(stream): add null ptr check. 2023-09-02 16:44:21 +08:00
Haojun Liao 037a232bfa refactor: do some internal refactor. 2023-09-01 17:05:36 +08:00
wangmm0220 fd85d5885a fix:add limit time for consume in 1 seconds 2023-09-01 16:57:49 +08:00
wangmm0220 02ac3eac5a fix:logic error 2023-09-01 16:51:44 +08:00
yihaoDeng 5f78c27535 add enable white list 2023-09-01 15:11:25 +08:00
Haojun Liao 4fee5ba59a fix(stream): even in ck, start stream tasks. 2023-09-01 14:40:30 +08:00
yihaoDeng 832b78c0e8 Merge branch '3.0' into szhou/ip-whitelist 2023-09-01 13:44:23 +08:00
dapan1121 cc17848b78 fix: merge 3.0 to main 2023-09-01 13:24:47 +08:00
dapan1121 2141ac8460 Merge remote-tracking branch 'origin/main' into fix/m23.2 2023-09-01 11:21:38 +08:00
yihaoDeng 8b146f793d Merge branch '3.0' into szhou/ip-whitelist 2023-09-01 10:51:24 +08:00
Hongze Cheng 113867081e enh: upgrade more efficiently 2023-09-01 10:16:10 +08:00
dapan1121 228e6c6acd Merge remote-tracking branch 'origin/main' into 3.0 2023-09-01 10:01:10 +08:00
Haojun Liao 3765fbbba2 fix(stream): fix memory leak. 2023-09-01 09:59:56 +08:00
Haojun Liao e8294ed8dc fix(stream): fix bug in multi-replica vnode redistribute. 2023-09-01 03:10:12 +08:00
Haojun Liao fecba5b097 fix(stream): check for meta 2023-08-31 20:54:02 +08:00
Haojun Liao 95da66e3e8 fix(stream): fix error. 2023-08-31 20:50:12 +08:00
Haojun Liao e816d0efa5
Merge pull request #22669 from taosdata/fix/TD-26069
fix invalid insert
2023-08-31 18:29:25 +08:00
wade zhang fcd3c6f109
Merge pull request #22668 from taosdata/feat/audit-table-namee
Feat/audit table name
2023-08-31 17:48:19 +08:00
wangmm0220 a02ab4ccfb fix:coredump if saved epoch bigger than request epoch & modify test cases 2023-08-31 17:35:41 +08:00
dmchen 03de7ad5a6 stream name 2023-08-31 16:44:36 +08:00
dmchen 12ffc58b7e password and topic name 2023-08-31 16:37:24 +08:00
yihaoDeng 1833be028f fix invalid insert 2023-08-31 15:28:31 +08:00
yihaoDeng 9fd0bff673 fix invalid insert 2023-08-31 14:57:26 +08:00
dmchen 9b7bbe0168 audit table name 2023-08-31 14:42:25 +08:00
Haojun Liao 92e258617a refactor: do some internal refactor. 2023-08-31 14:31:45 +08:00
Haojun Liao e2bb64eb18 refactor: do some internal refactor. 2023-08-31 14:23:46 +08:00
Haojun Liao 69f95f9324 other: merge 3.0 2023-08-31 13:56:34 +08:00
Haojun Liao 3fc3dafca6 refactor: do some internal refactor. 2023-08-31 13:46:48 +08:00
Haojun Liao 3ed78ddadd
Merge pull request #22662 from taosdata/fix/3_liaohj
refactor: do some internal refactor.
2023-08-31 13:46:14 +08:00
Haojun Liao 8645f763b5
Merge pull request #22661 from taosdata/enh/reserve
stream change ver
2023-08-31 13:35:23 +08:00
yihaoDeng 83a5e2be4c stream change ver 2023-08-31 11:42:12 +08:00
wade zhang 2978efafa6
Merge pull request #22660 from taosdata/feat/audit-dropnode-no-ipport
typo and remove ip port
2023-08-31 11:05:02 +08:00
Haojun Liao e53b5d4392 refactor: do some internal refactor. 2023-08-31 11:01:53 +08:00
Haojun Liao 0facde6ddc
Merge pull request #22659 from taosdata/fix/TD-26035
fix(stream): do not restart the stream tasks when it is running.
2023-08-31 10:16:59 +08:00
Haojun Liao 0c599fa869
Merge pull request #22415 from taosdata/szhou/tsdb-neigh-block
tsdb neighbouring block search and set it to global block iterator
2023-08-31 09:46:37 +08:00
yihaoDeng 05ca71d5de stream change ver 2023-08-31 09:28:43 +08:00
dmchen 22f0778cca typo and remove ip port 2023-08-31 09:26:44 +08:00
wangmm0220 7f2a9a7262 fix:cancel the limit time for consume 2023-08-31 09:07:40 +08:00
kailixu f4dd1895b2 Merge branch '3.0' into feat/TD-25964-3.0 2023-08-31 08:56:53 +08:00
wade zhang 68e4a72021
Merge pull request #22643 from taosdata/feat/audit-user-typestr
alter user type to str
2023-08-31 07:59:31 +08:00
wangmm0220 4f20359f43 fix:modify log level to trace 2023-08-30 23:57:48 +08:00
Haojun Liao a2c6e4306a fix(stream): reset the counter. 2023-08-30 20:20:20 +08:00
Haojun Liao fd2f988cdb fix(stream): reset the counter. 2023-08-30 20:19:51 +08:00
Haojun Liao 5d23df100c fix(stream): ignore the fill-history tasks. 2023-08-30 19:07:06 +08:00
Haojun Liao 65eaa9b15f fix(stream): add task release. 2023-08-30 19:06:12 +08:00
wangmm0220 23c4d7eb0a fix:dead lock 2023-08-30 18:10:19 +08:00
dmchen 3d9274d713 create table db name 2023-08-30 17:28:03 +08:00
Haojun Liao d99d8875e1 fix(stream): if stream task is running, do not recheck its status. 2023-08-30 17:24:13 +08:00
slzhou 82dc2de2f4 Merge branch '3.0' of github.com:taosdata/TDengine into szhou/ip-whitelist 2023-08-30 17:11:42 +08:00
dmchen 623660d012 enhance 2023-08-30 16:17:13 +08:00
dmchen 04a89b4a49 long fields 2023-08-30 16:03:57 +08:00
Haojun Liao c5b279f045 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-08-30 16:01:08 +08:00
Haojun Liao 24b1a050fc other: merge 3.0 2023-08-30 16:00:14 +08:00
dmchen 63e2926a60 topic 2023-08-30 15:26:54 +08:00
kailixu eb7d2d495a chore: supports obtaining physical/virtual CPU cores 2023-08-30 15:21:03 +08:00
dapan1121 718f97e506
Merge pull request #22640 from taosdata/fix/m23.1
Fix/m23.1
2023-08-30 14:58:40 +08:00
liuyao 0a72e576bd op stream pause
pause data dispatch

opt stream pause
2023-08-30 14:53:49 +08:00
slzhou 1ab94d0992 Merge branch '3.0' of github.com:taosdata/TDengine into szhou/ip-whitelist 2023-08-30 14:42:26 +08:00
dmchen 7790afd85d fields 2023-08-30 13:13:05 +08:00
dmchen b9f77798a2 alter user type to str 2023-08-30 12:06:11 +08:00
kailixu 1a34cd1020 chore: optimize of report time series by quantity 2023-08-30 11:45:07 +08:00
wade zhang bec05f2677
Merge pull request #22638 from taosdata/feat/TD-26033
TD-26033
2023-08-30 11:40:44 +08:00
kailixu 8e20740622 enh: report time series by quantity 2023-08-30 11:39:21 +08:00
wade zhang bbed968256
Merge pull request #22617 from taosdata/FIX/TD-25995-3.0
enh: adjust criteria of completion to retrieve SShowObj info from mnode in mndProcessSysTableReq
2023-08-30 11:33:13 +08:00
dapan1121 f6321d0c4f Merge remote-tracking branch 'origin/main' into fix/m23.1 2023-08-30 11:03:33 +08:00
Haojun Liao dec4d69529 fix(stream): set correct user-define table name in sink table info cache. 2023-08-30 10:52:39 +08:00
dmchen 7bea92cbf9 TD-26033 2023-08-30 10:28:39 +08:00
Haojun Liao 3a7a220d43 fix(stream): fix error found by ci. 2023-08-30 10:14:01 +08:00
wade zhang 782c936ee8
Merge pull request #22635 from taosdata/feat/audit-dbname
audit-dbname
2023-08-30 09:55:48 +08:00
kailixu 9d1ac801ed Merge branch '3.0' into enh/TS-3812-3.0 2023-08-30 09:27:17 +08:00
Haojun Liao 610132e29a
Merge pull request #22633 from taosdata/fix/update_db_attr
fix(tsdb): add more check for block rows
2023-08-29 22:05:57 +08:00
wade zhang 701ac939c1
Merge pull request #22632 from taosdata/fix/ttl
fix/TD-26032: ttl cache entry record the original information for deletion
2023-08-29 18:27:50 +08:00
Haojun Liao 8dadae5d3a fix(stream): fix invalid read. 2023-08-29 18:24:32 +08:00
dmchen bb33620f5c dbname 2023-08-29 18:12:08 +08:00
Haojun Liao d6368798da fix(query): disable the set quit flag for tsdbreader. 2023-08-29 18:11:17 +08:00
Benguang Zhao dbeafb508b fix: reset show obj iter on no more data to read in mndRetrieveIdx 2023-08-29 17:56:24 +08:00
Haojun Liao b740ce8ad6 fix(tsdb): add more check for block rows to detect the duplicate rows in data block. 2023-08-29 17:49:43 +08:00
kailixu 3036b78910 Merge branch '3.0' into enh/TD-23879-3.0 2023-08-29 17:43:14 +08:00
shenglian zhou 33966cf856 enhance: continue coding 2023-08-29 17:35:03 +08:00
Haojun Liao 204fb97f68 fix(stream): fix error in snode, fix memory leaks, fix repeatly create bug in sink task. 2023-08-29 17:34:31 +08:00
Shungang Li df2b2484df fix: ttl cache entry record the original information for deletion 2023-08-29 17:18:22 +08:00
Minglei Jin 82fc1f41fb fix(tsdb/cache read): remove all null row 2023-08-29 16:15:00 +08:00
kailixu f00596868f fix: remove duplicated line 2023-08-29 16:12:49 +08:00
kailixu db07511c93 enh: report time series by period and quantity 2023-08-29 16:08:51 +08:00
Benguang Zhao a6455672c0 fix: check completeness of retrieval properly in mndProcessRetrieveSysTableReq 2023-08-29 15:47:11 +08:00
wade zhang 53a24e04f2
Merge pull request #22604 from taosdata/feat/audit-db-detail
audit db detail
2023-08-29 15:46:10 +08:00
kailixu 523994d93b enh: allow altering options to the same value 2023-08-29 15:15:07 +08:00
Haojun Liao c3e9590740 fix(stream): fix error. 2023-08-29 15:11:01 +08:00
Benguang Zhao 5e5b7a3328 fix: reserve enough space of show Obj rows for vnodes of each vgroup in mndRetrieveVnodes 2023-08-29 12:07:52 +08:00
Haojun Liao 6e4acddd96
Merge pull request #22603 from taosdata/fix/TD-25962
fix:unregister push manager if delete subscribe to avoid tqProcessPol…
2023-08-29 10:58:49 +08:00
Minglei Jin 432eaf5110 Merge branch '3.0' into fix/TD-25963 2023-08-29 10:51:53 +08:00
Minglei Jin b88d79d2ef fix(tsdb/open fs): fix retval 2023-08-29 10:33:20 +08:00
wade zhang ff6de8ebe2
Merge pull request #22600 from taosdata/fix/TD-25010-10
enh(s3/evict): evict cache data files for other migrated head, stt, etc.
2023-08-28 18:12:40 +08:00
dmchen 1372cede48 init 2023-08-28 17:44:10 +08:00
dapan1121 778e50da79
Merge pull request #22592 from taosdata/fix/m23.0
Fix/m23.0
2023-08-28 17:35:35 +08:00
wangmm0220 2e04d513a4 fix:unregister push manager if delete subscribe to avoid tqProcessPollPush 2023-08-28 16:41:28 +08:00
Minglei Jin 9ef455a454 enh(s3/evict): evict cache data files for other migrated head, stt, etc. 2023-08-28 15:57:13 +08:00
Haojun Liao 05bb164675 fix(stream): release tasks. 2023-08-28 15:56:02 +08:00
Haojun Liao 391103bc5a fix(stream): do dome internal refactor. 2023-08-28 15:54:01 +08:00
Haojun Liao 33672f2f35 fix(stream): release stream tasks. 2023-08-28 15:52:54 +08:00
wade zhang cd3702e91c
Merge pull request #22596 from taosdata/fix/TD-25963
fix(tsdb/s3): fix scan and fix with s3 files
2023-08-28 15:19:47 +08:00
Minglei Jin f299ae9bc3 fix(tsdb/s3): fix scan and fix with s3 files 2023-08-28 12:22:53 +08:00
wade zhang 1797fe50e2
Merge pull request #22590 from taosdata/feat/TD-18801
init
2023-08-28 11:05:38 +08:00
Haojun Liao da0b4e1f92 Merge branch '3.0' into enh/triggerCheckPoint2 2023-08-28 10:55:38 +08:00
wade zhang e95c9d5fdc
Merge pull request #22591 from taosdata/feat/TD-18572
feat/TD-18572: dynamic 'supportvnodes'
2023-08-28 10:46:44 +08:00
dapan1121 0cce255a02 Merge remote-tracking branch 'origin/3.0' into fix/m23.0 2023-08-28 10:06:53 +08:00
Haojun Liao b75ae217f6 fix(stream): notify close for snode. 2023-08-28 09:53:08 +08:00
Haojun Liao 88f6596965
Merge pull request #22464 from taosdata/feat/TD-18789
feat:support varbinary type
2023-08-28 09:45:57 +08:00
Haojun Liao b11975f00c
Merge pull request #22534 from taosdata/mark/tmq
fix:[TD-258900]modify tmq trans conflict to db level
2023-08-28 09:45:47 +08:00
dapan1121 1f40da6fef Merge remote-tracking branch 'origin/main' into 3.0 2023-08-28 09:28:55 +08:00
Shungang Li 0c28c9aee8 feat: dynamic 'supportvnodes' 2023-08-28 09:17:35 +08:00
dmchen 06083e1eb9 init 2023-08-28 09:15:51 +08:00
dapan1121 cda08087b9
Merge pull request #22586 from taosdata/fix/TD-25936.3
fix: no explain response issue
2023-08-28 08:52:13 +08:00
Haojun Liao 6b327886e9 fix(stream): add null ptr check. 2023-08-27 00:27:04 +08:00
wangmm0220 8b745de397 fix:transaction error 2023-08-26 00:43:47 +08:00
Haojun Liao d8a6ec024a Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-08-25 19:21:00 +08:00
Haojun Liao 7ceb8dc627 fix(stream): disable the follower to execute the stop/resume instruction. 2023-08-25 19:20:49 +08:00
yihaoDeng 22b8d90fbc fix invalid read 2023-08-25 18:34:11 +08:00
wangmm0220 047707fa17 fix:error in privilege 2023-08-25 17:56:17 +08:00
Haojun Liao 43a3f9f535 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-08-25 17:32:50 +08:00
Haojun Liao e013ba6795 fix(stream): fix the counter. 2023-08-25 17:32:34 +08:00
Minglei Jin f0fdbaa3f3 fix(tsdb/close): fix uaf with file closing 2023-08-25 17:27:32 +08:00
Haojun Liao 60d1df0e25
Merge branch '3.0' into enh/triggerCheckPoint2 2023-08-25 15:49:28 +08:00
wangmm0220 26e025d78d feat:[TD-18789]support varbinary type 2023-08-25 15:43:45 +08:00
Haojun Liao f951635602 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-08-25 15:33:08 +08:00
Haojun Liao ab2aad2b2c fix(stream): update the task status even it is in stop status. 2023-08-25 15:32:55 +08:00
dapan1121 e24498b0fd enh: add task notify 2023-08-25 14:59:34 +08:00
liuyao 7d44b7e4cb mem leak 2023-08-25 14:53:29 +08:00
Hongze Cheng e1095e7d02 fix: improve upgrade speed 2023-08-25 14:40:29 +08:00
Haojun Liao 4c7ad54c9c fix(stream): not restart tasks when in restoring procedure. 2023-08-25 11:28:28 +08:00
Haojun Liao 38bb123701 fix(stream): release task. 2023-08-25 10:33:15 +08:00
Haojun Liao ce1a3a379c fix(stream): handle the case when the task not in ready state, and the checkpoint msg arrived. 2023-08-25 10:12:12 +08:00
Haojun Liao f805a49df2
Merge pull request #22555 from taosdata/fix/TD-25948
mem leak
2023-08-25 09:28:18 +08:00
Haojun Liao 6f514b2bee
Merge pull request #22561 from taosdata/fix/TD-25651
fix:[TD-25651] reset epoch if consumer changed to avoid consumeing no…
2023-08-25 09:09:41 +08:00
wade zhang abe97e1e21
Merge pull request #22566 from taosdata/fix/TD-25952
enh(tsdb/openfile): lazy file open to read/write
2023-08-25 07:57:52 +08:00
Haojun Liao f7ea875af1 fix(stream): add some logs. 2023-08-24 23:27:48 +08:00
Haojun Liao f7dada53b9
Merge pull request #22559 from taosdata/fix/liaohj
other: merge main.
2023-08-24 19:01:18 +08:00
wangmm0220 cca00406a5 fix:drop topic error if topic not exist 2023-08-24 18:16:57 +08:00
Haojun Liao 82e356a9b5 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2
# Conflicts:
#	source/dnode/vnode/src/tq/tq.c
2023-08-24 18:04:44 +08:00
Haojun Liao 70396aa5a5 fix(stream): wakeup the hb timer every 200ms, to speeup the close db procedure. 2023-08-24 17:54:50 +08:00
yihaoDeng 286ac3e3fc fix merge error 2023-08-24 17:35:53 +08:00
yihaoDeng 9310d138a6 Merge branch 'enh/3.0' into enh/triggerCheckPoint2 2023-08-24 17:30:35 +08:00
yihaoDeng 8883d66227 Merge branch 'enh/triggerCheckPoint2' of https://github.com/taosdata/TDengine into enh/triggerCheckPoint2 2023-08-24 17:20:12 +08:00
yihaoDeng 090515c684 refactor code 2023-08-24 17:20:04 +08:00
Haojun Liao caf20d7b5d fix(stream): release the stream task. 2023-08-24 17:16:34 +08:00
Minglei Jin 70871139bf enh(tsdb/openfile): lazy file open to read/write 2023-08-24 17:16:28 +08:00
wangmm0220 b83cc11043 fix:[TD-25651] reset epoch if consumer changed to avoid consumeing no data 2023-08-24 16:38:53 +08:00
wangmm0220 89884e1c49 fix:transaction in tmq 2023-08-24 16:34:52 +08:00
liuyao a72e6fd219 mem leak 2023-08-24 16:32:34 +08:00
wangmm0220 49216ffa54 fix:transaction in tmq 2023-08-24 16:32:15 +08:00
Haojun Liao 7d9d4ae850 fix(stream): fix the ptr ref. 2023-08-24 16:26:30 +08:00
Haojun Liao 5344efe181 fix(stream): adjust the ptr. 2023-08-24 16:22:24 +08:00
Haojun Liao 4c6bc4d2c3 fix(stream): continue check wal when meeting empty delete block msg. 2023-08-24 16:10:03 +08:00
Haojun Liao 523bad3951 fix(stream): continue check wal when meeting empty delete block msg. 2023-08-24 15:45:43 +08:00
Haojun Liao 2c9f28d97f Merge branch 'main' into fix/liaohj 2023-08-24 14:12:15 +08:00
wangjiaming0909 366a9cc009 Revert "feat: support column comment"
This reverts commit dcbef83dea.
2023-08-24 13:54:27 +08:00
wangjiaming0909 7fad1de841 Revert "feat: show create table, desc table with col comments"
This reverts commit 16754b5ac1.
2023-08-24 13:38:41 +08:00
wade zhang 0860670d37
Merge pull request #22526 from taosdata/enh/TD-25445-new
enh/TD-25445: ttl split flush and drop table
2023-08-24 13:57:07 +08:00
shenglian-zhou e76e6bbb84
Update tsdbReadUtil.c 2023-08-24 11:34:56 +08:00
shenglian-zhou 1965703d53
Merge branch '3.0' into szhou/tsdb-neigh-block 2023-08-24 10:58:23 +08:00
yihaoDeng 3afea998ac refactor log 2023-08-24 10:15:15 +08:00
wangmm0220 be74370e98 fix:memory leak 2023-08-24 09:25:26 +08:00
wangmm0220 775f0668c5 fix:[TD-258900]modify tmq trans conflict to db level 2023-08-24 09:25:26 +08:00
wangmm0220 8f3956cc67 fix:[TD-258900]modify tmq trans conflict to db level 2023-08-24 09:25:26 +08:00
wangmm0220 4591f24746 fix:memory leak 2023-08-23 19:41:02 +08:00
Haojun Liao 809d3087ff Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2
# Conflicts:
#	source/dnode/mnode/impl/src/mndStream.c
2023-08-23 17:53:50 +08:00
Haojun Liao 230d8c2d80 fix(stream): fix error in stream computing after vnode is transferred to other dnodes. 2023-08-23 17:50:44 +08:00
wangmm0220 f19c1ea3fe fix:[TD-258900]modify tmq trans conflict to db level 2023-08-23 16:46:33 +08:00
wangmm0220 8fc8aad1b5 fix:[TD-258900]modify tmq trans conflict to db level 2023-08-23 16:44:29 +08:00
yihaoDeng 5b621fc0c5 fix mem leak 2023-08-23 16:32:32 +08:00
yihaoDeng ccb675fe2b Merge branch 'enh/triggerCheckPoint2' of https://github.com/taosdata/TDengine into enh/triggerCheckPoint2 2023-08-23 14:27:35 +08:00
yihaoDeng faa4bbcaca fix mem leak 2023-08-23 14:26:45 +08:00
Haojun Liao b0c5fa8290 fix(stream): reset the task status. 2023-08-23 14:10:41 +08:00
Hongze Cheng a601cd21bd fix: alter stt_trigger bug 2023-08-23 13:31:19 +08:00
Shungang Li 458fd07976 enh: ttl split flush and drop table
config:
1. ttlFlushThreshold: maximum number of dirty items in memory
2. tsTtlBatchDropNum: number of tables dropped per batch
3. tsTrimVDbIntervalSec: interval of trimming db in all vgroups
2023-08-23 11:13:34 +08:00
wade zhang 8c4062c1b0
Merge pull request #22515 from taosdata/fix/TD-25819-2
fix(tsdb/file): save errno for shell reporting
2023-08-23 10:49:48 +08:00
wade zhang e069d72229
Merge pull request #22513 from taosdata/FIX/TD-25864-3.0
enh: adjust the order of pre-close actions in vnodePreClose
2023-08-22 17:27:17 +08:00
Haojun Liao 000e39aa18 fix(stream): add one more check. 2023-08-22 15:52:29 +08:00
Haojun Liao af80d94a88 refactor: do some internal refactor. 2023-08-22 15:43:50 +08:00
Minglei Jin 345743aba5 fix(tsdb/file): save errno for shell reporting 2023-08-22 14:44:32 +08:00
Haojun Liao cc8b2263cb fix(stream): fix error in heartbeat from vnode. 2023-08-22 13:37:38 +08:00
Benguang Zhao 8be670aee8 enh: place vnodeSyncPreStop ahead of vnodeQueryPreStop in vnodePreClose 2023-08-22 11:30:40 +08:00
dmchen 9f004c209a keep version change 2023-08-22 11:28:50 +08:00
Haojun Liao 64556c9f1d Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-08-22 10:47:02 +08:00
Haojun Liao def0877980 fix(stream): add timer to check stream task status. 2023-08-22 10:46:49 +08:00
dm chen b899a8b7df
Merge branch '3.0' into feat/TD-22970 2023-08-22 10:12:30 +08:00
yihaoDeng 1531e2d7d3 Merge branch 'enh/3.0' into enh/triggerCheckPoint2 2023-08-22 09:51:38 +08:00
Haojun Liao 873c22abb1 fix(stream): reset update stream tasks. 2023-08-21 19:32:27 +08:00
wade zhang 1a0ebb7ed9
Merge pull request #22502 from taosdata/feat/clean_useless_file
feat: clean useless file
2023-08-21 19:20:04 +08:00
Haojun Liao 8b27f98ee4 refactor: do some internal refactor. 2023-08-21 19:08:27 +08:00
yihaoDeng 387b4d365e refactor checkpoint 2023-08-21 19:07:15 +08:00
Hongze Cheng b8d62a86ed feat: clean useless file 2023-08-21 16:29:48 +08:00
wade zhang 501c86f858
Merge pull request #22488 from taosdata/FIX/TD-25762-3.0
enh: ensure transactional atomicity of db names in create database
2023-08-21 16:04:58 +08:00
Haojun Liao fbd67ce977 fix(stream): fix memory leak. 2023-08-21 11:50:53 +08:00
Haojun Liao 99024e9d78 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-08-21 11:49:08 +08:00
Haojun Liao 29bb5854cc fix(stream): fix error in check stream state. 2023-08-21 11:48:55 +08:00
Benguang Zhao d3ce0c1f80 fix: ensure creating status of create-db before completion 2023-08-21 11:46:25 +08:00
dm chen dda51d8019
Merge branch '3.0' into feat/TD-22970 2023-08-21 10:50:45 +08:00
yihaoDeng d934d91fb1 refactor checkpoint 2023-08-21 10:34:08 +08:00
dapan1121 fb80d6d36c
Merge pull request #22471 from taosdata/fix/m/TD-24871
fix: get systable cols error
2023-08-21 10:03:10 +08:00
wade zhang 54e1f69db4
Merge pull request #22481 from taosdata/fix/TD-25822
enh(tsdb/write): timestamp out of range with s3's last tier storage
2023-08-21 09:33:06 +08:00
yihaoDeng 6fe649c458 Merge branch 'enh/3.0' into enh/triggerCheckPoint2 2023-08-21 09:12:40 +08:00
Haojun Liao b8101afbe2 fix(stream): refactor the tasks restart mechanism. 2023-08-18 22:36:38 +08:00
Benguang Zhao f30d1ebacd enh: refactor func name as mndTransAppendPrepareLog 2023-08-18 18:35:44 +08:00
Benguang Zhao 9f1c8cc7b8 enh: unify validation of prepare actions with cb validateFp 2023-08-18 18:21:30 +08:00
Minglei Jin c4a3a5da35 vnode: fix write to s3 last tier 2023-08-18 18:02:53 +08:00
wade zhang a7e11c2520
Merge pull request #22482 from taosdata/fix/TD-25818
fix(vnode/destroy): delete objects
2023-08-18 17:49:22 +08:00
Benguang Zhao e7411183d9 enh: create SDB_DB entry in prepareAction 2023-08-18 17:08:24 +08:00
Haojun Liao 41fe441dad fix(stream): update the conflict scope. 2023-08-18 17:00:35 +08:00
wade zhang 87a8fe34ef
Merge pull request #22480 from taosdata/fix/TD-25819
fix(tsdb/reader): use ENOENT for not found objects
2023-08-18 16:49:54 +08:00
Minglei Jin 7b4bb72392 fix(vnode/destroy): delete objects 2023-08-18 16:38:26 +08:00
Minglei Jin 0242d4ce33 enh(tsdb/write): timestamp out of range with s3's last tier storage 2023-08-18 16:07:15 +08:00
Haojun Liao c26d625152
Merge branch '3.0' into enh/triggerCheckPoint2 2023-08-18 15:51:07 +08:00
Minglei Jin 73ae493fa7 tsdb/reader: use ENOENT for not found objects 2023-08-18 15:43:08 +08:00
liuyao 9afd5155ed Merge branch 'enh/triggerCheckPoint2' of https://github.com/taosdata/TDengine into enh/triggerCheckPoint2 2023-08-18 15:33:37 +08:00
liuyao 87c65f3b68 Merge remote-tracking branch 'origin/3.0' into enh/triggerCheckPoint2 2023-08-18 15:27:02 +08:00
dapan1121 9b953707b8 Merge remote-tracking branch 'origin/main' into fix/mainto3.0 2023-08-18 14:42:43 +08:00
Benguang Zhao f01a26f68a enh: refactor func names of new Vg prepare actions 2023-08-18 14:26:58 +08:00
Haojun Liao edbad45772 other: add logs. 2023-08-18 13:45:08 +08:00
dm chen e393a98ee9
Merge branch '3.0' into feat/TD-22970 2023-08-18 13:37:18 +08:00
Haojun Liao f68650fef9 other: add logs. 2023-08-18 10:53:58 +08:00
Haojun Liao a8b53c2e69 other: add logs. 2023-08-18 10:51:59 +08:00
Haojun Liao 633ecf66e5 other: add logs. 2023-08-18 10:39:32 +08:00
Haojun Liao 9ad8cf48dc other: add logs. 2023-08-18 10:38:24 +08:00
Haojun Liao 2a9668da67 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2
# Conflicts:
#	source/dnode/mnode/impl/src/mndStream.c
2023-08-18 10:30:30 +08:00
Haojun Liao 87785b1d9c refactor: add some logs. 2023-08-18 10:30:00 +08:00
wangjiaming0909 4dcdb549c9 fix: get systable cols error 2023-08-18 10:19:12 +08:00
Haojun Liao fbf80fb4c3
Merge pull request #22459 from taosdata/mark/tmq
fix:set terrno = 0 to avoid affect next fetch msg
2023-08-18 09:11:35 +08:00
slzhou 4e2a26e8be Merge branch '3.0' of github.com:taosdata/TDengine into szhou/select-tags-scan 2023-08-18 08:46:17 +08:00
yihaoDeng 80f6d092a1 add trace log 2023-08-18 08:43:37 +08:00
yihaoDeng ebd4cac36b Merge branch 'enh/triggerCheckPoint2' of https://github.com/taosdata/TDengine into enh/triggerCheckPoint2 2023-08-17 18:58:18 +08:00
yihaoDeng 46574c385f fix mem leak 2023-08-17 18:52:33 +08:00
Haojun Liao a18989df88 fix(stream): add lost codes caused by merge 3.0. 2023-08-17 18:51:39 +08:00
Hongze Cheng 8582e0c71a fix: important fix for compact file corruption 2023-08-17 18:13:37 +08:00
dmchen 5f138941f8 tsdb snap core 2023-08-17 17:58:35 +08:00
slzhou 85d1dbe00a Merge branch '3.0' of github.com:taosdata/TDengine into szhou/select-tags-scan 2023-08-17 16:27:37 +08:00
Benguang Zhao 7735e6f388 Merge branch 3.0 to FEAT/TD-25699-3.0 2023-08-17 16:04:23 +08:00
shenglian zhou 4a9391929c fix: select tags - ctb cursor pause/unlock and lock/resume 2023-08-17 14:59:17 +08:00
dapan1121 0e10e94a40
Merge pull request #22453 from taosdata/feat/TD-25685
feat: support column comment
2023-08-17 14:23:54 +08:00
Benguang Zhao 9b089d6446 enh: wrap state updating of vnodes and mnodes in mndProcessStatusReq 2023-08-17 11:59:53 +08:00
dmchen 4448e7d159 revert drop vnode 2023-08-17 11:57:17 +08:00
kailixu 49efb4ae72 fix: modify column length for super table 2023-08-17 11:43:07 +08:00
wangjiaming0909 16754b5ac1 feat: show create table, desc table with col comments 2023-08-17 11:39:34 +08:00
liuyao 5ce7688a93 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/ly_refactor 2023-08-17 09:06:46 +08:00
wade zhang e493a30a0b
Merge pull request #22460 from taosdata/fix/tsdb_snapshot_bug
fix: tsdb snapshot bug
2023-08-17 08:25:32 +08:00
Haojun Liao 6746339609 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2
# Conflicts:
#	source/libs/stream/src/streamSnapshot.c
2023-08-17 00:08:44 +08:00
Haojun Liao ea6574b3c7 other: merge 3.0 2023-08-17 00:07:55 +08:00
Haojun Liao f8f8e7a8f0
Merge pull request #22465 from taosdata/fix/3_liaohj
fix(stream): add the back pressure for sink node.
2023-08-16 22:59:36 +08:00
Benguang Zhao a94b8aeea6 feat: update vnodesSchema and mndRetrieveVnodes for show vnodes 2023-08-16 20:17:11 +08:00