Commit Graph

3360 Commits

Author SHA1 Message Date
kailixu aefebfca7f enh: update of user auth version 2023-06-28 20:49:29 +08:00
Haojun Liao d0542f99e2
Merge pull request #21744 from taosdata/mark/tmq
opti:tmq logic
2023-06-28 17:23:56 +08:00
wangmm0220 4ead47bcbd fix:add rows to pSub if rebalance 2023-06-28 16:43:30 +08:00
wangmm0220 865a3b2509 fix:add rows to pSub if rebalance 2023-06-28 16:37:57 +08:00
wangmm0220 ce0b71c634 fix:add rows to pSub if rebalance 2023-06-28 15:57:30 +08:00
wangmm0220 4a17f4b9f5 fix:add rows to pSub if rebalance 2023-06-28 14:57:31 +08:00
slzhou fc3fe9dff8 fix: remove connect to mnode 2023-06-28 13:49:13 +08:00
wangmm0220 fb82b61d2f fix:pSub is null 2023-06-28 10:35:38 +08:00
wangmm0220 d34dc1242f fix:memory leak 2023-06-28 09:41:20 +08:00
wangmm0220 7e38ef7091 fix:add limit for topic and group num 2023-06-27 17:44:51 +08:00
wangmm0220 4b95ea9cad fix:clear consumer if normal close 2023-06-27 17:11:20 +08:00
Haojun Liao 32fddeff18 fix(stream): fix error retrieve data from source task.And optimize the test cases. 2023-06-27 16:24:47 +08:00
Haojun Liao 3289ad62be other: merge 3.0 2023-06-27 11:33:40 +08:00
wade zhang d7e9eda6bc
Merge pull request #21844 from taosdata/FIX/TD-24924-3.0
enh:  change trans conflict scope of create topic
2023-06-27 10:47:53 +08:00
Benguang Zhao 69d451db26 enh: check trans conflict in mndCreateTopic ahead of time 2023-06-26 19:49:47 +08:00
Benguang Zhao 9e2062f54a fix: resolve memory leak on exceptions in mndCreateTopic 2023-06-26 19:49:47 +08:00
Haojun Liao 437eb93a4d fix(stream): fix error while fill history exists. 2023-06-26 18:44:59 +08:00
dapan1121 4dae9f4eff merge main to 3.0 2023-06-26 18:43:00 +08:00
Benguang Zhao 14e2e1e574 fix: change conflict scope of create topic to be DB inside 2023-06-26 18:23:19 +08:00
wangmm0220 0ae6cd7a89 fix:memory leak 2023-06-26 17:27:13 +08:00
Haojun Liao 01c0bbb3f8
Merge pull request #21827 from taosdata/feature/TS-3495
fear:fix error for report offset & rows in tmq
2023-06-26 16:54:42 +08:00
Haojun Liao daafe240ed fix(stream): fix memory leak. 2023-06-26 14:18:47 +08:00
Benguang Zhao e8649670aa enh: not allow to split vgroup when streams or topics exist 2023-06-26 11:57:24 +08:00
wangmm0220 7c9168f4b4 Merge branch 'mark/tmq' of https://github.com/taosdata/TDengine into mark/tmq 2023-06-26 11:42:52 +08:00
shenglian zhou 2f9c8417b6 fix: use appname to see whether it is udfd 2023-06-26 07:53:00 +08:00
Haojun Liao 000325f716 fix(stream): fix memory leak. 2023-06-25 19:30:21 +08:00
wangmm0220 7a49d67078 Merge branch '3.0' of https://github.com/taosdata/TDengine into feature/TS-3495 2023-06-25 14:54:16 +08:00
shenglian zhou fd754eaa08 fix: udfd can not connect to taosd since authentification failure 2023-06-25 11:31:33 +08:00
liuyao c950c7379d Merge branch 'refact/fillhistory' of https://github.com/taosdata/TDengine into refact/fillhistory 2023-06-25 10:58:43 +08:00
liuyao e9d3198e05 mem leak 2023-06-25 10:57:10 +08:00
Haojun Liao 6857881742 Merge branch '3.0' into refact/fillhistory 2023-06-25 10:41:32 +08:00
wade zhang 254a20bdf3
Merge pull request #21660 from luckeverda/feat/TD-23739
feat/TD-23739: enhance ttl, deletetime modified by writing-op
2023-06-25 09:06:57 +08:00
Haojun Liao ceb78fdad2
Merge branch '3.0' into refact/fillhistory 2023-06-24 18:53:48 +08:00
wade zhang e95b430e89
Merge pull request #21786 from taosdata/FIX/TD-24817-3.0
enh: make alter-hashrange atomic and idempotent
2023-06-21 13:29:04 +08:00
Shungang Li b93f653d7e feat: enhance ttl, deletetime modified by writing-ops
new config item: ttlChangeOnWrite (default 0)
ttl delete time changes on last write if true
2023-06-19 19:03:35 +08:00
liuyao 41c193945f fill history pause&resume 2023-06-19 17:28:19 +08:00
Benguang Zhao 20a55c3412 fix: make vmProcessAlterHashRangeReq idempotent 2023-06-19 15:09:00 +08:00
yihaoDeng 0eeaab9cd3 Merge branch 'refact/fillhistory1' into refact/fillhistory 2023-06-19 13:53:37 +08:00
wangmm0220 c5dfe169a6 fix:error 2023-06-16 19:33:03 +08:00
wangjiaming0909 bc2cc64873 fix: show queries returned less rows when one conn has more than 100 queries 2023-06-16 18:17:56 +08:00
Haojun Liao 64365666b7 fix(stream): update the info, and do some internal refactor. 2023-06-16 16:04:43 +08:00
wangmm0220 779e35b679 fix:drop consumer wher drop topic or group 2023-06-16 13:52:08 +08:00
Haojun Liao 933801269a fix(stream): fix memory leak and failed to close vnode. 2023-06-16 09:55:11 +08:00
yihaoDeng 9f9171719a support fill history 2023-06-15 21:29:52 +08:00
wangmm0220 38dc8e2107 Merge branch 'fix/TS-3540' of https://github.com/taosdata/TDengine into fix/TS-3540 2023-06-15 19:45:15 +08:00
wangmm0220 c243e470c9 fix:null pointer error if restore from file 2023-06-15 19:44:58 +08:00
wangmm0220 e019ed2cc3 fix:conflict 2023-06-15 18:50:44 +08:00
wangmm0220 5de4600739 fix:remove lost_reb status 2023-06-15 18:48:45 +08:00
Haojun Liao f3df37bf28 fix(stream): fix memory leak. 2023-06-15 17:56:58 +08:00
yihaoDeng a17a8cc192 fix:null pointer error 2023-06-15 16:35:53 +08:00
wangmm0220 a7a518aaed opti:tmq logic 2023-06-15 15:44:52 +08:00
Haojun Liao 74e0138f72 Merge branch '3.0' into refact/fillhistory 2023-06-15 15:25:00 +08:00
wangmm0220 22776e60d5 fix:control memory size if consumer group is too much 2023-06-15 14:51:04 +08:00
Haojun Liao 1b9eca5ce0 other: merge main. 2023-06-15 13:03:17 +08:00
Haojun Liao 55724157c4 refactor: remove one function. 2023-06-15 10:40:25 +08:00
dapan1121 0c2bfde7fe
Merge pull request #21706 from taosdata/szhou/version-not-compatible-log
enhance: version not compatible log
2023-06-15 09:05:47 +08:00
wangmm0220 864236a8dc fix:conflicts 2023-06-14 12:05:10 +08:00
wangmm0220 c28d7d9bf8 fix:open info log in tmq client & modify parametes in show consumers 2023-06-14 12:01:54 +08:00
Haojun Liao b44447e6f3 enh(stream): support restore from disk. 2023-06-14 10:19:03 +08:00
Haojun Liao 4fac83ecf2
Merge pull request #21709 from taosdata/feature/TD-24749
feat:control memory size if consumer group is too much
2023-06-14 10:15:20 +08:00
wangmm0220 827e84b1a5 fix:memory leak 2023-06-13 17:10:23 +08:00
dapan1121 f84eef0ac4
Merge branch '3.0' into feat/TD-24499 2023-06-13 15:27:18 +08:00
wangmm0220 d8d6b6dd21 Merge branch '3.0' of https://github.com/taosdata/TDengine into feature/TD-24749 2023-06-13 15:15:05 +08:00
wangmm0220 8a81278024 fix:load pHandle if necessary wher tq restore 2023-06-13 15:14:11 +08:00
Haojun Liao 933d08b489
Merge pull request #21690 from taosdata/feature/TS-3495
feat:add parameters for consumer & add offset rows for subscription
2023-06-13 14:59:15 +08:00
shenglian zhou 28e6c45021 enhance: version not compatible log 2023-06-13 14:41:42 +08:00
dapan1121 73d3c21e21 Merge remote-tracking branch 'origin/3.0' into feat/TD-24499 2023-06-13 11:44:41 +08:00
wangmm0220 fb123d8761 fix:conflict from 3.0 2023-06-13 09:47:08 +08:00
wangmm0220 fb59ec4591 feat:move plan msg from vginfo to subscription info 2023-06-13 09:32:54 +08:00
wangmm0220 a723fc37c3 fix:modify offset description to string 2023-06-12 17:18:06 +08:00
dapan1121 59b8cfbc7d enh: add sub_query in systable and kill subquery 2023-06-12 17:14:41 +08:00
wangmm0220 fe155898fe fix:modify offset description to string 2023-06-12 16:34:53 +08:00
wangmm0220 6657b8d849 fix:modify offset description to string 2023-06-12 09:44:00 +08:00
Benguang Zhao 3689b41f3a Merge branch '3.0' into FIX/TD-24182-3.0 2023-06-12 09:39:49 +08:00
slzhou 76d341682e fix: select * from information_schema.ins_columns can not complete 2023-06-09 20:55:17 +08:00
wangmm0220 aa610b27a4 feat:add parameters for consumer & add offset rows for subscription 2023-06-09 18:51:10 +08:00
Haojun Liao 69c9eda7af fix(stream): fix race condition. 2023-06-09 11:37:38 +08:00
Haojun Liao 53246ed6bb other: merge other branch. 2023-06-09 09:41:10 +08:00
wangmm0220 d7a4817124 feat:add parameters for consumer & add offset rows for subscription 2023-06-08 19:11:15 +08:00
wangmm0220 ac5862c321 feat:add parameters for consumer & add offset rows for subscription 2023-06-08 19:08:22 +08:00
wangmm0220 3f46a9bbc9 feat:add parameters for consumer & add offset rows for subscription 2023-06-08 18:14:02 +08:00
Haojun Liao 6c13491428 refactor: do some internal refactor. 2023-06-08 16:55:41 +08:00
Haojun Liao 06cf3588da refactor: do some internal refactor. 2023-06-07 15:03:04 +08:00
dmchen 169a2bd349 fix/TD-24644 2023-06-07 11:13:48 +08:00
Haojun Liao 6a3c935b4a fix(stream): fix error in fill history scan. 2023-06-07 09:15:55 +08:00
dapan1121 fe7ba9d92e
Merge pull request #21523 from taosdata/feat/TS-3134-3.0
feat: allow user to reset root passwd
2023-06-06 11:10:11 +08:00
dapan1121 dff35ac584
Merge pull request #21550 from wangjiaming0909/feature/3.0/TD-23974
feature: add user priv when create db, remove priv check with create_dbs
2023-06-06 11:06:18 +08:00
Haojun Liao 0dd933013c enh(stream): make history task for stream running. 2023-06-05 17:58:00 +08:00
Haojun Liao fcc706c45c enh(stream): refactor the fill history task. 2023-06-05 15:59:01 +08:00
Haojun Liao 077e1a1ed4 Merge branch '3.0' into refact/fillhistory 2023-06-05 11:41:13 +08:00
Benguang Zhao ae26f701ae fix: ignore TSDB_CODE_MND_TRANS_SYNC_TIMEOUT on updating trans 2023-06-02 18:49:15 +08:00
wangmm0220 b2f0d88639 fix:conflict 2023-06-02 15:43:35 +08:00
Haojun Liao d45aa7ef84
Merge pull request #21555 from taosdata/fix/liaohj_main
other: merge main into 3.0.
2023-06-02 13:11:12 +08:00
wangmm0220 56782a5d41 fix:open task case & modify mqRebVgReq encode/decode style 2023-06-01 18:29:16 +08:00
Benguang Zhao 2ef2715ee1 enh: add mndAddVgStatusAction and mndAddDbStatusAction 2023-06-01 17:58:27 +08:00
wangmm0220 bb772e2062 fix:make version compatible 2023-06-01 17:03:02 +08:00
wangmm0220 21920721f3 fix:make version compatible 2023-06-01 15:10:08 +08:00
Haojun Liao 5301c5756a other: merge main into 3.0. 2023-06-01 09:29:18 +08:00
wangjiaming0909 60100a0fb6 feature: add user priv when create db, remove priv check with create_dbs 2023-05-31 18:43:56 +08:00
Benguang Zhao 28efd7dcd7 enh: check trans conflicts in mndTransValidate 2023-05-31 10:53:36 +08:00
Benguang Zhao 4a6d81855b enh: add mndTransValidate for prepare actions 2023-05-30 18:50:00 +08:00
Haojun Liao eda06081ff enh(stream): refactor and serialize the attributes of history tasks. 2023-05-30 16:55:37 +08:00
Haojun Liao d9c364d663 Merge branch '3.0' into refact/fillhistory 2023-05-30 15:51:12 +08:00
Haojun Liao be8fd9e48b enh(stream): create additional task for history data processing. 2023-05-30 14:47:10 +08:00
Benguang Zhao 6679b8af7b fix: release action.pCont on error 2023-05-30 10:55:56 +08:00
wangmm0220 d490ca753f Merge branch '3.0' of https://github.com/taosdata/TDengine into feature/TD-19042 2023-05-30 09:48:49 +08:00
Haojun Liao 2977a4d07f refactor: do some internal refactor. 2023-05-30 09:41:19 +08:00
Haojun Liao bcba18d90e
Merge pull request #21521 from taosdata/refact/fillhistory
refactor: do some internal refactor.
2023-05-30 00:38:38 +08:00
kailixu 9501d4f417 feat: allow user to reset root passwd 2023-05-29 19:44:11 +08:00
Haojun Liao 3628888ecc refactor: do some internal refactor. 2023-05-29 18:02:45 +08:00
Haojun Liao cd2d225c93 refactor: do some internal refactor. 2023-05-29 17:50:39 +08:00
dmchen 23983e506f fix test case 2023-05-29 16:12:26 +08:00
Haojun Liao f2887278e2 refactor: do some internal refactor. 2023-05-29 15:44:45 +08:00
wangmm0220 78db3520a6 fix:conflict 2023-05-29 14:57:03 +08:00
Benguang Zhao 3c698b2461 enh: add mndAddPrepareNewVgAction 2023-05-29 14:13:11 +08:00
Benguang Zhao 873ad8839b enh: add prepareActions in STrans 2023-05-29 14:13:11 +08:00
tangfangzhi e21a2f9cce check empty 2023-05-29 14:02:36 +08:00
wangmm0220 a71878d07f feat: support create topic as stable with conditions 2023-05-29 11:46:59 +08:00
dmchen 24937c3d5b check empty dnode 2023-05-26 19:01:13 +08:00
dmchen fcf2b58aad check offline when force 2023-05-26 12:48:37 +08:00
wade zhang 57b999233d
Merge pull request #21483 from taosdata/fix/prompt-message-when-2-mnode
prompt message when 2 mnode
2023-05-26 09:35:03 +08:00
Haojun Liao cea8334427
Merge pull request #21449 from taosdata/refact/fillhistory
refactor: remove the module dependency.  TD-24279
2023-05-26 09:01:45 +08:00
dmchen efa1570b6e prompt message when 2 mnode 2023-05-25 20:10:40 +08:00
Benguang Zhao f8841046bc enh: refactor func name of mndTransPerformFinishStage 2023-05-25 15:44:26 +08:00
Benguang Zhao 30104f300c enh: refactor func names of mndTransPerformFinishedStage and mndTrancCheckConflict 2023-05-25 15:44:26 +08:00
Haojun Liao 4a42f6b983 fix: fix error in api call. 2023-05-25 00:50:03 +08:00
wangmm0220 8537e4e80e feat:add tag filter for stable subscribe 2023-05-24 18:26:55 +08:00
Dingle Zhang 984211f3b4
Feature/3.0 geometry (#21037)
* Add GEOMETRY data type and make sql.c able to parse it. The GEMETRY works like BINARY so far.

* add GEOMETRY type into gConvertTypes to fix some issues like DELETE calling

* change some test cases to make sure no same timestamp is inserted, and add my smoketest.sh

* Add a function MakePoint() and introduce a lib geometry

* implement sql functions GeomFromText() and AsText()

* Use GEOS *_r funcions instead for thread safety

* Handle with TSDB_DATA_TYPE_GEOMETRY when INSERT geometry data by converting WKT.
Add geosWrapper to wrap the basic GEOS functions for TDEngine.

* refactor AsText and MakePoint functions to be like GeomFromText

* Show WKT when print geometry data in screen
Dump hex data when dump geometry data in a file

* define TYPE_BYTES item for TSDB_DATA_TYPE_GEOMETRY, which casued some strange issues.

* set number of decimals of WKT to 6

* Implement SQL function Intersects()

* refactor geometry sql functions

* Add geosErrMsgeHandler() to get the GEOS error detail

* use threadlocal to instantiate SGeosContext
call destroyGeosContext() only if the thread exists

* remove SGeosContext *context param for all geometry functions since we use thread local one,
so that all caller do not need to know the context.

* Modify Intersects() to call PreparedIntersects() when one of param is a constant, which has higher performance.

* rename prepareFn() to initCtxFn() to avoid confusion with PreparedFn

* Add prefix "ST_" for all geometry functions

* move getThreadLocalGeosCtx() and destroyThreadLocalGeosCtx() into util,
so that all unit test tools can compile

* Add unit test for geometry lib, only test MakePoint so far

* refactor and enhance existing cases in geomFuncTest

* implement NULL type and NULL value test for geomFuncTest

* add test on geomFromText()

* add unit test on AsText() in geomFuncTest

* combine some makePointFunction test items

* add intersectsFunctionTwoColumns test
refactor on callGeomFromTextWrapper functions

* enhance intersectsFunction test to add cases like input constant , NULL type, NULL value, or wrong content

* add more cases into intersectsFunction test

* Add basic test on geometry in system test

* Add ST_GeomFromText and ST_AsText function test in system test on geometry

* add ST_Intersects function test in system test on geometry

* support to check expectedErrno in system test on geometry

* adjust geomTest unit test and geometry system test

* add geometry data type and functions in doc english version

* implement touchesFunction() in geometry lib
refactor geometry relation functions model

* separate gemFuncTest into several src files

* add unit test on touchesFunction

* support sql function ST_Touches()
add system test on ST_Touches

* add docs for ST_Touches()

* Add ST_Contains()

* Add ST_Covers()

* Add ST_Equals()

* add swapAllowed param for geomRelationFunction()
read geom2 earlier intead of at doGeosRelation()

* Add ST_ContainsProperly()

* build on windows

* Merge from 3.0 to 3.0_geometry

* change macro definition TSDB_DATA_TYPE_GEOMETRY as the last one for compatibility

* change '\\NULL' to 'NULL' back in shellDumpFieldToFile()

* add /usr/local/include into include directory

* add /usr/local/inlcude and /usr/local/lib in cmake.platform for DARWIN
2023-05-24 15:36:46 +08:00
Haojun Liao 99f669434a
Merge pull request #21282 from taosdata/feature/TD-23117
feat:[TD-23117] add schema for ins_topics
2023-05-24 14:54:42 +08:00
dmchen ab3d54aae3 comfirm msg when add learner 2023-05-24 11:08:41 +08:00
kailixu 34cf6aad30 fix: alter dnode option has no effect 2023-05-23 18:29:53 +08:00
dapan1121 6e5ec3d097
Merge pull request #21358 from taosdata/feat/TD-23362-3.0
feat: support update active code by SQL
2023-05-20 14:09:20 +08:00
dapan1121 42c65898ea
Merge pull request #21335 from taosdata/feat/TD-22746
feat: support client meta control
2023-05-19 16:55:08 +08:00
dapan1121 6e6853413c fix: db cfg memory issue 2023-05-19 16:48:05 +08:00
kailixu 8fd4b27c43 chore: code optimization 2023-05-19 16:10:44 +08:00
kailixu 301f7f7a41 Merge branch 'feat/TD-23362-3.0' of https://github.com/taosdata/TDengine into feat/TD-23362-3.0 2023-05-19 16:06:36 +08:00
kailixu 8571e6f6c5 chore: code optimization 2023-05-19 16:06:20 +08:00
kailixu de93895859 chore: code optimization 2023-05-19 09:25:26 +08:00
wade zhang 1ade314043
Merge pull request #21325 from taosdata/feat/force-drop-dnode
Feat/force drop dnode
2023-05-19 09:23:54 +08:00
kailixu c770a5c306 chore: code optimization 2023-05-19 06:59:28 +08:00
kailixu e3f194ed9b chore: code optimization 2023-05-18 19:13:04 +08:00
kailixu 1de90208f7 test: test case for alter dnode active code 2023-05-18 18:02:48 +08:00
liuyao da3fc5111e fix pause agg task 2023-05-18 15:29:41 +08:00
kailixu 0e891c5c14 chore: more code 2023-05-18 13:30:45 +08:00
kailixu ab06dd04f4 feat: support update active code in sdb 2023-05-18 13:01:28 +08:00
kailixu 5098d44068 feat: support update active code in sdb 2023-05-18 12:59:44 +08:00
dapan1121 f5ebc17fae
Merge branch '3.0' into feat/TD-22746 2023-05-18 09:10:49 +08:00
dmchen 32c6ef4b6e fix ci 2023-05-17 23:09:16 +08:00
kailixu cf0d3ddde3 feat: support update active code by SQL 2023-05-17 20:27:12 +08:00
dmchen c7911c6640 fix ci 2023-05-17 18:33:35 +08:00