Commit Graph

2996 Commits

Author SHA1 Message Date
Benguang Zhao 4a6d81855b enh: add mndTransValidate for prepare actions 2023-05-30 18:50:00 +08:00
Haojun Liao eda06081ff enh(stream): refactor and serialize the attributes of history tasks. 2023-05-30 16:55:37 +08:00
kailixu 9501d4f417 feat: allow user to reset root passwd 2023-05-29 19:44:11 +08:00
wangmm0220 78db3520a6 fix:conflict 2023-05-29 14:57:03 +08:00
wangmm0220 a71878d07f feat: support create topic as stable with conditions 2023-05-29 11:46:59 +08:00
dapan1121 e2d45438cb
Merge pull request #21405 from taosdata/szhou/scl-flt
enhance: scalar filter improvement
2023-05-28 18:49:39 +08:00
slzhou b83bf9163e fix: restore scalar mode computation and add filterScalarMode config variable and add test case 2023-05-26 14:46:32 +08:00
Haojun Liao cea8334427
Merge pull request #21449 from taosdata/refact/fillhistory
refactor: remove the module dependency.  TD-24279
2023-05-26 09:01:45 +08:00
dapan1121 2713f4f6d4 feat: support create topic as stable with conditions 2023-05-25 19:01:58 +08:00
wangmm0220 357e86b994 feat:add tag filter for stable subscribe 2023-05-24 18:59:47 +08:00
wangmm0220 8537e4e80e feat:add tag filter for stable subscribe 2023-05-24 18:26:55 +08:00
Dingle Zhang 984211f3b4
Feature/3.0 geometry (#21037)
* Add GEOMETRY data type and make sql.c able to parse it. The GEMETRY works like BINARY so far.

* add GEOMETRY type into gConvertTypes to fix some issues like DELETE calling

* change some test cases to make sure no same timestamp is inserted, and add my smoketest.sh

* Add a function MakePoint() and introduce a lib geometry

* implement sql functions GeomFromText() and AsText()

* Use GEOS *_r funcions instead for thread safety

* Handle with TSDB_DATA_TYPE_GEOMETRY when INSERT geometry data by converting WKT.
Add geosWrapper to wrap the basic GEOS functions for TDEngine.

* refactor AsText and MakePoint functions to be like GeomFromText

* Show WKT when print geometry data in screen
Dump hex data when dump geometry data in a file

* define TYPE_BYTES item for TSDB_DATA_TYPE_GEOMETRY, which casued some strange issues.

* set number of decimals of WKT to 6

* Implement SQL function Intersects()

* refactor geometry sql functions

* Add geosErrMsgeHandler() to get the GEOS error detail

* use threadlocal to instantiate SGeosContext
call destroyGeosContext() only if the thread exists

* remove SGeosContext *context param for all geometry functions since we use thread local one,
so that all caller do not need to know the context.

* Modify Intersects() to call PreparedIntersects() when one of param is a constant, which has higher performance.

* rename prepareFn() to initCtxFn() to avoid confusion with PreparedFn

* Add prefix "ST_" for all geometry functions

* move getThreadLocalGeosCtx() and destroyThreadLocalGeosCtx() into util,
so that all unit test tools can compile

* Add unit test for geometry lib, only test MakePoint so far

* refactor and enhance existing cases in geomFuncTest

* implement NULL type and NULL value test for geomFuncTest

* add test on geomFromText()

* add unit test on AsText() in geomFuncTest

* combine some makePointFunction test items

* add intersectsFunctionTwoColumns test
refactor on callGeomFromTextWrapper functions

* enhance intersectsFunction test to add cases like input constant , NULL type, NULL value, or wrong content

* add more cases into intersectsFunction test

* Add basic test on geometry in system test

* Add ST_GeomFromText and ST_AsText function test in system test on geometry

* add ST_Intersects function test in system test on geometry

* support to check expectedErrno in system test on geometry

* adjust geomTest unit test and geometry system test

* add geometry data type and functions in doc english version

* implement touchesFunction() in geometry lib
refactor geometry relation functions model

* separate gemFuncTest into several src files

* add unit test on touchesFunction

* support sql function ST_Touches()
add system test on ST_Touches

* add docs for ST_Touches()

* Add ST_Contains()

* Add ST_Covers()

* Add ST_Equals()

* add swapAllowed param for geomRelationFunction()
read geom2 earlier intead of at doGeosRelation()

* Add ST_ContainsProperly()

* build on windows

* Merge from 3.0 to 3.0_geometry

* change macro definition TSDB_DATA_TYPE_GEOMETRY as the last one for compatibility

* change '\\NULL' to 'NULL' back in shellDumpFieldToFile()

* add /usr/local/include into include directory

* add /usr/local/inlcude and /usr/local/lib in cmake.platform for DARWIN
2023-05-24 15:36:46 +08:00
dapan1121 5bedf6b19a enh: support config batch rows number when import data from csv file 2023-05-23 19:21:52 +08:00
Haojun Liao e67b532d8a refactor: refactor the module dependency. 2023-05-23 18:29:23 +08:00
Ganlin Zhao 709b59a3a6 fix: fix assert crash in tsort.c 2023-05-19 17:27:15 +08:00
dapan1121 42c65898ea
Merge pull request #21335 from taosdata/feat/TD-22746
feat: support client meta control
2023-05-19 16:55:08 +08:00
wade zhang 1ade314043
Merge pull request #21325 from taosdata/feat/force-drop-dnode
Feat/force drop dnode
2023-05-19 09:23:54 +08:00
Haojun Liao 1e020a46c9 other: merge main. 2023-05-19 09:07:35 +08:00
Haojun Liao d4b0e102af fix:do some internal refactor. 2023-05-19 08:55:59 +08:00
Haojun Liao c4c5bbb65c other: merge 3.0 2023-05-18 17:28:40 +08:00
yihaoDeng 9380b22394 merge 3.0 2023-05-18 05:46:38 +00:00
Haojun Liao 81f821a6fc refactor: do some internal refactor. 2023-05-18 10:51:43 +08:00
dapan1121 f5ebc17fae
Merge branch '3.0' into feat/TD-22746 2023-05-18 09:10:49 +08:00
Haojun Liao 041ffa91bd other: merge main. 2023-05-17 15:42:15 +08:00
dapan1121 ee2521a6ab Merge remote-tracking branch 'origin/3.0' into feat/TD-22746 2023-05-16 10:53:21 +08:00
dapan1121 cf7b4593e7 feat: add drop dnode unsafe command 2023-05-16 09:50:10 +08:00
liuyao 502efb3d01 op stream selectivity buff 2023-05-15 16:26:24 +08:00
Haojun Liao b98a465304 fix: fix syntax error. 2023-05-13 20:47:38 +08:00
Haojun Liao 170c603995 other: merge 3.0 2023-05-13 20:16:55 +08:00
Haojun Liao 99148d6719 other: merge 3.0 2023-05-13 20:02:48 +08:00
dapan1121 69795286fa Merge remote-tracking branch 'origin/main' into enh/tsbsPerf.4 2023-05-12 13:46:16 +08:00
Haojun Liao 7ef16e1922 other: merge main. 2023-05-12 11:49:53 +08:00
dapan1121 eda4c85dbb
Merge pull request #21253 from taosdata/feat/TD-23643-3.0
feat: support connectors licensing
2023-05-11 18:19:04 +08:00
kailixu f444b7ac6a chore: more code 2023-05-11 13:03:21 +08:00
kailixu aacdd8446d chore: more code 2023-05-11 11:45:38 +08:00
kailixu bd00a4f217 chore:more code 2023-05-11 11:32:39 +08:00
kailixu fd107f2c26 chore: more code 2023-05-11 00:16:41 +08:00
dapan1121 daedb3618b Merge remote-tracking branch 'origin/3.0' into feat/TD-22746 2023-05-10 17:47:11 +08:00
dapan1121 79d4403377 feat: add client meta limitation 2023-05-10 17:44:53 +08:00
yihaoDeng 5708fcb5cb Merge branch 'enh/3.0' into enh/rocksdbSstateMerge 2023-05-10 08:02:16 +00:00
dapan1121 6c7d4ec898 Merge branch 'feat/restore-dnode' of github.com:taosdata/TDengine into feat/restore-dnode 2023-05-09 19:19:42 +08:00
dapan1121 a8c65cd25a feat: support restore dnode clause 2023-05-09 19:19:14 +08:00
dmchen 542e1567f3 message type 2023-05-09 19:17:19 +08:00
kailixu 665681947f chore: more code 2023-05-09 19:02:09 +08:00
cadem 843d606058 feat/restore dnode 2023-05-09 17:15:37 +08:00
dapan1121 52fd6a84ac enh: support db cfg cache update 2023-05-09 17:04:20 +08:00
kailixu e4882765ae Merge branch '3.0' into feat/TD-23643-3.0 2023-05-08 16:28:20 +08:00
kailixu 2be6ff4630 chore: more code 2023-05-06 20:38:50 +08:00
yihaoDeng 08c3a63341 Merge branch 'enh/standVer' into enh/rocksdbSstateMerge 2023-05-06 12:37:54 +00:00
Haojun Liao da6212bab0 other: merge main. 2023-05-06 12:51:38 +08:00
Benguang Zhao 5d63f438b5 enh: confirm alter hash range 2023-05-04 19:43:11 +08:00
Haojun Liao 09a04052ec refactor: do some internal refactor. 2023-05-04 16:15:14 +08:00
liuyao 2984c5a758 merge main 2023-04-28 10:34:46 +08:00
kailixu f075652e18 chore: update grantsSchema to support connectors 2023-04-27 20:10:03 +08:00
Haojun Liao e1bd65ec0a
Merge pull request #21105 from taosdata/fix/liaohj_main
fix(query): check the init status for pReader->status.merger  TD-23903
2023-04-27 12:40:13 +08:00
Haojun Liao db1d75bb48 refactor: do some internal refactor. 2023-04-27 09:28:20 +08:00
dapan1121 51a1e07dbf
Merge pull request #21029 from taosdata/fix/TD-23797
fix: fix crash caused by deleting from system table
2023-04-26 17:48:58 +08:00
Xiaoyu Wang 05dc0fd6b1
Merge pull request #21056 from taosdata/feat/TD-23693
feat: subtable level privilege
2023-04-26 09:17:23 +08:00
54liuyao 255af84139 resume option 2023-04-25 19:01:19 +08:00
dapan1121 f22d279f5f
Merge pull request #21057 from taosdata/feat/TD-19567
feat: support log slow query by default
2023-04-25 13:43:34 +08:00
dapan1121 b743b889fc
Merge pull request #20828 from taosdata/enh/TD-23421-M
enh: support user passwd version
2023-04-24 17:16:37 +08:00
Ganlin Zhao 782566ad08 refactor 2023-04-24 17:15:46 +08:00
liuyao eca7b68fa0 ignore update 2023-04-24 15:01:56 +08:00
Xiaoyu Wang dc5235eb92 feat: add pause/resume stream statement 2023-04-24 14:48:33 +08:00
Haojun Liao 057cc2d30d
Merge pull request #21018 from taosdata/feature/3_liaohj
fix(stream): set the correct start offset for stream task.
2023-04-24 12:02:20 +08:00
Xiaoyu Wang 4bb7a25fc7 feat: subtable level privilege 2023-04-23 16:30:28 +08:00
dapan1121 5fe99c5ad2 feat: support log long query 2023-04-23 15:54:15 +08:00
54liuyao 5089528a02 feat:stream pause&resume 2023-04-23 15:08:51 +08:00
Haojun Liao 9cf89c6b6f enh(tmq): add check for consumer Id; 2023-04-23 11:51:43 +08:00
Ganlin Zhao c5b3737702 fix: forbid delete from system table 2023-04-23 11:21:01 +08:00
Xiaoyu Wang aba9a236c0 compiled sql.y 2023-04-23 11:20:34 +08:00
yihaoDeng 917b07348c Merge branch 'fix/rocksdbState' into enh/rocksRevert 2023-04-23 02:37:26 +00:00
Haojun Liao 3dbe208712 enh(tmq): fix memory error and add retrieve wal info as required. 2023-04-22 15:34:46 +08:00
dapan1121 f4d1ac4e93
Merge pull request #21007 from taosdata/feat/TS-3249
feat: support table_prefix/table_suffix new mode
2023-04-21 19:18:28 +08:00
Haojun Liao 3f432cca2e
Merge pull request #20970 from taosdata/fix/TS-3116
opti:escape logic in schemaless
2023-04-21 18:44:06 +08:00
chenhaoran 7d7a0769b3 Merge remote-tracking branch 'origin/main' into enh/tsbsPerf.1 2023-04-21 16:20:37 +08:00
kailixu 9e71b6d071 Merge branch '3.0' into enh/TD-23421-M 2023-04-21 16:04:13 +08:00
dapan1121 3c2fc48e74 feat: support new table_prefix/table_suffix mode 2023-04-21 14:17:07 +08:00
dm chen d594e4963f
Merge branch '3.0' into feat/learner 2023-04-20 19:11:06 +08:00
wangmm0220 5df7906a62 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/rocksRevert 2023-04-20 18:33:37 +08:00
Benguang Zhao a21e0fe75e enh: propose vnode commit synchronously 2023-04-20 14:28:56 +08:00
Haojun Liao c654f1145d enh(stream): add new msg for seek, and do some internal refactor. 2023-04-20 10:59:16 +08:00
Haojun Liao a69e2a8045 fix(os): fix the link error in unit test cases. 2023-04-19 15:33:02 +08:00
wangmm0220 5b3087e48b opti:escape logic in schemaless 2023-04-19 00:55:26 +08:00
cadem 3b78d4382b add learner 2023-04-18 19:03:45 +08:00
wangmm0220 1771a54256 fix:rebalance not only one in once timer 2023-04-17 19:59:11 +08:00
Haojun Liao 04e042f21d Merge branch 'feature/3_liaohj' into enh/rocksRevert 2023-04-15 09:35:43 +08:00
Haojun Liao 5850a3ab01 Merge remote-tracking branch 'origin/enh/rocksRevert' into enh/rocksRevert 2023-04-14 10:37:17 +08:00
Haojun Liao b57c813681 other: merge feature/3_liaohj 2023-04-14 10:36:54 +08:00
Haojun Liao 9597453631
Merge pull request #20925 from taosdata/fix/TS-3106-MAIN
add option enableScience on taos.cfg to show float and double scientific notation
2023-04-14 10:28:00 +08:00
Alex Duan a0be0c1d06 fix: add client option tsEnableScience 2023-04-13 16:40:38 +08:00
dapan1121 7f518ca4ea feat: support cache db cfg 2023-04-13 10:54:57 +08:00
kailixu ac841b02bf merge 3.0 2023-04-12 13:09:52 +08:00
liuyao 6a98d55c2f add ci test 2023-04-12 11:04:57 +08:00
Xiaoyu Wang 9578c4538a Merge remote-tracking branch 'origin/3.0' into fix/3.0_merge_main 2023-04-11 19:33:23 +08:00
yihaoDeng b24b91886a Merge branch 'dev3' into enh/rocksRevert 2023-04-11 10:59:00 +00:00
Xiaoyu Wang 5ce6220106
Merge pull request #20781 from taosdata/szhou/replace-function
feature: udf replace function
2023-04-11 17:25:21 +08:00
Xiaoyu Wang 4c04b155d5 merge main 2023-04-11 15:56:28 +08:00
dapan1121 28ea375fe1
Merge pull request #20850 from taosdata/enh/ts-3112
enh: add queryMaxConcurrentTables configuration
2023-04-11 11:21:30 +08:00
Xiaoyu Wang 416af9a58d feat: table level privilege 2023-04-11 10:11:25 +08:00
dapan1121 d2f9f2d755 Merge remote-tracking branch 'origin/main' into enh/ts-3112 2023-04-11 09:02:36 +08:00
dapan1121 38231fc48e enh: add queryMaxConcurrentTables configuration 2023-04-11 09:01:19 +08:00
kailixu 76386b9fad enh: assign passVer during taos_connect 2023-04-10 13:07:18 +08:00
Xiaoyu Wang e2f82f4423 merge main 2023-04-10 09:56:03 +08:00
kailixu e689356c65 chore: more code 2023-04-09 19:01:51 +08:00
kailixu ec8cd0c6b8 enh: support passwd version 2023-04-09 18:44:46 +08:00
shenglian zhou 32523d72f9 fix: add created time to file name and keep file reuse 2023-04-08 10:11:57 +08:00
liuyao 0716a4aee8 feat:add check point 2023-04-06 16:45:22 +08:00
Xiaoyu Wang 54f13f6f55
Merge pull request #20756 from taosdata/fix/3.0_merge_main
merge main
2023-04-06 15:44:23 +08:00
shenglian-zhou 3d8776e266
Merge branch '3.0' into szhou/replace-function 2023-04-06 13:40:52 +08:00
Xiaoyu Wang a971d1a997
Merge pull request #20770 from taosdata/enh/3.0_planner_optimize
feat: add 'or replace' clause to 'create function' statement
2023-04-06 13:09:56 +08:00
Haojun Liao 2b2059ef18
Merge pull request #20534 from taosdata/fix/TD-22671
fix:error in TD-23218 & remove useless logic
2023-04-06 11:47:24 +08:00
shenglian zhou 47719b1028 Merge branch '2.0' of github.com:taosdata/TDengine into szhou/replace-function 2023-04-06 11:19:10 +08:00
Xiaoyu Wang c134432c45 merge main 2023-04-06 09:31:45 +08:00
Xiaoyu Wang 9b2a94f281 fix: column comment is not supported 2023-04-04 18:04:10 +08:00
Xiaoyu Wang cc7485812a feat: add 'or replace' clause to 'create function' statement 2023-04-04 17:45:18 +08:00
Xiaoyu Wang 6825b196ef feat: table level write privilege check 2023-04-04 17:19:18 +08:00
54liuyao 1892b806b5 feat:add stream state buff 2023-04-04 17:09:35 +08:00
54liuyao 429b5cd646 feat:add stream file state 2023-04-04 17:09:35 +08:00
Xiaoyu Wang e9d7a099cc merge main 2023-04-04 14:50:58 +08:00
Ganlin Zhao 23ec9287c9 fix: fix tsim crash on windows due to invalid input to strftime 2023-04-04 10:33:41 +08:00
wangmm0220 97b5c7abee fix:merge from main 2023-03-31 16:20:21 +08:00
cademfly 3ae4996458 remove all handle 2023-03-30 16:17:51 +08:00
shenglian zhou 23d4eef114 feat: startup of replace function when no active query 2023-03-30 11:46:40 +08:00
Xiaoyu Wang 6265251a03 feat: table level privilege syntax 2023-03-29 19:08:40 +08:00
wangmm0220 2243184a4d fix:conflicts 2023-03-29 17:53:05 +08:00
dapan1121 9952be43f6 Merge remote-tracking branch 'origin/main' into fix/cencVer 2023-03-29 15:50:14 +08:00
cademfly 2fd10c2aa0 table 2023-03-29 13:30:32 +08:00
dapan1121 0659814d16
Merge pull request #20674 from taosdata/fix/TS-3010
fix: query schema is old issue
2023-03-29 11:41:07 +08:00
dapan1121 0327a8eaa3 fix: block rows number type 2023-03-29 10:46:56 +08:00
cademfly 28584839ea change msg number 2023-03-28 20:19:01 +08:00
cademfly 4d04f0f44d add stb msg 2023-03-28 20:14:50 +08:00
Xiaoyu Wang daaf4871ac feat: table level privilege syntax 2023-03-28 18:43:58 +08:00
Benguang Zhao ae8d87643f Merge branch 'main' into FIX/TD-22975-main 2023-03-28 18:00:51 +08:00
dapan1121 22ad3129b9 fix: query schema is old issue 2023-03-28 15:21:47 +08:00
cadem 57d7ee29f3 fix/change msg order 2023-03-24 09:17:46 +08:00
cadem 86ca5ce210 fix/trigger election by sync msg 2023-03-24 09:13:20 +08:00
dapan1121 7f50b463bb
Merge pull request #20599 from taosdata/fix/mainT3.0
fix: merge main to 3.0
2023-03-23 16:17:01 +08:00
Xiaoyu Wang a5d8549cb1
Merge pull request #20593 from taosdata/FEAT/TD-23258-3.0
feat: support WAL_RETENTION_PERIOD and WAL_RETENTION_SIZE for alter database
2023-03-23 11:43:01 +08:00
wangmm0220 dd4cf0597b fix:error in optimize consume logic 2023-03-22 17:04:02 +08:00
dapan1121 5b02af6a91 fix: merge main to 3.0 2023-03-22 16:08:16 +08:00
Xiaoyu Wang eb79046a70 merge 3.0 2023-03-22 11:42:02 +08:00
Benguang Zhao 0b101e4952 feat: support WAL_RETENTION_PERIOD and WAL_RETENTION_SIZE for alter database 2023-03-22 11:40:24 +08:00
Xiaoyu Wang fbc9b2404e feat: add sql command 'balance vgroup leader' 2023-03-22 09:53:56 +08:00
cadem ea35f0ae11 feat/balance vgroup leader 2023-03-22 09:36:59 +08:00
Xiaoyu Wang 58ebd3539d feat: alter database wal_retention_period/wal_retention_size 2023-03-21 16:45:19 +08:00
wangmm0220 a5144f0ba2 fix:set offset if read wal none 2023-03-20 10:10:07 +08:00
wangmm0220 55fb48b699 fix:error in TD-23218 & remove useless logic 2023-03-18 18:48:50 +08:00
wangmm0220 ccba1d07c6 fix:error in TD-23218 & remove useless logic 2023-03-18 18:42:49 +08:00
wangmm0220 7616a283e3 fix:error in TD-23218 & remove useless logic 2023-03-18 18:23:38 +08:00