Commit Graph

9774 Commits

Author SHA1 Message Date
Hongze Cheng 4d526ed0cd change more 2023-05-24 18:59:09 +08:00
Dingle Zhang 984211f3b4
Feature/3.0 geometry (#21037)
* Add GEOMETRY data type and make sql.c able to parse it. The GEMETRY works like BINARY so far.

* add GEOMETRY type into gConvertTypes to fix some issues like DELETE calling

* change some test cases to make sure no same timestamp is inserted, and add my smoketest.sh

* Add a function MakePoint() and introduce a lib geometry

* implement sql functions GeomFromText() and AsText()

* Use GEOS *_r funcions instead for thread safety

* Handle with TSDB_DATA_TYPE_GEOMETRY when INSERT geometry data by converting WKT.
Add geosWrapper to wrap the basic GEOS functions for TDEngine.

* refactor AsText and MakePoint functions to be like GeomFromText

* Show WKT when print geometry data in screen
Dump hex data when dump geometry data in a file

* define TYPE_BYTES item for TSDB_DATA_TYPE_GEOMETRY, which casued some strange issues.

* set number of decimals of WKT to 6

* Implement SQL function Intersects()

* refactor geometry sql functions

* Add geosErrMsgeHandler() to get the GEOS error detail

* use threadlocal to instantiate SGeosContext
call destroyGeosContext() only if the thread exists

* remove SGeosContext *context param for all geometry functions since we use thread local one,
so that all caller do not need to know the context.

* Modify Intersects() to call PreparedIntersects() when one of param is a constant, which has higher performance.

* rename prepareFn() to initCtxFn() to avoid confusion with PreparedFn

* Add prefix "ST_" for all geometry functions

* move getThreadLocalGeosCtx() and destroyThreadLocalGeosCtx() into util,
so that all unit test tools can compile

* Add unit test for geometry lib, only test MakePoint so far

* refactor and enhance existing cases in geomFuncTest

* implement NULL type and NULL value test for geomFuncTest

* add test on geomFromText()

* add unit test on AsText() in geomFuncTest

* combine some makePointFunction test items

* add intersectsFunctionTwoColumns test
refactor on callGeomFromTextWrapper functions

* enhance intersectsFunction test to add cases like input constant , NULL type, NULL value, or wrong content

* add more cases into intersectsFunction test

* Add basic test on geometry in system test

* Add ST_GeomFromText and ST_AsText function test in system test on geometry

* add ST_Intersects function test in system test on geometry

* support to check expectedErrno in system test on geometry

* adjust geomTest unit test and geometry system test

* add geometry data type and functions in doc english version

* implement touchesFunction() in geometry lib
refactor geometry relation functions model

* separate gemFuncTest into several src files

* add unit test on touchesFunction

* support sql function ST_Touches()
add system test on ST_Touches

* add docs for ST_Touches()

* Add ST_Contains()

* Add ST_Covers()

* Add ST_Equals()

* add swapAllowed param for geomRelationFunction()
read geom2 earlier intead of at doGeosRelation()

* Add ST_ContainsProperly()

* build on windows

* Merge from 3.0 to 3.0_geometry

* change macro definition TSDB_DATA_TYPE_GEOMETRY as the last one for compatibility

* change '\\NULL' to 'NULL' back in shellDumpFieldToFile()

* add /usr/local/include into include directory

* add /usr/local/inlcude and /usr/local/lib in cmake.platform for DARWIN
2023-05-24 15:36:46 +08:00
Haojun Liao 99f669434a
Merge pull request #21282 from taosdata/feature/TD-23117
feat:[TD-23117] add schema for ins_topics
2023-05-24 14:54:42 +08:00
dapan1121 cbbbaca553
Merge pull request #21437 from taosdata/fix/TD-23955-3.0
fix: delete index filter for desc query
2023-05-24 14:05:07 +08:00
wade zhang 398bf8f322
Merge pull request #21446 from taosdata/fix/confirm-msg-when-add-learner
comfirm msg when add learner
2023-05-24 13:54:15 +08:00
kailixu ef899a0cc3 fix: delete index filter for desc query 2023-05-24 11:28:45 +08:00
dmchen ab3d54aae3 comfirm msg when add learner 2023-05-24 11:08:41 +08:00
liuyao 180abf2229 set agg task status 2023-05-24 09:34:40 +08:00
liuyao b5d01f9bab set agg pause status 2023-05-24 09:19:28 +08:00
kailixu 82b8c3c3d1 fix: delete index filter for desc query 2023-05-23 18:21:21 +08:00
kailixu 18e83173c8 fix: delete index filter for desc query 2023-05-23 17:21:45 +08:00
wade zhang 68a98d4d09
Merge pull request #21429 from taosdata/fix/TD-24306
fix(cache): sychronize commit, read and write threads with writebatch
2023-05-23 16:20:59 +08:00
Minglei Jin 6d620a7d7c fix(cache/read): set none to null instead of skipping column 2023-05-23 14:51:26 +08:00
Minglei Jin 81048f93b0 fix(cache): sychronize commit, read and write threads with writebatch 2023-05-23 13:44:33 +08:00
kailixu a171c0c860 Merge branch '3.0' into fix/TD-21457-3.0 2023-05-23 09:27:31 +08:00
wade zhang 9e73a69316
Merge pull request #21389 from taosdata/fix/TD-24306
fix(cache/commit): skip batch write if empty
2023-05-23 08:22:33 +08:00
kailixu a3bf49d22f chore: revert 2023-05-22 20:35:52 +08:00
kailixu c75aa54a3d fix: tsdb read and append _wstart for tsma 2023-05-22 20:33:29 +08:00
Minglei Jin 75ccd024a2 cache/writebatch: separate read & write batches 2023-05-22 18:06:58 +08:00
dapan1121 08ff4f4540 fix: crash issue 2023-05-22 17:06:01 +08:00
kailixu f18fc19d76 fix: tsdb read and tsma _wstart append 2023-05-22 16:13:50 +08:00
Minglei Jin 21adc23af4 cache/loading: skip partial loading tables 2023-05-22 15:21:19 +08:00
Haojun Liao 9423001fea
Merge pull request #21396 from taosdata/refact/fillhistory
Refact/fillhistory
2023-05-21 01:12:00 +08:00
Haojun Liao dcb91082f9 fix(stream): fix error. 2023-05-20 23:37:40 +08:00
Haojun Liao 899e4d3350 refactor: do some internal refactor. 2023-05-20 18:13:58 +08:00
Haojun Liao de44c9160c refactor: do some internal refactor. 2023-05-20 18:05:39 +08:00
dapan1121 6e5ec3d097
Merge pull request #21358 from taosdata/feat/TD-23362-3.0
feat: support update active code by SQL
2023-05-20 14:09:20 +08:00
Haojun Liao e2ec8d738c other: add some logs. 2023-05-19 18:08:01 +08:00
Minglei Jin a5c1b9a054 cache/commit: skip batch write if empty 2023-05-19 17:10:24 +08:00
dapan1121 42c65898ea
Merge pull request #21335 from taosdata/feat/TD-22746
feat: support client meta control
2023-05-19 16:55:08 +08:00
kailixu 8fd4b27c43 chore: code optimization 2023-05-19 16:10:44 +08:00
kailixu 301f7f7a41 Merge branch 'feat/TD-23362-3.0' of https://github.com/taosdata/TDengine into feat/TD-23362-3.0 2023-05-19 16:06:36 +08:00
kailixu 8571e6f6c5 chore: code optimization 2023-05-19 16:06:20 +08:00
Haojun Liao d8525123a2 enh(stream): add API to retrieve last ts for multi-tables. 2023-05-19 11:03:41 +08:00
wade zhang 208c9756cf
Merge pull request #21331 from taosdata/fix/TD-24097
enh(cache/batchread): load columns in one trip
2023-05-19 10:20:47 +08:00
kailixu de93895859 chore: code optimization 2023-05-19 09:25:26 +08:00
wade zhang 1ade314043
Merge pull request #21325 from taosdata/feat/force-drop-dnode
Feat/force drop dnode
2023-05-19 09:23:54 +08:00
wade zhang 7374ea2f0b
Merge pull request #21322 from taosdata/fix/status-resp-return-null-when-only-one-ep
status resp return null when only one ep
2023-05-19 09:04:41 +08:00
kailixu c770a5c306 chore: code optimization 2023-05-19 06:59:28 +08:00
kailixu e3f194ed9b chore: code optimization 2023-05-18 19:13:04 +08:00
Minglei Jin 35f74ce2e8 cache/schema: not cache schema 2023-05-18 18:35:06 +08:00
kailixu 1de90208f7 test: test case for alter dnode active code 2023-05-18 18:02:48 +08:00
Haojun Liao c4c5bbb65c other: merge 3.0 2023-05-18 17:28:40 +08:00
Haojun Liao dbd52ecffa
Merge pull request #21364 from taosdata/enh/rocksdbSstate
state merge into 3.0
2023-05-18 17:25:44 +08:00
liuyao da3fc5111e fix pause agg task 2023-05-18 15:29:41 +08:00
Minglei Jin f95867d255 cache/del: fix lru key length 2023-05-18 14:48:08 +08:00
Minglei Jin 3b316051bf cache/schema: fix schema double free 2023-05-18 13:51:07 +08:00
yihaoDeng 9380b22394 merge 3.0 2023-05-18 05:46:38 +00:00
kailixu 0e891c5c14 chore: more code 2023-05-18 13:30:45 +08:00
Minglei Jin 0f8b7c87f7 cache/delete: fix rocks key length 2023-05-18 13:15:25 +08:00