Commit Graph

873 Commits

Author SHA1 Message Date
Dingle Zhang 984211f3b4
Feature/3.0 geometry (#21037)
* Add GEOMETRY data type and make sql.c able to parse it. The GEMETRY works like BINARY so far.

* add GEOMETRY type into gConvertTypes to fix some issues like DELETE calling

* change some test cases to make sure no same timestamp is inserted, and add my smoketest.sh

* Add a function MakePoint() and introduce a lib geometry

* implement sql functions GeomFromText() and AsText()

* Use GEOS *_r funcions instead for thread safety

* Handle with TSDB_DATA_TYPE_GEOMETRY when INSERT geometry data by converting WKT.
Add geosWrapper to wrap the basic GEOS functions for TDEngine.

* refactor AsText and MakePoint functions to be like GeomFromText

* Show WKT when print geometry data in screen
Dump hex data when dump geometry data in a file

* define TYPE_BYTES item for TSDB_DATA_TYPE_GEOMETRY, which casued some strange issues.

* set number of decimals of WKT to 6

* Implement SQL function Intersects()

* refactor geometry sql functions

* Add geosErrMsgeHandler() to get the GEOS error detail

* use threadlocal to instantiate SGeosContext
call destroyGeosContext() only if the thread exists

* remove SGeosContext *context param for all geometry functions since we use thread local one,
so that all caller do not need to know the context.

* Modify Intersects() to call PreparedIntersects() when one of param is a constant, which has higher performance.

* rename prepareFn() to initCtxFn() to avoid confusion with PreparedFn

* Add prefix "ST_" for all geometry functions

* move getThreadLocalGeosCtx() and destroyThreadLocalGeosCtx() into util,
so that all unit test tools can compile

* Add unit test for geometry lib, only test MakePoint so far

* refactor and enhance existing cases in geomFuncTest

* implement NULL type and NULL value test for geomFuncTest

* add test on geomFromText()

* add unit test on AsText() in geomFuncTest

* combine some makePointFunction test items

* add intersectsFunctionTwoColumns test
refactor on callGeomFromTextWrapper functions

* enhance intersectsFunction test to add cases like input constant , NULL type, NULL value, or wrong content

* add more cases into intersectsFunction test

* Add basic test on geometry in system test

* Add ST_GeomFromText and ST_AsText function test in system test on geometry

* add ST_Intersects function test in system test on geometry

* support to check expectedErrno in system test on geometry

* adjust geomTest unit test and geometry system test

* add geometry data type and functions in doc english version

* implement touchesFunction() in geometry lib
refactor geometry relation functions model

* separate gemFuncTest into several src files

* add unit test on touchesFunction

* support sql function ST_Touches()
add system test on ST_Touches

* add docs for ST_Touches()

* Add ST_Contains()

* Add ST_Covers()

* Add ST_Equals()

* add swapAllowed param for geomRelationFunction()
read geom2 earlier intead of at doGeosRelation()

* Add ST_ContainsProperly()

* build on windows

* Merge from 3.0 to 3.0_geometry

* change macro definition TSDB_DATA_TYPE_GEOMETRY as the last one for compatibility

* change '\\NULL' to 'NULL' back in shellDumpFieldToFile()

* add /usr/local/include into include directory

* add /usr/local/inlcude and /usr/local/lib in cmake.platform for DARWIN
2023-05-24 15:36:46 +08:00
dapan1121 693bac60a0
Merge pull request #21430 from taosdata/fix/TD-24349
fix: last(tbname) out of memory issue
2023-05-24 08:52:49 +08:00
dapan1121 d66f45308c fix: fix last(tbname) out of memory issue 2023-05-23 14:06:29 +08:00
kailixu a37d2c40fc chore: error logs of create sma cols 2023-05-23 11:06:44 +08:00
kailixu 329797ce23 fix: add _wstart if not exists 2023-05-23 10:57:34 +08:00
kailixu a171c0c860 Merge branch '3.0' into fix/TD-21457-3.0 2023-05-23 09:27:31 +08:00
kailixu c75aa54a3d fix: tsdb read and append _wstart for tsma 2023-05-22 20:33:29 +08:00
dapan1121 840eb21825 fix: last(tag) report error issue 2023-05-22 18:19:39 +08:00
kailixu f18fc19d76 fix: tsdb read and tsma _wstart append 2023-05-22 16:13:50 +08:00
Haojun Liao 041ffa91bd other: merge main. 2023-05-17 15:42:15 +08:00
Haojun Liao 5b2ef2a675 other: merge main and remove invalid return data for poll. 2023-05-13 02:31:39 +08:00
slzhou 51fa0aeb64 Merge branch 'main' of github.com:taosdata/TDengine into szhou/fix-ts3400 2023-05-13 00:02:03 +08:00
shenglian zhou 0ea8de64df fix: code refactor 2023-05-12 20:20:53 +08:00
slzhou 5b866edae7 fix: disable table count scan optimized when filters and group by both exist 2023-05-12 18:51:18 +08:00
Haojun Liao 7ef16e1922 other: merge main. 2023-05-12 11:49:53 +08:00
slzhou e58fda2bdd fix: bypass projection pruning if union set op and subquery 2023-05-11 16:04:06 +08:00
dapan1121 a1eefd25ea fix: count wrong group number issue 2023-05-09 11:33:47 +08:00
dapan1121 1526eb2923 fix: projection group merge issue 2023-05-08 10:28:07 +08:00
dapan1121 1f25cc57cd fix: projection merge issue 2023-05-06 16:39:40 +08:00
dapan1121 51a1e07dbf
Merge pull request #21029 from taosdata/fix/TD-23797
fix: fix crash caused by deleting from system table
2023-04-26 17:48:58 +08:00
shenglian zhou 93ab81437f enhance: code refactor and operator full implement slimit 2023-04-25 11:08:58 +08:00
shenglian zhou 758427b3c4 fix: use slimit to indicate group for tag scan 2023-04-24 15:48:20 +08:00
Ganlin Zhao 1251245c2a move code to parser 2023-04-24 09:49:03 +08:00
Ganlin Zhao c5b3737702 fix: forbid delete from system table 2023-04-23 11:21:01 +08:00
shenglian zhou 3a9dddd619 enhance: modify inside isEligibleAgg func 2023-04-20 15:11:12 +08:00
shenglian zhou cc78a6356c fix: do not performace table count scan optimized where there are no agg functions 2023-04-20 13:54:22 +08:00
Xiaoyu Wang 5367f25b4d feat: the having clause can be used after the partition by clause or window clause 2023-04-19 16:55:08 +08:00
Xiaoyu Wang 586b3945d1 feat: last queries with tags output can be read from cache 2023-04-19 13:09:11 +08:00
Xiaoyu Wang 6669c3a5ad feat: last queries with tags output can be read from cache 2023-04-18 17:13:14 +08:00
shenglian zhou 71d59281ff fix: select * from (select * from t order by ts desc) order by ts 2023-04-10 14:03:56 +08:00
Xiaoyu Wang 0e53e578a7
Merge pull request #20748 from taosdata/fix/TD-23473
ehn(plan/optimizer): remove tbname fetching with cached groupby
2023-04-04 09:36:56 +08:00
Minglei Jin 6a3bcf4a71 ehn(plan/optimizer): remove tbname fetching with cached groupby 2023-04-03 19:08:57 +08:00
Xiaoyu Wang 10979f6fc2 fix: when the set operator statement is used for subquery, the outer layer filtering fails. 2023-03-30 13:34:35 +08:00
Xiaoyu Wang f30cb8e527 fix: when the set operator statement is used for subquery, the outer layer filtering fails. 2023-03-30 10:58:33 +08:00
Xiaoyu Wang 3382a24a69 merge main 2023-02-10 18:03:11 +08:00
54liuyao 40987fa507 feat:do not check whether the expired data has been update 2023-02-09 11:14:28 +08:00
Xiaoyu Wang 98e2fa2d7b feat: add ignore update option for create stream 2023-02-08 18:46:12 +08:00
Xiaoyu Wang 8b6a50d970 feat: add explain test case 2023-02-07 18:35:42 +08:00
Xiaoyu Wang 5d499e52f9 merge main 2023-02-03 17:13:11 +08:00
Xiaoyu Wang 637195ce94 fix: the problem of creating a stream without partition by clause 2023-02-01 17:27:03 +08:00
Xiaoyu Wang 8258c68b6d fix: subquery output ignores group id 2023-01-28 11:11:37 +08:00
Xiaoyu Wang beb3de8530 fix: limit push down error 2023-01-28 10:53:43 +08:00
Xiaoyu Wang ec1592390a fix: limit push down error 2023-01-28 10:35:21 +08:00
Xiaoyu Wang f8082bc752
Merge pull request #19623 from taosdata/enh/3.0_planner_optimize
enh: optimize execute plan when 'tail' function is used with 'partition by' clause
2023-01-18 17:25:16 +08:00
Xiaoyu Wang f1d6262630 enh: optimize execute plan when 'tail' function is used with 'partition by' clause 2023-01-18 12:26:01 +08:00
Xiaoyu Wang 554b8c6418 enh: optimize execute plan when 'tail' function is used with 'partition by' clause 2023-01-18 04:43:04 +08:00
dapan1121 62b64631dc
Merge pull request #19547 from taosdata/fix/TD-21648
fix:add interface for odbc
2023-01-16 13:29:15 +08:00
Xiaoyu Wang 30381ec446 fix: sma optimize memory leak 2023-01-16 11:03:53 +08:00
Shengliang Guan d90eef6656 Merge branch '3.0' into merge/mainto3.0_0108 2023-01-08 09:54:21 +08:00
Xiaoyu Wang aa8eea0d65 fix: set operator precision miss 2023-01-06 13:35:07 +08:00