Commit Graph

376 Commits

Author SHA1 Message Date
wangmm0220 4b29184408 fix:[TD-29793] check if column and tag name are dumplicate in schemaless 2024-04-25 11:06:20 +08:00
yihaoDeng 4948bd690d 3.0 merge compress 2024-04-15 11:38:44 +08:00
wangmm0220 6174c3bfd3 fix:disable primary key in schemaless 2024-04-07 14:54:58 +08:00
yihaoDeng 0e3c63e94d fix ci error 2024-03-31 04:04:50 +00:00
wangmm0220 c63a7e3979 feat:add paras for schemaless interface 2024-03-13 10:52:54 +08:00
wangmm0220 b4f33eacf2 feat:add paras for schemaless interface 2024-03-13 10:10:20 +08:00
factosea 30e52bb71a col compress sql parse 2024-03-07 18:06:15 +08:00
wangmm0220 84d18005f2 fix:add control for raw data in schemaless 2023-12-19 11:34:15 +08:00
wangmm0220 ef621a06a7 opti:logic in parse raw line & make log more specific 2023-12-18 19:21:02 +08:00
wangmm0220 7f8479f953 opti:logic in parse raw line & make log more specific 2023-12-18 15:16:33 +08:00
wangmm0220 ff23e9afae fix:inline error 2023-12-07 17:03:48 +08:00
wangmm0220 60500f4a81 fix:error 2023-12-07 15:17:15 +08:00
wangmm0220 26855848f6 opti:schemaless logic 2023-12-07 14:07:09 +08:00
wangmm0220 f4b0e7baf5 fix:remove debug info 2023-12-06 15:46:45 +08:00
wangmm0220 82f54f094a fix:add log for time cost 2023-12-05 20:08:18 +08:00
dapan1121 42f440b0fb Merge remote-tracking branch 'origin/3.0' into feat/TD-25204 2023-10-20 08:46:32 +08:00
dapan1121 969b002936 enh: support view privilege 2023-10-20 08:41:49 +08:00
wangmm0220 a16c9be49f feat:[TD-19291]Schemaless table name can be composed based on rule 2023-10-17 15:34:16 +08:00
wangmm0220 e2db22017a fix:change error code -1 to code 2023-10-08 09:46:18 +08:00
dapan1121 cc17848b78 fix: merge 3.0 to main 2023-09-01 13:24:47 +08:00
wangmm0220 64959f14e9 fix:dot process in schemaless 2023-08-24 18:18:02 +08:00
wangmm0220 f2553b8718 fix:add configuration to control if change dot to underline in schemaless 2023-07-26 09:52:04 +08:00
wangmm0220 d3970c113f fix:memory leak 2023-07-25 14:35:21 +08:00
wangmm0220 853c495aed fix:heap over flow 2023-07-24 20:23:17 +08:00
wangmm0220 2714db10bd fix:modify dot to underline in schemaless supertable name 2023-07-24 19:15:33 +08:00
wangmm0220 7ebbe0603b fix:coverity scan error 2023-06-26 18:26:10 +08:00
wangmm0220 f154d29ac7 fix:Vnode is closed or removed if drop database 2023-06-13 16:34:46 +08:00
wangmm0220 ee978a3604 fix:do not modify source data in schemaless 2023-06-02 16:09:54 +08:00
wangmm0220 b77544b30d Merge branch '3.0' of https://github.com/taosdata/TDengine into mark/sml 2023-05-26 09:03:36 +08:00
wangmm0220 40fa0e0620 fix:memory leak 2023-05-25 18:07:36 +08:00
Haojun Liao b932fdb5c4
Merge pull request #21470 from taosdata/feature/TD-24070
feat:add privilege for schemaless
2023-05-25 17:52:28 +08:00
wangmm0220 d9042f5ed3 fix:memory leak 2023-05-25 17:24:11 +08:00
wangmm0220 fcba7e326c feat:add privilege for schemaless 2023-05-25 14:24:25 +08:00
Dingle Zhang 984211f3b4
Feature/3.0 geometry (#21037)
* Add GEOMETRY data type and make sql.c able to parse it. The GEMETRY works like BINARY so far.

* add GEOMETRY type into gConvertTypes to fix some issues like DELETE calling

* change some test cases to make sure no same timestamp is inserted, and add my smoketest.sh

* Add a function MakePoint() and introduce a lib geometry

* implement sql functions GeomFromText() and AsText()

* Use GEOS *_r funcions instead for thread safety

* Handle with TSDB_DATA_TYPE_GEOMETRY when INSERT geometry data by converting WKT.
Add geosWrapper to wrap the basic GEOS functions for TDEngine.

* refactor AsText and MakePoint functions to be like GeomFromText

* Show WKT when print geometry data in screen
Dump hex data when dump geometry data in a file

* define TYPE_BYTES item for TSDB_DATA_TYPE_GEOMETRY, which casued some strange issues.

* set number of decimals of WKT to 6

* Implement SQL function Intersects()

* refactor geometry sql functions

* Add geosErrMsgeHandler() to get the GEOS error detail

* use threadlocal to instantiate SGeosContext
call destroyGeosContext() only if the thread exists

* remove SGeosContext *context param for all geometry functions since we use thread local one,
so that all caller do not need to know the context.

* Modify Intersects() to call PreparedIntersects() when one of param is a constant, which has higher performance.

* rename prepareFn() to initCtxFn() to avoid confusion with PreparedFn

* Add prefix "ST_" for all geometry functions

* move getThreadLocalGeosCtx() and destroyThreadLocalGeosCtx() into util,
so that all unit test tools can compile

* Add unit test for geometry lib, only test MakePoint so far

* refactor and enhance existing cases in geomFuncTest

* implement NULL type and NULL value test for geomFuncTest

* add test on geomFromText()

* add unit test on AsText() in geomFuncTest

* combine some makePointFunction test items

* add intersectsFunctionTwoColumns test
refactor on callGeomFromTextWrapper functions

* enhance intersectsFunction test to add cases like input constant , NULL type, NULL value, or wrong content

* add more cases into intersectsFunction test

* Add basic test on geometry in system test

* Add ST_GeomFromText and ST_AsText function test in system test on geometry

* add ST_Intersects function test in system test on geometry

* support to check expectedErrno in system test on geometry

* adjust geomTest unit test and geometry system test

* add geometry data type and functions in doc english version

* implement touchesFunction() in geometry lib
refactor geometry relation functions model

* separate gemFuncTest into several src files

* add unit test on touchesFunction

* support sql function ST_Touches()
add system test on ST_Touches

* add docs for ST_Touches()

* Add ST_Contains()

* Add ST_Covers()

* Add ST_Equals()

* add swapAllowed param for geomRelationFunction()
read geom2 earlier intead of at doGeosRelation()

* Add ST_ContainsProperly()

* build on windows

* Merge from 3.0 to 3.0_geometry

* change macro definition TSDB_DATA_TYPE_GEOMETRY as the last one for compatibility

* change '\\NULL' to 'NULL' back in shellDumpFieldToFile()

* add /usr/local/include into include directory

* add /usr/local/inlcude and /usr/local/lib in cmake.platform for DARWIN
2023-05-24 15:36:46 +08:00
wangmm0220 fb9b0a3e86 feat:add privilege for schemaless 2023-05-24 14:34:52 +08:00
Haojun Liao 170c603995 other: merge 3.0 2023-05-13 20:16:55 +08:00
Haojun Liao 236926b9ee other: merge enh/rocksdbstate 2023-05-13 19:49:28 +08:00
Haojun Liao 1975e94501 Merge branch 'main' into enh/rocksdbSstate 2023-05-13 19:41:03 +08:00
Haojun Liao 7ef16e1922 other: merge main. 2023-05-12 11:49:53 +08:00
wangmm0220 29bab82a0c fix:compile error in release mode 2023-05-10 22:51:32 +08:00
yihaoDeng 5708fcb5cb Merge branch 'enh/3.0' into enh/rocksdbSstateMerge 2023-05-10 08:02:16 +00:00
Yihao Deng c6e5879f44
Merge branch 'main' into enh/rocksdbSstate 2023-05-10 10:04:28 +08:00
yihaoDeng 8356533eb1 Merge branch 'enh/standVer' into enh/rocksdbSstateMerge 2023-05-09 12:13:16 +00:00
wangmm0220 f9142c0ddb fix:[TD24010] lost data if apply ver is small than commit ver 2023-05-08 16:49:56 +08:00
Yihao Deng cb223acf82
Merge branch 'main' into enh/rocksdbSstate 2023-05-08 09:45:27 +08:00
yihaoDeng 08c3a63341 Merge branch 'enh/standVer' into enh/rocksdbSstateMerge 2023-05-06 12:37:54 +00:00
Minglei Jin 596bee8028 Merge branch '3.0' into fix/TD-23623 2023-05-06 16:07:26 +08:00
Haojun Liao db0ad95649
Merge pull request #21152 from taosdata/fix/TS-3303
fix:[TS-3303]use stable name + child table name as key to save uid to…
2023-05-06 14:31:12 +08:00
Haojun Liao 2ea81179ae
Merge pull request #21153 from taosdata/fix/TD-23881
fix:change field bytes if length is bigger than 1024
2023-05-06 14:30:41 +08:00
Haojun Liao da6212bab0 other: merge main. 2023-05-06 12:51:38 +08:00
kailixu 4ae9eab90e chore: fix 2023-05-05 20:42:49 +08:00
kailixu 0c3dc0867f chore: sync fix from main 2023-05-05 20:33:41 +08:00
wangmm0220 fdee112ae4 fix:[TS-3277]table not exist if drop stable in another client when insert data using schemaless interface 2023-05-05 17:31:08 +08:00
wangmm0220 0a469484fa fix:[TS-3277]table not exist if drop stable in another client when insert data using schemaless interface 2023-05-05 15:01:27 +08:00
wangmm0220 1d8c517844 fix:[TS-3303]use stable name + child table name as key to save uid to avoid multi items for one table in submit block 2023-05-05 10:46:54 +08:00
wangmm0220 bb33f054b4 fix:change field bytes if length is bigger than 1024 2023-05-04 17:21:18 +08:00
Haojun Liao dbf28b434e
Merge pull request #21137 from taosdata/fix/TD-23881
fix:change field bytes if length is bigger than 1024
2023-05-04 17:05:29 +08:00
Haojun Liao 23c49594b7 other: merge main. 2023-05-04 16:41:53 +08:00
wangmm0220 b1f3a010df fix:change field bytes if length is bigger than 1024 2023-05-04 13:58:45 +08:00
Haojun Liao 851193a033
Merge pull request #21060 from taosdata/fix/TS-3222
opti:change push mgr to consume msg for subscribe
2023-05-04 10:16:41 +08:00
kailixu d492904188 chore: error process and test cases 2023-04-28 16:40:26 +08:00
wangmm0220 a7a73ace4a fix:memory leak in schemaless if key dump 2023-04-28 15:26:24 +08:00
liuyao 2984c5a758 merge main 2023-04-28 10:34:46 +08:00
kailixu fa822ff286 Merge branch '3.0' into enh/TD-21161-3.0 2023-04-27 19:11:16 +08:00
wangmm0220 8677b56a4f fix:assert error in tqProcessSubmitReqForSubscribe if put pHandle to array twice 2023-04-27 15:44:44 +08:00
wangmm0220 8be78ddee2 fix:[TD-23881] check the max row's length in schemaless 2023-04-26 14:23:25 +08:00
kailixu a6e37622ff chore: more code 2023-04-25 22:15:06 +08:00
kailixu 2d4dd64584 chore: more code 2023-04-24 20:21:28 +08:00
dapan1121 9551a269b3 feat: support log slow query by default 2023-04-24 16:45:34 +08:00
yihaoDeng 917b07348c Merge branch 'fix/rocksdbState' into enh/rocksRevert 2023-04-23 02:37:26 +00:00
Haojun Liao 3f432cca2e
Merge pull request #20970 from taosdata/fix/TS-3116
opti:escape logic in schemaless
2023-04-21 18:44:06 +08:00
wangmm0220 3d8faa690d fix:[TS-3250] change strtegy in schemaless if modifyDBSchema error 2023-04-21 11:39:02 +08:00
wangmm0220 5bd6b16e73 fix:memory leak in schemaless if key dump 2023-04-20 18:39:03 +08:00
wangmm0220 e61b51b083 fix:add test cases for escape in schemaless 2023-04-20 17:49:40 +08:00
wangmm0220 2714da26e7 fix:[TS-3221] reset max stmt if execute error 2023-04-20 17:26:54 +08:00
wangmm0220 b1561c95c3 fix:add test cases for escape in schemaless 2023-04-20 15:31:18 +08:00
wangmm0220 5b3087e48b opti:escape logic in schemaless 2023-04-19 00:55:26 +08:00
Xiaoyu Wang 8b8ac0cd77 merge main 2023-04-12 10:43:28 +08:00
Xiaoyu Wang 4c04b155d5 merge main 2023-04-11 15:56:28 +08:00
wangmm0220 c40c695ea7 fix:optimize log & change the length of tag if tag is null in schemaless 2023-04-11 13:49:18 +08:00
wangmm0220 f8bcdcecea fix:remove smlChildTableName from tag 2023-04-06 16:24:04 +08:00
Xiaoyu Wang e9d7a099cc merge main 2023-04-04 14:50:58 +08:00
wangmm0220 2d6436c57d fix:modify log & sleep 500ms if data is inserting while consume 2023-04-03 11:24:22 +08:00
wangmm0220 a9cc66ba8f fix:int64 parse error in schemaless 2023-03-30 19:48:21 +08:00
dapan1121 5b02af6a91 fix: merge main to 3.0 2023-03-22 16:08:16 +08:00
Haojun Liao ea0cc2c584
Merge pull request #20554 from taosdata/fix/TS-2828
fix: add retry if insert error with meta change
2023-03-21 09:01:22 +08:00
wangmm0220 b0fbb0601f fix:add retry times if schemaless insert with meta error 2023-03-20 17:04:30 +08:00
wangmm0220 8fe084cc5c fix:add log for schmaless 2023-03-17 19:44:52 +08:00
wangmm0220 d5328b7a2b fix:add log for schmaless 2023-03-17 19:11:40 +08:00
wangmm0220 0a54d00cd2 fix:converity scan defects 2023-03-17 14:54:27 +08:00
wangmm0220 fa2e7b234c fix:add log for schemaless & sleep longer if modify schema error 2023-03-16 19:13:15 +08:00
Xiaoyu Wang a846c26ef9 merge main 2023-03-11 16:14:27 +08:00
wangmm0220 80e0aad1f0 fix:heap overflow 2023-03-10 12:11:46 +08:00
wangmm0220 f7ed0b184f fix:add log 2023-03-10 10:49:51 +08:00
wangmm0220 d020753cdb fix:[TS-2828] retry if ver is old 2023-03-10 10:03:43 +08:00
wangmm0220 88c3d0d4b3 fix:[TS-2828] retry if ver is old 2023-03-09 19:48:21 +08:00
Xiaoyu Wang 4c8bab7e58 merge main 2023-03-08 10:59:33 +08:00
wangmm0220 4827c25a61 fix:give error if col is same in schemless & fix json parse error in TD-22903 2023-03-04 18:16:41 +08:00
wangmm0220 3bfd156616 fix:[TD-22898]:modify schema if schema change 2023-03-04 17:37:38 +08:00
wangmm0220 e54e12eff0 fix:give error if col is same in schemless & fix json parse error in TD-22903 2023-03-04 11:57:27 +08:00