Commit Graph

251 Commits

Author SHA1 Message Date
wangmm0220 f6fef3e9d6 feat:add privilege for schemaless 2023-05-25 14:54:21 +08:00
wangmm0220 fcba7e326c feat:add privilege for schemaless 2023-05-25 14:24:25 +08:00
Dingle Zhang 984211f3b4
Feature/3.0 geometry (#21037)
* Add GEOMETRY data type and make sql.c able to parse it. The GEMETRY works like BINARY so far.

* add GEOMETRY type into gConvertTypes to fix some issues like DELETE calling

* change some test cases to make sure no same timestamp is inserted, and add my smoketest.sh

* Add a function MakePoint() and introduce a lib geometry

* implement sql functions GeomFromText() and AsText()

* Use GEOS *_r funcions instead for thread safety

* Handle with TSDB_DATA_TYPE_GEOMETRY when INSERT geometry data by converting WKT.
Add geosWrapper to wrap the basic GEOS functions for TDEngine.

* refactor AsText and MakePoint functions to be like GeomFromText

* Show WKT when print geometry data in screen
Dump hex data when dump geometry data in a file

* define TYPE_BYTES item for TSDB_DATA_TYPE_GEOMETRY, which casued some strange issues.

* set number of decimals of WKT to 6

* Implement SQL function Intersects()

* refactor geometry sql functions

* Add geosErrMsgeHandler() to get the GEOS error detail

* use threadlocal to instantiate SGeosContext
call destroyGeosContext() only if the thread exists

* remove SGeosContext *context param for all geometry functions since we use thread local one,
so that all caller do not need to know the context.

* Modify Intersects() to call PreparedIntersects() when one of param is a constant, which has higher performance.

* rename prepareFn() to initCtxFn() to avoid confusion with PreparedFn

* Add prefix "ST_" for all geometry functions

* move getThreadLocalGeosCtx() and destroyThreadLocalGeosCtx() into util,
so that all unit test tools can compile

* Add unit test for geometry lib, only test MakePoint so far

* refactor and enhance existing cases in geomFuncTest

* implement NULL type and NULL value test for geomFuncTest

* add test on geomFromText()

* add unit test on AsText() in geomFuncTest

* combine some makePointFunction test items

* add intersectsFunctionTwoColumns test
refactor on callGeomFromTextWrapper functions

* enhance intersectsFunction test to add cases like input constant , NULL type, NULL value, or wrong content

* add more cases into intersectsFunction test

* Add basic test on geometry in system test

* Add ST_GeomFromText and ST_AsText function test in system test on geometry

* add ST_Intersects function test in system test on geometry

* support to check expectedErrno in system test on geometry

* adjust geomTest unit test and geometry system test

* add geometry data type and functions in doc english version

* implement touchesFunction() in geometry lib
refactor geometry relation functions model

* separate gemFuncTest into several src files

* add unit test on touchesFunction

* support sql function ST_Touches()
add system test on ST_Touches

* add docs for ST_Touches()

* Add ST_Contains()

* Add ST_Covers()

* Add ST_Equals()

* add swapAllowed param for geomRelationFunction()
read geom2 earlier intead of at doGeosRelation()

* Add ST_ContainsProperly()

* build on windows

* Merge from 3.0 to 3.0_geometry

* change macro definition TSDB_DATA_TYPE_GEOMETRY as the last one for compatibility

* change '\\NULL' to 'NULL' back in shellDumpFieldToFile()

* add /usr/local/include into include directory

* add /usr/local/inlcude and /usr/local/lib in cmake.platform for DARWIN
2023-05-24 15:36:46 +08:00
wangmm0220 fb9b0a3e86 feat:add privilege for schemaless 2023-05-24 14:34:52 +08:00
Haojun Liao 4b961753a5 test: update the test case. 2023-05-12 15:13:25 +08:00
Haojun Liao f20afb7304 fix(test): update the test case. 2023-05-12 14:53:01 +08:00
wangmm0220 3fb2d7656d fix:[TS-3303]use stable name + child table name as key to save uid to avoid multi items for one table in submit block 2023-05-05 13:39:37 +08:00
wangmm0220 1d8c517844 fix:[TS-3303]use stable name + child table name as key to save uid to avoid multi items for one table in submit block 2023-05-05 10:46:54 +08:00
Haojun Liao 851193a033
Merge pull request #21060 from taosdata/fix/TS-3222
opti:change push mgr to consume msg for subscribe
2023-05-04 10:16:41 +08:00
wangmm0220 db5b5c828e fix:add log for msg push 2023-04-27 18:35:10 +08:00
wangmm0220 206c62703a fix:modify the compile error in windows for long string 2023-04-27 09:33:56 +08:00
wangmm0220 8be78ddee2 fix:[TD-23881] check the max row's length in schemaless 2023-04-26 14:23:25 +08:00
wangmm0220 ea939c1efb fix:add test cases for escape in schemaless 2023-04-20 17:41:38 +08:00
wangmm0220 2714da26e7 fix:[TS-3221] reset max stmt if execute error 2023-04-20 17:26:54 +08:00
wangmm0220 b1561c95c3 fix:add test cases for escape in schemaless 2023-04-20 15:31:18 +08:00
Xiaoyu Wang 4c04b155d5 merge main 2023-04-11 15:56:28 +08:00
wangmm0220 9493ecd18f Merge branch 'fix/TS-3081' of https://github.com/taosdata/TDengine into fix/TS-3081 2023-04-07 19:53:35 +08:00
wangmm0220 9bb921d5a8 fix:add tools to get tmq offset 2023-04-07 17:10:57 +08:00
wangmm0220 5f700d59bd fix:add tools to get tmq offset 2023-04-07 17:10:00 +08:00
wangmm0220 dd22347992 fix:add tools to get tmq offset 2023-04-07 17:05:23 +08:00
wangmm0220 f8bcdcecea fix:remove smlChildTableName from tag 2023-04-06 16:24:04 +08:00
Xiaoyu Wang c134432c45 merge main 2023-04-06 09:31:45 +08:00
Xiaoyu Wang e9d7a099cc merge main 2023-04-04 14:50:58 +08:00
Ganlin Zhao 23ec9287c9 fix: fix tsim crash on windows due to invalid input to strftime 2023-04-04 10:33:41 +08:00
Ganlin Zhao 8079532055 fix: fix tsim crash on windows due to invalid input to strftime 2023-04-03 18:26:01 +08:00
Ganlin Zhao 6c64b760a0 fix: fix tsim crash on windows due to invalid input to strftime 2023-04-03 17:58:43 +08:00
wangmm0220 2dcf68fc5e Merge branch 'main' of https://github.com/taosdata/TDengine into fix/TS-3039 2023-03-31 14:17:51 +08:00
wangmm0220 373c128a7a fix:[TS-3038] coredump if nchar data not clear SColVal in schemaless 2023-03-31 14:16:39 +08:00
Haojun Liao d2d3fc14e8
Merge pull request #20700 from taosdata/fix/TS-2940
opti:disable set enable.heartbeat.background
2023-03-31 11:33:01 +08:00
wangmm0220 a9cc66ba8f fix:int64 parse error in schemaless 2023-03-30 19:48:21 +08:00
wangmm0220 b7e6e4197d opti:disable set enable.heartbeat.background 2023-03-30 11:18:35 +08:00
Xiaoyu Wang 97855c6233
Merge pull request #20607 from taosdata/FEAT/TD-23257-3.0
feat: WAL cleanup not affected by topic consumption anymore
2023-03-27 17:58:31 +08:00
wangmm0220 e1b9aac4c4 fix:add test case for raw_block interface 2023-03-27 10:41:25 +08:00
wangmm0220 5a2e3c1603 fix:add test case for raw_block interface 2023-03-27 10:32:30 +08:00
Benguang Zhao bac441b317 fix: create database with wal_retention_period in tmq_taosx_ci.c 2023-03-25 13:21:50 +08:00
wangmm0220 5d06474f2e fix:send data batch if consume wal where subscribe db 2023-03-24 14:43:29 +08:00
wangmm0220 dcaab41a27 fix:error in optimize consume logic 2023-03-24 13:20:03 +08:00
dapan1121 5b02af6a91 fix: merge main to 3.0 2023-03-22 16:08:16 +08:00
Haojun Liao 18b121c69c fix(tmq): fix the invalid write and do some internal refactor. 2023-03-21 13:45:43 +08:00
wangmm0220 0a54d00cd2 fix:converity scan defects 2023-03-17 14:54:27 +08:00
Xuefeng Tan 449f7115e4
fix: windows test (#20256)
* fix: windows sim test

* fix: windows sim test

* fix: random on windows

* fix: taosd online check

* fix: windows path in python test

* fix: windows python test

* fix: windows python test

* fix: windows python test

* fix: windows python test

* fix: windows python test

* fix: windows python test

* fix: windows python test

* fix: windows python test

* fix: windows python test

* fix: make_install.bat

* fix: python test

* fix: jdbc test

* fix: develop test

* fix: develop test

* fix:add log

* test:add win case file

* test:add win case file

* test:add win case file

* fix: python test get taosBenchmark path

* test:add win case file

* test:comment some failed cases in win

* test:add win case file

* test:add win case file

* test:comment some win case file

* test:add some win case file

---------

Co-authored-by: wangmm0220 <wangmm0220@gmail.com>
Co-authored-by: chenhaoran <haoran920c@163.com>
2023-03-16 10:18:06 +08:00
Haojun Liao 8f1f423c90 fix(tmq): fix the error in tmq. 2023-03-14 00:37:09 +08:00
Haojun Liao 7f2aae69d4 fix(tmq): fix error in taosx 2023-03-13 01:54:29 +08:00
Xiaoyu Wang 4c8bab7e58 merge main 2023-03-08 10:59:33 +08:00
wangmm0220 cea32f2e3c fix:give error if col is same in schemless & fix json parse error in TD-22903 2023-03-04 18:18:20 +08:00
wangmm0220 3bfd156616 fix:[TD-22898]:modify schema if schema change 2023-03-04 17:37:38 +08:00
wangmm0220 e54e12eff0 fix:give error if col is same in schemless & fix json parse error in TD-22903 2023-03-04 11:57:27 +08:00
54liuyao fe4123e814 feat:window close && ignore expired 2023-02-28 18:20:58 +08:00
WANG MINGMING 5dfc9ed4d0
Merge branch '3.0' into fix/TD-22667-3.0 2023-02-28 09:52:34 +08:00
Xiaoyu Wang 5856a39827
Merge pull request #20123 from taosdata/fix/3.0_merge_main
merge main
2023-02-25 10:01:26 +08:00
Xiaoyu Wang 67a94707b7
Merge pull request #20104 from taosdata/feat/3.0_wxy
enh: drop tables syntax optimization
2023-02-24 16:57:30 +08:00
Xiaoyu Wang 58fc265b80 merge main 2023-02-24 13:26:45 +08:00
Haojun Liao 645c3e672f
Merge pull request #20144 from taosdata/fix/3_coverity
fix(query): fix coverity issue.
2023-02-24 11:31:36 +08:00
Haojun Liao 97024f1468 fix(query): fix coverity issue. 2023-02-24 09:48:34 +08:00
Xiaoyu Wang 1ab144609e merge main 2023-02-23 14:58:22 +08:00
Xiaoyu Wang a71f728cc4 enh: drop tables syntax optimization 2023-02-22 17:45:55 +08:00
Haojun Liao edc64122cb refactor: fix coverity issues. 2023-02-22 16:50:47 +08:00
wangmm0220 91d5df423f fix:error by coverity scan 2023-02-22 15:48:39 +08:00
Minglei Jin 298296a6ac fix(tsim): ignore return value of taos fsync 2023-02-22 14:46:43 +08:00
wangmm0220 c330588d55 fix:error in subscribe table for taosx 2023-02-03 15:35:13 +08:00
wangmm0220 94a3fa4ff3 fix:htol(length) & set vgId,uid correct for auto create table in taosx 2023-01-30 09:55:22 +08:00
wangmm0220 0f1f239425 Merge branch '3.0' of https://github.com/taosdata/TDengine into refact/submit_req_marks 2023-01-26 11:03:34 +08:00
wangmm0220 2455822df9 fix:open test case for sml 2023-01-26 11:03:07 +08:00
wangmm0220 8098a2995d opti:parse non-standard json format 2023-01-23 22:20:44 +05:00
wangmm0220 51bb0ed602 opti:json non standard 2023-01-17 23:43:05 +05:00
dapan1121 62b64631dc
Merge pull request #19547 from taosdata/fix/TD-21648
fix:add interface for odbc
2023-01-16 13:29:15 +08:00
Xiaoyu Wang 9a0c2805f4 merge main 2023-01-13 13:54:04 +08:00
wangmm0220 792d19fbe7 fix:table num in ins_tables 2023-01-13 11:48:26 +08:00
wangmm0220 b5e4861c50 fix:add test cases for odbc interface 2023-01-12 23:57:06 +08:00
dapan1121 54558b438c
Merge pull request #19448 from taosdata/refact/submit_req_marks
fix:table name error in schemaless
2023-01-09 18:36:57 +08:00
wangmm0220 a462f518e3 fix:table name error in schemaless 2023-01-09 15:14:20 +08:00
wangmm0220 060fc941b5 fix:add config dir for libtaos in sml_test 2023-01-09 11:39:14 +08:00
wangmm0220 d1b4dc94d8 fix:table name error in schemaless 2023-01-05 19:26:45 +08:00
dapan1121 ad6681b424
Merge pull request #19366 from taosdata/refact/submit_req_marks
fix:memory leak in schemaless
2023-01-05 09:55:05 +08:00
wangmm0220 3645ae868f opti:test case for schemaless 2023-01-04 17:18:03 +08:00
Xiaoyu Wang fdde287ca9 merge main 2023-01-04 11:43:20 +08:00
wangmm0220 d7dce180e4 Merge branch '3.0' of https://github.com/taosdata/TDengine into refact/submit_req_marks 2023-01-03 19:27:17 +08:00
wangmm0220 087f88a617 fix:malloc too large 2023-01-03 18:18:46 +08:00
WANG MINGMING 0260512d95
Merge pull request #19335 from taosdata/refact/submit_req_marks
fix:Refact/submit req marks
2023-01-03 17:02:34 +08:00
wangmm0220 50d2a1c11f fix:malloc too large 2023-01-03 16:01:03 +08:00
wangmm0220 89b29690fb fix:add log for json parse 2023-01-03 15:24:36 +08:00
wangmm0220 5cd433f756 fix:add log for json parse 2023-01-03 15:05:25 +08:00
wangmm0220 99b2e71b8b fix:write const memory 2023-01-03 14:05:23 +08:00
WANG MINGMING dbd41bff41
Merge pull request #19307 from taosdata/refact/submit_req_marks
opti:submit req marks
2023-01-02 17:55:16 +08:00
wangmm0220 1cb2e865d6 fix:error in schemaless 2023-01-02 17:53:03 +08:00
Shengliang Guan c2323db00d fix: allow the ip resolved by fqdn different between dnodes 2022-12-30 17:04:14 +08:00
Haojun Liao 723efba79b
Merge branch '3.0' into refact/submit_req 2022-12-26 13:25:25 +08:00
wangmm0220 c5abfe838d fix:add test case for TS-2035 2022-12-23 17:50:01 +08:00
wangmm0220 9a5c327b7b fix:modify delete msg type to tmq meta 2022-12-22 17:34:48 +08:00
wangmm0220 1b2a047397 opti:json parser 2022-12-15 11:25:03 +08:00
wangmm0220 097a2b928c opti:modify parse json 2022-12-15 00:35:58 +08:00
wangmm0220 efee9afad9 opti:parse value in schemaless 2022-12-12 22:42:33 +08:00
wangmm0220 408ae6aaad fix:split clientSml.c to 3 files & modify unit test cases for sml 2022-12-12 16:26:02 +08:00
wangmm0220 dc69c4daa6 Merge branch 'refact/submit_req_marks' of https://github.com/taosdata/TDengine into refact/submit_req_marks 2022-12-09 11:19:56 +08:00
wangmm0220 1c38e767a8 fix:modify test cases 2022-12-09 11:19:28 +08:00
Haojun Liao 27ebafdbaa other: merge 3.0 2022-12-09 10:19:05 +08:00
wangmm0220 200d879fe5 opti:modify logic for telnet and json in schemaless 2022-12-09 05:03:42 +08:00
wangmm0220 aae9407926 opti:modify logic for telnet and json in schemaless 2022-12-09 00:35:42 +08:00
wangmm0220 5d6494d5ae opti:modify logic for telnet and json in schemaless 2022-12-08 23:06:07 +08:00
Shengliang Guan 1bb1025f7d enh: add tassert 2022-12-07 22:24:47 +08:00
Shengliang Guan 6d94afe48f
Revert "refact: adjust some assert cases" 2022-12-07 21:51:17 +08:00
wangmm0220 5711572b71 fix:error for destroy 2022-12-07 21:13:16 +08:00
wangmm0220 a4d03b43a0 opti: async->sync for schemaless 2022-12-07 20:33:54 +08:00
Shengliang Guan d5126d469a refact: replcase ASSERT with tAssert 2022-12-07 18:42:48 +08:00
Shengliang Guan f69a188f7e refact: replcase ASSERT with tAssert 2022-12-07 18:37:40 +08:00
wangmm0220 443aa2ee3f fix:modify influxdb parse logic for sml 2022-12-07 11:05:33 +08:00
dapan1121 d20d1e07a7
Merge pull request #18553 from taosdata/fix/TD-20613
fix:[TD-20612] error if write raw with some cols
2022-11-30 13:21:48 +08:00
wangmm0220 8b02719ea5 fix:[TD-20612] error if write raw with some cols 2022-11-29 17:01:16 +08:00
wangmm0220 b5e4b05752 fix:[TS-2057] add interface with ttl in schemaless 2022-11-29 11:52:40 +08:00
Shengliang Guan 4cd660b3b1 refactor: format tmqSim.c 2022-11-27 15:39:17 +08:00
Shengliang Guan f08a183ab5 test: fsync consum file 2022-11-27 15:39:01 +08:00
wangmm0220 a8dc0a9cb2 fix:add test case for schemaless 2022-10-27 10:01:15 +08:00
wangmm0220 d212be8a37 fix:defects in coverity 2022-10-26 17:54:19 +08:00
Xiaoyu Wang 5e970f1506 Merge remote-tracking branch 'origin/3.0' into fix/3.0_bugfix_wxy 2022-10-21 10:18:26 +08:00
Xiaoyu Wang c640c03453 import format error 2022-10-21 08:59:19 +08:00
Shengliang Guan 2e82fdee93
Merge pull request #17506 from taosdata/enh/TD-19660
fix: improve test coverage
2022-10-20 14:56:46 +08:00
Shengliang Guan 025c92586f Merge remote-tracking branch 'origin/3.0' into enh/TD-19660 2022-10-20 11:45:56 +08:00
wangmm0220 487feea4a0 fix:defects in coverity scan 2022-10-20 11:18:14 +08:00
Shengliang Guan 5c928eac6a fix: improve test coverage 2022-10-20 10:16:49 +08:00
Liu Jicong 63096c9d43 fix(sim): buffer size not enough 2022-10-20 09:35:41 +08:00
Shengliang Guan 985e6f53e4 Merge branch '3.0' into FIX/TD-19593-3.0 2022-10-19 19:06:03 +08:00
Benguang Zhao 0930f1b742 fix: disable the -Wformat-y2k compiler option to keep tsim testcases from affected 2022-10-19 16:13:14 +08:00
Shengliang Guan 96ca18e61e Merge remote-tracking branch 'origin/3.0' into enh/TD-19623 2022-10-19 11:18:21 +08:00
Shengliang Guan 8764cf9adb refact: remove multi process codes 2022-10-19 11:08:42 +08:00
Benguang Zhao 00a066443f Merge branch '3.0' into FIX/TD-19593-3.0 2022-10-19 09:38:36 +08:00
Benguang Zhao 3b0968d7f9 enh: enable the -Wformat=2 compiler option 2022-10-19 09:24:15 +08:00
Shengliang Guan 3592344fc6
Merge pull request #17449 from taosdata/fix/TD-19628
enh: comment out unused codes in tsim
2022-10-19 09:05:59 +08:00
dapan1121 b621f04e40
Merge pull request #17436 from taosdata/feature/TD-14761
fix:defeats in converity scan
2022-10-19 09:00:07 +08:00
Shengliang Guan 797ed80f70 enh: comment out unused codes in tsim 2022-10-18 18:08:49 +08:00
wangmm0220 41866ed397 fix:defeats in converity scan 2022-10-18 15:13:52 +08:00
wangmm0220 bce4fc9cf8 feat:add new interface for schemaless 2022-10-18 14:43:06 +08:00
wangmm0220 7b84b217c2 opti:add auto compile 2022-10-18 13:46:42 +08:00
wangmm0220 9fe6d23462 feat:add new interface for schemaless 2022-10-18 11:49:03 +08:00
wangmm0220 54e3617a6f fix:scan converity defects 2022-10-17 14:32:18 +08:00
Shengliang Guan e98335bdfa fix: coverity issues 2022-10-08 11:29:46 +08:00
wangmm0220 0e734f7aee fix:timestamp out of range 2022-09-29 10:39:22 +08:00
Shengliang Guan eead619f1a fix: coverity issues 2022-09-27 17:10:48 +08:00
Shengliang Guan c16f4ae3f7
Merge pull request #17037 from taosdata/fix/TD-19220
fix: do not send ttl msg on taosd startup
2022-09-27 11:24:03 +08:00
Shengliang Guan 8198516b7e fix: compile error in windows 2022-09-27 10:27:25 +08:00
Shengliang Guan 555a99bf90 enh: dump sdb info from mnode 2022-09-26 16:18:48 +08:00
Shengliang Guan 69e1edb344
Merge pull request #16898 from taosdata/fix/TD-18740
feat:Complete the automatic table creation function for taosX
2022-09-20 11:35:18 +08:00
wangmm0220 0a497f6f21 fix:error in auto create table for taosX 2022-09-19 15:07:18 +08:00
wangmm0220 6bfb85314e fix:error in auto create table for taosX 2022-09-19 13:49:55 +08:00
Shengliang Guan 30b2bd98b8 fix: STrans struct dbname2 naming ambiguity 2022-09-19 10:39:51 +08:00
wangmm0220 dfc5ce23a0 fix:error in auto create table for taosX 2022-09-16 17:01:41 +08:00
wangmm0220 13059c40bc fix:error in auto create table for taosX 2022-09-16 10:45:32 +08:00
wangmm0220 414021a8e0 fix:error in auto create table for taosX 2022-09-15 19:23:12 +08:00
wangmm0220 0afef12ce0 fix:add createTableList element in tmq_get_json 2022-09-14 18:52:56 +08:00
wangmm0220 8a8423d66d fix:add logic for auto create table in taosX 2022-09-14 16:44:41 +08:00
dapan1121 7bbb86f177 fix: fix test case issue 2022-09-05 10:19:17 +08:00