Commit Graph

273 Commits

Author SHA1 Message Date
wangmm0220 e76e06cf2e feat:[TD-30975]process return value in schemaless 2024-07-16 11:50:40 +08:00
wangmm0220 4ef2c39649 fix:[TS-4592]remove lost status 2024-07-11 14:56:25 +08:00
wangmm0220 69f235d6b5 fix:remove using alarm when sending slow log & use one thread to send all slow log 2024-06-29 16:16:36 +08:00
wangmm0220 4dddbf35bd fix:[TD-30360] drop database in the end to avoid not enough memory 2024-06-05 09:56:01 +08:00
dapan1121 affdeed944
Merge pull request #25909 from taosdata/feat/ly_tmq_batch_meta
optimize tmq snapshot meta
2024-06-03 10:19:57 +08:00
54liuyao 2cf657c767 add ci 2024-05-28 19:33:38 +08:00
54liuyao d815bb117b add json for batch meta 2024-05-28 16:56:23 +08:00
54liuyao 7fc2e8cc26 batch meta 2024-05-28 10:17:20 +08:00
wangmm0220 a23294d5f2 fix:[TD-30231]case failed in sometimes 2024-05-24 13:40:10 +08:00
54liuyao 441a150d66 optimize tmq snapshot meta 2024-05-23 17:35:54 +08:00
yihaoDeng 697ca8914e enh compress 2024-06-22 11:35:47 +08:00
wangmm0220 19b7bb9e0c fix:[TD-29793] check if column and tag name are dumplicate in schemaless 2024-04-26 11:41:41 +08:00
wangmm0220 c5f45c5114 fix:memory leak 2024-04-25 14:28:28 +08:00
wangmm0220 aed5e50eee fix:[TD-29793] check if column and tag name are dumplicate in schemaless 2024-04-25 11:25:20 +08:00
wangmm0220 4b29184408 fix:[TD-29793] check if column and tag name are dumplicate in schemaless 2024-04-25 11:06:20 +08:00
Yihao Deng b244344fb3 add tmq interface 2024-04-23 02:56:39 +00:00
Yihao Deng 957100d108 add tmq interface 2024-04-22 13:53:33 +00:00
wangmm0220 16065e2a2d fix:move err msg to tmq interface 2024-04-19 16:36:11 +08:00
wangmm0220 fe7bfc88c0 fix:ci error 2024-04-19 14:14:09 +08:00
wangmm0220 529ca1d1c1 opti:add local thread error msg array 2024-04-18 13:56:43 +08:00
wangmm0220 2052c347dd fix:case error 2024-04-12 14:19:16 +08:00
wangmm0220 ca8153fb98 fix:filter data error & add test case 2024-04-12 09:49:08 +08:00
wangmm0220 da6eda6912 Merge branch 'feat/TS-4243-3.0' of https://github.com/taosdata/TDengine into feat/TS-4243-tmq 2024-04-09 13:44:09 +08:00
wangmm0220 4285f07f76 fix:memory leak 2024-04-08 23:33:58 +08:00
wangmm0220 64280a10cc fix:disable primary key in schemaless 2024-04-07 15:04:34 +08:00
wangmm0220 6174c3bfd3 fix:disable primary key in schemaless 2024-04-07 14:54:58 +08:00
wangmm0220 f1853ced26 feat:[TS-4243] add logic for primark key in tmq 2024-03-22 17:48:59 +08:00
wangmm0220 5d2d8d5f48 Merge branch 'mark/3.0' of https://github.com/taosdata/TDengine into mark/3.0 2024-03-04 14:58:26 +08:00
wangmm0220 c7d115d8aa fix:add excluded msg for delete in tmq 2024-03-04 14:58:13 +08:00
wangmm0220 828889a6d8 opti:deal with escape in the end of field in schemaless 2024-02-27 19:16:11 +08:00
wangmm0220 d62b82c295 opti:deal with escape in the end of field in schemaless 2024-02-27 16:02:15 +08:00
wangmm0220 c22360a529 fix:add excluded msg for meta in tmq 2024-02-22 11:32:45 +08:00
wangmm0220 478e1a67ae fix:[TD-28590]add logic for consume excluded 2024-02-06 18:14:06 +08:00
wangmm0220 35f154da37 fix:[TS-4479] support long varbinary in format like \x3423 2024-01-29 13:55:46 +08:00
wangmm0220 4346d6ef5d fix:[TD-27803]process commit logic if manual commit in the end 2023-12-14 14:59:30 +08:00
Alex Duan 37cfe6e783
Merge pull request #23974 from taosdata/case/TD-25756-3.0
fix: add write_raw_block api check ret error message
2023-12-08 09:08:07 +08:00
wangmm0220 60500f4a81 fix:error 2023-12-07 15:17:15 +08:00
Alex Duan 5143def177 fix: add write_raw_block api check ret error message 2023-12-07 15:05:56 +08:00
Alex Duan 8488f25d20 fix: add write_raw_block api check ret error message 2023-12-07 15:01:38 +08:00
wangmm0220 916f5d4cf9 fix:format-overflow may be happend 2023-11-21 19:15:57 +08:00
wangmm0220 b3ca673fe9 fix:test case for windows 2023-11-21 14:35:41 +08:00
wangmm0220 bb8b65da1e fix:open test cases 2023-10-30 10:03:51 +08:00
Haojun Liao c6dd73b68b
Merge pull request #23187 from taosdata/feat/TD-26056
feat:add replay logic
2023-10-18 11:43:43 +08:00
wangmm0220 a16c9be49f feat:[TD-19291]Schemaless table name can be composed based on rule 2023-10-17 15:34:16 +08:00
wangmm0220 7a23615b3f fix:offset set to earliest clearly 2023-10-16 17:53:48 +08:00
wangmm0220 473142fab7 fix:conflicts from 3.0 2023-10-16 11:35:56 +08:00
Haojun Liao eb4449999f other: merge 3.0 2023-10-12 10:33:48 +08:00
wangmm0220 d42e819d2d feat:[TD-26056] add replay logic 2023-10-10 09:02:37 +08:00
wangmm0220 b12c734f09 feat:[TD-26056] add replay logic 2023-10-09 21:14:32 +08:00
wangmm0220 d10915dce6 feat:[TD-26056] add replay logic 2023-10-09 19:03:13 +08:00
wangmm0220 33045e63ae feat:[TD-26056] add replay logic 2023-10-09 17:35:40 +08:00
wangmm0220 b04d57fcc3 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26056 2023-10-08 16:15:19 +08:00
wangmm0220 3f2d890560 feat:[TD-26056] add replay logic 2023-10-08 16:06:15 +08:00
wangmm0220 be27e13ed9 fix:test case error for reset=latest 2023-10-08 15:29:02 +08:00
Alex Duan 0ca99ea9c9 feat: add TSZ algo test cases 2023-09-20 19:33:25 +08:00
Haojun Liao 60f5056ab7 other: merge 3.0 2023-09-12 22:00:40 +08:00
wangmm0220 53c4f4a147 opti:commit logic 2023-09-05 10:35:05 +08:00
wangmm0220 a0fadb07ea fix:support length function for varbinary 2023-09-04 17:15:03 +08:00
wangmm0220 f0fbe08e1d fix:core dump if tmq is null 2023-09-01 16:45:46 +08:00
dapan1121 cc17848b78 fix: merge 3.0 to main 2023-09-01 13:24:47 +08:00
Haojun Liao b1aa86a290
Merge pull request #22605 from taosdata/feat/TD-18789
feat:support varbinary type
2023-08-30 11:29:26 +08:00
wangmm0220 af89cb0af5 fix:memory error 2023-08-29 15:58:24 +08:00
wangmm0220 df5f46634b fix:open test case 2023-08-29 15:41:45 +08:00
wangmm0220 34c7832850 feat:support stmt/tmq json in varbinary type 2023-08-29 15:24:12 +08:00
wangmm0220 201a8f0918 feat:support varbinary type 2023-08-28 19:06:16 +08:00
wangmm0220 f5256a4091 fix:sml error because of the config of smlDot2Underline 2023-08-28 14:35:01 +08:00
wangmm0220 c0002e55ad fix:sml error because of the config of smlDot2Underline 2023-08-28 14:33:21 +08:00
dapan1121 0cce255a02 Merge remote-tracking branch 'origin/3.0' into fix/m23.0 2023-08-28 10:06:53 +08:00
wangmm0220 1319066e0e fix:memory leak 2023-08-28 10:05:54 +08:00
dapan1121 1f40da6fef Merge remote-tracking branch 'origin/main' into 3.0 2023-08-28 09:28:55 +08:00
wangmm0220 26e025d78d feat:[TD-18789]support varbinary type 2023-08-25 15:43:45 +08:00
wangmm0220 64959f14e9 fix:dot process in schemaless 2023-08-24 18:18:02 +08:00
wangmm0220 b3f945c4c5 fix:conflict 2023-08-16 19:35:05 +08:00
wade zhang 1a1a12b7b8
Merge pull request #22327 from taosdata/fix/TD-25010-3
feat(tsdb/cos): s3 migration
2023-08-16 08:02:20 +08:00
wangmm0220 7441801e9d feat:support varbinary type 2023-08-15 13:57:05 +08:00
dapan1121 937dcf00bb
Merge pull request #22430 from taosdata/fix/TD-25622-3.0x
fix: use taos_static for tmq_sim on windows
2023-08-15 09:54:57 +08:00
Haojun Liao 9e3733a02c
Merge pull request #22358 from taosdata/feat/TD-24559
feat:[TD-24559]support geomety type in schemaless
2023-08-14 22:06:41 +08:00
kailixu 8d0461e98c fix: use taos_static for tmq_sim on windows 2023-08-14 16:31:58 +08:00
wangmm0220 25e32bbf7c fix:offset error in tmq & add test cases 2023-08-11 14:25:12 +08:00
wangmm0220 6155c80729 fix:offset error in tmq & add test cases 2023-08-10 18:38:01 +08:00
wangmm0220 ab9ad7d088 fix:offset error in tmq & add test cases 2023-08-10 17:13:10 +08:00
wangmm0220 78fd70202c fix:offset error in tmq & add test cases 2023-08-10 16:18:53 +08:00
wangmm0220 1f5532fd67 fix:offset error in tmq & add test cases 2023-08-09 19:41:22 +08:00
wangmm0220 d0335bec97 feat:[TD-24559]support geomety type in schemaless 2023-08-08 09:49:31 +08:00
Minglei Jin fac7e521e9 s3/evict: fetch atime from stat file 2023-08-07 15:59:37 +08:00
wangmm0220 1f8e5eae6a fix:conflicts 2023-07-28 15:04:12 +08:00
wangmm0220 2714db10bd fix:modify dot to underline in schemaless supertable name 2023-07-24 19:15:33 +08:00
wangmm0220 136bc379d1 feat:ignore delete info 2023-07-03 11:02:08 +08:00
wangmm0220 8bb16b3efb fix:add config for tmq test 2023-06-30 18:16:03 +08:00
dapan1121 4dae9f4eff merge main to 3.0 2023-06-26 18:43:00 +08:00
Shungang Li b93f653d7e feat: enhance ttl, deletetime modified by writing-ops
new config item: ttlChangeOnWrite (default 0)
ttl delete time changes on last write if true
2023-06-19 19:03:35 +08:00
yihaoDeng 9b749b8faa change link op t 2023-06-08 02:43:44 +00:00
Haojun Liao b932fdb5c4
Merge pull request #21470 from taosdata/feature/TD-24070
feat:add privilege for schemaless
2023-05-25 17:52:28 +08:00
wangmm0220 f6fef3e9d6 feat:add privilege for schemaless 2023-05-25 14:54:21 +08:00
wangmm0220 fcba7e326c feat:add privilege for schemaless 2023-05-25 14:24:25 +08:00
Dingle Zhang 984211f3b4
Feature/3.0 geometry (#21037)
* Add GEOMETRY data type and make sql.c able to parse it. The GEMETRY works like BINARY so far.

* add GEOMETRY type into gConvertTypes to fix some issues like DELETE calling

* change some test cases to make sure no same timestamp is inserted, and add my smoketest.sh

* Add a function MakePoint() and introduce a lib geometry

* implement sql functions GeomFromText() and AsText()

* Use GEOS *_r funcions instead for thread safety

* Handle with TSDB_DATA_TYPE_GEOMETRY when INSERT geometry data by converting WKT.
Add geosWrapper to wrap the basic GEOS functions for TDEngine.

* refactor AsText and MakePoint functions to be like GeomFromText

* Show WKT when print geometry data in screen
Dump hex data when dump geometry data in a file

* define TYPE_BYTES item for TSDB_DATA_TYPE_GEOMETRY, which casued some strange issues.

* set number of decimals of WKT to 6

* Implement SQL function Intersects()

* refactor geometry sql functions

* Add geosErrMsgeHandler() to get the GEOS error detail

* use threadlocal to instantiate SGeosContext
call destroyGeosContext() only if the thread exists

* remove SGeosContext *context param for all geometry functions since we use thread local one,
so that all caller do not need to know the context.

* Modify Intersects() to call PreparedIntersects() when one of param is a constant, which has higher performance.

* rename prepareFn() to initCtxFn() to avoid confusion with PreparedFn

* Add prefix "ST_" for all geometry functions

* move getThreadLocalGeosCtx() and destroyThreadLocalGeosCtx() into util,
so that all unit test tools can compile

* Add unit test for geometry lib, only test MakePoint so far

* refactor and enhance existing cases in geomFuncTest

* implement NULL type and NULL value test for geomFuncTest

* add test on geomFromText()

* add unit test on AsText() in geomFuncTest

* combine some makePointFunction test items

* add intersectsFunctionTwoColumns test
refactor on callGeomFromTextWrapper functions

* enhance intersectsFunction test to add cases like input constant , NULL type, NULL value, or wrong content

* add more cases into intersectsFunction test

* Add basic test on geometry in system test

* Add ST_GeomFromText and ST_AsText function test in system test on geometry

* add ST_Intersects function test in system test on geometry

* support to check expectedErrno in system test on geometry

* adjust geomTest unit test and geometry system test

* add geometry data type and functions in doc english version

* implement touchesFunction() in geometry lib
refactor geometry relation functions model

* separate gemFuncTest into several src files

* add unit test on touchesFunction

* support sql function ST_Touches()
add system test on ST_Touches

* add docs for ST_Touches()

* Add ST_Contains()

* Add ST_Covers()

* Add ST_Equals()

* add swapAllowed param for geomRelationFunction()
read geom2 earlier intead of at doGeosRelation()

* Add ST_ContainsProperly()

* build on windows

* Merge from 3.0 to 3.0_geometry

* change macro definition TSDB_DATA_TYPE_GEOMETRY as the last one for compatibility

* change '\\NULL' to 'NULL' back in shellDumpFieldToFile()

* add /usr/local/include into include directory

* add /usr/local/inlcude and /usr/local/lib in cmake.platform for DARWIN
2023-05-24 15:36:46 +08:00
wangmm0220 fb9b0a3e86 feat:add privilege for schemaless 2023-05-24 14:34:52 +08:00
Haojun Liao 4b961753a5 test: update the test case. 2023-05-12 15:13:25 +08:00
Haojun Liao f20afb7304 fix(test): update the test case. 2023-05-12 14:53:01 +08:00
wangmm0220 3fb2d7656d fix:[TS-3303]use stable name + child table name as key to save uid to avoid multi items for one table in submit block 2023-05-05 13:39:37 +08:00