Commit Graph

575 Commits

Author SHA1 Message Date
Haojun Liao 0c578ab6c0 refactor: do some internal refactor. 2024-03-21 10:44:27 +08:00
Hongze Cheng f6c2a6bba2 more fix 2024-03-11 19:17:30 +08:00
dapan1121 46ea22eecb Merge remote-tracking branch 'origin/3.0' into feat/TD-27337 2024-03-06 13:12:01 +08:00
Hongze Cheng c8280e05dd Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TS-4243-3.0 2024-03-03 16:01:34 +08:00
dapan1121 ac1d757afe
Merge pull request #24866 from taosdata/fix/xsren/TD-28513/oom3.0
Fix/xsren/td 28513/oom3.0
2024-02-29 18:53:57 +08:00
factosea 1fe35031e0 fix: get firstNRows Length 2024-02-29 16:32:58 +08:00
factosea ae660f95ed fix: get firstNRows Length 2024-02-29 15:02:55 +08:00
factosea 551a65e161 fix: varmeta length reset 2024-02-29 10:44:25 +08:00
dapan1121 521c96913e Merge remote-tracking branch 'origin/3.0' into feat/TD-27337 2024-02-27 18:20:45 +08:00
Hongze Cheng 8a669d3adc Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TS-4243-3.0 2024-02-26 10:48:14 +08:00
factosea 8230b238fb fix: keepFirstNRows 2024-02-25 22:56:32 +08:00
factosea 5647d990b4 fix: colDataAssign 2024-02-25 21:37:33 +08:00
Haojun Liao 3cd158f681 fix(stream): fix the invalid check for subtable name. 2024-02-24 02:19:40 +08:00
Haojun Liao 2800454c35 Merge branch '3.0' into fix/nullcheck 2024-02-24 01:46:15 +08:00
Haojun Liao df2488431e fix(stream): add logs. 2024-02-24 00:40:26 +08:00
Hongze Cheng a6423b7816 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TS-4243-3.0 2024-02-23 14:47:10 +08:00
dapan1121 a745319b81 Merge remote-tracking branch 'origin/3.0' into feat/TD-27337 2024-02-23 08:59:16 +08:00
wangmm0220 c2c49a4b22 fix:change datablock to old version for compatibility 2024-02-22 19:01:58 +08:00
wangmm0220 604ae220f3 fix:change datablock to old version for compatibility 2024-02-22 17:48:33 +08:00
factosea 3341d02060 fix: don't copy all data when use limit 2024-02-22 17:03:17 +08:00
wangmm0220 4037a7a1a5 fix:change datablock to old version for compatibility 2024-02-22 15:44:50 +08:00
Hongze Cheng 4b71031014 more code 2024-02-21 14:29:10 +08:00
dapan1121 ba41231373
Merge pull request #24614 from taosdata/szhou/tms/port-3
feat: multi-readers and one merge tree
2024-02-21 10:00:52 +08:00
dapan1121 98ed2458ea Merge remote-tracking branch 'origin/3.0' into feat/TD-27337 2024-02-20 17:39:51 -08:00
factosea ccba2c6612 fix: block format 2024-02-19 17:30:06 +08:00
factosea 5434019d2b fix: count(tag) when use qnode 2024-02-18 15:50:34 +08:00
dapan1121 ab87953362 enh: support window join 2024-02-01 14:58:08 +08:00
slzhou af422e77c6 fix: restore pseudo column pData and not skip and data block cleanup 2024-01-29 14:36:40 +08:00
slzhou 1eedb9e7fa fix: preallocated columns does not have data 2024-01-26 10:55:14 +08:00
dapan1121 6640809638 Merge remote-tracking branch 'origin/3.0' into feat/TD-27337 2024-01-23 14:48:12 +08:00
dapan1121 fb20dd51de Merge remote-tracking branch 'origin/3.0' into feat/TD-27337 2024-01-18 17:11:25 +08:00
wangmm0220 4227340d9e opti:[TD-28118] raw block data for tmq 2024-01-18 09:11:58 +08:00
wangmm0220 d5d1dd9127 opti:[TD-28118] raw block data for tmq 2024-01-17 20:08:26 +08:00
dapan1121 dec6e3fffe enh: support asof join 2024-01-12 18:29:27 +08:00
wangmm0220 02c7bdd4f0 fix:[TD-28032]fsdfasd 2024-01-10 14:57:16 +08:00
wangmm0220 df70a6ef57 fix:[TD-28032]concat subtable and hash val as new subtable name to avoid data from multi time line write to one time line 2024-01-03 21:11:26 +08:00
wangmm0220 b200e6807f fix:[TD-28032]concat subtable and hash val as new subtable name to avoid data from multi time line write to one time line 2024-01-03 19:44:30 +08:00
wangmm0220 317f0c6a39 fix:[TD-28032]concat subtable and hash val as new subtable name to avoid data from multi time line write to one time line 2024-01-03 18:48:54 +08:00
wangmm0220 8add4dc177 fix:[TD-28032]concat subtable and hash val as new subtable name to avoid data from multi time line write to one time line 2024-01-02 18:37:29 +08:00
dapan1121 8bdf3df6a9 enh: left join ut 2023-12-22 19:25:55 +08:00
dapan1121 e55b7c52d8 fix: add left join case 2023-12-14 17:06:19 +08:00
dapan1121 6d24c08651 fix: compile errors 2023-12-14 14:13:01 +08:00
dapan1121 b2fb30f6c0 feat: support hash join 2023-12-13 18:54:16 +08:00
dapan1121 d7535f832a enh: support cart in join 2023-12-07 19:22:46 +08:00
dapan1121 7c0e8b559c feat: support left join 2023-12-06 19:22:14 +08:00
kailixu 5fae10bc76 enh: error code when build delete req 2023-11-10 15:09:01 +08:00
kailixu 674e878ffa enh: rsma support delete 2023-11-10 14:44:29 +08:00
kailixu ee6e68a71e enh: rsma support delete 2023-11-10 07:02:46 +08:00
Haojun Liao eb4449999f other: merge 3.0 2023-10-12 10:33:48 +08:00
wangjiaming0909 b7725ac2fe fix: query tbname from systables memory corruption 2023-09-19 14:13:37 +08:00
dapan1121 8ef01584ee
Merge pull request #22629 from taosdata/feat/TD-25620
feat: optimize partition node, replace with sort node
2023-09-14 17:26:15 +08:00
Haojun Liao 24524e1a8d fix(stream): fix the invalid length of tag column name. 2023-09-11 19:10:54 +08:00
Haojun Liao 50ef500f51 refactor(stream): do sink module refactor. 2023-09-11 10:09:31 +08:00
wangjiaming0909 4a131000e4 fix: data error of partition by col + interval 2023-09-07 10:49:09 +08:00
dapan1121 2e7897239a fix: trim block and partition by constant function issue 2023-08-30 16:51:44 +08:00
dapan1121 0cce255a02 Merge remote-tracking branch 'origin/3.0' into fix/m23.0 2023-08-28 10:06:53 +08:00
Haojun Liao 88f6596965
Merge pull request #22464 from taosdata/feat/TD-18789
feat:support varbinary type
2023-08-28 09:45:57 +08:00
dapan1121 1f40da6fef Merge remote-tracking branch 'origin/main' into 3.0 2023-08-28 09:28:55 +08:00
liuyao b142979f7f mem leak 2023-08-24 15:00:09 +08:00
dapan1121 3045a623e1 Merge remote-tracking branch 'origin/3.0' into feat/TD-24700 2023-08-17 14:16:05 +08:00
wangmm0220 b3f945c4c5 fix:conflict 2023-08-16 19:35:05 +08:00
wangmm0220 f266d51764 feat:support varbinary type 2023-08-16 19:05:07 +08:00
dapan1121 143c657571 Merge remote-tracking branch 'origin/3.0' into feat/TD-24700 2023-08-16 14:50:31 +08:00
liuyao 919ffbaf72 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/ly_refactor 2023-08-16 10:04:07 +08:00
yihaoDeng 7d1e4a9894 rebuild index at tag0 2023-08-15 08:25:33 +00:00
liuyao 9d1e5a512d add stream task id 2023-08-14 17:52:39 +08:00
dapan1121 6ce28e8886 Merge remote-tracking branch 'origin/3.0' into feat/TD-24700 2023-08-14 10:49:56 +08:00
slzhou ff36f5f6ca fix: reset rowsize since it is set during blockDataAppendColInfo 2023-08-08 13:23:35 +08:00
dapan1121 4f75eb5655 Merge remote-tracking branch 'origin/3.0' into feat/TD-24700 2023-07-24 11:43:15 +08:00
slzhou b9aeda263c fix: fix ubsan error of null argument 2023-07-19 09:48:52 +08:00
dapan1121 779224f0a6 fix: fix bugs 2023-07-06 19:33:31 +08:00
dapan1121 c85bbef2e9 Merge remote-tracking branch 'origin/3.0' into feat/TD-24700 2023-07-05 11:13:57 +08:00
dapan1121 9f0da17c49 Merge remote-tracking branch 'origin/3.0' into feat/TD-24700 2023-06-28 19:40:55 +08:00
Haojun Liao ed900d6ff6
Merge branch '3.0' into refact/fillhistory 2023-06-28 13:48:26 +08:00
wangjiaming0909 57ddb3437d feature: optimize order by limit using priority queue 2023-06-27 17:50:50 +08:00
Haojun Liao 3289ad62be other: merge 3.0 2023-06-27 11:33:40 +08:00
dapan1121 4dae9f4eff merge main to 3.0 2023-06-26 18:43:00 +08:00
dapan1121 9972aa81d6 Merge remote-tracking branch 'origin/3.0' into feat/TD-24700 2023-06-25 17:31:32 +08:00
dapan1121 24a5a3f41b fix: compile issues 2023-06-25 17:31:04 +08:00
Haojun Liao 0322fdc1fc fix(stream): fix memory leak. 2023-06-24 23:43:43 +08:00
Haojun Liao ceb78fdad2
Merge branch '3.0' into refact/fillhistory 2023-06-24 18:53:48 +08:00
dapan1121 7e555e437b enh: add hash join 2023-06-20 19:34:16 +08:00
dapan1121 1ca24fea6b
Merge pull request #21742 from wangjiaming0909/feature/3.0/TD-24656
feature: add input, output ts order for execution plans
2023-06-18 19:24:29 +08:00
wangjiaming0909 fb4f174fbc feature: add input, output ts order for execution plans 2023-06-16 10:26:09 +08:00
Haojun Liao 74e0138f72 Merge branch '3.0' into refact/fillhistory 2023-06-15 15:25:00 +08:00
Haojun Liao 1b9eca5ce0 other: merge main. 2023-06-15 13:03:17 +08:00
Haojun Liao 55724157c4 refactor: remove one function. 2023-06-15 10:40:25 +08:00
slzhou a36557f009 fix: calculate the rows that can be put in one page 2023-06-14 13:44:11 +08:00
Haojun Liao 53246ed6bb other: merge other branch. 2023-06-09 09:41:10 +08:00
Haojun Liao 2b6ace653a refactor: do some internal refactor. 2023-06-08 16:14:27 +08:00
Haojun Liao f582705feb refactor: do some internal refactor. 2023-06-08 14:18:06 +08:00
liuyao 1e9c4d5fac opt stream block dispatch 2023-06-07 10:45:27 +08:00
dapan1121 a0428387a9 enh: corrent column data reassign issue 2023-06-06 16:44:15 +08:00
dapan1121 02b1257b01 enh: reassign data column in blocks 2023-06-06 11:17:02 +08:00
dapan1121 7381209618 enh: optimize filter performance 2023-06-05 16:08:11 +08:00
dapan1121 532e02fb2a enh: improve filter performance 2023-06-05 10:47:15 +08:00
liuyao 1f81642303 fix sma sliding window 2023-05-25 09:12:10 +08:00
Dingle Zhang 984211f3b4
Feature/3.0 geometry (#21037)
* Add GEOMETRY data type and make sql.c able to parse it. The GEMETRY works like BINARY so far.

* add GEOMETRY type into gConvertTypes to fix some issues like DELETE calling

* change some test cases to make sure no same timestamp is inserted, and add my smoketest.sh

* Add a function MakePoint() and introduce a lib geometry

* implement sql functions GeomFromText() and AsText()

* Use GEOS *_r funcions instead for thread safety

* Handle with TSDB_DATA_TYPE_GEOMETRY when INSERT geometry data by converting WKT.
Add geosWrapper to wrap the basic GEOS functions for TDEngine.

* refactor AsText and MakePoint functions to be like GeomFromText

* Show WKT when print geometry data in screen
Dump hex data when dump geometry data in a file

* define TYPE_BYTES item for TSDB_DATA_TYPE_GEOMETRY, which casued some strange issues.

* set number of decimals of WKT to 6

* Implement SQL function Intersects()

* refactor geometry sql functions

* Add geosErrMsgeHandler() to get the GEOS error detail

* use threadlocal to instantiate SGeosContext
call destroyGeosContext() only if the thread exists

* remove SGeosContext *context param for all geometry functions since we use thread local one,
so that all caller do not need to know the context.

* Modify Intersects() to call PreparedIntersects() when one of param is a constant, which has higher performance.

* rename prepareFn() to initCtxFn() to avoid confusion with PreparedFn

* Add prefix "ST_" for all geometry functions

* move getThreadLocalGeosCtx() and destroyThreadLocalGeosCtx() into util,
so that all unit test tools can compile

* Add unit test for geometry lib, only test MakePoint so far

* refactor and enhance existing cases in geomFuncTest

* implement NULL type and NULL value test for geomFuncTest

* add test on geomFromText()

* add unit test on AsText() in geomFuncTest

* combine some makePointFunction test items

* add intersectsFunctionTwoColumns test
refactor on callGeomFromTextWrapper functions

* enhance intersectsFunction test to add cases like input constant , NULL type, NULL value, or wrong content

* add more cases into intersectsFunction test

* Add basic test on geometry in system test

* Add ST_GeomFromText and ST_AsText function test in system test on geometry

* add ST_Intersects function test in system test on geometry

* support to check expectedErrno in system test on geometry

* adjust geomTest unit test and geometry system test

* add geometry data type and functions in doc english version

* implement touchesFunction() in geometry lib
refactor geometry relation functions model

* separate gemFuncTest into several src files

* add unit test on touchesFunction

* support sql function ST_Touches()
add system test on ST_Touches

* add docs for ST_Touches()

* Add ST_Contains()

* Add ST_Covers()

* Add ST_Equals()

* add swapAllowed param for geomRelationFunction()
read geom2 earlier intead of at doGeosRelation()

* Add ST_ContainsProperly()

* build on windows

* Merge from 3.0 to 3.0_geometry

* change macro definition TSDB_DATA_TYPE_GEOMETRY as the last one for compatibility

* change '\\NULL' to 'NULL' back in shellDumpFieldToFile()

* add /usr/local/include into include directory

* add /usr/local/inlcude and /usr/local/lib in cmake.platform for DARWIN
2023-05-24 15:36:46 +08:00
Haojun Liao 9423001fea
Merge pull request #21396 from taosdata/refact/fillhistory
Refact/fillhistory
2023-05-21 01:12:00 +08:00
Haojun Liao 8ab065d01e other: update some logs. 2023-05-19 23:53:23 +08:00