Commit Graph

24 Commits

Author SHA1 Message Date
Haojun Liao ab92886820
fix(stream): reduce the consensus checkpoint id trans. (#30105)
* fix(stream): reduce the consensus checkpoint id trans.

* refactor(stream): add some logs.

* refactor(stream): set the max checkpoint exec time 30min.

* refactor(stream): add checkpoint-consensus trans conflict check.

* refactor(stream): remove unused local variables.

* fix(stream): fix syntax error.

* fix(stream): 1. fix free memory error 2. continue if put result into dst hashmap failed.

* fix issue

* fix issue

* fix(mnd): follower mnode not processes the timer event.

* fix(stream): print correct error msg.

* fix(stream): add some logs.

* fix(stream): add some logs.

* fix(stream): add some logs.

* fix(stream): add some logs.

* fix(stream): add some logs.

* fix(stream): add some logs.

* fix(stream): add some logs.

* fix(stream): add some logs.

* fix(stream): truncate long subtable name

* fix(stream): add buffer len.

* refactor(stream): update some logs.

* fix issue

* refactor(stream): update some logs.

* refactor(stream): update some logs.

* fix(stream): check return value.

* fix(stream): fix syntax error.

* fix(stream): check return value.

* fix(stream): update the timer check in mnode.

* fix(stream): add restart stage tracking.

* fix(stream): track the start task stage for meta.

* fix(stream): fix error in log.

* refactor(stream): adjust log info.

* fix mem issue

* fix(stream): check the number of required tasks for consensus checkpointId.

* fix(stream): lock the whole start procedure.

* fix(stream): add lock during start all tasks.

* fix(stream): update logs.

* fix(stream): update logs.

* fix(stream): update logs.

* fix(stream): fix dead-lock.

* fix(stream): fix syntax error.

* fix(stream): not drop the scan-history task.

* fix(stream): fix syntax error.

* fix(stream): wait for executor stop before restarting.

* fix(stream): add some logs.

* fix(stream): add some logs.

* fix(stream): add some logs.

* fix(stream): disable some logs.

* fix(stream): reset the start info if no task left.

---------

Co-authored-by: 54liuyao <54liuyao@163.com>
Co-authored-by: Jinqing Kuang <kuangjinqingcn@gmail.com>
2025-03-17 10:20:17 +08:00
wangmm0220 bfe0f143da fix[TS-5812]:add params check 2024-12-25 19:34:58 +08:00
wangmm0220 25dc5d7b5c fix[TS-5812]:add params check 2024-12-25 17:53:34 +08:00
Jinqing Kuang 0199c8dddf fix(query)[TD-32415]. Replace memory-unsafe functions
- Replace memory unsafe functions with secure alternatives
- Fix automatical generation of subtable names
2024-10-11 14:34:19 +08:00
wangmm0220 919e2848b3 fix:remove dot from child table in stream 2024-05-15 13:40:33 +08:00
Hongze Cheng ac1d7c2bdb fix compile error 2024-02-27 10:08:02 +08:00
kailixu 17ae867ec6 fix: grammar of init on windows 2024-02-26 09:07:11 +08:00
kailixu bc456e6183 fix: grammar of init on windows 2024-02-26 08:51:06 +08:00
kailixu c54dfc36c2 enh: coverity for dataformatTest 2024-02-26 01:35:18 +08:00
kailixu 4ceb085613 enh: coverity of trow 2024-02-26 01:03:08 +08:00
Dingle Zhang 984211f3b4
Feature/3.0 geometry (#21037)
* Add GEOMETRY data type and make sql.c able to parse it. The GEMETRY works like BINARY so far.

* add GEOMETRY type into gConvertTypes to fix some issues like DELETE calling

* change some test cases to make sure no same timestamp is inserted, and add my smoketest.sh

* Add a function MakePoint() and introduce a lib geometry

* implement sql functions GeomFromText() and AsText()

* Use GEOS *_r funcions instead for thread safety

* Handle with TSDB_DATA_TYPE_GEOMETRY when INSERT geometry data by converting WKT.
Add geosWrapper to wrap the basic GEOS functions for TDEngine.

* refactor AsText and MakePoint functions to be like GeomFromText

* Show WKT when print geometry data in screen
Dump hex data when dump geometry data in a file

* define TYPE_BYTES item for TSDB_DATA_TYPE_GEOMETRY, which casued some strange issues.

* set number of decimals of WKT to 6

* Implement SQL function Intersects()

* refactor geometry sql functions

* Add geosErrMsgeHandler() to get the GEOS error detail

* use threadlocal to instantiate SGeosContext
call destroyGeosContext() only if the thread exists

* remove SGeosContext *context param for all geometry functions since we use thread local one,
so that all caller do not need to know the context.

* Modify Intersects() to call PreparedIntersects() when one of param is a constant, which has higher performance.

* rename prepareFn() to initCtxFn() to avoid confusion with PreparedFn

* Add prefix "ST_" for all geometry functions

* move getThreadLocalGeosCtx() and destroyThreadLocalGeosCtx() into util,
so that all unit test tools can compile

* Add unit test for geometry lib, only test MakePoint so far

* refactor and enhance existing cases in geomFuncTest

* implement NULL type and NULL value test for geomFuncTest

* add test on geomFromText()

* add unit test on AsText() in geomFuncTest

* combine some makePointFunction test items

* add intersectsFunctionTwoColumns test
refactor on callGeomFromTextWrapper functions

* enhance intersectsFunction test to add cases like input constant , NULL type, NULL value, or wrong content

* add more cases into intersectsFunction test

* Add basic test on geometry in system test

* Add ST_GeomFromText and ST_AsText function test in system test on geometry

* add ST_Intersects function test in system test on geometry

* support to check expectedErrno in system test on geometry

* adjust geomTest unit test and geometry system test

* add geometry data type and functions in doc english version

* implement touchesFunction() in geometry lib
refactor geometry relation functions model

* separate gemFuncTest into several src files

* add unit test on touchesFunction

* support sql function ST_Touches()
add system test on ST_Touches

* add docs for ST_Touches()

* Add ST_Contains()

* Add ST_Covers()

* Add ST_Equals()

* add swapAllowed param for geomRelationFunction()
read geom2 earlier intead of at doGeosRelation()

* Add ST_ContainsProperly()

* build on windows

* Merge from 3.0 to 3.0_geometry

* change macro definition TSDB_DATA_TYPE_GEOMETRY as the last one for compatibility

* change '\\NULL' to 'NULL' back in shellDumpFieldToFile()

* add /usr/local/include into include directory

* add /usr/local/inlcude and /usr/local/lib in cmake.platform for DARWIN
2023-05-24 15:36:46 +08:00
Hongze Cheng c1db8a9e4d refact code 2022-11-23 20:13:27 +08:00
Hongze Cheng ac0ac3a577 Merge branch 'enh/cv_optimize' of https://github.com/taosdata/TDengine into feat/stream_compression 2022-09-23 19:08:21 +08:00
Hongze Cheng cac18913d5 make it unit test compile 2022-09-23 19:07:18 +08:00
Hongze Cheng f870f7e453 fix gtest compile error 2022-09-21 16:08:51 +08:00
Cary Xu 0f5983ad88 fix: merge dup rows in client 2022-07-20 20:30:54 +08:00
Hongze Cheng 31d3ae244e make it compile 2022-07-12 02:19:38 +00:00
Hongze Cheng 85b4896fa4 more row refact 2022-07-11 12:48:16 +00:00
Cary Xu 8997f2cdc1 fix: solve a non-standard explicit type conversion 2022-06-09 16:26:30 +08:00
Cary Xu fb3b66413e enh: code optimization for trow 2022-06-09 15:13:58 +08:00
Cary Xu 08a19b7b28 enh: set 0 in flen part for tsrow 2022-06-09 15:00:48 +08:00
Cary Xu c9b0b7cd76 feat: add test case for tsrow 2022-06-09 11:53:50 +08:00
Hongze Cheng 96eecc4d3e more refact 2022-05-16 11:43:48 +00:00
Hongze Cheng de5828e485 refact more 2022-05-16 11:35:37 +00:00