Commit Graph

1755 Commits

Author SHA1 Message Date
wangmm0220 7e38ef7091 fix:add limit for topic and group num 2023-06-27 17:44:51 +08:00
Haojun Liao 1ad05a06d6
Merge branch '3.0' into enh/tsdb_optimize 2023-06-27 11:46:37 +08:00
dapan1121 4dae9f4eff merge main to 3.0 2023-06-26 18:43:00 +08:00
dapan1121 c4d630aaa1 fix: merge tree free rc issue 2023-06-21 13:58:07 +08:00
Hongze Cheng 6d2ce5cd39 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-06-19 14:13:08 +08:00
Benguang Zhao 495ae49752 fix: refreshMeta on invalid schema of tb epSet in doAsyncQuery 2023-06-16 15:41:52 +08:00
wade zhang d5f37359f4
Merge pull request #21722 from taosdata/fix/TD-24761
fix(tsdb/cache): rewrite cache update to fix cpu usage
2023-06-16 11:52:02 +08:00
Minglei Jin 968e3cf1ea lru/applyF: fix ret value 2023-06-16 10:00:17 +08:00
dapan1121 575c48212a
Merge pull request #21721 from taosdata/fix/TD-24707
fix: forbid system table functions
2023-06-15 18:52:33 +08:00
Minglei Jin 158ae209bf cache/lru: new applyF API for tlrucache 2023-06-15 16:34:51 +08:00
wangmm0220 22776e60d5 fix:control memory size if consumer group is too much 2023-06-15 14:51:04 +08:00
Ganlin Zhao e79d63d766 add error code 2023-06-14 13:34:25 +08:00
Hongze Cheng 48ea3963e7 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-06-14 13:12:31 +08:00
wangmm0220 d8d6b6dd21 Merge branch '3.0' of https://github.com/taosdata/TDengine into feature/TD-24749 2023-06-13 15:15:05 +08:00
wangmm0220 8a81278024 fix:load pHandle if necessary wher tq restore 2023-06-13 15:14:11 +08:00
Hongze Cheng 7baeabc6b9 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-06-13 13:21:12 +08:00
Benguang Zhao 3689b41f3a Merge branch '3.0' into FIX/TD-24182-3.0 2023-06-12 09:39:49 +08:00
Hongze Cheng 91c8391bff Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-06-08 09:53:57 +08:00
wade zhang e12af9327e
Merge pull request #21612 from luckeverda/geo
fix: compress core by tDataTypes
2023-06-06 14:20:45 +08:00
Shungang Li 472665e4b1 fix: compress core by tDataTypes 2023-06-06 13:06:53 +08:00
Benguang Zhao ae26f701ae fix: ignore TSDB_CODE_MND_TRANS_SYNC_TIMEOUT on updating trans 2023-06-02 18:49:15 +08:00
Hongze Cheng 33afb08e5c Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-06-02 14:40:01 +08:00
Haojun Liao 5301c5756a other: merge main into 3.0. 2023-06-01 09:29:18 +08:00
Hongze Cheng b479a0a06b Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-05-29 21:46:26 +08:00
dapan1121 94c3569a27
Merge pull request #21512 from wangjiaming0909/fix/3.0/TS-3457
fix: page buffer cache flush wrong bytes of data into disk
2023-05-29 16:55:23 +08:00
kailixu f984e67eaa fix(query): invalid buffer page 2023-05-29 16:04:35 +08:00
wangjiaming0909 5e2d3939fe fix: page buffer cache flush wrong bytes of data into disk 2023-05-29 15:19:34 +08:00
kailixu 3bbf5405c6 fix(query): invalid buf page 2023-05-29 14:36:29 +08:00
Hongze Cheng 880359ddb3 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-05-27 11:50:25 +08:00
dmchen fcf2b58aad check offline when force 2023-05-26 12:48:37 +08:00
Ganlin Zhao a57da3bdf7 fix: fix log not compressed when logKeepDays set to positive value 2023-05-25 14:13:34 +08:00
Hongze Cheng 3c2a54ab4b Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-05-24 18:28:56 +08:00
Dingle Zhang 984211f3b4
Feature/3.0 geometry (#21037)
* Add GEOMETRY data type and make sql.c able to parse it. The GEMETRY works like BINARY so far.

* add GEOMETRY type into gConvertTypes to fix some issues like DELETE calling

* change some test cases to make sure no same timestamp is inserted, and add my smoketest.sh

* Add a function MakePoint() and introduce a lib geometry

* implement sql functions GeomFromText() and AsText()

* Use GEOS *_r funcions instead for thread safety

* Handle with TSDB_DATA_TYPE_GEOMETRY when INSERT geometry data by converting WKT.
Add geosWrapper to wrap the basic GEOS functions for TDEngine.

* refactor AsText and MakePoint functions to be like GeomFromText

* Show WKT when print geometry data in screen
Dump hex data when dump geometry data in a file

* define TYPE_BYTES item for TSDB_DATA_TYPE_GEOMETRY, which casued some strange issues.

* set number of decimals of WKT to 6

* Implement SQL function Intersects()

* refactor geometry sql functions

* Add geosErrMsgeHandler() to get the GEOS error detail

* use threadlocal to instantiate SGeosContext
call destroyGeosContext() only if the thread exists

* remove SGeosContext *context param for all geometry functions since we use thread local one,
so that all caller do not need to know the context.

* Modify Intersects() to call PreparedIntersects() when one of param is a constant, which has higher performance.

* rename prepareFn() to initCtxFn() to avoid confusion with PreparedFn

* Add prefix "ST_" for all geometry functions

* move getThreadLocalGeosCtx() and destroyThreadLocalGeosCtx() into util,
so that all unit test tools can compile

* Add unit test for geometry lib, only test MakePoint so far

* refactor and enhance existing cases in geomFuncTest

* implement NULL type and NULL value test for geomFuncTest

* add test on geomFromText()

* add unit test on AsText() in geomFuncTest

* combine some makePointFunction test items

* add intersectsFunctionTwoColumns test
refactor on callGeomFromTextWrapper functions

* enhance intersectsFunction test to add cases like input constant , NULL type, NULL value, or wrong content

* add more cases into intersectsFunction test

* Add basic test on geometry in system test

* Add ST_GeomFromText and ST_AsText function test in system test on geometry

* add ST_Intersects function test in system test on geometry

* support to check expectedErrno in system test on geometry

* adjust geomTest unit test and geometry system test

* add geometry data type and functions in doc english version

* implement touchesFunction() in geometry lib
refactor geometry relation functions model

* separate gemFuncTest into several src files

* add unit test on touchesFunction

* support sql function ST_Touches()
add system test on ST_Touches

* add docs for ST_Touches()

* Add ST_Contains()

* Add ST_Covers()

* Add ST_Equals()

* add swapAllowed param for geomRelationFunction()
read geom2 earlier intead of at doGeosRelation()

* Add ST_ContainsProperly()

* build on windows

* Merge from 3.0 to 3.0_geometry

* change macro definition TSDB_DATA_TYPE_GEOMETRY as the last one for compatibility

* change '\\NULL' to 'NULL' back in shellDumpFieldToFile()

* add /usr/local/include into include directory

* add /usr/local/inlcude and /usr/local/lib in cmake.platform for DARWIN
2023-05-24 15:36:46 +08:00
Hongze Cheng 70c2d5ae49 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-05-19 17:57:02 +08:00
dapan1121 42c65898ea
Merge pull request #21335 from taosdata/feat/TD-22746
feat: support client meta control
2023-05-19 16:55:08 +08:00
dapan efbc3fc7c6 fix: tmr in windows can't re-init issue 2023-05-19 14:19:29 +08:00
dapan1121 5183e5dd51
Merge pull request #21348 from wangjiaming0909/fix/3.0/TD-24227
fix: invalid memory access of buffer after vsnprintf
2023-05-19 11:18:38 +08:00
Hongze Cheng 66ea10755e Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-05-19 10:58:12 +08:00
wade zhang 1ade314043
Merge pull request #21325 from taosdata/feat/force-drop-dnode
Feat/force drop dnode
2023-05-19 09:23:54 +08:00
wade zhang f3bdc855cb
refine an error messsage 2023-05-18 19:09:54 +08:00
Hongze Cheng c7d1c88fbc more code 2023-05-18 15:06:21 +08:00
dmchen 178a303832 change restore prompt message 2023-05-18 14:43:10 +08:00
dapan1121 cde094f72f
Merge pull request #21337 from taosdata/fix/TD-24214
fix: union clause error message
2023-05-18 10:39:19 +08:00
Hongze Cheng c8ba83cb31 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-05-18 10:38:50 +08:00
wangjiaming0909 77cfab5093 fix: invalid memory access of buffer after vsnprintf 2023-05-18 07:35:36 +08:00
Hongze Cheng 4b5ea55d1a more code 2023-05-17 16:46:10 +08:00
Haojun Liao 041ffa91bd other: merge main. 2023-05-17 15:42:15 +08:00
dapan1121 28b098c824 fix: union clause error message 2023-05-17 10:47:11 +08:00
dmchen 9ff56a4e2b unsafe command 2023-05-16 14:02:54 +08:00
Hongze Cheng e783609ebd more code 2023-05-16 09:36:32 +08:00
Hongze Cheng c31b1034cd Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-05-15 14:26:40 +08:00
dapan1121 198be9a7a6 fix: double decompress issue and memory leak issue 2023-05-15 10:13:20 +08:00
Haojun Liao 99148d6719 other: merge 3.0 2023-05-13 20:02:48 +08:00
dapan1121 3ca5559b37 fix: invalid read issue 2023-05-12 19:27:11 +08:00
kailixu 7643114216 Merge branch '3.0' into enh/TD-23582-3.0 2023-05-12 14:26:33 +08:00
Hongze Cheng a15a1ab806 Merge branches 'enh/tsdb_optimize' and '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-05-12 14:14:45 +08:00
kailixu 0c9aa5bf3f merge main 2023-05-12 13:55:22 +08:00
dapan1121 69795286fa Merge remote-tracking branch 'origin/main' into enh/tsbsPerf.4 2023-05-12 13:46:16 +08:00
yihaoDeng 5708fcb5cb Merge branch 'enh/3.0' into enh/rocksdbSstateMerge 2023-05-10 08:02:16 +00:00
dmchen 565c930f77 check 2 mnode 2023-05-10 15:50:54 +08:00
dmchen 9b29cfe831 fix/restore check 2023-05-10 14:36:52 +08:00
yihaoDeng 8356533eb1 Merge branch 'enh/standVer' into enh/rocksdbSstateMerge 2023-05-09 12:13:16 +00:00
cadem 843d606058 feat/restore dnode 2023-05-09 17:15:37 +08:00
yihaoDeng 55014aa003 Merge branch 'enh/rocksdbSstate' into enh/rocksdbSstateMerge 2023-05-09 08:58:51 +00:00
wangjiaming0909 e22c62ffba fix: data compare of signed and unsigned integers 2023-05-08 18:13:37 +08:00
yihaoDeng 8617af2a55 fix queue failure 2023-05-08 07:43:44 +00:00
Hongze Cheng c9dc9b3170 more code 2023-05-08 10:27:55 +08:00
Yihao Deng cb223acf82
Merge branch 'main' into enh/rocksdbSstate 2023-05-08 09:45:27 +08:00
Haojun Liao a7691aba9c fix(stream): set the correct queue item size. 2023-05-08 00:24:00 +08:00
yihaoDeng 08c3a63341 Merge branch 'enh/standVer' into enh/rocksdbSstateMerge 2023-05-06 12:37:54 +00:00
Haojun Liao 71a2886fa5
Merge pull request #21163 from taosdata/fix/TS-3277
fix:[TS-3277]table not exist if drop stable in another client when in…
2023-05-06 14:30:23 +08:00
Haojun Liao da6212bab0 other: merge main. 2023-05-06 12:51:38 +08:00
dm chen 87696d8ab3
Update terror.c 2023-05-05 17:50:06 +08:00
wangmm0220 0a469484fa fix:[TS-3277]table not exist if drop stable in another client when insert data using schemaless interface 2023-05-05 15:01:27 +08:00
dmchen af0ca38a89 int16 overflow 2023-05-04 17:12:02 +08:00
Haojun Liao 23c49594b7 other: merge main. 2023-05-04 16:41:53 +08:00
Haojun Liao 8b57184a9a
Merge pull request #21123 from taosdata/fix/liaohj_main
refactor: remove assert.
2023-04-29 00:44:24 +08:00
kailixu dcb193a85e enh: error code optimization 2023-04-28 18:18:15 +08:00
kailixu f012c70f04 enh: error code optimization 2023-04-28 18:16:35 +08:00
yihaoDeng dda1c8803c Merge branch 'enh/rocksdbSstate' into enh/rocksdbSstateMerge 2023-04-28 09:17:22 +00:00
Haojun Liao 03b1de017a refactor: remove assert. 2023-04-28 14:12:17 +08:00
liuyao 2984c5a758 merge main 2023-04-28 10:34:46 +08:00
yihaoDeng 36a4413bf1 merge rocksdb inst 2023-04-27 14:38:33 +00:00
kailixu fa822ff286 Merge branch '3.0' into enh/TD-21161-3.0 2023-04-27 19:11:16 +08:00
Haojun Liao ad7c3218f7
Merge pull request #21111 from taosdata/fix/liaohj_main
enh(query): stop tsdb reader ASAP.  TD-23249
2023-04-27 17:45:38 +08:00
Haojun Liao 17a5691afb refactor: remove assert. 2023-04-27 15:37:33 +08:00
Haojun Liao d83f29dc23 refactor: remove assert. 2023-04-27 15:33:04 +08:00
Haojun Liao 12e0f3fda8 refactor: do some internal refactor. 2023-04-27 13:36:09 +08:00
dapan1121 a7f405d4d4
Merge pull request #21077 from taosdata/fix/TS-3271-MAIN
fix: log file size over 4G report error on windows
2023-04-26 15:02:20 +08:00
Benguang Zhao 23a915da3b enh: adjust error msgs in sync and wal 2023-04-25 19:11:51 +08:00
Benguang Zhao fee4050d79 enh: rename error code TSDB_CODE_SYN_NEGO_WIN_EXCEEDED 2023-04-25 18:05:36 +08:00
Benguang Zhao 693bc09f19 enh: comment off unused error codes in sync and wal 2023-04-25 17:36:13 +08:00
Alex Duan ee93500619 fix: log file size over 4G report error on windows 2023-04-25 17:03:58 +08:00
dapan1121 f22d279f5f
Merge pull request #21057 from taosdata/feat/TD-19567
feat: support log slow query by default
2023-04-25 13:43:34 +08:00
kailixu 781834065a Merge branch '3.0' into enh/TD-21161-3.0 2023-04-25 08:22:08 +08:00
dapan1121 28bff83096 fix: log thread quit issue 2023-04-24 19:29:33 +08:00
dapan1121 6386c32392
Merge pull request #21034 from taosdata/szhou/td-23586
enhance: error code refactor
2023-04-24 16:53:53 +08:00
dapan1121 9551a269b3 feat: support log slow query by default 2023-04-24 16:45:34 +08:00
Haojun Liao 7360a6b65c enh(query): opt hash. 2023-04-24 16:39:55 +08:00
kailixu b26842e398 Merge branch '3.0' into enh/TD-21161-3.0 2023-04-24 14:19:49 +08:00
Haojun Liao 057cc2d30d
Merge pull request #21018 from taosdata/feature/3_liaohj
fix(stream): set the correct start offset for stream task.
2023-04-24 12:02:20 +08:00
dapan1121 5fe99c5ad2 feat: support log long query 2023-04-23 15:54:15 +08:00
shenglian zhou 8ce07b0cc7 fix: change error description of udf pipe not exist 2023-04-23 15:04:08 +08:00
shenglian zhou bb3ce6a3d7 enhance: error code refactor 2023-04-23 14:54:12 +08:00
yihaoDeng 917b07348c Merge branch 'fix/rocksdbState' into enh/rocksRevert 2023-04-23 02:37:26 +00:00
dapan1121 13852f5699 fix: compile issue 2023-04-21 17:07:20 +08:00
chenhaoran 7d7a0769b3 Merge remote-tracking branch 'origin/main' into enh/tsbsPerf.1 2023-04-21 16:20:37 +08:00
kailixu 77a8e3b213 Merge branch '3.0' into enh/TD-21161-3.0 2023-04-21 16:04:09 +08:00
wangmm0220 5df7906a62 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/rocksRevert 2023-04-20 18:33:37 +08:00
Benguang Zhao a1ca9466cd enh: adjust size limit of appyQ and negotiationWin 2023-04-20 14:28:56 +08:00
yihaoDeng 5402a6061f Merge branch 'dev' into enh/rocksRevert 2023-04-19 17:37:07 +08:00
Haojun Liao a69e2a8045 fix(os): fix the link error in unit test cases. 2023-04-19 15:33:02 +08:00
Haojun Liao 9fb7589fb5 fix(os): fix a deadlock. 2023-04-19 14:08:41 +08:00
Shuduo Sang 4417c79cb1
fix: atoi on int64 config item (#20956) 2023-04-18 14:03:24 +08:00
dapan1121 ed34b401ee fix: optimize decompress double 2023-04-18 13:44:41 +08:00
kailixu 50053fdc01 Merge branch '3.0' into enh/TD-21161-3.0 2023-04-18 11:13:30 +08:00
Shuduo Sang 76c628c8ee
fix: atoi on int64 config item (#20946) 2023-04-18 09:22:49 +08:00
kailixu fd3b552357 Merge branch '3.0' into enh/TD-21161-3.0 2023-04-17 11:42:46 +08:00
Haojun Liao 1350af5267 fix(stream): set the correct initial checkpoint version to restore the operators state and add check for the initial destination tables. 2023-04-16 22:48:22 +08:00
Haojun Liao b57c813681 other: merge feature/3_liaohj 2023-04-14 10:36:54 +08:00
Haojun Liao f8b672f09f other: merge main. 2023-04-14 09:07:18 +08:00
Haojun Liao 70b45a4cf0 fix(stream): all data should be extracted from wal. 2023-04-13 23:22:09 +08:00
dapan1121 e1d7b76adf fix: array dup issue 2023-04-13 13:26:28 +08:00
dapan1121 7f518ca4ea feat: support cache db cfg 2023-04-13 10:54:57 +08:00
Xiaoyu Wang 933660ae8d Merge remote-tracking branch 'origin/main' into fix/3.0_merge_main 2023-04-12 14:13:23 +08:00
Xiaoyu Wang 9c0027cb2a
Merge pull request #20880 from taosdata/FIX/TD-23509-main
enh: refactor some sync func names
2023-04-12 14:01:55 +08:00
dapan1121 23920e10c1 enh: optimize log perf 2023-04-12 13:58:29 +08:00
kailixu 04fa4d2e87 Merge branch '3.0' into enh/TD-21161-3.0 2023-04-12 13:05:47 +08:00
Benguang Zhao edc9fe9705 enh: change the error msg of INVALID_VGROUP_ID to Vnode is closed or removed 2023-04-12 10:12:41 +08:00
yihaoDeng b24b91886a Merge branch 'dev3' into enh/rocksRevert 2023-04-11 10:59:00 +00:00
Xiaoyu Wang 4c04b155d5 merge main 2023-04-11 15:56:28 +08:00
Haojun Liao a4ba5401f9 enh(stream): set the start version of all operators. 2023-04-11 10:01:36 +08:00
Xiaoyu Wang e2f82f4423 merge main 2023-04-10 09:56:03 +08:00
kailixu e976fcb91d Merge branch '3.0' into enh/TD-21161-3.0 2023-04-07 17:51:35 +08:00
Xiaoyu Wang c134432c45 merge main 2023-04-06 09:31:45 +08:00
yihaoDeng 5aff5aa93b add backpressure 2023-04-04 12:38:56 +00:00
54liuyao 429b5cd646 feat:add stream file state 2023-04-04 17:09:35 +08:00
yihaoDeng 628bb62c8a add backpressure 2023-04-04 07:20:05 +00:00
Xiaoyu Wang e9d7a099cc merge main 2023-04-04 14:50:58 +08:00
Ganlin Zhao 23ec9287c9 fix: fix tsim crash on windows due to invalid input to strftime 2023-04-04 10:33:41 +08:00
kailixu 37bc1bca36 enh: column/row max length support up to 64K 2023-04-03 17:00:52 +08:00
cademfly dbc75feac3 normal table 2023-03-30 15:56:08 +08:00
kailixu 9552ac2800 enh: coverity scan for sma 2023-03-30 15:11:35 +08:00
wangmm0220 2243184a4d fix:conflicts 2023-03-29 17:53:05 +08:00
Xiaoyu Wang b9d905c2d3
Merge pull request #20686 from taosdata/fix/liaohj
fix(tsdb/read): use correct scheme for mem & imem merging
2023-03-29 15:38:21 +08:00
Xiaoyu Wang 4a085db970 fix: hotfix version compatibility 2023-03-29 11:10:15 +08:00
Haojun Liao 7a050d64bd fix(query): set ptr to be NULL. 2023-03-29 10:27:05 +08:00
Haojun Liao f1ff5dcec4 fix(query): use hashmap to keep the multiple schema. 2023-03-28 22:53:57 +08:00
wangmm0220 d0c55ef572 fix:conflicts 2023-03-28 18:12:13 +08:00
Haojun Liao 6c1515624a refactor: do some internal refactor. 2023-03-28 11:24:12 +08:00