Commit Graph

1951 Commits

Author SHA1 Message Date
dapan1121 d229492616 Merge remote-tracking branch 'origin/3.0' into feat/TD-25204 2023-10-09 18:34:08 +08:00
wangmm0220 b04d57fcc3 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26056 2023-10-08 16:15:19 +08:00
wangmm0220 3f2d890560 feat:[TD-26056] add replay logic 2023-10-08 16:06:15 +08:00
kailixu 5067eb8cc5 chore: more code for check active code 2023-09-30 16:00:14 +08:00
kailixu e677e41573 fix: support check and merge activeCode 2023-09-30 12:29:44 +08:00
dapan1121 0a0f512023 feat: add view meta processing 2023-09-28 11:44:38 +08:00
Alex Duan c9af9eb15b
Merge pull request #22915 from lx1zhong/3.0
add TSZ and ADT-FSE algorithm
2023-09-25 15:48:30 +08:00
Haojun Liao dbc53069db
Merge branch 'main' into fix/liaohj 2023-09-25 10:41:18 +08:00
Alex Duan 293840d707 fix: compatible for open and close TSZ 2023-09-23 14:34:23 +08:00
Alex Duan 6fa4bfb492 fix: cfgAddDouble set to fval is error 2023-09-23 11:22:22 +08:00
dapan1121 a61d90f672 enh: remove column list 2023-09-22 11:36:53 +08:00
dapan1121 a67b0c99fc feat: support create/drop view 2023-09-21 19:28:07 +08:00
Haojun Liao 6633fb971b fix(stream): update logs. 2023-09-20 18:18:31 +08:00
kailixu 97c87bdbdc enh: mutex/rwlock/pread/pwrite adaption for windows 2023-09-20 15:35:38 +08:00
Alex Duan 09d91cc116 fix: windows build error 2023-09-20 09:26:59 +08:00
Alex Duan 2fdc06e62d fix: windows build error 2023-09-19 18:08:53 +08:00
Alex Duan 8066c68b2d fix: window and arm platform build 2023-09-19 16:07:15 +08:00
dapan1121 b9d554275c Merge remote-tracking branch 'origin/3.0' into feat/TD-25204 2023-09-19 14:21:00 +08:00
dapan1121 14e8db289d feat: support view 2023-09-19 14:19:54 +08:00
Alex Duan 20cded7d6e fix: build error 2023-09-19 12:57:18 +08:00
Alex Duan 4a4e778a6a fix: remove depends from util to common 2023-09-19 10:46:52 +08:00
Alex Duan 88c091e575
Update CMakeLists.txt
add common on util cmakefile.txt
2023-09-18 21:09:04 +08:00
Alex Duan 570ac79a79
Merge branch 'taosdata:3.0' into 3.0 2023-09-18 14:28:00 +08:00
xsren 83d8e3a524 mem exception handle 2023-09-18 13:48:09 +08:00
Haojun Liao de04090f04
Merge pull request #22940 from taosdata/fix/avoidConflictOfIdxName
reduce the confliction of first tag index name
2023-09-18 09:47:58 +08:00
lx1zhong 5f730fda4e fix compile error 2023-09-17 18:13:20 +08:00
xsren 98cbb92ad9 merge stable sort intead of qsort as insert unordered data 2023-09-15 17:53:31 +08:00
yihaoDeng a66145a494 reduce the possible of first tag index name 2023-09-15 17:41:04 +08:00
lx1zhong ffa9560b43 fix compile error: add libraries link 2023-09-15 17:38:46 +08:00
lx1zhong abee7c0b80 fix compile error 2023-09-15 15:32:55 +08:00
lx1zhong 6da4088012 add TSZ and ADT-FSE algorithm 2023-09-15 14:30:23 +08:00
yihaoDeng 2d1d74d4e8 Merge branch 'enh/ipWhiteList' of https://github.com/taosdata/TDengine into enh/ipWhiteList 2023-09-14 16:52:23 +08:00
yihaoDeng 2002ed8709 add more error code 2023-09-14 15:34:28 +08:00
Yihao Deng fa302ac6b9
Merge branch '3.0' into enh/ipWhiteList 2023-09-13 10:14:08 +08:00
Haojun Liao 60f5056ab7 other: merge 3.0 2023-09-12 22:00:40 +08:00
yihaoDeng 7ce8f694dc Merge branch 'enh/dev3New' into enh/ipWhiteList 2023-09-12 15:54:06 +08:00
Haojun Liao 93159729f6 fix(stream):check error when vnode is closing. 2023-09-12 11:45:51 +08:00
yihaoDeng 8ea284f914 add rpc update interface 2023-09-10 14:53:08 +08:00
yihaoDeng 25bc0b226b add rpc update interface 2023-09-10 14:09:36 +08:00
wangmm0220 ef87b9c571 fix:conflicts from 3.0 2023-09-05 16:19:04 +08:00
wangmm0220 f0fbe08e1d fix:core dump if tmq is null 2023-09-01 16:45:46 +08:00
yihaoDeng 8b146f793d Merge branch '3.0' into szhou/ip-whitelist 2023-09-01 10:51:24 +08:00
wade zhang f9aaf42cd0
Merge pull request #22657 from taosdata/feat/TD-18789
fix:modify error tips
2023-08-31 11:05:29 +08:00
wangmm0220 be893c1bb0 fix:modify error tips 2023-08-30 18:21:37 +08:00
shenglian zhou b8205f23bf enhance: ip whitelist before debug 2023-08-30 14:32:46 +08:00
yihaoDeng 20b037d9cc Merge branch 'enh/3.0' into enh/triggerCheckPoint2 2023-08-28 10:46:00 +08:00
Haojun Liao 88f6596965
Merge pull request #22464 from taosdata/feat/TD-18789
feat:support varbinary type
2023-08-28 09:45:57 +08:00
Haojun Liao 60d1df0e25
Merge branch '3.0' into enh/triggerCheckPoint2 2023-08-25 15:49:28 +08:00
wangmm0220 26e025d78d feat:[TD-18789]support varbinary type 2023-08-25 15:43:45 +08:00
dapan1121 c126538f4f
Merge pull request #22549 from taosdata/fix/TD-25901-3.0
fix: taoslog file num limit on windows
2023-08-25 11:24:13 +08:00
yihaoDeng 9310d138a6 Merge branch 'enh/3.0' into enh/triggerCheckPoint2 2023-08-24 17:30:35 +08:00
kailixu f36cff8d7d fix: taoslog file num limit on windows 2023-08-24 13:33:02 +08:00
Hongze Cheng 6a20420f07 feat: add minDiskFreeSize cfg 2023-08-23 16:41:29 +08:00
yihaoDeng 6fe649c458 Merge branch 'enh/3.0' into enh/triggerCheckPoint2 2023-08-21 09:12:40 +08:00
yihaoDeng d9700f6cf7 add trace log 2023-08-18 13:36:33 +08:00
dapan1121 adcd1a2df2 fix: join error msg 2023-08-17 19:20:09 +08:00
Haojun Liao 6746339609 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2
# Conflicts:
#	source/libs/stream/src/streamSnapshot.c
2023-08-17 00:08:44 +08:00
wangmm0220 b3f945c4c5 fix:conflict 2023-08-16 19:35:05 +08:00
wangmm0220 f266d51764 feat:support varbinary type 2023-08-16 19:05:07 +08:00
dapan1121 143c657571 Merge remote-tracking branch 'origin/3.0' into feat/TD-24700 2023-08-16 14:50:31 +08:00
dapan1121 39ae880597
Merge pull request #22445 from taosdata/enh/TD-25708-3.0
enh: disable stream/udf on windows
2023-08-16 13:20:01 +08:00
kailixu 242bf77f4c chore: code optimization 2023-08-15 16:13:51 +08:00
wangmm0220 7441801e9d feat:support varbinary type 2023-08-15 13:57:05 +08:00
kailixu f7a5bef17d enh: disable stream/udf on windows 2023-08-15 13:02:32 +08:00
yihaoDeng ba4ce9db02 Merge branch 'enh/triggerCheckPoint2' into enh/chkpTransfer 2023-08-11 02:15:07 +00:00
yihaoDeng bbcfa9ab03 support reopen stream state 2023-08-09 06:10:40 +00:00
Minglei Jin fac7e521e9 s3/evict: fetch atime from stat file 2023-08-07 15:59:37 +08:00
dapan1121 0546bdceb2 Merge remote-tracking branch 'origin/3.0' into feat/TD-24700 2023-08-07 11:23:15 +08:00
wade zhang bae028d65c
Merge pull request #22230 from taosdata/mark/tmq
fix:semaphore always wait in tmq commit logic
2023-07-31 09:10:13 +08:00
dapan1121 b7126b9cc6 Merge remote-tracking branch 'origin/3.0' into feat/TD-24700 2023-07-28 18:01:11 +08:00
wangmm0220 6e673072cd fix:conflicts 2023-07-28 14:57:13 +08:00
Haojun Liao b145771a1b other: merge 3.0 2023-07-27 16:38:57 +08:00
Haojun Liao 3d403dca5a other: merge main. 2023-07-27 16:23:41 +08:00
wangmm0220 5fa580960e fix:semaphore always wait in tmq commit logic 2023-07-27 13:53:42 +08:00
dapan1121 4e5fbb52ee Merge remote-tracking branch 'origin/3.0' into feat/TD-24700 2023-07-26 13:56:46 +08:00
wangmm0220 be4e47e9a7 fix:add macro ASSERT_NOT_CORE to control ASSERT not core in release version 2023-07-25 16:15:33 +08:00
Benguang Zhao 01f45b2a99 enh: compatibility between getFileNamePrefix and tsdbTFileName 2023-07-25 11:35:35 +08:00
dapan1121 4f75eb5655 Merge remote-tracking branch 'origin/3.0' into feat/TD-24700 2023-07-24 11:43:15 +08:00
wade zhang 7b1e809d98
Merge pull request #21794 from taosdata/enh/tsdb_optimize
for test purpose
2023-07-21 14:18:32 +08:00
dapan1121 cbe03ef212
Merge pull request #22069 from taosdata/enh/TS-2288
enh: add scope for show xx variables
2023-07-19 18:01:11 +08:00
wangmm0220 5cb35f2fa6 feat:add committed & position & commite_offset interface 2023-07-19 17:29:39 +08:00
Minglei Jin 4b96bc7147
Merge branch '3.0' into enh/tsdb_optimize 2023-07-19 11:15:57 +08:00
wangmm0220 e812a659a8 fix:add tmq_position() interface & optimize commit logic 2023-07-18 19:30:40 +08:00
Benguang Zhao 02f4613154 enh: report VND_INIT_FAILED on vnodes open failure in vmOpenVnodes 2023-07-18 15:44:51 +08:00
Ganlin Zhao 0a5439e3c9 fix test case 2023-07-18 11:38:40 +08:00
Ganlin Zhao 929db3d647 Merge branch '3.0' into enh/TS-2288 2023-07-17 16:09:07 +08:00
Ganlin Zhao 707be3a6fe unify scope for client/system/server configs 2023-07-17 15:53:08 +08:00
Ganlin Zhao cdb3453812 add show local variables scope 2023-07-14 14:38:35 +08:00
dapan1121 aca9c5fe19 Merge remote-tracking branch 'origin/3.0' into feat/TD-24700 2023-07-14 13:31:07 +08:00
Hongze Cheng 1fad69df3b Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-07-14 10:13:15 +08:00
dapan1121 9bf7180074
Merge pull request #21969 from taosdata/enh/TD-23769-3.0
enh: rsma stream state adaption
2023-07-13 19:19:37 +08:00
Haojun Liao e0ea0f2df4
Merge pull request #22020 from taosdata/fix/liaohj
other: merge main
2023-07-13 17:55:28 +08:00
Haojun Liao e2ae868377
Merge pull request #22032 from taosdata/mark/tmq
fix:set firset version to reqOffset of response
2023-07-13 16:35:21 +08:00
Haojun Liao f41bcd73b0 other: merge main. 2023-07-13 11:02:09 +08:00
Hongze Cheng 3fc282f035 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-07-12 11:57:19 +08:00
kailixu 8cb6356b99 chore: more code 2023-07-12 10:47:02 +08:00
kailixu 8c8bcabdd4 Merge branch '3.0' into enh/TD-23769-3.0 2023-07-12 09:11:34 +08:00
dapan1121 a42bd9e478 Merge remote-tracking branch 'origin/3.0' into feat/TD-24700 2023-07-11 19:34:39 +08:00
dapan1121 185071fae9 enh: add group cache func 2023-07-11 19:34:03 +08:00
wangmm0220 cb62d4cb97 fix:set firset version to reqOffset of response 2023-07-11 14:49:53 +08:00
wangjiaming0909 1d7515213b feat: 1. add limit for diskBasedBuf
2. use referenced tuple before actually pushing into pq
3. use limitInfo instead of maxRows in sort pyhsical node
2023-07-11 14:16:20 +08:00
kailixu d37a760655 Merge branch '3.0' into enh/TD-23769-3.0 2023-07-11 13:50:17 +08:00
Shungang Li 8f91da24e4 fix: type convert failure returns errcode
TSDB_CODE_SCALAR_CONVERT_ERROR:
"Cannot convert to specific type"
2023-07-11 10:20:50 +08:00
Haojun Liao 3ffdbe923d other: merge 3.0 2023-07-11 09:12:57 +08:00
wangmm0220 9648117454 fix:can not do assignment if in tsdb mode 2023-07-10 11:28:30 +08:00
Shungang Li 8de31219b4 fix: type convert failure returns errcode
TSDB_CODE_SCALAR_CONVERT_ERROR:
"Cannot convert to specific type"
2023-07-10 09:29:29 +08:00
Hongze Cheng 090ca39132 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-07-07 10:38:04 +08:00
kailixu cb8b10f6a2 Merge branch '3.0' into enh/TD-23769-3.0 2023-07-07 10:19:43 +08:00
wangjiaming0909 2de37b9426 refine select interval from sys table error msg 2023-07-06 13:52:52 +08:00
Benguang Zhao 9b477eed81 enh: terminate on failure to recover WAL from writing errors, or to commit vnode 2023-07-05 17:54:56 +08:00
kailixu d093b0e20f chore: merge 3.0 2023-07-05 16:45:12 +08:00
Hongze Cheng 214c92264c Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-07-03 11:27:26 +08:00
dapan1121 3519e9170e Merge remote-tracking branch 'origin/main' into 3.0 2023-06-29 11:13:45 +08:00
wade zhang 80130b2691
Merge pull request #21851 from luckeverda/fix/TD-24473
fix/TD-24542/TD-24484/TD-24473
2023-06-29 10:42:53 +08:00
Shungang Li 308ba7a02e fix: type geometry predicates support
support "=, <>, is null, is not null, in, not in"
2023-06-29 09:44:51 +08:00
wangjiaming0909 57ddb3437d feature: optimize order by limit using priority queue 2023-06-27 17:50:50 +08:00
wangmm0220 7e38ef7091 fix:add limit for topic and group num 2023-06-27 17:44:51 +08:00
Haojun Liao 1ad05a06d6
Merge branch '3.0' into enh/tsdb_optimize 2023-06-27 11:46:37 +08:00
dapan1121 4dae9f4eff merge main to 3.0 2023-06-26 18:43:00 +08:00
dapan1121 c4d630aaa1 fix: merge tree free rc issue 2023-06-21 13:58:07 +08:00
Hongze Cheng 6d2ce5cd39 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-06-19 14:13:08 +08:00
Benguang Zhao 495ae49752 fix: refreshMeta on invalid schema of tb epSet in doAsyncQuery 2023-06-16 15:41:52 +08:00
wade zhang d5f37359f4
Merge pull request #21722 from taosdata/fix/TD-24761
fix(tsdb/cache): rewrite cache update to fix cpu usage
2023-06-16 11:52:02 +08:00
Minglei Jin 968e3cf1ea lru/applyF: fix ret value 2023-06-16 10:00:17 +08:00
dapan1121 575c48212a
Merge pull request #21721 from taosdata/fix/TD-24707
fix: forbid system table functions
2023-06-15 18:52:33 +08:00
Minglei Jin 158ae209bf cache/lru: new applyF API for tlrucache 2023-06-15 16:34:51 +08:00
wangmm0220 22776e60d5 fix:control memory size if consumer group is too much 2023-06-15 14:51:04 +08:00
Ganlin Zhao e79d63d766 add error code 2023-06-14 13:34:25 +08:00
Hongze Cheng 48ea3963e7 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-06-14 13:12:31 +08:00
wangmm0220 d8d6b6dd21 Merge branch '3.0' of https://github.com/taosdata/TDengine into feature/TD-24749 2023-06-13 15:15:05 +08:00
wangmm0220 8a81278024 fix:load pHandle if necessary wher tq restore 2023-06-13 15:14:11 +08:00
Hongze Cheng 7baeabc6b9 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-06-13 13:21:12 +08:00
Benguang Zhao 3689b41f3a Merge branch '3.0' into FIX/TD-24182-3.0 2023-06-12 09:39:49 +08:00
Hongze Cheng 91c8391bff Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-06-08 09:53:57 +08:00
wade zhang e12af9327e
Merge pull request #21612 from luckeverda/geo
fix: compress core by tDataTypes
2023-06-06 14:20:45 +08:00
Shungang Li 472665e4b1 fix: compress core by tDataTypes 2023-06-06 13:06:53 +08:00
Benguang Zhao ae26f701ae fix: ignore TSDB_CODE_MND_TRANS_SYNC_TIMEOUT on updating trans 2023-06-02 18:49:15 +08:00
Hongze Cheng 33afb08e5c Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-06-02 14:40:01 +08:00
Haojun Liao 5301c5756a other: merge main into 3.0. 2023-06-01 09:29:18 +08:00
Hongze Cheng b479a0a06b Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-05-29 21:46:26 +08:00
dapan1121 94c3569a27
Merge pull request #21512 from wangjiaming0909/fix/3.0/TS-3457
fix: page buffer cache flush wrong bytes of data into disk
2023-05-29 16:55:23 +08:00
kailixu f984e67eaa fix(query): invalid buffer page 2023-05-29 16:04:35 +08:00
wangjiaming0909 5e2d3939fe fix: page buffer cache flush wrong bytes of data into disk 2023-05-29 15:19:34 +08:00
kailixu 3bbf5405c6 fix(query): invalid buf page 2023-05-29 14:36:29 +08:00
Hongze Cheng 880359ddb3 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-05-27 11:50:25 +08:00
dmchen fcf2b58aad check offline when force 2023-05-26 12:48:37 +08:00
Ganlin Zhao a57da3bdf7 fix: fix log not compressed when logKeepDays set to positive value 2023-05-25 14:13:34 +08:00
Hongze Cheng 3c2a54ab4b Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-05-24 18:28:56 +08:00
Dingle Zhang 984211f3b4
Feature/3.0 geometry (#21037)
* Add GEOMETRY data type and make sql.c able to parse it. The GEMETRY works like BINARY so far.

* add GEOMETRY type into gConvertTypes to fix some issues like DELETE calling

* change some test cases to make sure no same timestamp is inserted, and add my smoketest.sh

* Add a function MakePoint() and introduce a lib geometry

* implement sql functions GeomFromText() and AsText()

* Use GEOS *_r funcions instead for thread safety

* Handle with TSDB_DATA_TYPE_GEOMETRY when INSERT geometry data by converting WKT.
Add geosWrapper to wrap the basic GEOS functions for TDEngine.

* refactor AsText and MakePoint functions to be like GeomFromText

* Show WKT when print geometry data in screen
Dump hex data when dump geometry data in a file

* define TYPE_BYTES item for TSDB_DATA_TYPE_GEOMETRY, which casued some strange issues.

* set number of decimals of WKT to 6

* Implement SQL function Intersects()

* refactor geometry sql functions

* Add geosErrMsgeHandler() to get the GEOS error detail

* use threadlocal to instantiate SGeosContext
call destroyGeosContext() only if the thread exists

* remove SGeosContext *context param for all geometry functions since we use thread local one,
so that all caller do not need to know the context.

* Modify Intersects() to call PreparedIntersects() when one of param is a constant, which has higher performance.

* rename prepareFn() to initCtxFn() to avoid confusion with PreparedFn

* Add prefix "ST_" for all geometry functions

* move getThreadLocalGeosCtx() and destroyThreadLocalGeosCtx() into util,
so that all unit test tools can compile

* Add unit test for geometry lib, only test MakePoint so far

* refactor and enhance existing cases in geomFuncTest

* implement NULL type and NULL value test for geomFuncTest

* add test on geomFromText()

* add unit test on AsText() in geomFuncTest

* combine some makePointFunction test items

* add intersectsFunctionTwoColumns test
refactor on callGeomFromTextWrapper functions

* enhance intersectsFunction test to add cases like input constant , NULL type, NULL value, or wrong content

* add more cases into intersectsFunction test

* Add basic test on geometry in system test

* Add ST_GeomFromText and ST_AsText function test in system test on geometry

* add ST_Intersects function test in system test on geometry

* support to check expectedErrno in system test on geometry

* adjust geomTest unit test and geometry system test

* add geometry data type and functions in doc english version

* implement touchesFunction() in geometry lib
refactor geometry relation functions model

* separate gemFuncTest into several src files

* add unit test on touchesFunction

* support sql function ST_Touches()
add system test on ST_Touches

* add docs for ST_Touches()

* Add ST_Contains()

* Add ST_Covers()

* Add ST_Equals()

* add swapAllowed param for geomRelationFunction()
read geom2 earlier intead of at doGeosRelation()

* Add ST_ContainsProperly()

* build on windows

* Merge from 3.0 to 3.0_geometry

* change macro definition TSDB_DATA_TYPE_GEOMETRY as the last one for compatibility

* change '\\NULL' to 'NULL' back in shellDumpFieldToFile()

* add /usr/local/include into include directory

* add /usr/local/inlcude and /usr/local/lib in cmake.platform for DARWIN
2023-05-24 15:36:46 +08:00
Hongze Cheng 70c2d5ae49 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-05-19 17:57:02 +08:00