Commit Graph

10186 Commits

Author SHA1 Message Date
wangmm0220 56782a5d41 fix:open task case & modify mqRebVgReq encode/decode style 2023-06-01 18:29:16 +08:00
Haojun Liao ee8a9856cb
Merge pull request #21557 from taosdata/feature/TD-19042
fix:make version compatible
2023-06-01 18:25:37 +08:00
Benguang Zhao 2ef2715ee1 enh: add mndAddVgStatusAction and mndAddDbStatusAction 2023-06-01 17:58:27 +08:00
Hongze Cheng 9d1e90f914 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-06-01 17:20:37 +08:00
Hongze Cheng 65720b80fa more code 2023-06-01 17:12:26 +08:00
Hongze Cheng a3cacfe68b more code 2023-06-01 17:08:46 +08:00
Hongze Cheng e07afeeeaf more code 2023-06-01 17:05:20 +08:00
wangmm0220 bb772e2062 fix:make version compatible 2023-06-01 17:03:02 +08:00
wangmm0220 69499b9582 fix:make version compatible 2023-06-01 16:09:17 +08:00
wangmm0220 d20e0a06f6 fix:make version compatible 2023-06-01 16:04:45 +08:00
wangmm0220 21920721f3 fix:make version compatible 2023-06-01 15:10:08 +08:00
Hongze Cheng e99b33ede5 more code 2023-06-01 15:08:45 +08:00
Hongze Cheng bdc9fc473c more code 2023-06-01 11:11:02 +08:00
Minglei Jin 9b9bf2de68 meta/tbc: key cannot be null 2023-06-01 10:41:01 +08:00
Hongze Cheng fbc4d649de more code 2023-06-01 10:36:12 +08:00
Haojun Liao 5d98a319c7
Merge pull request #21515 from taosdata/feature/TD-19042
feat: support create topic as stable with conditions
2023-06-01 09:56:55 +08:00
Haojun Liao 5301c5756a other: merge main into 3.0. 2023-06-01 09:29:18 +08:00
Minglei Jin fb2f367aac meta/split: trim invalidated uids 2023-06-01 08:13:32 +08:00
Haojun Liao 6d04c4e2fd refactor: do some internal refactor. 2023-05-31 19:05:40 +08:00
Haojun Liao 9e021087a9 refactor: do some internal refactor. 2023-05-31 19:04:53 +08:00
Haojun Liao a3abe25539 refactor: do some internal refactor. 2023-05-31 19:03:37 +08:00
wangjiaming0909 60100a0fb6 feature: add user priv when create db, remove priv check with create_dbs 2023-05-31 18:43:56 +08:00
Hongze Cheng d4f4ac1d89 more code 2023-05-31 17:49:08 +08:00
Haojun Liao fa5c024b3e refactor: do some internal refactor. 2023-05-31 17:22:59 +08:00
Haojun Liao 18b971c666 fix(query): check the version range when dump partial rows of file block to sdata block directly. 2023-05-31 17:06:38 +08:00
Hongze Cheng dc8901268e fix code 2023-05-31 16:34:50 +08:00
Hongze Cheng cf0228f87e more code 2023-05-31 15:57:51 +08:00
Minglei Jin 99d6c5cfa0 Merge branch '3.0' into fix/TD-23549 2023-05-31 15:31:20 +08:00
Hongze Cheng 10e6e52670 more code 2023-05-31 15:19:28 +08:00
Hongze Cheng 616a675682 more code 2023-05-31 10:59:47 +08:00
Benguang Zhao 28efd7dcd7 enh: check trans conflicts in mndTransValidate 2023-05-31 10:53:36 +08:00
Hongze Cheng 938d87f601 more code 2023-05-31 09:02:50 +08:00
Benguang Zhao 4a6d81855b enh: add mndTransValidate for prepare actions 2023-05-30 18:50:00 +08:00
Hongze Cheng 838a47cb45 more code 2023-05-30 18:08:32 +08:00
Hongze Cheng 03f7c6533e more code 2023-05-30 18:06:28 +08:00
wangmm0220 689ee05527 Merge branch '3.0' of https://github.com/taosdata/TDengine into feature/TD-19042 2023-05-30 15:45:46 +08:00
Hongze Cheng e0889b404d more code 2023-05-30 15:31:11 +08:00
Hongze Cheng 9222d9651e Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-05-30 14:21:19 +08:00
Hongze Cheng 29c29871d2 more code 2023-05-30 14:20:15 +08:00
Haojun Liao d122a398b3
Merge pull request #21516 from taosdata/fix/TD-24447
set sched status
2023-05-30 10:59:28 +08:00
Benguang Zhao 6679b8af7b fix: release action.pCont on error 2023-05-30 10:55:56 +08:00
Hongze Cheng 8626d3e691 more code 2023-05-30 10:43:44 +08:00
wangmm0220 d490ca753f Merge branch '3.0' of https://github.com/taosdata/TDengine into feature/TD-19042 2023-05-30 09:48:49 +08:00
Haojun Liao 65b1574fbe
Merge pull request #21499 from taosdata/mark/tmq
fix:put poll to push manager if wal not exist when offset is latest
2023-05-30 09:36:53 +08:00
Haojun Liao 20a0054c4a
Merge pull request #21472 from taosdata/enh/addCompileError
change parameter
2023-05-30 09:36:36 +08:00
dapan1121 2d6859d5d6
Merge pull request #21510 from taosdata/szhou/fix-ts3461
fix: if block row num is less than definit min rows, set the bucket index to 0
2023-05-30 08:51:24 +08:00
wade zhang 3a2831a3f4
Merge pull request #21517 from taosdata/fix/TD-24472
fix(rocks/log): set info log level to warn_level
2023-05-30 08:35:00 +08:00
Haojun Liao bcba18d90e
Merge pull request #21521 from taosdata/refact/fillhistory
refactor: do some internal refactor.
2023-05-30 00:38:38 +08:00
Hongze Cheng b479a0a06b Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-05-29 21:46:26 +08:00
kailixu 9501d4f417 feat: allow user to reset root passwd 2023-05-29 19:44:11 +08:00
Hongze Cheng 41459a92c0 more code 2023-05-29 18:42:31 +08:00
Haojun Liao 3628888ecc refactor: do some internal refactor. 2023-05-29 18:02:45 +08:00
Haojun Liao cd2d225c93 refactor: do some internal refactor. 2023-05-29 17:50:39 +08:00
wade zhang 3b6d196ec3
Merge pull request #21498 from taosdata/fix/check-empty-dnode
check empty dnode
2023-05-29 17:45:56 +08:00
wangmm0220 41ed0138b4 fix:compile error 2023-05-29 17:25:11 +08:00
wangmm0220 07bdb95b1a fix:compile error 2023-05-29 17:10:11 +08:00
wangmm0220 9eb15e41ef fix:put poll to push manager if wal not exist when offset is latest 2023-05-29 16:44:03 +08:00
dmchen 23983e506f fix test case 2023-05-29 16:12:26 +08:00
Hongze Cheng 6aac0e0c49 more code 2023-05-29 15:58:54 +08:00
Minglei Jin 3a9d55ca35 fix(rocks/log): set info log level to warn_level 2023-05-29 15:56:28 +08:00
wangmm0220 5eb1c559e5 fix:save offset if latest 2023-05-29 15:51:00 +08:00
Haojun Liao f2887278e2 refactor: do some internal refactor. 2023-05-29 15:44:45 +08:00
liuyao b541a0a053 set sched status 2023-05-29 15:42:47 +08:00
wangmm0220 78db3520a6 fix:conflict 2023-05-29 14:57:03 +08:00
Benguang Zhao 3c698b2461 enh: add mndAddPrepareNewVgAction 2023-05-29 14:13:11 +08:00
Benguang Zhao 873ad8839b enh: add prepareActions in STrans 2023-05-29 14:13:11 +08:00
tangfangzhi e21a2f9cce check empty 2023-05-29 14:02:36 +08:00
wangmm0220 a71878d07f feat: support create topic as stable with conditions 2023-05-29 11:46:59 +08:00
Haojun Liao 8f61e2d6ef refactor: do some internal refactor. 2023-05-29 10:50:50 +08:00
shenglian zhou 43c0656df2 fix: if block row num is less than definit min rows, set the bucket index to 0 2023-05-29 10:45:26 +08:00
yihaoDeng 342ce14c7d Merge branch 'enh/3.0' into fix/shared_link_rocksdb 2023-05-29 02:37:47 +00:00
yihaoDeng 58cc631c22 Merge branch 'enh/3.0' into fix/shared_link_rocksdb 2023-05-29 02:29:56 +00:00
Haojun Liao 953a69a829 refactor: do some internal refactor. 2023-05-29 10:12:27 +08:00
Hongze Cheng 9d6a264e4d more code 2023-05-28 23:33:03 +08:00
Hongze Cheng 9d031f4d7b Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-05-28 11:08:39 +08:00
Hongze Cheng 5bcc9c540a more code 2023-05-27 23:08:08 +08:00
Haojun Liao 1e786624b2
Merge pull request #21501 from taosdata/refact/fillhistory
fix(stream): set the skip offset when resume stream task.
2023-05-27 22:45:54 +08:00
Hongze Cheng 6668da43f8 more code 2023-05-27 20:13:07 +08:00
Hongze Cheng e4b7318ced more code 2023-05-27 19:54:07 +08:00
Hongze Cheng 442586692b more code 2023-05-27 19:01:52 +08:00
Haojun Liao d9de1813da Merge branch '3.0' into refact/fillhistory 2023-05-27 16:31:11 +08:00
Hongze Cheng 2cf70ab0cc more code 2023-05-27 15:29:22 +08:00
Hongze Cheng 880359ddb3 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-05-27 11:50:25 +08:00
Hongze Cheng 62a3c27176 more code 2023-05-27 11:49:59 +08:00
Hongze Cheng b4b0db9a3d more code 2023-05-26 23:51:18 +08:00
Hongze Cheng 0090d02226 more code 2023-05-26 23:42:47 +08:00
Haojun Liao b38e253019 fix(stream): set the skip offset when resume stream task. 2023-05-26 22:51:58 +08:00
Hongze Cheng 9abfe52c4d more code 2023-05-26 19:41:27 +08:00
Hongze Cheng 4cb4c6388c more code 2023-05-26 19:32:02 +08:00
wangmm0220 a3e214b9e8 fix:put poll to push manager if wal not exist when offset is latest 2023-05-26 19:17:04 +08:00
wangmm0220 50487255b3 fix:put poll to push manager if wal not exist when offset is latest 2023-05-26 19:02:40 +08:00
dmchen 24937c3d5b check empty dnode 2023-05-26 19:01:13 +08:00
wade zhang c7886d319b
Merge pull request #21490 from taosdata/fix/check-offline-when-force
check offline when force
2023-05-26 17:03:29 +08:00
wade zhang 66b7d90849
Merge pull request #21479 from taosdata/fix/TD-24405
fix(cache): fix deleted data
2023-05-26 17:02:33 +08:00
Haojun Liao 87957e2bb0
Merge pull request #21478 from taosdata/fix/TD-23423
fix tsdb read error version
2023-05-26 16:56:09 +08:00
Hongze Cheng f5286359fa more code 2023-05-26 15:57:31 +08:00
Hongze Cheng 7acc124dfc more code 2023-05-26 15:25:29 +08:00
Minglei Jin 34b9b322cd cache/var-data: realloc for cache reading 2023-05-26 15:01:57 +08:00
Hongze Cheng b07ad168c3 more code 2023-05-26 14:49:50 +08:00
Haojun Liao f61f37c936 fix(tmq): set the correct offset rsp when no poll occuring. 2023-05-26 14:20:01 +08:00
Minglei Jin 6e29d7879f cache/var-data: realloc var data 2023-05-26 14:13:01 +08:00
dmchen fcf2b58aad check offline when force 2023-05-26 12:48:37 +08:00
Hongze Cheng 9156b297ae more code 2023-05-26 11:51:08 +08:00
Haojun Liao 1e845acabe fix(tmq): allow seek before get assignment 2023-05-26 11:34:12 +08:00
Minglei Jin bb481c52b6 cache/skyline: fix skyline false condition 2023-05-26 11:26:55 +08:00
Haojun Liao ccbea13012 Merge branch '3.0' into refact/fillhistory 2023-05-26 10:40:53 +08:00
Haojun Liao 974b59c238 fix(query): fix bug in iterating the table list. 2023-05-26 10:10:10 +08:00
Haojun Liao 409656f7b6 fix(query): fix bug in iterating the table list. 2023-05-26 10:05:54 +08:00
Hongze Cheng fa00d0df77 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-05-26 09:55:27 +08:00
wade zhang 57b999233d
Merge pull request #21483 from taosdata/fix/prompt-message-when-2-mnode
prompt message when 2 mnode
2023-05-26 09:35:03 +08:00
Haojun Liao cea8334427
Merge pull request #21449 from taosdata/refact/fillhistory
refactor: remove the module dependency.  TD-24279
2023-05-26 09:01:45 +08:00
liuyao 75eb724c37 fix tsdb read error version 2023-05-26 08:55:23 +08:00
Haojun Liao e24ce2111f fix: set function ptr. 2023-05-26 00:00:07 +08:00
dmchen efa1570b6e prompt message when 2 mnode 2023-05-25 20:10:40 +08:00
Haojun Liao 1e22d875b3 fix: fix dead lock. 2023-05-25 20:00:26 +08:00
Haojun Liao 1090afd108 fix(stream): add new file. 2023-05-25 18:46:53 +08:00
Haojun Liao c3be7b14be fix: set correct function ptr. 2023-05-25 17:51:03 +08:00
Minglei Jin 8ee1288611 fix(cache): remove deleted data 2023-05-25 17:47:55 +08:00
Benguang Zhao f8841046bc enh: refactor func name of mndTransPerformFinishStage 2023-05-25 15:44:26 +08:00
Benguang Zhao 30104f300c enh: refactor func names of mndTransPerformFinishedStage and mndTrancCheckConflict 2023-05-25 15:44:26 +08:00
Haojun Liao 0966213847 fix(arch): set the correct module api dependency. 2023-05-25 14:21:40 +08:00
Haojun Liao da9f33a483 fix: fix error in set function ptr. 2023-05-25 09:56:34 +08:00
wade zhang 511ff7130b
Merge pull request #21445 from taosdata/fix/TD-24373
fix(cache/read): associate tbname with primary ts column
2023-05-25 08:01:51 +08:00
Haojun Liao 4a42f6b983 fix: fix error in api call. 2023-05-25 00:50:03 +08:00
Haojun Liao a9b18d203d fix:fix error. 2023-05-24 23:49:26 +08:00
Haojun Liao ab907e3344 fix(query): fix syntax error. 2023-05-24 21:53:40 +08:00
Hongze Cheng 5586c6d8fb Merge branch 'fix/shared_link_rocksdb' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-05-24 19:05:30 +08:00
Hongze Cheng 4d526ed0cd change more 2023-05-24 18:59:09 +08:00
Minglei Jin fc5d06681e cache/last_row: treat none as null with last_row 2023-05-24 18:55:51 +08:00
Hongze Cheng 3c2a54ab4b Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-05-24 18:28:56 +08:00
Hongze Cheng 7d7c8af852 more code 2023-05-24 18:28:44 +08:00
wangmm0220 8537e4e80e feat:add tag filter for stable subscribe 2023-05-24 18:26:55 +08:00
Haojun Liao fe09705855 fix: set the init function pointer. 2023-05-24 17:13:20 +08:00
Dingle Zhang 984211f3b4
Feature/3.0 geometry (#21037)
* Add GEOMETRY data type and make sql.c able to parse it. The GEMETRY works like BINARY so far.

* add GEOMETRY type into gConvertTypes to fix some issues like DELETE calling

* change some test cases to make sure no same timestamp is inserted, and add my smoketest.sh

* Add a function MakePoint() and introduce a lib geometry

* implement sql functions GeomFromText() and AsText()

* Use GEOS *_r funcions instead for thread safety

* Handle with TSDB_DATA_TYPE_GEOMETRY when INSERT geometry data by converting WKT.
Add geosWrapper to wrap the basic GEOS functions for TDEngine.

* refactor AsText and MakePoint functions to be like GeomFromText

* Show WKT when print geometry data in screen
Dump hex data when dump geometry data in a file

* define TYPE_BYTES item for TSDB_DATA_TYPE_GEOMETRY, which casued some strange issues.

* set number of decimals of WKT to 6

* Implement SQL function Intersects()

* refactor geometry sql functions

* Add geosErrMsgeHandler() to get the GEOS error detail

* use threadlocal to instantiate SGeosContext
call destroyGeosContext() only if the thread exists

* remove SGeosContext *context param for all geometry functions since we use thread local one,
so that all caller do not need to know the context.

* Modify Intersects() to call PreparedIntersects() when one of param is a constant, which has higher performance.

* rename prepareFn() to initCtxFn() to avoid confusion with PreparedFn

* Add prefix "ST_" for all geometry functions

* move getThreadLocalGeosCtx() and destroyThreadLocalGeosCtx() into util,
so that all unit test tools can compile

* Add unit test for geometry lib, only test MakePoint so far

* refactor and enhance existing cases in geomFuncTest

* implement NULL type and NULL value test for geomFuncTest

* add test on geomFromText()

* add unit test on AsText() in geomFuncTest

* combine some makePointFunction test items

* add intersectsFunctionTwoColumns test
refactor on callGeomFromTextWrapper functions

* enhance intersectsFunction test to add cases like input constant , NULL type, NULL value, or wrong content

* add more cases into intersectsFunction test

* Add basic test on geometry in system test

* Add ST_GeomFromText and ST_AsText function test in system test on geometry

* add ST_Intersects function test in system test on geometry

* support to check expectedErrno in system test on geometry

* adjust geomTest unit test and geometry system test

* add geometry data type and functions in doc english version

* implement touchesFunction() in geometry lib
refactor geometry relation functions model

* separate gemFuncTest into several src files

* add unit test on touchesFunction

* support sql function ST_Touches()
add system test on ST_Touches

* add docs for ST_Touches()

* Add ST_Contains()

* Add ST_Covers()

* Add ST_Equals()

* add swapAllowed param for geomRelationFunction()
read geom2 earlier intead of at doGeosRelation()

* Add ST_ContainsProperly()

* build on windows

* Merge from 3.0 to 3.0_geometry

* change macro definition TSDB_DATA_TYPE_GEOMETRY as the last one for compatibility

* change '\\NULL' to 'NULL' back in shellDumpFieldToFile()

* add /usr/local/include into include directory

* add /usr/local/inlcude and /usr/local/lib in cmake.platform for DARWIN
2023-05-24 15:36:46 +08:00
Ganlin Zhao 89bea7100f fix: fix count var type error 2023-05-24 00:31:05 -07:00
Haojun Liao 99f669434a
Merge pull request #21282 from taosdata/feature/TD-23117
feat:[TD-23117] add schema for ins_topics
2023-05-24 14:54:42 +08:00
dapan1121 cbbbaca553
Merge pull request #21437 from taosdata/fix/TD-23955-3.0
fix: delete index filter for desc query
2023-05-24 14:05:07 +08:00
wade zhang 398bf8f322
Merge pull request #21446 from taosdata/fix/confirm-msg-when-add-learner
comfirm msg when add learner
2023-05-24 13:54:15 +08:00
Hongze Cheng ab7f6eb764 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-05-24 13:47:35 +08:00
Hongze Cheng 106f701ebb more code 2023-05-24 13:47:28 +08:00
Haojun Liao b2ce45b07b refactor: do some internal refactor. 2023-05-24 13:39:20 +08:00
Haojun Liao a2f29aa0f5 refactor: do some internal refactor. 2023-05-24 13:34:46 +08:00
Haojun Liao 1f7f326bed refactor: do some internal refactor and set the api function ptr. 2023-05-24 13:22:05 +08:00
Hongze Cheng 4775b26e5e more code 2023-05-24 11:52:38 +08:00
kailixu ef899a0cc3 fix: delete index filter for desc query 2023-05-24 11:28:45 +08:00
dmchen ab3d54aae3 comfirm msg when add learner 2023-05-24 11:08:41 +08:00
Minglei Jin 26bfa4363d fix(cache/read): associate tbname with primary ts column 2023-05-24 11:01:47 +08:00
Hongze Cheng d6d0bf0e41 enh: add varchar sma 2023-05-24 10:47:26 +08:00
liuyao 180abf2229 set agg task status 2023-05-24 09:34:40 +08:00
Hongze Cheng 166a86db69 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-05-24 09:31:20 +08:00