Commit Graph

9966 Commits

Author SHA1 Message Date
wade zhang 3b6d196ec3
Merge pull request #21498 from taosdata/fix/check-empty-dnode
check empty dnode
2023-05-29 17:45:56 +08:00
wangmm0220 41ed0138b4 fix:compile error 2023-05-29 17:25:11 +08:00
wangmm0220 07bdb95b1a fix:compile error 2023-05-29 17:10:11 +08:00
wangmm0220 9eb15e41ef fix:put poll to push manager if wal not exist when offset is latest 2023-05-29 16:44:03 +08:00
dmchen 23983e506f fix test case 2023-05-29 16:12:26 +08:00
Minglei Jin 3a9d55ca35 fix(rocks/log): set info log level to warn_level 2023-05-29 15:56:28 +08:00
wangmm0220 5eb1c559e5 fix:save offset if latest 2023-05-29 15:51:00 +08:00
Haojun Liao f2887278e2 refactor: do some internal refactor. 2023-05-29 15:44:45 +08:00
liuyao b541a0a053 set sched status 2023-05-29 15:42:47 +08:00
wangmm0220 78db3520a6 fix:conflict 2023-05-29 14:57:03 +08:00
tangfangzhi e21a2f9cce check empty 2023-05-29 14:02:36 +08:00
wangmm0220 a71878d07f feat: support create topic as stable with conditions 2023-05-29 11:46:59 +08:00
Haojun Liao 8f61e2d6ef refactor: do some internal refactor. 2023-05-29 10:50:50 +08:00
shenglian zhou 43c0656df2 fix: if block row num is less than definit min rows, set the bucket index to 0 2023-05-29 10:45:26 +08:00
yihaoDeng 342ce14c7d Merge branch 'enh/3.0' into fix/shared_link_rocksdb 2023-05-29 02:37:47 +00:00
yihaoDeng 58cc631c22 Merge branch 'enh/3.0' into fix/shared_link_rocksdb 2023-05-29 02:29:56 +00:00
Haojun Liao 953a69a829 refactor: do some internal refactor. 2023-05-29 10:12:27 +08:00
Haojun Liao 1e786624b2
Merge pull request #21501 from taosdata/refact/fillhistory
fix(stream): set the skip offset when resume stream task.
2023-05-27 22:45:54 +08:00
Haojun Liao d9de1813da Merge branch '3.0' into refact/fillhistory 2023-05-27 16:31:11 +08:00
Haojun Liao b38e253019 fix(stream): set the skip offset when resume stream task. 2023-05-26 22:51:58 +08:00
wangmm0220 a3e214b9e8 fix:put poll to push manager if wal not exist when offset is latest 2023-05-26 19:17:04 +08:00
wangmm0220 50487255b3 fix:put poll to push manager if wal not exist when offset is latest 2023-05-26 19:02:40 +08:00
dmchen 24937c3d5b check empty dnode 2023-05-26 19:01:13 +08:00
wade zhang c7886d319b
Merge pull request #21490 from taosdata/fix/check-offline-when-force
check offline when force
2023-05-26 17:03:29 +08:00
wade zhang 66b7d90849
Merge pull request #21479 from taosdata/fix/TD-24405
fix(cache): fix deleted data
2023-05-26 17:02:33 +08:00
Haojun Liao 87957e2bb0
Merge pull request #21478 from taosdata/fix/TD-23423
fix tsdb read error version
2023-05-26 16:56:09 +08:00
Minglei Jin 34b9b322cd cache/var-data: realloc for cache reading 2023-05-26 15:01:57 +08:00
Haojun Liao f61f37c936 fix(tmq): set the correct offset rsp when no poll occuring. 2023-05-26 14:20:01 +08:00
Minglei Jin 6e29d7879f cache/var-data: realloc var data 2023-05-26 14:13:01 +08:00
dmchen fcf2b58aad check offline when force 2023-05-26 12:48:37 +08:00
Haojun Liao 1e845acabe fix(tmq): allow seek before get assignment 2023-05-26 11:34:12 +08:00
Minglei Jin bb481c52b6 cache/skyline: fix skyline false condition 2023-05-26 11:26:55 +08:00
Haojun Liao ccbea13012 Merge branch '3.0' into refact/fillhistory 2023-05-26 10:40:53 +08:00
Haojun Liao 974b59c238 fix(query): fix bug in iterating the table list. 2023-05-26 10:10:10 +08:00
Haojun Liao 409656f7b6 fix(query): fix bug in iterating the table list. 2023-05-26 10:05:54 +08:00
wade zhang 57b999233d
Merge pull request #21483 from taosdata/fix/prompt-message-when-2-mnode
prompt message when 2 mnode
2023-05-26 09:35:03 +08:00
Haojun Liao cea8334427
Merge pull request #21449 from taosdata/refact/fillhistory
refactor: remove the module dependency.  TD-24279
2023-05-26 09:01:45 +08:00
liuyao 75eb724c37 fix tsdb read error version 2023-05-26 08:55:23 +08:00
Haojun Liao e24ce2111f fix: set function ptr. 2023-05-26 00:00:07 +08:00
dmchen efa1570b6e prompt message when 2 mnode 2023-05-25 20:10:40 +08:00
Haojun Liao 1e22d875b3 fix: fix dead lock. 2023-05-25 20:00:26 +08:00
Haojun Liao 1090afd108 fix(stream): add new file. 2023-05-25 18:46:53 +08:00
Haojun Liao c3be7b14be fix: set correct function ptr. 2023-05-25 17:51:03 +08:00
Minglei Jin 8ee1288611 fix(cache): remove deleted data 2023-05-25 17:47:55 +08:00
Haojun Liao 0966213847 fix(arch): set the correct module api dependency. 2023-05-25 14:21:40 +08:00
Haojun Liao da9f33a483 fix: fix error in set function ptr. 2023-05-25 09:56:34 +08:00
wade zhang 511ff7130b
Merge pull request #21445 from taosdata/fix/TD-24373
fix(cache/read): associate tbname with primary ts column
2023-05-25 08:01:51 +08:00
Haojun Liao 4a42f6b983 fix: fix error in api call. 2023-05-25 00:50:03 +08:00
Haojun Liao a9b18d203d fix:fix error. 2023-05-24 23:49:26 +08:00
Haojun Liao ab907e3344 fix(query): fix syntax error. 2023-05-24 21:53:40 +08:00
Hongze Cheng 4d526ed0cd change more 2023-05-24 18:59:09 +08:00
Minglei Jin fc5d06681e cache/last_row: treat none as null with last_row 2023-05-24 18:55:51 +08:00
wangmm0220 8537e4e80e feat:add tag filter for stable subscribe 2023-05-24 18:26:55 +08:00
Haojun Liao fe09705855 fix: set the init function pointer. 2023-05-24 17:13:20 +08:00
Dingle Zhang 984211f3b4
Feature/3.0 geometry (#21037)
* Add GEOMETRY data type and make sql.c able to parse it. The GEMETRY works like BINARY so far.

* add GEOMETRY type into gConvertTypes to fix some issues like DELETE calling

* change some test cases to make sure no same timestamp is inserted, and add my smoketest.sh

* Add a function MakePoint() and introduce a lib geometry

* implement sql functions GeomFromText() and AsText()

* Use GEOS *_r funcions instead for thread safety

* Handle with TSDB_DATA_TYPE_GEOMETRY when INSERT geometry data by converting WKT.
Add geosWrapper to wrap the basic GEOS functions for TDEngine.

* refactor AsText and MakePoint functions to be like GeomFromText

* Show WKT when print geometry data in screen
Dump hex data when dump geometry data in a file

* define TYPE_BYTES item for TSDB_DATA_TYPE_GEOMETRY, which casued some strange issues.

* set number of decimals of WKT to 6

* Implement SQL function Intersects()

* refactor geometry sql functions

* Add geosErrMsgeHandler() to get the GEOS error detail

* use threadlocal to instantiate SGeosContext
call destroyGeosContext() only if the thread exists

* remove SGeosContext *context param for all geometry functions since we use thread local one,
so that all caller do not need to know the context.

* Modify Intersects() to call PreparedIntersects() when one of param is a constant, which has higher performance.

* rename prepareFn() to initCtxFn() to avoid confusion with PreparedFn

* Add prefix "ST_" for all geometry functions

* move getThreadLocalGeosCtx() and destroyThreadLocalGeosCtx() into util,
so that all unit test tools can compile

* Add unit test for geometry lib, only test MakePoint so far

* refactor and enhance existing cases in geomFuncTest

* implement NULL type and NULL value test for geomFuncTest

* add test on geomFromText()

* add unit test on AsText() in geomFuncTest

* combine some makePointFunction test items

* add intersectsFunctionTwoColumns test
refactor on callGeomFromTextWrapper functions

* enhance intersectsFunction test to add cases like input constant , NULL type, NULL value, or wrong content

* add more cases into intersectsFunction test

* Add basic test on geometry in system test

* Add ST_GeomFromText and ST_AsText function test in system test on geometry

* add ST_Intersects function test in system test on geometry

* support to check expectedErrno in system test on geometry

* adjust geomTest unit test and geometry system test

* add geometry data type and functions in doc english version

* implement touchesFunction() in geometry lib
refactor geometry relation functions model

* separate gemFuncTest into several src files

* add unit test on touchesFunction

* support sql function ST_Touches()
add system test on ST_Touches

* add docs for ST_Touches()

* Add ST_Contains()

* Add ST_Covers()

* Add ST_Equals()

* add swapAllowed param for geomRelationFunction()
read geom2 earlier intead of at doGeosRelation()

* Add ST_ContainsProperly()

* build on windows

* Merge from 3.0 to 3.0_geometry

* change macro definition TSDB_DATA_TYPE_GEOMETRY as the last one for compatibility

* change '\\NULL' to 'NULL' back in shellDumpFieldToFile()

* add /usr/local/include into include directory

* add /usr/local/inlcude and /usr/local/lib in cmake.platform for DARWIN
2023-05-24 15:36:46 +08:00
Ganlin Zhao 89bea7100f fix: fix count var type error 2023-05-24 00:31:05 -07:00
Haojun Liao 99f669434a
Merge pull request #21282 from taosdata/feature/TD-23117
feat:[TD-23117] add schema for ins_topics
2023-05-24 14:54:42 +08:00
dapan1121 cbbbaca553
Merge pull request #21437 from taosdata/fix/TD-23955-3.0
fix: delete index filter for desc query
2023-05-24 14:05:07 +08:00
wade zhang 398bf8f322
Merge pull request #21446 from taosdata/fix/confirm-msg-when-add-learner
comfirm msg when add learner
2023-05-24 13:54:15 +08:00
Haojun Liao b2ce45b07b refactor: do some internal refactor. 2023-05-24 13:39:20 +08:00
Haojun Liao a2f29aa0f5 refactor: do some internal refactor. 2023-05-24 13:34:46 +08:00
Haojun Liao 1f7f326bed refactor: do some internal refactor and set the api function ptr. 2023-05-24 13:22:05 +08:00
kailixu ef899a0cc3 fix: delete index filter for desc query 2023-05-24 11:28:45 +08:00
dmchen ab3d54aae3 comfirm msg when add learner 2023-05-24 11:08:41 +08:00
Minglei Jin 26bfa4363d fix(cache/read): associate tbname with primary ts column 2023-05-24 11:01:47 +08:00
Hongze Cheng d6d0bf0e41 enh: add varchar sma 2023-05-24 10:47:26 +08:00
liuyao 180abf2229 set agg task status 2023-05-24 09:34:40 +08:00
liuyao b5d01f9bab set agg pause status 2023-05-24 09:19:28 +08:00
Haojun Liao 39a1fa8f78 refactor: do some internal refactor. 2023-05-23 19:20:25 +08:00
Haojun Liao 66477a28ca refactor: do some internal refactor. 2023-05-23 19:10:50 +08:00
Haojun Liao 3d084adf1f Merge remote-tracking branch 'origin/refact/fillhistory' into refact/fillhistory
# Conflicts:
#	source/dnode/vnode/inc/vnode.h
#	source/libs/executor/src/executil.c
#	source/libs/index/CMakeLists.txt
#	source/libs/index/src/indexFilter.c
2023-05-23 18:32:47 +08:00
kailixu 34cf6aad30 fix: alter dnode option has no effect 2023-05-23 18:29:53 +08:00
Haojun Liao e67b532d8a refactor: refactor the module dependency. 2023-05-23 18:29:23 +08:00
kailixu 82b8c3c3d1 fix: delete index filter for desc query 2023-05-23 18:21:21 +08:00
kailixu 18e83173c8 fix: delete index filter for desc query 2023-05-23 17:21:45 +08:00
wade zhang 68a98d4d09
Merge pull request #21429 from taosdata/fix/TD-24306
fix(cache): sychronize commit, read and write threads with writebatch
2023-05-23 16:20:59 +08:00
Minglei Jin 6d620a7d7c fix(cache/read): set none to null instead of skipping column 2023-05-23 14:51:26 +08:00
Minglei Jin 81048f93b0 fix(cache): sychronize commit, read and write threads with writebatch 2023-05-23 13:44:33 +08:00
yihaoDeng c15b1e3520 opt compile 2023-05-23 11:46:02 +08:00
wangmm0220 ed612088c0 fix:lost data because tsdbreader or task is killed 2023-05-23 10:32:13 +08:00
kailixu a171c0c860 Merge branch '3.0' into fix/TD-21457-3.0 2023-05-23 09:27:31 +08:00
wade zhang 9e73a69316
Merge pull request #21389 from taosdata/fix/TD-24306
fix(cache/commit): skip batch write if empty
2023-05-23 08:22:33 +08:00
kailixu a3bf49d22f chore: revert 2023-05-22 20:35:52 +08:00
kailixu c75aa54a3d fix: tsdb read and append _wstart for tsma 2023-05-22 20:33:29 +08:00
wangmm0220 d8387b95ff fix:set task status to 0 in inti 2023-05-22 20:14:43 +08:00
Haojun Liao f3491310a9
Merge pull request #21411 from taosdata/fix/TD-24144
fix:remove get schema from previous for taosx
2023-05-22 18:37:20 +08:00
Minglei Jin 75ccd024a2 cache/writebatch: separate read & write batches 2023-05-22 18:06:58 +08:00
dapan1121 08ff4f4540 fix: crash issue 2023-05-22 17:06:01 +08:00
kailixu f18fc19d76 fix: tsdb read and tsma _wstart append 2023-05-22 16:13:50 +08:00
Hui Li 0f4fb1c31d
Merge pull request #21407 from taosdata/mark/tmq
fix:set task code success after kill
2023-05-22 16:10:18 +08:00
wangmm0220 ae515851c4 fix:remove get schema from previous for taosx 2023-05-22 15:32:30 +08:00
Minglei Jin 21adc23af4 cache/loading: skip partial loading tables 2023-05-22 15:21:19 +08:00
wangmm0220 591b51f624 fix:set task code success after kill 2023-05-22 12:42:21 +08:00
Haojun Liao f520de0dab refactor: adjust the module dependency. 2023-05-22 10:07:01 +08:00
Hui Li 3f824e2045
Merge pull request #21355 from taosdata/mark/tmq
fix:error in pHandle lock
2023-05-22 08:57:45 +08:00
Haojun Liao 9423001fea
Merge pull request #21396 from taosdata/refact/fillhistory
Refact/fillhistory
2023-05-21 01:12:00 +08:00
Haojun Liao dcb91082f9 fix(stream): fix error. 2023-05-20 23:37:40 +08:00
Haojun Liao 899e4d3350 refactor: do some internal refactor. 2023-05-20 18:13:58 +08:00
Haojun Liao de44c9160c refactor: do some internal refactor. 2023-05-20 18:05:39 +08:00
wangmm0220 7b735c67d0 fix:move sleep logic from rpc thread to tmq thread & fix some error 2023-05-20 16:36:25 +08:00
wangmm0220 8183be4aff fix:move sleep logic from rpc thread to tmq thread & fix some error 2023-05-20 16:13:52 +08:00
dapan1121 6e5ec3d097
Merge pull request #21358 from taosdata/feat/TD-23362-3.0
feat: support update active code by SQL
2023-05-20 14:09:20 +08:00
wangmm0220 04858fae22 fix:tsdbreader is free by mistake 2023-05-20 12:20:54 +08:00
wangmm0220 1ddbdad33c fix:set task status killed when vnode receive subscribe msg from mnode 2023-05-19 21:40:33 +08:00
wangmm0220 33d6df8717 fix:set task status killed when vnode receive subscribe msg from mnode 2023-05-19 19:11:49 +08:00
dapan1121 778b7b84fd
Merge pull request #21371 from taosdata/fix/TD-24234
fix: distinct wrong result issue
2023-05-19 18:15:04 +08:00
Haojun Liao e2ec8d738c other: add some logs. 2023-05-19 18:08:01 +08:00
wangmm0220 c7c255e967 fix:set task status killed when vnode receive subscribe msg from mnode 2023-05-19 18:06:05 +08:00
Haojun Liao bcaa44e290
Merge pull request #21385 from taosdata/fix/liaohj_main
fix(query): add null check.
2023-05-19 17:55:02 +08:00
wangmm0220 ff2b545b27 fix:set task status killed when vnode receive subscribe msg from mnode 2023-05-19 17:16:47 +08:00
Minglei Jin a5c1b9a054 cache/commit: skip batch write if empty 2023-05-19 17:10:24 +08:00
dapan1121 42c65898ea
Merge pull request #21335 from taosdata/feat/TD-22746
feat: support client meta control
2023-05-19 16:55:08 +08:00
dapan1121 6e6853413c fix: db cfg memory issue 2023-05-19 16:48:05 +08:00
kailixu 8fd4b27c43 chore: code optimization 2023-05-19 16:10:44 +08:00
kailixu 301f7f7a41 Merge branch 'feat/TD-23362-3.0' of https://github.com/taosdata/TDengine into feat/TD-23362-3.0 2023-05-19 16:06:36 +08:00
kailixu 8571e6f6c5 chore: code optimization 2023-05-19 16:06:20 +08:00
Haojun Liao be35194d16 fix(query): add null check. 2023-05-19 15:54:46 +08:00
wangmm0220 f7ab8dabf0 fix:[TD-23972] push subscribe msg to vnode even though consumer not change 2023-05-19 15:14:39 +08:00
wangmm0220 238254e49e fix:add task status check in doQueueScan & checkout consumer in tqProcessPollReq 2023-05-19 14:06:43 +08:00
Haojun Liao d8525123a2 enh(stream): add API to retrieve last ts for multi-tables. 2023-05-19 11:03:41 +08:00
wade zhang 208c9756cf
Merge pull request #21331 from taosdata/fix/TD-24097
enh(cache/batchread): load columns in one trip
2023-05-19 10:20:47 +08:00
kailixu de93895859 chore: code optimization 2023-05-19 09:25:26 +08:00
wade zhang 1ade314043
Merge pull request #21325 from taosdata/feat/force-drop-dnode
Feat/force drop dnode
2023-05-19 09:23:54 +08:00
dapan1121 e882601b67 fix: last table scan issue 2023-05-19 09:15:48 +08:00
wade zhang 7374ea2f0b
Merge pull request #21322 from taosdata/fix/status-resp-return-null-when-only-one-ep
status resp return null when only one ep
2023-05-19 09:04:41 +08:00
kailixu c770a5c306 chore: code optimization 2023-05-19 06:59:28 +08:00
wangmm0220 bca1af3f5d fix:change tmq subscribe try time to 60mins 2023-05-18 21:18:44 +08:00
kailixu e3f194ed9b chore: code optimization 2023-05-18 19:13:04 +08:00
Minglei Jin 35f74ce2e8 cache/schema: not cache schema 2023-05-18 18:35:06 +08:00
kailixu 1de90208f7 test: test case for alter dnode active code 2023-05-18 18:02:48 +08:00
Haojun Liao c4c5bbb65c other: merge 3.0 2023-05-18 17:28:40 +08:00
Haojun Liao dbd52ecffa
Merge pull request #21364 from taosdata/enh/rocksdbSstate
state merge into 3.0
2023-05-18 17:25:44 +08:00
liuyao da3fc5111e fix pause agg task 2023-05-18 15:29:41 +08:00
Minglei Jin f95867d255 cache/del: fix lru key length 2023-05-18 14:48:08 +08:00
Minglei Jin 3b316051bf cache/schema: fix schema double free 2023-05-18 13:51:07 +08:00
yihaoDeng 9380b22394 merge 3.0 2023-05-18 05:46:38 +00:00
kailixu 0e891c5c14 chore: more code 2023-05-18 13:30:45 +08:00
Minglei Jin 0f8b7c87f7 cache/delete: fix rocks key length 2023-05-18 13:15:25 +08:00
kailixu ab06dd04f4 feat: support update active code in sdb 2023-05-18 13:01:28 +08:00
kailixu 5098d44068 feat: support update active code in sdb 2023-05-18 12:59:44 +08:00
Haojun Liao 5d5b2bb16a refactor: do some internal refactor. 2023-05-18 12:59:19 +08:00
Haojun Liao ce61b2ab00 fix: fix syntax error in tqRead 2023-05-18 11:35:45 +08:00
Haojun Liao c3491dae16 refactor: do some interal refactor. 2023-05-18 10:56:40 +08:00
Haojun Liao 81f821a6fc refactor: do some internal refactor. 2023-05-18 10:51:43 +08:00
dapan1121 f5ebc17fae
Merge branch '3.0' into feat/TD-22746 2023-05-18 09:10:49 +08:00
dmchen 32c6ef4b6e fix ci 2023-05-17 23:09:16 +08:00
kailixu cf0d3ddde3 feat: support update active code by SQL 2023-05-17 20:27:12 +08:00
wangmm0220 54f4860139 fix:rollback [TD-23972] push subscribe msg to vnode even though consumer not change 2023-05-17 19:44:56 +08:00
Haojun Liao b9bda9b30f fix(stream): set the correct start offset for resumed stream task. 2023-05-17 19:36:42 +08:00
wangmm0220 405cdfa7bc fix:error in pHandle lock 2023-05-17 19:02:16 +08:00