Commit Graph

2844 Commits

Author SHA1 Message Date
Haojun Liao 0322fdc1fc fix(stream): fix memory leak. 2023-06-24 23:43:43 +08:00
Haojun Liao ceb78fdad2
Merge branch '3.0' into refact/fillhistory 2023-06-24 18:53:48 +08:00
Shungang Li b93f653d7e feat: enhance ttl, deletetime modified by writing-ops
new config item: ttlChangeOnWrite (default 0)
ttl delete time changes on last write if true
2023-06-19 19:03:35 +08:00
dapan1121 1ca24fea6b
Merge pull request #21742 from wangjiaming0909/feature/3.0/TD-24656
feature: add input, output ts order for execution plans
2023-06-18 19:24:29 +08:00
wangjiaming0909 fb4f174fbc feature: add input, output ts order for execution plans 2023-06-16 10:26:09 +08:00
wangmm0220 e019ed2cc3 fix:conflict 2023-06-15 18:50:44 +08:00
wangmm0220 a7a518aaed opti:tmq logic 2023-06-15 15:44:52 +08:00
Haojun Liao 74e0138f72 Merge branch '3.0' into refact/fillhistory 2023-06-15 15:25:00 +08:00
Haojun Liao b5a7ef9a7e fix: fix syntax error. 2023-06-15 13:29:41 +08:00
Haojun Liao 1b9eca5ce0 other: merge main. 2023-06-15 13:03:17 +08:00
Haojun Liao 55724157c4 refactor: remove one function. 2023-06-15 10:40:25 +08:00
slzhou a36557f009 fix: calculate the rows that can be put in one page 2023-06-14 13:44:11 +08:00
wangmm0220 864236a8dc fix:conflicts 2023-06-14 12:05:10 +08:00
wangmm0220 c28d7d9bf8 fix:open info log in tmq client & modify parametes in show consumers 2023-06-14 12:01:54 +08:00
dapan1121 f84eef0ac4
Merge branch '3.0' into feat/TD-24499 2023-06-13 15:27:18 +08:00
Haojun Liao 933d08b489
Merge pull request #21690 from taosdata/feature/TS-3495
feat:add parameters for consumer & add offset rows for subscription
2023-06-13 14:59:15 +08:00
dapan1121 73d3c21e21 Merge remote-tracking branch 'origin/3.0' into feat/TD-24499 2023-06-13 11:44:41 +08:00
dapan1121 59b8cfbc7d enh: add sub_query in systable and kill subquery 2023-06-12 17:14:41 +08:00
dapan1121 170182fecd feat: support fill history with sub request 2023-06-12 16:10:54 +08:00
wangmm0220 6657b8d849 fix:modify offset description to string 2023-06-12 09:44:00 +08:00
dapan1121 7956a8c420 fix: row size too big issue 2023-06-09 13:49:25 +08:00
Haojun Liao 53246ed6bb other: merge other branch. 2023-06-09 09:41:10 +08:00
wangmm0220 3f46a9bbc9 feat:add parameters for consumer & add offset rows for subscription 2023-06-08 18:14:02 +08:00
Haojun Liao 2b6ace653a refactor: do some internal refactor. 2023-06-08 16:14:27 +08:00
Haojun Liao f582705feb refactor: do some internal refactor. 2023-06-08 14:18:06 +08:00
liuyao 1e9c4d5fac opt stream block dispatch 2023-06-07 10:45:27 +08:00
dapan1121 a0428387a9 enh: corrent column data reassign issue 2023-06-06 16:44:15 +08:00
dapan1121 65d323d9c7
Merge pull request #21222 from taosdata/fix/TD-24001
enh: optimize timeline function validation
2023-06-06 14:22:53 +08:00
wade zhang e12af9327e
Merge pull request #21612 from luckeverda/geo
fix: compress core by tDataTypes
2023-06-06 14:20:45 +08:00
Shungang Li 472665e4b1 fix: compress core by tDataTypes 2023-06-06 13:06:53 +08:00
dapan1121 02b1257b01 enh: reassign data column in blocks 2023-06-06 11:17:02 +08:00
dapan1121 fe7ba9d92e
Merge pull request #21523 from taosdata/feat/TS-3134-3.0
feat: allow user to reset root passwd
2023-06-06 11:10:11 +08:00
dapan1121 7381209618 enh: optimize filter performance 2023-06-05 16:08:11 +08:00
dapan1121 532e02fb2a enh: improve filter performance 2023-06-05 10:47:15 +08:00
wade zhang b437024eca
Merge pull request #21588 from taosdata/fix/TD-24346-M
chore: unbind the dependency
2023-06-04 09:53:20 +08:00
kailixu 87a086996e chore: code optimization 2023-06-04 09:07:04 +08:00
kailixu 907feb23b0 chore: unbind the dependency 2023-06-04 07:56:46 +08:00
Haojun Liao d45aa7ef84
Merge pull request #21555 from taosdata/fix/liaohj_main
other: merge main into 3.0.
2023-06-02 13:11:12 +08:00
Haojun Liao 1036259a7b fix(query): fix error in fill. 2023-06-01 18:25:05 +08:00
Haojun Liao 5d98a319c7
Merge pull request #21515 from taosdata/feature/TD-19042
feat: support create topic as stable with conditions
2023-06-01 09:56:55 +08:00
Haojun Liao 5301c5756a other: merge main into 3.0. 2023-06-01 09:29:18 +08:00
yihaoDeng ed851b522c change db param 2023-05-31 03:30:10 +00:00
yihaoDeng 3b0a6d7f0b change db param 2023-05-31 03:15:25 +00:00
dapan1121 23bcfc2fd0 enh: stmt column length validation 2023-05-31 09:16:47 +08:00
kailixu 9501d4f417 feat: allow user to reset root passwd 2023-05-29 19:44:11 +08:00
wangmm0220 78db3520a6 fix:conflict 2023-05-29 14:57:03 +08:00
dapan1121 e2d45438cb
Merge pull request #21405 from taosdata/szhou/scl-flt
enhance: scalar filter improvement
2023-05-28 18:49:39 +08:00
dapan1121 faaa9da887 fix: sliding can't be 1a issue 2023-05-26 18:17:05 +08:00
slzhou b83bf9163e fix: restore scalar mode computation and add filterScalarMode config variable and add test case 2023-05-26 14:46:32 +08:00
dapan1121 2713f4f6d4 feat: support create topic as stable with conditions 2023-05-25 19:01:58 +08:00
Ganlin Zhao 459c1e6c0c fix: fix timestamp conversion error due to daylight saving time 2023-05-25 13:31:18 +08:00
liuyao 1f81642303 fix sma sliding window 2023-05-25 09:12:10 +08:00
wangmm0220 357e86b994 feat:add tag filter for stable subscribe 2023-05-24 18:59:47 +08:00
dapan1121 137a9eb602
Merge pull request #21455 from taosdata/enh/add_varchar_sma
fix: fix count var type error
2023-05-24 18:41:01 +08:00
wangmm0220 8537e4e80e feat:add tag filter for stable subscribe 2023-05-24 18:26:55 +08:00
Dingle Zhang 984211f3b4
Feature/3.0 geometry (#21037)
* Add GEOMETRY data type and make sql.c able to parse it. The GEMETRY works like BINARY so far.

* add GEOMETRY type into gConvertTypes to fix some issues like DELETE calling

* change some test cases to make sure no same timestamp is inserted, and add my smoketest.sh

* Add a function MakePoint() and introduce a lib geometry

* implement sql functions GeomFromText() and AsText()

* Use GEOS *_r funcions instead for thread safety

* Handle with TSDB_DATA_TYPE_GEOMETRY when INSERT geometry data by converting WKT.
Add geosWrapper to wrap the basic GEOS functions for TDEngine.

* refactor AsText and MakePoint functions to be like GeomFromText

* Show WKT when print geometry data in screen
Dump hex data when dump geometry data in a file

* define TYPE_BYTES item for TSDB_DATA_TYPE_GEOMETRY, which casued some strange issues.

* set number of decimals of WKT to 6

* Implement SQL function Intersects()

* refactor geometry sql functions

* Add geosErrMsgeHandler() to get the GEOS error detail

* use threadlocal to instantiate SGeosContext
call destroyGeosContext() only if the thread exists

* remove SGeosContext *context param for all geometry functions since we use thread local one,
so that all caller do not need to know the context.

* Modify Intersects() to call PreparedIntersects() when one of param is a constant, which has higher performance.

* rename prepareFn() to initCtxFn() to avoid confusion with PreparedFn

* Add prefix "ST_" for all geometry functions

* move getThreadLocalGeosCtx() and destroyThreadLocalGeosCtx() into util,
so that all unit test tools can compile

* Add unit test for geometry lib, only test MakePoint so far

* refactor and enhance existing cases in geomFuncTest

* implement NULL type and NULL value test for geomFuncTest

* add test on geomFromText()

* add unit test on AsText() in geomFuncTest

* combine some makePointFunction test items

* add intersectsFunctionTwoColumns test
refactor on callGeomFromTextWrapper functions

* enhance intersectsFunction test to add cases like input constant , NULL type, NULL value, or wrong content

* add more cases into intersectsFunction test

* Add basic test on geometry in system test

* Add ST_GeomFromText and ST_AsText function test in system test on geometry

* add ST_Intersects function test in system test on geometry

* support to check expectedErrno in system test on geometry

* adjust geomTest unit test and geometry system test

* add geometry data type and functions in doc english version

* implement touchesFunction() in geometry lib
refactor geometry relation functions model

* separate gemFuncTest into several src files

* add unit test on touchesFunction

* support sql function ST_Touches()
add system test on ST_Touches

* add docs for ST_Touches()

* Add ST_Contains()

* Add ST_Covers()

* Add ST_Equals()

* add swapAllowed param for geomRelationFunction()
read geom2 earlier intead of at doGeosRelation()

* Add ST_ContainsProperly()

* build on windows

* Merge from 3.0 to 3.0_geometry

* change macro definition TSDB_DATA_TYPE_GEOMETRY as the last one for compatibility

* change '\\NULL' to 'NULL' back in shellDumpFieldToFile()

* add /usr/local/include into include directory

* add /usr/local/inlcude and /usr/local/lib in cmake.platform for DARWIN
2023-05-24 15:36:46 +08:00
Haojun Liao 99f669434a
Merge pull request #21282 from taosdata/feature/TD-23117
feat:[TD-23117] add schema for ins_topics
2023-05-24 14:54:42 +08:00
Hongze Cheng d6d0bf0e41 enh: add varchar sma 2023-05-24 10:47:26 +08:00
dapan1121 5bedf6b19a enh: support config batch rows number when import data from csv file 2023-05-23 19:21:52 +08:00
Haojun Liao 9423001fea
Merge pull request #21396 from taosdata/refact/fillhistory
Refact/fillhistory
2023-05-21 01:12:00 +08:00
Haojun Liao 8ab065d01e other: update some logs. 2023-05-19 23:53:23 +08:00
Ganlin Zhao 709b59a3a6 fix: fix assert crash in tsort.c 2023-05-19 17:27:15 +08:00
dapan1121 42c65898ea
Merge pull request #21335 from taosdata/feat/TD-22746
feat: support client meta control
2023-05-19 16:55:08 +08:00
wade zhang 1ade314043
Merge pull request #21325 from taosdata/feat/force-drop-dnode
Feat/force drop dnode
2023-05-19 09:23:54 +08:00
Haojun Liao 1e020a46c9 other: merge main. 2023-05-19 09:07:35 +08:00
Haojun Liao d4b0e102af fix:do some internal refactor. 2023-05-19 08:55:59 +08:00
dapan1121 a61f0533cf fix: invalid read issue 2023-05-18 18:00:15 +08:00
dapan1121 f5ebc17fae
Merge branch '3.0' into feat/TD-22746 2023-05-18 09:10:49 +08:00
Haojun Liao 041ffa91bd other: merge main. 2023-05-17 15:42:15 +08:00
dmchen 9ff56a4e2b unsafe command 2023-05-16 14:02:54 +08:00
dapan1121 ee2521a6ab Merge remote-tracking branch 'origin/3.0' into feat/TD-22746 2023-05-16 10:53:21 +08:00
dapan1121 cf7b4593e7 feat: add drop dnode unsafe command 2023-05-16 09:50:10 +08:00
Haojun Liao 99148d6719 other: merge 3.0 2023-05-13 20:02:48 +08:00
Haojun Liao 236926b9ee other: merge enh/rocksdbstate 2023-05-13 19:49:28 +08:00
Haojun Liao 1975e94501 Merge branch 'main' into enh/rocksdbSstate 2023-05-13 19:41:03 +08:00
wangmm0220 e17a105eff feat:[TD-23117] add schema for ins_topics 2023-05-12 18:14:43 +08:00
dapan1121 69795286fa Merge remote-tracking branch 'origin/main' into enh/tsbsPerf.4 2023-05-12 13:46:16 +08:00
dapan1121 eda4c85dbb
Merge pull request #21253 from taosdata/feat/TD-23643-3.0
feat: support connectors licensing
2023-05-11 18:19:04 +08:00
kailixu efd6b578ff chore: more code 2023-05-11 14:57:50 +08:00
kailixu 1cf0b485e8 Merge branch '3.0' into feat/TD-23643-3.0 2023-05-11 00:17:24 +08:00
dapan1121 daedb3618b Merge remote-tracking branch 'origin/3.0' into feat/TD-22746 2023-05-10 17:47:11 +08:00
dapan1121 79d4403377 feat: add client meta limitation 2023-05-10 17:44:53 +08:00
yihaoDeng 5708fcb5cb Merge branch 'enh/3.0' into enh/rocksdbSstateMerge 2023-05-10 08:02:16 +00:00
dapan1121 a8c65cd25a feat: support restore dnode clause 2023-05-09 19:19:14 +08:00
cadem 843d606058 feat/restore dnode 2023-05-09 17:15:37 +08:00
dapan1121 52fd6a84ac enh: support db cfg cache update 2023-05-09 17:04:20 +08:00
wangjiaming0909 fb0183a642 fix: set telemetry reporting service url from telemetry.taosdata.com to telemetry.tdengine.com 2023-05-09 15:24:55 +08:00
kailixu e4882765ae Merge branch '3.0' into feat/TD-23643-3.0 2023-05-08 16:28:20 +08:00
Yihao Deng cb223acf82
Merge branch 'main' into enh/rocksdbSstate 2023-05-08 09:45:27 +08:00
kailixu 2be6ff4630 chore: more code 2023-05-06 20:38:50 +08:00
yihaoDeng 08c3a63341 Merge branch 'enh/standVer' into enh/rocksdbSstateMerge 2023-05-06 12:37:54 +00:00
Minglei Jin 596bee8028 Merge branch '3.0' into fix/TD-23623 2023-05-06 16:07:26 +08:00
dapan1121 8fe63e1e24
Merge pull request #21180 from taosdata/szhou/fix-ts3326
fix: clear null bitmap bit when set value
2023-05-06 15:58:57 +08:00
slzhou 25170e1a75 fix: restore the removal of show datablock to console 2023-05-06 13:32:58 +08:00
slzhou 6b0580eedf fix: clear null bitmap bit when set value 2023-05-06 13:30:49 +08:00
Haojun Liao da6212bab0 other: merge main. 2023-05-06 12:51:38 +08:00
Benguang Zhao 5d63f438b5 enh: confirm alter hash range 2023-05-04 19:43:11 +08:00
Haojun Liao 23c49594b7 other: merge main. 2023-05-04 16:41:53 +08:00
Haojun Liao 09a04052ec refactor: do some internal refactor. 2023-05-04 16:15:14 +08:00
Haojun Liao 851193a033
Merge pull request #21060 from taosdata/fix/TS-3222
opti:change push mgr to consume msg for subscribe
2023-05-04 10:16:41 +08:00
Haojun Liao 8b57184a9a
Merge pull request #21123 from taosdata/fix/liaohj_main
refactor: remove assert.
2023-04-29 00:44:24 +08:00
Haojun Liao 03b1de017a refactor: remove assert. 2023-04-28 14:12:17 +08:00
liuyao 2984c5a758 merge main 2023-04-28 10:34:46 +08:00
wangmm0220 cce868d140 fix:offset encode assert error 2023-04-28 09:45:16 +08:00
Haojun Liao ad7c3218f7
Merge pull request #21111 from taosdata/fix/liaohj_main
enh(query): stop tsdb reader ASAP.  TD-23249
2023-04-27 17:45:38 +08:00
Haojun Liao d83f29dc23 refactor: remove assert. 2023-04-27 15:33:04 +08:00
Haojun Liao e1bd65ec0a
Merge pull request #21105 from taosdata/fix/liaohj_main
fix(query): check the init status for pReader->status.merger  TD-23903
2023-04-27 12:40:13 +08:00
wangmm0220 6a889ae80e Merge branch 'main' of https://github.com/taosdata/TDengine into fix/TS-3222 2023-04-27 09:48:04 +08:00
Haojun Liao db1d75bb48 refactor: do some internal refactor. 2023-04-27 09:28:20 +08:00
Minglei Jin a1fba2df65 Merge branch '3.0' into fix/TD-23623 2023-04-26 17:38:47 +08:00
Xiaoyu Wang 05dc0fd6b1
Merge pull request #21056 from taosdata/feat/TD-23693
feat: subtable level privilege
2023-04-26 09:17:23 +08:00
Minglei Jin 2566bd4ae8 row/iter: fix null column iter 2023-04-25 16:17:58 +08:00
dapan1121 f22d279f5f
Merge pull request #21057 from taosdata/feat/TD-19567
feat: support log slow query by default
2023-04-25 13:43:34 +08:00
wangmm0220 168e6f8936 opti:change push mgr to consume msg for subscribe 2023-04-24 19:44:10 +08:00
wangmm0220 8572f4a32f opti:change push mgr to consume msg for subscribe 2023-04-24 19:41:30 +08:00
dapan1121 de1161dafb enh: ignore single row null data type validation 2023-04-24 19:22:44 +08:00
dapan1121 b743b889fc
Merge pull request #20828 from taosdata/enh/TD-23421-M
enh: support user passwd version
2023-04-24 17:16:37 +08:00
dapan1121 9551a269b3 feat: support log slow query by default 2023-04-24 16:45:34 +08:00
Haojun Liao 057cc2d30d
Merge pull request #21018 from taosdata/feature/3_liaohj
fix(stream): set the correct start offset for stream task.
2023-04-24 12:02:20 +08:00
Xiaoyu Wang 4bb7a25fc7 feat: subtable level privilege 2023-04-23 16:30:28 +08:00
dapan1121 5fe99c5ad2 feat: support log long query 2023-04-23 15:54:15 +08:00
54liuyao 5089528a02 feat:stream pause&resume 2023-04-23 15:08:51 +08:00
Haojun Liao 2e2e3a61e5 fix(tmq): update the seek info serialization. 2023-04-23 11:58:40 +08:00
Haojun Liao 9cf89c6b6f enh(tmq): add check for consumer Id; 2023-04-23 11:51:43 +08:00
yihaoDeng 917b07348c Merge branch 'fix/rocksdbState' into enh/rocksRevert 2023-04-23 02:37:26 +00:00
Haojun Liao 3f432cca2e
Merge pull request #20970 from taosdata/fix/TS-3116
opti:escape logic in schemaless
2023-04-21 18:44:06 +08:00
chenhaoran 7d7a0769b3 Merge remote-tracking branch 'origin/main' into enh/tsbsPerf.1 2023-04-21 16:20:37 +08:00
kailixu 9e71b6d071 Merge branch '3.0' into enh/TD-23421-M 2023-04-21 16:04:13 +08:00
cadem 6d948d8345 message compatible 2023-04-21 09:50:54 +08:00
wangmm0220 b1561c95c3 fix:add test cases for escape in schemaless 2023-04-20 15:31:18 +08:00
Haojun Liao c654f1145d enh(stream): add new msg for seek, and do some internal refactor. 2023-04-20 10:59:16 +08:00
cadem d51070922b message compitible 2023-04-20 09:45:32 +08:00
Haojun Liao 5fd6ac4fc5
Merge pull request #20977 from taosdata/fix/liaohj_main
fix(os): fix a deadlock.
2023-04-20 09:14:26 +08:00
Haojun Liao a69e2a8045 fix(os): fix the link error in unit test cases. 2023-04-19 15:33:02 +08:00
dapan1121 4a9d62b467 enh: ignore single row null data type validation 2023-04-19 10:18:41 +08:00
cadem 3b78d4382b add learner 2023-04-18 19:03:45 +08:00
Haojun Liao 9627e8105b enh(tmq): support seek offset. 2023-04-18 13:52:47 +08:00
kailixu 97aa8aede2 chore: revert 2023-04-17 14:26:02 +08:00
Haojun Liao 04e042f21d Merge branch 'feature/3_liaohj' into enh/rocksRevert 2023-04-15 09:35:43 +08:00
Haojun Liao 02ec67ad9e
Merge pull request #20882 from taosdata/fix/TS-3081
fix:open test cases for tmq & add log if rebalance error
2023-04-14 17:56:58 +08:00
Haojun Liao b57c813681 other: merge feature/3_liaohj 2023-04-14 10:36:54 +08:00
Haojun Liao 9597453631
Merge pull request #20925 from taosdata/fix/TS-3106-MAIN
add option enableScience on taos.cfg to show float and double scientific notation
2023-04-14 10:28:00 +08:00
wangmm0220 e985f15cf0 fix:memset nullBitmap of SSDataBlock to 0 in udf 2023-04-14 09:36:36 +08:00
Alex Duan eb03a0bb48 fix: adjust format 2023-04-13 16:55:22 +08:00
Alex Duan 73d5bdf01f fix: build error fix 2023-04-13 16:45:06 +08:00
Alex Duan a0be0c1d06 fix: add client option tsEnableScience 2023-04-13 16:40:38 +08:00
dapan1121 7f518ca4ea feat: support cache db cfg 2023-04-13 10:54:57 +08:00
wangmm0220 7648e03e31 fix:doBitmapMerge error if remaind bytes is not 0 2023-04-13 10:03:30 +08:00
kailixu ac841b02bf merge 3.0 2023-04-12 13:09:52 +08:00
Xiaoyu Wang 9578c4538a Merge remote-tracking branch 'origin/3.0' into fix/3.0_merge_main 2023-04-11 19:33:23 +08:00