Commit Graph

278 Commits

Author SHA1 Message Date
Pan Wei c5841939d8
fix: add ahandle release log (#30395) 2025-03-24 13:26:49 +08:00
Simon Guan ddc05f168e
refactor: adjust the log to track the data writing process on the server via QID (#30195)
* refactor: adjust wal log infos

* refactor: adjust some log's level

* refactor: adjust some log's level

* fix: add traceId for sync module

* refactor: adjust log level

* refactor: adjust log level

* refactor: adjust log levels

* refactor: adjust log levels

* refactor: adjust log levels

* refactor: adjust log levels

* refactor: adjust log levels

* refactor: adjust log levels

* refactor: adjust log levels

* fix: compile errors in windows

* refactor: minor changes
2025-03-18 16:21:44 +08:00
Zhixiao Bao 2523e60d3b
fix: remove meaningless error logs when fetching child table metadata. (#30201)
* Enh: remove useless error logs.

* Fix: solving performance issues.

* fix: format code

---------

Co-authored-by: Simon Guan <slguan@taosdata.com>
2025-03-18 14:01:06 +08:00
Jinqing Kuang ac23a4fc55
feat(stream): support stream processing for virtual tables (#30144)
* enh: add client processing

* enh: add mnode vtables processing

* enh: add mnode vtable processing

* enh: add normal child vtable support

* fix: compile issues

* fix: compile issues

* fix: create stream issues

* fix: multi stream scan issue

* fix: remove debug info

* fix: agg task and task level issues

* fix: correct task output type

* fix: split vtablescan from agg

* fix: memory leak issues

* fix: add limitations

* Update 09-error-code.md

* Update 09-error-code.md

* fix: remove usless case

* feat(stream): extract original table data in source scan task

Implemented functionality in the source task to extract data
corresponding to the virtual table from the original table using WAL.
The extracted data is then sent to the downstream merge task for further
processing.

* feat(stream): multi-way merge using loser tree in virtual merge task

Implemented multi-way merge in the merge task using a loser tree to
combine data from multiple original table into a single virtual table.
The merged virtual table data is then pushed downstream for further
processing.  Introduced memory limit handling during the merge process
with configurable behavior when the memory limit is reached.

* fix(test): remove useless cases

---------

Co-authored-by: dapan1121 <wpan@taosdata.com>
Co-authored-by: Pan Wei <72057773+dapan1121@users.noreply.github.com>
2025-03-15 17:06:48 +08:00
Jing Sima 410324746b
feat:[TS-4897] virtual table (#30098)
* feat: [TS-4897] Support create/drop/alter/show/describe vtable

* feat: [TS-4897] Support vtable's query

* feat: [TS-4897] Support create virtual supertable

* feat: [TS-4897] Support explain analyze / where / count(*) and only select ts of vtable.

* feat: [TS-4897] Add create test and fix bugs

* feat: [TS-4897] Add alter/drop test and fix bugs

* feat: [TS-4897] Add describe/show test and fix bugs

* feat: [TS-4897] Add auth test and fix bugs

* feat: [TS-4897] Fix meta/catalog/cache bugs

* feat: [TS-4897] Support select tag from virtual child table

* feat: [TS-4897] Add select test and fix plenty of bugs

* feat: [TS-4897] Add optimize rule for vtable scan / support create vtable cross database / remove enterprise constraint / fix bugs.

* feat: [TS-4897] Fix 'schema is old'

* feat: [TS-4897] Support virtual stable query

* feat: [TS-4897] Add tests and Fix bugs

* feat: [TS-4897] resolve conflict.
2025-03-15 14:10:46 +08:00
wangjiaming f50fcb85b8
feat(decimal): support decimal data type (#30060)
* decimal: create table

* decimal: add test case decimal.py

* decimal: add decimal.c

* support input decimal

* decimal test

* refactor svalue

* fix test cases

* add decimal unit test

* add decimal test cmake

* support insert and query decimal type

* define wide integer, support decimal128

* support decimal128 divide

* set decimal type expr res types

* scalar decimal

* convert to decimal

* fix decimal64/128 from str and to str

* fix decimal from str and decimal to str

* decimal simple conversion

* unit test for decimal

* decimal conversion and unit tests

* decimal + - * /

* decimal scalar ops and comparision

* start to refactor GET_TYPED_DATA

* support decimal max func, cast func

* refactor GET_TYPED_DATA interface

* decimal scalar comparision

* start to implement sum for decimal

* support sum and avg for decimal type

* decimal tests

* add decimal test

* decimal add test cases

* decimal use int256/int128

* decimal testing

* fix decimal table meta and add tests for decimal col streams

* fix create stream and create tsma

* test insert decimal values

* decimal from str

* test decimal input

* test parse decimal from string

* add taos_fetch_field_e api

* decimal insert tests

* test decimal operators

* decimal operator test

* feat:support decimal in raw block

* decimal operator tests

* decimal test

* feat:support decimal in raw block

* feat:support decimal in raw block

* feat:add schemaExt to SMqDataRsp

* feat:remove add schemaExt to SMqDataRsp

* feat:remove add schemaExt to SMqDataRsp

* feat:remove add schemaExt to SMqDataRsp

* decimal test operators

* decimal operator test

* test decimal operators

* test decimal compare operators

* decimal unary operator test

* decimal col with decimal col oper test

* test decimal col filtering

* fix decimal float operator test

* decimal test where filtering

* fix decimal filtering

* fix decimal order by

* fix decimal op test

* test decimal agg funcs

* test decimal functions

* remove assert

* fix ci build for ret check

* fix decimal windows build

* fix ci ret check

* skip decimal ret check

* skip decimal ret check

* fix decimal tests

* fix decimal ci test

* decimal test

* fix(tmq): heap user after free

* fix(tmq): double free

* fix(tmq): double free

* fix decimal tests

* fix(decimal): decimal test ci build

* fix(decimal): windows build

* fix(decimal): decimal test build

* fix(decimal): fix decimal build and tests

* fix(decimal): fix decimal tests

* fix(decimal): fix taos_fetch_fields_e api

* fix(decimal): fix decimal taos_fetch_fields_e api

* fix(decimal): rebase 3.0

* fix(decimal): fix decimal functions

* fix(decimal): fix decimal test case memory leak

* fix(decimal): fix decimal tests

* fix(decimal): fix decimal test case

* fix(decimal): fix decimal tests

* feat(decimal): fix unit tests

* feat(decimal): fix deicmal unit test

---------

Co-authored-by: wangmm0220 <wangmm0220@gmail.com>
Co-authored-by: yihaoDeng <yhdeng@taosdata.com>
2025-03-14 18:08:07 +08:00
Simon Guan 1a9f75e663 Merge branch '3.0' into fix/internal 2025-03-04 13:47:03 +08:00
Simon Guan 6826edf5e0 Merge branch 'main' into merge/mainto3.0 2025-03-03 14:01:43 +08:00
facetosea 887444669c fix: error log 2025-02-28 16:51:25 +08:00
Simon Guan 43ca6d5f9e refactor: adjust some logs 2025-02-28 16:49:46 +08:00
Simon Guan 76ad364b93 enh: adjust some logs 2025-02-27 09:55:11 +08:00
pengrongkun94@qq.com aef5611d1b switch create thread to taosc task queue 2025-02-18 18:10:26 +08:00
dapan1121 bd450fe751 fix: add meta debug log 2025-01-23 16:12:54 +08:00
dapan1121 b1702132b4 fix: add ut cases 2024-12-20 13:52:53 +08:00
dapan1121 2bd493f77b fix: return code issues 2024-12-11 19:18:50 +08:00
wangmm0220 f338357477 feat:[TD-32642] add test case for charset 2024-12-04 18:50:52 +08:00
wangmm0220 0e2a16d70f feat:[TD-32642] add charset for connection support 2024-11-27 14:25:34 +08:00
Shengliang Guan d097e307f7
Merge pull request #28745 from taosdata/enh/TD-32167/query
enh: param valid, query
2024-11-13 14:39:15 +08:00
factosea 6b37b32997 fix: transportedid 2024-11-12 18:13:35 +08:00
factosea 057d388451 fix: set pointer to null after free 2024-11-12 17:59:58 +08:00
factosea e3499f2377 enh:queryUtil 2024-11-12 16:47:39 +08:00
factosea c1f8e59c1b enh: query 2024-11-12 16:11:47 +08:00
xsren e03ccdc6e2 replace snprintf 2024-10-10 10:35:48 +08:00
xsren eaf8bf0ca6 tstrncpy 2024-10-09 11:26:35 +08:00
xsren 95a26d7ee9 tstrncpy 2024-10-09 09:53:32 +08:00
xsren e88a8317af fix: buff size 2024-10-09 09:45:56 +08:00
xsren 7f2a2cfbd0 enh: safe function 2024-10-08 14:25:51 +08:00
Hongze Cheng 5639fd0baf
Merge pull request #27947 from taosdata/enh/TS-5111-3.0
enh: support drop table with uid
2024-09-23 13:36:27 +08:00
lyh250-666 df147c60b0 enh:modify error code passing 2024-09-23 08:58:10 +08:00
kailixu 9cc0702a77 enh: drop table with uid 2024-09-19 18:34:49 +08:00
kailixu 2ea574fa4f chore: merge 3.0 2024-09-18 19:06:15 +08:00
kailixu ba10e95723 enh: support drop table with uid 2024-09-18 16:05:05 +08:00
kailixu d7fcf21f8b enh: support drop table with uid 2024-09-17 15:41:10 +08:00
kailixu 1b6694af20 enh: support drop table with uid 2024-09-16 11:39:11 +08:00
xsren f684e12c27 pointer check 2024-09-14 18:11:36 +08:00
lyh250-666 6cbb0cf172 enh:modify error code passing libs/ 2024-09-11 09:58:41 +08:00
wangjiaming0909 b39b6589c4 fix client taskqueueWorkerpool stuck problem when querypolicy = 4 2024-09-09 13:30:22 +08:00
Jing Sima 2eb1f95224 fix:[TS-5349] fix wrong dbFName setted in mndPerfsInitMeta. 2024-09-04 13:34:11 +08:00
yihaoDeng 198486977e fix mem leak 2024-09-02 17:35:10 +08:00
dapan1121 905d1eb762
Merge pull request #26972 from taosdata/fix/TD-29679/l2cache
Fix/td 29679/l2cache
2024-08-08 16:51:44 +08:00
xsren bec6dfe16b return value 2024-08-07 16:51:39 +08:00
dapan1121 dd28770bf7
Merge pull request #26914 from taosdata/fix/TD-31167
add new interface
2024-08-07 16:41:17 +08:00
yihaoDeng f2a3951c23 refact code 2024-08-06 16:12:41 +08:00
yihaoDeng e063a8092c refact code 2024-08-06 16:12:41 +08:00
dapan1121 ce52865c46 fix: db vgroup info clone issue 2024-08-06 13:20:51 +08:00
xsren aa46b1d99f return:queryUtil 2024-07-29 14:58:47 +08:00
xsren e86189d9ea check serialize result 2024-07-22 09:36:59 +08:00
xsren 99dcaaff21 build on windows 2024-07-22 09:36:59 +08:00
xsren ebec7c928b array push 2024-07-22 09:36:59 +08:00
xsren 010a1da482 return value: querymsg.c 2024-07-22 09:36:56 +08:00