Commit Graph

181 Commits

Author SHA1 Message Date
Mario Peng c625106609
fix(stmt2):stmt2 get fields return wrong when tag is value (#30283)
* ci: add 3.3.6 branch

* fix: delete taos-tools repo in Jenkinsfile2

* ci:add 3.3.6 branch to taosd-ci.yml

* fix: [TD-34074] compile error (#30220)

* fix: add case

* fix: stmt2 get fields return wrong when tag is value

* enh: replace preCtb bool to flag,handle more situation

* fix: some unit test error

* diff: add case and fix some problem

* fix: remove async test, handle in TD-34077

* fix: [TD-34074] Forbid virtual table in tq and stmt and forbid supertable query's origin table from different databases.

fix: [TD-34074] Forbid virtual table in tq and stmt and forbid supertable query's origin table from different databases.

* fix(sml): process space in the end if writing raw data in sml & change some log level  #30306

 fix(sml): process space in the end if writing raw data in sml & change some log level

* fix: taosadapter version 3.3.6 (#30324)

* docs(stream): document streaming computation support for virtual tables in user manual (#30319)

* docs(stream): document streaming computation support for virtual tables in user manual

- Added section to user manual describing streaming computation support for virtual tables
- Listed known limitations and behavior when using virtual tables in streaming mode

* Update 14-stream.md

---------

Co-authored-by: Pan Wei <72057773+dapan1121@users.noreply.github.com>

* fix: review

* ci: add tdgpt .c file into TDengine and TDgpt workflow

* ci: add tdgpt .c file into TDengine and TDgpt workflow

---------

Signed-off-by: WANG Xu <feici02@outlook.com>
Co-authored-by: WANG Xu <feici02@outlook.com>
Co-authored-by: haoranchen <haoran920c@163.com>
Co-authored-by: Simon Guan <slguan@taosdata.com>
Co-authored-by: Feng Chao <flyingangel_2008@163.com>
Co-authored-by: facetosea <285808407@qq.com>
Co-authored-by: Jing Sima <simondominic9997@outlook.com>
Co-authored-by: Jinqing Kuang <kuangjinqingcn@gmail.com>
Co-authored-by: dapan1121 <wpan@taosdata.com>
Co-authored-by: Pan Wei <72057773+dapan1121@users.noreply.github.com>
Co-authored-by: Haojun Liao <hjxilinx@users.noreply.github.com>
Co-authored-by: huohong <346479823@qq.com>
Co-authored-by: Minglei Jin <mljin@taosdata.com>
Co-authored-by: freemine <freemine@yeah.net>
Co-authored-by: Yihao Deng <luomoxyz@126.com>
Co-authored-by: 54liuyao <54liuyao@163.com>
Co-authored-by: Bomin Zhang <localvar@hotmail.com>
Co-authored-by: 蟑螂·魂 <cockroach888@outlook.com>
Co-authored-by: wangjiaming <wangjiaming0909@sina.com>
Co-authored-by: Haojun Liao <hjliao@taosdata.com>
Co-authored-by: dongming chen <cademfly@hotmail.com>
Co-authored-by: Zhiyu Yang <69311263+zyyang90@users.noreply.github.com>
Co-authored-by: Nie Minhui <143420805+minhuinie@users.noreply.github.com>
Co-authored-by: Zhixiao Bao <62235797+xiao-77@users.noreply.github.com>
Co-authored-by: Kaili Xu <klxu@taosdata.com>
Co-authored-by: Linhe Huo <linhehuo@gmail.com>
Co-authored-by: tjuzyp <ypzhang@taosdata.com>
Co-authored-by: yanyuxing <yuxing.bitcapybara@gmail.com>
Co-authored-by: WANG MINGMING <wangmm0220@gmail.com>
Co-authored-by: yihaoDeng <yhdeng@taosdata.com>
Co-authored-by: facetosea <25808407@qq.com>
Co-authored-by: Minglei Jin <49711132+stephenkgu@users.noreply.github.com>
Co-authored-by: She Yanjie <57549981+sheyanjie-qq@users.noreply.github.com>
Co-authored-by: jiajingbin <39030567+jiajingbin@users.noreply.github.com>
Co-authored-by: Alex Duan <51781608+DuanKuanJun@users.noreply.github.com>
Co-authored-by: kevin men <men_shi_bin@163.com>
Co-authored-by: Hongze Cheng <hzcheng@taosdata.com>
Co-authored-by: Yaming Pei <sanwenyuv@sina.com>
Co-authored-by: Xuefeng Tan <1172915550@qq.com>
2025-03-22 21:14:08 +08:00
Jinqing Kuang ac23a4fc55
feat(stream): support stream processing for virtual tables (#30144)
* enh: add client processing

* enh: add mnode vtables processing

* enh: add mnode vtable processing

* enh: add normal child vtable support

* fix: compile issues

* fix: compile issues

* fix: create stream issues

* fix: multi stream scan issue

* fix: remove debug info

* fix: agg task and task level issues

* fix: correct task output type

* fix: split vtablescan from agg

* fix: memory leak issues

* fix: add limitations

* Update 09-error-code.md

* Update 09-error-code.md

* fix: remove usless case

* feat(stream): extract original table data in source scan task

Implemented functionality in the source task to extract data
corresponding to the virtual table from the original table using WAL.
The extracted data is then sent to the downstream merge task for further
processing.

* feat(stream): multi-way merge using loser tree in virtual merge task

Implemented multi-way merge in the merge task using a loser tree to
combine data from multiple original table into a single virtual table.
The merged virtual table data is then pushed downstream for further
processing.  Introduced memory limit handling during the merge process
with configurable behavior when the memory limit is reached.

* fix(test): remove useless cases

---------

Co-authored-by: dapan1121 <wpan@taosdata.com>
Co-authored-by: Pan Wei <72057773+dapan1121@users.noreply.github.com>
2025-03-15 17:06:48 +08:00
Jing Sima 410324746b
feat:[TS-4897] virtual table (#30098)
* feat: [TS-4897] Support create/drop/alter/show/describe vtable

* feat: [TS-4897] Support vtable's query

* feat: [TS-4897] Support create virtual supertable

* feat: [TS-4897] Support explain analyze / where / count(*) and only select ts of vtable.

* feat: [TS-4897] Add create test and fix bugs

* feat: [TS-4897] Add alter/drop test and fix bugs

* feat: [TS-4897] Add describe/show test and fix bugs

* feat: [TS-4897] Add auth test and fix bugs

* feat: [TS-4897] Fix meta/catalog/cache bugs

* feat: [TS-4897] Support select tag from virtual child table

* feat: [TS-4897] Add select test and fix plenty of bugs

* feat: [TS-4897] Add optimize rule for vtable scan / support create vtable cross database / remove enterprise constraint / fix bugs.

* feat: [TS-4897] Fix 'schema is old'

* feat: [TS-4897] Support virtual stable query

* feat: [TS-4897] Add tests and Fix bugs

* feat: [TS-4897] resolve conflict.
2025-03-15 14:10:46 +08:00
wangjiaming f50fcb85b8
feat(decimal): support decimal data type (#30060)
* decimal: create table

* decimal: add test case decimal.py

* decimal: add decimal.c

* support input decimal

* decimal test

* refactor svalue

* fix test cases

* add decimal unit test

* add decimal test cmake

* support insert and query decimal type

* define wide integer, support decimal128

* support decimal128 divide

* set decimal type expr res types

* scalar decimal

* convert to decimal

* fix decimal64/128 from str and to str

* fix decimal from str and decimal to str

* decimal simple conversion

* unit test for decimal

* decimal conversion and unit tests

* decimal + - * /

* decimal scalar ops and comparision

* start to refactor GET_TYPED_DATA

* support decimal max func, cast func

* refactor GET_TYPED_DATA interface

* decimal scalar comparision

* start to implement sum for decimal

* support sum and avg for decimal type

* decimal tests

* add decimal test

* decimal add test cases

* decimal use int256/int128

* decimal testing

* fix decimal table meta and add tests for decimal col streams

* fix create stream and create tsma

* test insert decimal values

* decimal from str

* test decimal input

* test parse decimal from string

* add taos_fetch_field_e api

* decimal insert tests

* test decimal operators

* decimal operator test

* feat:support decimal in raw block

* decimal operator tests

* decimal test

* feat:support decimal in raw block

* feat:support decimal in raw block

* feat:add schemaExt to SMqDataRsp

* feat:remove add schemaExt to SMqDataRsp

* feat:remove add schemaExt to SMqDataRsp

* feat:remove add schemaExt to SMqDataRsp

* decimal test operators

* decimal operator test

* test decimal operators

* test decimal compare operators

* decimal unary operator test

* decimal col with decimal col oper test

* test decimal col filtering

* fix decimal float operator test

* decimal test where filtering

* fix decimal filtering

* fix decimal order by

* fix decimal op test

* test decimal agg funcs

* test decimal functions

* remove assert

* fix ci build for ret check

* fix decimal windows build

* fix ci ret check

* skip decimal ret check

* skip decimal ret check

* fix decimal tests

* fix decimal ci test

* decimal test

* fix(tmq): heap user after free

* fix(tmq): double free

* fix(tmq): double free

* fix decimal tests

* fix(decimal): decimal test ci build

* fix(decimal): windows build

* fix(decimal): decimal test build

* fix(decimal): fix decimal build and tests

* fix(decimal): fix decimal tests

* fix(decimal): fix taos_fetch_fields_e api

* fix(decimal): fix decimal taos_fetch_fields_e api

* fix(decimal): rebase 3.0

* fix(decimal): fix decimal functions

* fix(decimal): fix decimal test case memory leak

* fix(decimal): fix decimal tests

* fix(decimal): fix decimal test case

* fix(decimal): fix decimal tests

* feat(decimal): fix unit tests

* feat(decimal): fix deicmal unit test

---------

Co-authored-by: wangmm0220 <wangmm0220@gmail.com>
Co-authored-by: yihaoDeng <yhdeng@taosdata.com>
2025-03-14 18:08:07 +08:00
Mario Peng f5a339f03e
enh(stmt2): [TD-33660] interlace mode support auto create table (#30084)
* enh: remove interlace autocreate tb limit

* enh: autocreate tb with single ctb

* enh: multi-insert in one ctb

* enh: Function realization

* fix: some unit test error

fix: stmt1 unit test

* fix: review and autoCreateTb & interlace support insert into stb syntax

* fix: insert into tags fixed value auto create table

* fix: remove a wrong test

* fix: adapter segment fault

* fix: adaptor core

* fix: get fields make interlace error

* fix: adapter core problem 2

* fix: multi bind exec invalid message problem
2025-03-14 14:13:26 +08:00
WANG MINGMING 3d053e2c9b
feat(stream): optimize client logic of creating stream if with history (#30059)
* feat:[TS-5617]use last_row cache mode if creating stream in fill_history

* feat(stream): optimize client logic of creating stream if with history

* feat(stream): optimize client logic of creating stream if with history

* feat(stream): optimize client logic of creating stream if with history

* feat(stream): optimize client logic of creating stream if with history

* feat(stream): optimize client logic of creating stream if with history

* feat(stream): optimize client logic of creating stream if with history

* feat(stream): optimize client logic of creating stream if with history

* feat(stream): optimize client logic of creating stream if with history

* feat(stream): optimize client logic of creating stream if with history

* feat(stream): optimize client logic of creating stream if with history

* feat(stream): optimize client logic of creating stream if with history

* fix: heap use after free

* feat: add log

* fix: ci case error

* fix: compile error in windows

* fix: ci case error

* fix: heap user after free

* fix: memory leak

* fix: ci case error

* fix: ci case error

* fix: ci case error

---------

Co-authored-by: yihaoDeng <yhdeng@taosdata.com>
2025-03-14 13:55:52 +08:00
pengrongkun94@qq.com 10f3a388f2 add row format bind control argument 2025-02-26 20:04:33 +08:00
pengrongkun94@qq.com 8cf363fbf3 Merge remote-tracking branch 'origin/3.0' into enh/3.0/TD-32686 2025-02-26 10:36:19 +08:00
wangmm0220 7c5c9f6245 fix:[TS-5776]add raw type from consumer 2025-01-22 16:38:37 +08:00
pengrongkun94@qq.com e362a045c0 test code 2025-01-17 15:53:29 +08:00
Pengrongkun f6b9bc44c7 refactor stmt2_get_fields 2024-12-13 15:28:13 +08:00
wangmm0220 0165684131 feat:[TD-32642] merge from 3.0 2024-12-05 23:47:46 +08:00
Pengrongkun 653eff8c1a taos_stmt2_get_stb_fields support insert into ? using stb tags(?) values(?) 2024-11-29 10:12:29 +08:00
wangmm0220 0e2a16d70f feat:[TD-32642] add charset for connection support 2024-11-27 14:25:34 +08:00
wangmm0220 2ca9f9c8ce feat:[TD-32642] merge from 3.0 2024-11-26 00:13:43 +08:00
wangmm0220 69da972796 feat:[TD-32642] add timezone logic 2024-11-22 18:31:51 +08:00
Pengrongkun b011ef49e0 TD-32120:add api taos_stmt2_get_all_fields
fix some format

convert TAOS_FIELD_E to TAOS_FIELD_ALL, to prevent modifications to the original API

rename taos_stmt2_get_stb_fields

refact parse for ctbname parameterized

refactor some code, fix some core problem.
2024-11-04 16:59:13 +08:00
wangmm0220 67fe609129 enh:[TS-5441] cost too long in tmq write meta data by cache meta and vg info 2024-10-08 18:24:16 +08:00
wangmm0220 3763a6adae enh:[TS-5441] cost too long in tmq write meta data by cache meta and vg info 2024-10-08 16:06:12 +08:00
Minglei Jin 2ac23f72e8 Merge branch '3.0' into feat/TD-30813-2 2024-09-06 14:01:54 +08:00
dapan1121 b75adfcd9f fix: only query issue 2024-09-05 14:18:13 +08:00
Minglei Jin 298c4b4812 feat(stmt2): initial commit for stmt2 2024-08-15 09:28:32 +08:00
wangjiaming0909 4d5cd9cd1a planner/nodes/parser ret check 2024-07-26 17:57:27 +08:00
dapan1121 fa2fb83014
Merge pull request #26609 from taosdata/TD-31000
ret value for parTranslater.c
2024-07-17 17:33:39 +08:00
wangjiaming0909 0cccaa8ac4 ret value for parTranslater.c 2024-07-17 10:26:06 +08:00
wangmm0220 aed8a75e35 feat:[TD-30975]process return value in schemaless 2024-07-15 19:07:20 +08:00
xjzhou 88aa15e944 enh: Enhance error handling for stmt 2024-07-02 11:05:54 +08:00
xjzhou b444e18d90 enh: stmt supports 'insert into db.?' 2024-06-25 16:16:32 +08:00
dapan1121 3f99e5e064 fix: memory issues 2024-06-07 09:25:17 +08:00
dapan1121 da8616d98a fix: add stbInterlace mode test cases 2024-06-05 17:12:15 +08:00
dapan1121 c0e4ab20a4 enh: optimize stmt performance 2024-05-30 13:26:17 +08:00
wangmm0220 529ca1d1c1 opti:add local thread error msg array 2024-04-18 13:56:43 +08:00
dapan1121 1c8dcaf46c enh: support timeline functions 2024-03-15 18:10:08 +08:00
kailixu a9316c3710 feat: support uniq grant 2024-02-04 12:28:00 +08:00
Haojun Liao cb2ea4a721 fix(stream): take ver snapshot for all vgroups before launching stream with fill-history option opened. 2024-02-01 11:37:57 +08:00
wangmm0220 f95d5e4f62 opti:[TD-28118] raw block data for tmq 2024-01-19 15:28:23 +08:00
dapan1121 099f72e84a fix: memory issues 2023-10-27 11:36:17 +08:00
dapan1121 dbbceae061 fix: union all view issue 2023-10-24 11:29:04 +08:00
dapan1121 969b002936 enh: support view privilege 2023-10-20 08:41:49 +08:00
dapan1121 d229492616 Merge remote-tracking branch 'origin/3.0' into feat/TD-25204 2023-10-09 18:34:08 +08:00
dapan1121 5b639a172d feat: support query from view 2023-10-08 18:36:06 +08:00
dapan1121 a61d90f672 enh: remove column list 2023-09-22 11:36:53 +08:00
dapan1121 a67b0c99fc feat: support create/drop view 2023-09-21 19:28:07 +08:00
shenglian zhou 80f77251b2 merge with 3.0 and finish coding star expansion 2023-09-21 17:04:12 +08:00
dapan1121 14e8db289d feat: support view 2023-09-19 14:19:54 +08:00
shenglian zhou 94a616fcc1 fix: save and continue 2023-09-18 16:59:07 +08:00
wangmm0220 9cd8df12c2 fix:memory leak 2023-08-25 16:32:01 +08:00
wangmm0220 26e025d78d feat:[TD-18789]support varbinary type 2023-08-25 15:43:45 +08:00
dapan1121 75c250f503 fix: report permission error when all columns are invisiable 2023-07-12 11:49:57 +08:00
dapan1121 170182fecd feat: support fill history with sub request 2023-06-12 16:10:54 +08:00