Commit Graph

480 Commits

Author SHA1 Message Date
Jinqing Kuang ac23a4fc55
feat(stream): support stream processing for virtual tables (#30144)
* enh: add client processing

* enh: add mnode vtables processing

* enh: add mnode vtable processing

* enh: add normal child vtable support

* fix: compile issues

* fix: compile issues

* fix: create stream issues

* fix: multi stream scan issue

* fix: remove debug info

* fix: agg task and task level issues

* fix: correct task output type

* fix: split vtablescan from agg

* fix: memory leak issues

* fix: add limitations

* Update 09-error-code.md

* Update 09-error-code.md

* fix: remove usless case

* feat(stream): extract original table data in source scan task

Implemented functionality in the source task to extract data
corresponding to the virtual table from the original table using WAL.
The extracted data is then sent to the downstream merge task for further
processing.

* feat(stream): multi-way merge using loser tree in virtual merge task

Implemented multi-way merge in the merge task using a loser tree to
combine data from multiple original table into a single virtual table.
The merged virtual table data is then pushed downstream for further
processing.  Introduced memory limit handling during the merge process
with configurable behavior when the memory limit is reached.

* fix(test): remove useless cases

---------

Co-authored-by: dapan1121 <wpan@taosdata.com>
Co-authored-by: Pan Wei <72057773+dapan1121@users.noreply.github.com>
2025-03-15 17:06:48 +08:00
Jing Sima 410324746b
feat:[TS-4897] virtual table (#30098)
* feat: [TS-4897] Support create/drop/alter/show/describe vtable

* feat: [TS-4897] Support vtable's query

* feat: [TS-4897] Support create virtual supertable

* feat: [TS-4897] Support explain analyze / where / count(*) and only select ts of vtable.

* feat: [TS-4897] Add create test and fix bugs

* feat: [TS-4897] Add alter/drop test and fix bugs

* feat: [TS-4897] Add describe/show test and fix bugs

* feat: [TS-4897] Add auth test and fix bugs

* feat: [TS-4897] Fix meta/catalog/cache bugs

* feat: [TS-4897] Support select tag from virtual child table

* feat: [TS-4897] Add select test and fix plenty of bugs

* feat: [TS-4897] Add optimize rule for vtable scan / support create vtable cross database / remove enterprise constraint / fix bugs.

* feat: [TS-4897] Fix 'schema is old'

* feat: [TS-4897] Support virtual stable query

* feat: [TS-4897] Add tests and Fix bugs

* feat: [TS-4897] resolve conflict.
2025-03-15 14:10:46 +08:00
WANG MINGMING 3d053e2c9b
feat(stream): optimize client logic of creating stream if with history (#30059)
* feat:[TS-5617]use last_row cache mode if creating stream in fill_history

* feat(stream): optimize client logic of creating stream if with history

* feat(stream): optimize client logic of creating stream if with history

* feat(stream): optimize client logic of creating stream if with history

* feat(stream): optimize client logic of creating stream if with history

* feat(stream): optimize client logic of creating stream if with history

* feat(stream): optimize client logic of creating stream if with history

* feat(stream): optimize client logic of creating stream if with history

* feat(stream): optimize client logic of creating stream if with history

* feat(stream): optimize client logic of creating stream if with history

* feat(stream): optimize client logic of creating stream if with history

* feat(stream): optimize client logic of creating stream if with history

* fix: heap use after free

* feat: add log

* fix: ci case error

* fix: compile error in windows

* fix: ci case error

* fix: heap user after free

* fix: memory leak

* fix: ci case error

* fix: ci case error

* fix: ci case error

---------

Co-authored-by: yihaoDeng <yhdeng@taosdata.com>
2025-03-14 13:55:52 +08:00
dmchen 80f60449e3 feat/TS-5927-long-password-fix-cases 2025-02-13 10:02:17 +00:00
dmchen 55e12e520b feat/TS-5927-long-password-encrypt-pass 2025-02-13 07:45:42 +00:00
dmchen 48123446d6 feat/TS-5927-long-password-fix-cases 2025-02-13 00:46:08 +00:00
Shengliang Guan d4ceb37f8c fix: ut errors 2025-01-17 13:44:21 +08:00
Shengliang Guan 25f5b8673f fix: compile errors 2025-01-17 10:53:02 +08:00
Shengliang Guan e844ced5c1 Merge remote-tracking branch 'freemine/freemine.bypass.specific.test.case.for.community' into fix/contrib 2025-01-17 09:21:05 +08:00
Minglei Jin d6587af9fd test/parser: use stt trigger 1 2025-01-07 14:03:38 +08:00
Minglei Jin ad8d38068a test/parser: fix UT for community parser 2025-01-06 17:23:48 +08:00
freemine 4ac3d55709 bypass some specific test case which believes to fail in community version of taos 2025-01-01 16:15:37 +08:00
dapan1121 5503e07181 fix: ut error code 2024-09-05 15:57:23 +08:00
wangmm0220 4d19f48d8a feat:[TS-3718]save slow log file one day one file 2024-08-02 16:29:48 +08:00
wangjiaming0909 d35bdba180 fix parser/planner/nodes ret check ci 2024-07-26 17:57:29 +08:00
wangjiaming0909 4d5cd9cd1a planner/nodes/parser ret check 2024-07-26 17:57:27 +08:00
sima 6a9441528a enh:[TD-31043] Handling return value in builtinsimpl.c 2024-07-23 15:37:17 +08:00
Minglei Jin 11b26d80b7 wal_level 0: update unit & tsim test cases 2024-06-05 18:22:23 +08:00
wangjiaming0909 e43580f71b fix ci 2024-04-16 14:25:20 +08:00
dapan1121 42b0d00575 enh:support join type 2024-03-25 15:19:16 +08:00
Shungang Li 3a656c3595 feat: support 2 replica with arbitrator 2024-03-19 09:30:35 +08:00
kailixu 2c4a4a0d2d Merge branch '3.0' into fix/TS-4421-3.0 2024-02-28 09:49:43 +08:00
wangmm0220 22bd628c14 fix:[TD-28698] unit test error 2024-02-23 16:36:53 +08:00
wangjiaming0909 573fdfbbfd fix: plannerTest/parserTest crash and memory leaks 2024-02-05 13:05:01 +08:00
factosea 6115d7a67f fix functionNode ref 2024-01-12 10:47:48 +08:00
factosea 3ed63df082 fix case 2024-01-11 18:34:21 +08:00
factosea 8c3fe7cc70 fix: SColumnRefNode transfer to SelectFunction's param 2024-01-08 11:41:58 +08:00
kailixu 9a2d60bb07 test: update unit test case 2024-01-02 22:41:04 +08:00
facetosea 6694bf86c6 fix test case 2023-11-24 11:14:24 +08:00
dapan1121 91df56fcf0 Merge remote-tracking branch 'origin/3.0' into feat/TD-25204 2023-10-31 18:44:54 +08:00
kailixu da4fac4204 test: update test case for retentions 2023-10-30 17:04:09 +08:00
dapan1121 1517fe0ff0 fix: ut case issue 2023-10-30 16:44:10 +08:00
dapan1121 969b002936 enh: support view privilege 2023-10-20 08:41:49 +08:00
dapan1121 afe963a9d1 enh: support view privilege 2023-10-19 08:31:31 +08:00
dapan1121 478de7ae56 feat: add show create view implement 2023-10-11 10:38:22 +08:00
dapan1121 6c8db261f3 feat: support show views command 2023-10-09 17:19:36 +08:00
dapan1121 14e8db289d feat: support view 2023-09-19 14:19:54 +08:00
dapan1121 1f40da6fef Merge remote-tracking branch 'origin/main' into 3.0 2023-08-28 09:28:55 +08:00
Haojun Liao 3c6870275b fix(parser): update the key words for disk io throttling. 2023-08-24 16:45:47 +08:00
Benguang Zhao bad2bb52b5 enh: update test cases for show vnodes 2023-08-16 20:17:11 +08:00
dapan1121 328104a15a
Merge pull request #21971 from wangjiaming0909/fix/3.0/TD-25068
refine select interval from sys table error msg
2023-07-07 08:40:06 +08:00
wangjiaming0909 2de37b9426 refine select interval from sys table error msg 2023-07-06 13:52:52 +08:00
wangjiaming0909 1f71ce9409 feature: get last timestamp before create sma index 2023-07-06 10:33:22 +08:00
wade zhang 254a20bdf3
Merge pull request #21660 from luckeverda/feat/TD-23739
feat/TD-23739: enhance ttl, deletetime modified by writing-op
2023-06-25 09:06:57 +08:00
Shungang Li b93f653d7e feat: enhance ttl, deletetime modified by writing-ops
new config item: ttlChangeOnWrite (default 0)
ttl delete time changes on last write if true
2023-06-19 19:03:35 +08:00
dapan1121 48b9cac75c fix: fix no data in db issue 2023-06-13 11:44:13 +08:00
dapan1121 ddd3a53e56 Merge remote-tracking branch 'origin/3.0' into fix/TD-24001 2023-06-02 13:57:34 +08:00
Haojun Liao d45aa7ef84
Merge pull request #21555 from taosdata/fix/liaohj_main
other: merge main into 3.0.
2023-06-02 13:11:12 +08:00
Haojun Liao 5301c5756a other: merge main into 3.0. 2023-06-01 09:29:18 +08:00
wangmm0220 78db3520a6 fix:conflict 2023-05-29 14:57:03 +08:00