ac23a4fc55
feat(stream): support stream processing for virtual tables ( #30144 )
...
* enh: add client processing
* enh: add mnode vtables processing
* enh: add mnode vtable processing
* enh: add normal child vtable support
* fix: compile issues
* fix: compile issues
* fix: create stream issues
* fix: multi stream scan issue
* fix: remove debug info
* fix: agg task and task level issues
* fix: correct task output type
* fix: split vtablescan from agg
* fix: memory leak issues
* fix: add limitations
* Update 09-error-code.md
* Update 09-error-code.md
* fix: remove usless case
* feat(stream): extract original table data in source scan task
Implemented functionality in the source task to extract data
corresponding to the virtual table from the original table using WAL.
The extracted data is then sent to the downstream merge task for further
processing.
* feat(stream): multi-way merge using loser tree in virtual merge task
Implemented multi-way merge in the merge task using a loser tree to
combine data from multiple original table into a single virtual table.
The merged virtual table data is then pushed downstream for further
processing. Introduced memory limit handling during the merge process
with configurable behavior when the memory limit is reached.
* fix(test): remove useless cases
---------
Co-authored-by: dapan1121 <wpan@taosdata.com>
Co-authored-by: Pan Wei <72057773+dapan1121@users.noreply.github.com>
2025-03-15 17:06:48 +08:00
afb71f1536
test/duration: fix duration values
2024-10-24 10:42:39 +08:00
a249bef104
feat:[TS-4893] Add random and support use min/max on string column.
2024-09-09 18:48:24 +08:00
e43580f71b
fix ci
2024-04-16 14:25:20 +08:00
f06ea9fceb
enh: wait more time for result
2023-11-10 17:32:33 +08:00
11c0427b22
enh: test case to delete mutiple tables
2023-11-10 16:41:41 +08:00
674e878ffa
enh: rsma support delete
2023-11-10 14:44:29 +08:00
96b5024347
enh: rsma checkpoint
2023-11-02 13:05:36 +08:00
bacf771ada
chore: test case for rsma persist
2023-11-02 08:55:01 +08:00
ab266c712f
chore: checkpoint for rsma stream state
2023-11-01 12:29:54 +08:00
b03baaed2c
chore: revert the code change
2023-10-30 19:49:50 +08:00
89651626e3
chore: reopen rsma stream commit
2023-10-30 19:45:18 +08:00
c77153cb81
enh: use placeholder '-' for interval of 1st retention level
2023-10-30 14:02:31 +08:00
a576a3b972
rebuild index at tag0
2023-08-15 06:23:27 +00:00
f282acbc4c
chore: rsma refactor
2023-07-12 10:13:50 +08:00
cb8b10f6a2
Merge branch '3.0' into enh/TD-23769-3.0
2023-07-07 10:19:43 +08:00
61380b7822
chore: test case adaption
2023-07-06 11:09:44 +08:00
25d9405b05
chore: rsma test case adaption
2023-07-06 10:45:43 +08:00
4f29e14963
tsim/sma/drop_sma: sleep 1s before creating db to avoid in dropping
2023-07-06 10:26:26 +08:00
3f6768d8cf
chore: rsma rocksdb adaption
2023-07-05 19:43:29 +08:00
df7866e9f6
chore: refactor
2023-07-05 19:08:43 +08:00
d093b0e20f
chore: merge 3.0
2023-07-05 16:45:12 +08:00
4097b860d3
enh: support delete tsma interval
2023-06-16 19:04:12 +08:00
bcac24b6b7
fix: tsma query with order by _wstart/_wend
2023-06-06 17:19:59 +08:00
c75aa54a3d
fix: tsdb read and append _wstart for tsma
2023-05-22 20:33:29 +08:00
58b7e2eafb
disable sma some test
2023-04-19 16:45:45 +08:00
9552ac2800
enh: coverity scan for sma
2023-03-30 15:11:35 +08:00
fabd96deef
enh: coverity scan for sma
2023-03-29 15:56:44 +08:00
24861a9c95
test: check result after reboot without commit for tsma
2023-01-22 22:29:50 +08:00
45b58ffd48
test: check result after reboot without commit for tsma/rsma
2023-01-22 22:21:08 +08:00
b89561c077
test: add test case for tsma
2023-01-16 14:12:44 +08:00
ecd1e499f2
test: add test case for tsma
2023-01-16 14:08:27 +08:00
66d8431472
chore: test case adaption
2023-01-14 16:57:44 +08:00
e571ddf37e
fix: tsma transaction refactor
2023-01-12 21:13:15 +08:00
691b75adf5
enh: flush database for test cases of rsma
2022-12-27 15:42:00 +08:00
391389e989
test: close all dnodes when tsim execution is complete
2022-11-21 11:47:55 +08:00
b07670a680
enh: improve test case coverage of tsma
2022-10-25 18:03:09 +08:00
76843a54cb
chore: test case optimization for tsma
2022-10-19 10:30:14 +08:00
a9fcc12c33
enh: rsma batch process
2022-08-19 20:08:09 +08:00
6b9699aaa4
Merge pull request #15978 from taosdata/feature/3.0_wxy
...
enh: show command optimize
2022-08-12 00:40:35 +08:00
a4a7022caf
Merge pull request #15976 from taosdata/feature/3.0_interval_hash_optimize
...
enh: rsma fetch optimization
2022-08-11 23:20:01 +08:00
64a92ff839
test: tsma case optimization
2022-08-11 21:31:34 +08:00
44df51f98f
enh: show command optimize
2022-08-11 20:56:31 +08:00
72d6802231
fix test cases
2022-08-11 16:41:22 +08:00
0aac37a45c
enh: rsma fetch logic optimization
2022-08-08 11:25:32 +08:00
59d095bec3
test: add test case basic2.sim
2022-07-22 14:21:18 +08:00
7522c2edf3
refactor: do some internal refactor.
2022-07-21 20:44:36 +08:00
41b2595086
fix(sma): fix case
2022-07-14 17:40:32 +08:00
43b5ca1efe
feat: support pseudo columns such as _qstart, _qend and _qduration
2022-07-13 15:13:01 +08:00
4bd1268138
test: test case adapation for rsma recovery
2022-07-04 20:34:37 +08:00
Jinqing Kuang
Minglei Jin
Jing Sima
wangjiaming0909
kailixu
yihaoDeng
liuyao
Benguang Zhao
Shengliang Guan
Xiaoyu Wang
Xiaoyu Wang
Ganlin Zhao
Haojun Liao
Liu Jicong