Liu Jicong
2a4708d82a
fix: save fill history state
2023-02-16 17:01:09 +08:00
Haojun Liao
c9ce01c878
Merge branch 'main' into feature/3_liaohj
2023-02-13 17:09:27 +08:00
Liu Jicong
7a4c8f30db
reset default cfg
2023-02-13 10:54:13 +08:00
Liu Jicong
0cd6bd3d86
Merge branch 'main' into enh/stream_buffer_param
2023-02-13 09:48:02 +08:00
Liu Jicong
1114fef337
add cfg
2023-02-13 09:47:30 +08:00
Haojun Liao
a7fdc4bae3
other: merge 3.0
2023-02-10 19:20:24 +08:00
Liu Jicong
c8acfc4d54
fix: stream meta
2023-02-10 10:48:26 +08:00
Xiaoyu Wang
b2e60da1cf
merge main
2023-02-10 10:34:55 +08:00
Xiaoyu Wang
09925437e3
merge main
2023-02-08 09:51:52 +08:00
Minglei Jin
f4a60a4364
fix(stream/state): switch tdb rollback on to restore from journals
2023-02-07 15:11:22 +08:00
Xiaoyu Wang
5d499e52f9
merge main
2023-02-03 17:13:11 +08:00
Haojun Liao
ab8c977417
other: merge main.
2023-02-02 14:00:36 +08:00
Minglei Jin
df30b51a75
fix(stream): use tdb page replacement with stream state
2023-02-01 17:59:39 +08:00
Liu Jicong
98906bb272
remove assert
2023-01-29 15:24:31 +08:00
Xiaoyu Wang
24157e78d6
merge main
2023-01-28 17:52:58 +08:00
Liu Jicong
51866dadbe
Merge branch 'fix/task_db' into enh/stream_buffer_param
2023-01-28 11:24:46 +08:00
Liu Jicong
089bc74055
Merge branch 'main' into enh/stream_buffer_param
2023-01-28 11:24:25 +08:00
Liu Jicong
0c6f6d3a42
fix: task db
2023-01-28 10:59:09 +08:00
54liuyao
e03deeaed8
feat:add stream delete mark
2023-01-17 16:21:51 +08:00
Haojun Liao
07cf336fa0
refactor: add an array list api.
2023-01-17 09:43:33 +08:00
Minglei Jin
a2e35ce13b
streamState/tdb: use NULL for tdbBegin's heap source
2023-01-12 11:26:13 +08:00
54liuyao
d5ade95b31
feat(stream):user define tag
2023-01-10 10:13:56 +08:00
Shengliang Guan
398161eb5f
Merge branch 'main' into merge/mainto3.0_0108
2023-01-09 10:00:53 +08:00
Liu Jicong
65e7dbda0c
enh: enlarge state buffer size
2023-01-06 17:37:45 +08:00
Xiaoyu Wang
fdde287ca9
merge main
2023-01-04 11:43:20 +08:00
Benguang Zhao
4031dc1af4
Merge branch main into FIX/TD-21043-main
2023-01-02 16:41:46 +08:00
Benguang Zhao
3edde0eadf
fix: tdbAbort on metaClose or streamMetaClose instead of tdbTxnClose
2023-01-01 21:07:32 +08:00
Shengliang Guan
3a11c62243
Merge pull request #19290 from taosdata/feature/stream_main
...
fix: reset stream status when load from disk
2022-12-30 19:44:09 +08:00
Liu Jicong
095c6d39ca
reset param
2022-12-30 17:30:02 +08:00
Liu Jicong
4601e67e67
fix: reset stream status when load from disk
2022-12-30 16:59:48 +08:00
Shengliang Guan
85eba36190
Merge pull request #19257 from taosdata/refactor/stream_dispatch_main
...
refactor: stream dispatch
2022-12-30 10:18:29 +08:00
Shengliang Guan
fad687161b
Merge pull request #19255 from taosdata/enh/stream_drop_when_scan
...
enh: optimize drop when scan exec
2022-12-29 17:17:59 +08:00
Shengliang Guan
25e9d94f5b
Merge pull request #19244 from taosdata/feature/stream_main
...
enh: put func state into tdb
2022-12-29 17:17:29 +08:00
Liu Jicong
bfb92457fa
refactor: stream dispatch
2022-12-29 16:24:30 +08:00
Liu Jicong
66b9fa01f7
enh: optimize drop when scan exec
2022-12-29 15:51:12 +08:00
Liu Jicong
7721353b6b
enh: put func state into tdb
2022-12-29 12:39:07 +08:00
Benguang Zhao
d307413c36
Merge branch 'main' into FIX/TD-21043-main
2022-12-29 10:03:17 +08:00
Shengliang Guan
2bbf2f3ab1
Merge branch '3.0' into merge/mainto3.0_1229
2022-12-29 09:36:52 +08:00
Shengliang Guan
d09011def8
Merge pull request #19190 from taosdata/feature/stream_main
...
fix memory leak
2022-12-28 17:46:30 +08:00
Shengliang Guan
78c14a2c88
Merge remote-tracking branch 'origin/3.0' into merge/mainto3.0_1228
2022-12-28 14:59:02 +08:00
Benguang Zhao
6fc47beb71
enh: streamMetaCommit in sync with vnodeCommit
2022-12-28 14:34:23 +08:00
Shengliang Guan
d342ebcd77
Merge pull request #18720 from taosdata/refact/submit_req
...
Refact/submit req
2022-12-28 10:29:00 +08:00
Liu Jicong
bbab03274a
fix memory leak
2022-12-27 18:02:43 +08:00
Liu Jicong
dcb71e4af1
refactor: stream dispatch
2022-12-27 15:17:43 +08:00
Liu Jicong
39eb62d80d
enh: set scan limit
2022-12-27 14:52:41 +08:00
Liu Jicong
5826e40aa7
enh: drop stream eagerly
2022-12-27 11:20:35 +08:00
54liuyao
70ffbabcbf
fix:remove assert
2022-12-26 10:15:14 +08:00
Xiaoyu Wang
0c269c317b
merge 3.0
2022-12-23 17:50:05 +08:00
Liu Jicong
b1bd24d15a
enh: scan exec set limit
2022-12-23 16:35:40 +08:00
Liu Jicong
69d410591f
refactor: add debug log
2022-12-22 17:14:17 +08:00
Liu Jicong
2a7de0cd46
refactor: remove assert
2022-12-21 13:54:14 +08:00
Haojun Liao
48f7fc5c3d
Merge branch '3.0' into refact/submit_req
2022-12-12 18:11:17 +08:00
Shengliang Guan
50b66df39f
fix: control rpc qitem memory
2022-12-10 14:02:57 +08:00
Liu Jicong
ecbc09663f
enh: tolerate exec error
2022-12-09 09:35:53 +08:00
Liu Jicong
74a253eac4
refactor
2022-12-08 13:34:42 +08:00
Shengliang Guan
6d94afe48f
Revert "refact: adjust some assert cases"
2022-12-07 21:51:17 +08:00
Shengliang Guan
d5126d469a
refact: replcase ASSERT with tAssert
2022-12-07 18:42:48 +08:00
Shengliang Guan
f69a188f7e
refact: replcase ASSERT with tAssert
2022-12-07 18:37:40 +08:00
Liu Jicong
b133a56219
refactor: support submitreq2
2022-12-07 15:19:34 +08:00
Shengliang Guan
c45001744f
Merge pull request #18674 from taosdata/feat/async_commit
...
feat: async commit
2022-12-04 22:31:04 +08:00
Alex Duan
213b97b79a
feat(api): taos_affected_rows64 add and modfiy tmsg.h
2022-12-02 23:20:19 +08:00
Minglei Jin
6cb65f336d
Merge branch 'v3.0' into feat/async_commit
2022-12-02 14:49:58 +08:00
Shengliang Guan
a366696478
Merge pull request #18596 from taosdata/feature/stream
...
refactor(stream): distributed checkpoint
2022-12-02 07:51:10 +08:00
Liu Jicong
3424b184d3
refactor(stream): distributed checkpoint
2022-12-02 03:48:45 +08:00
Hongze Cheng
3fc30c991e
Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/async_commit
2022-12-01 18:59:21 +08:00
Haojun Liao
124fb5fc50
refactor: do some internal refactor.
2022-11-30 17:52:12 +08:00
Hongze Cheng
df7c07a541
Merge branch 'fix/tdb-async-commit' of https://github.com/taosdata/TDengine into feat/async_commit
2022-11-30 16:48:09 +08:00
Liu Jicong
548684e5ac
fix(stream): delete multiple row
2022-11-29 23:39:58 +08:00
Minglei Jin
2c771153ef
fix(streamState): use new txn related api
2022-11-28 16:27:20 +08:00
Minglei Jin
506554b5d2
Merge branch 'v3.0' into fix/tdb-async-commit
2022-11-28 16:20:48 +08:00
Haojun Liao
6e81e8cc73
refactor: do some internal refactor.
2022-11-28 12:32:40 +08:00
Liu Jicong
48894c8bdb
enh(stream): new api for stream queue
2022-11-25 18:03:40 +08:00
Minglei Jin
ada76477fc
fix: free stream state cursor
2022-11-21 11:54:25 +08:00
54liuyao
3e29f19782
fix:stream state abnormal failure
2022-11-20 10:32:25 +08:00
Liu Jicong
9a603e5663
enh(stream): put user defined tb name into stream state
2022-11-18 17:21:50 +08:00
Minglei Jin
78335f83d2
tdb/api: migrate txn related api changes of meta, sma, tq, and stream meta/state
2022-11-17 20:02:13 +08:00
Liu Jicong
5161eca70f
fix(stream): stop scan when no output
2022-11-17 10:30:05 +08:00
Liu Jicong
015c00aaca
fix(stream): timer refer stream task
2022-11-16 11:16:32 +08:00
Liu Jicong
a9bf05bc01
refactor: stream meta ref count
2022-11-15 19:11:42 +08:00
Liu Jicong
aa9e935854
enh(stream): set path max length to 1024
2022-11-14 14:46:50 +08:00
54liuyao
7ea790021f
fix:avoid duplicate results
2022-11-11 16:18:54 +08:00
Liu Jicong
64f22d560c
refactor(stream): drop stream task
2022-11-10 16:36:49 +08:00
Haojun Liao
015f1a1df8
other: merge 3.0
2022-11-09 19:17:45 +08:00
Haojun Liao
b48752686e
refactor: do some internal refactor.
2022-11-09 13:45:46 +08:00
54liuyao
f66eded1e1
fix(stream): state window, error result after deleting data
2022-11-08 14:40:44 +08:00
Shengliang Guan
7a5be43d14
Merge pull request #17954 from taosdata/feature/stream
...
fix(stream): delete tb should be checked in write thread
2022-11-08 13:50:15 +08:00
Liu Jicong
bc469f7f7b
fix(stream): delete tb should be checked in write thread
2022-11-08 11:30:29 +08:00
Minglei Jin
1a4cf6964b
fix: add post commit to tq & stream
2022-11-07 20:34:23 +08:00
Liu Jicong
2fbc8e6306
refactor(stream): stream deploy and state transfer
2022-11-03 13:22:23 +08:00
Liu Jicong
5e253cc8ea
refactor(stream): fill history
2022-11-01 11:56:14 +08:00
Liu Jicong
2e640c38a2
refactor: stream and tmq message
2022-10-31 18:37:28 +08:00
54liuyao
7d8a282258
fix(stream):tqBuildDeleteReq error
2022-10-28 11:19:26 +08:00
Liu Jicong
8d8fd2b2bc
refactor(stream): recover and fill history
2022-10-26 10:20:33 +08:00
Liu Jicong
52b4b510a8
merge 3.0
2022-10-26 09:18:29 +08:00
Liu Jicong
75e5e490fd
refactor(stream): recover and fill history
2022-10-26 00:31:00 +08:00
54liuyao
5cee271cbc
fix(stream): stream state invalid cur
2022-10-24 13:28:13 +08:00
Liu Jicong
f49d91ac1a
fix(stream): decode bloom filter
2022-10-21 17:22:31 +08:00
Liu Jicong
5571ebee0f
Merge pull request #17542 from taosdata/feature/stream
...
enh(stream): internal optimize
2022-10-21 14:31:42 +08:00
54liuyao
d9beaeb3a3
fix(stream):session window max_delay crash
2022-10-21 11:49:45 +08:00
Liu Jicong
26d4af6968
fix: memory leak
2022-10-21 11:42:30 +08:00
Liu Jicong
e0b5b9263e
refactor: remove unused code
2022-10-21 10:42:24 +08:00
Liu Jicong
035e6b13c8
enh(stream): internal optimize
2022-10-21 10:29:05 +08:00
54liuyao
86a858e04d
fix(stream): coverity scan
2022-10-20 11:41:20 +08:00
54liuyao
368f5134c5
feat(stream):optimize state window disc buff
2022-10-20 09:04:51 +08:00
Hongze Cheng
eb7de2e571
Merge pull request #17443 from taosdata/fix/commit_txn
...
fix: commit txn
2022-10-19 13:15:15 +08:00
54liuyao
7f16081e29
feat(stream): stream task and meta
2022-10-19 10:49:42 +08:00
Hongze Cheng
efa9f19d18
make it compile
2022-10-19 09:12:37 +08:00
Hongze Cheng
71a2db6cf2
Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/commit_txn
2022-10-19 09:10:36 +08:00
Minglei Jin
82132cdfdd
meta: new metaFinishCommit api & rollback parameter with metaOpen
2022-10-18 18:34:39 +08:00
54liuyao
8efd7e8763
feat(stream):replace disk buff
2022-10-18 18:13:47 +08:00
Liu Jicong
bf2d8540d3
Merge pull request #17355 from taosdata/feature/stream
...
fix(stream): memory leak
2022-10-14 17:24:24 +08:00
Liu Jicong
a57a305035
fix(stream): memory leak
2022-10-14 14:43:22 +08:00
54liuyao
d5a410b90e
fix(stream):Defects Tracking, delete log
2022-10-14 14:29:25 +08:00
Hongze Cheng
5b6e928d65
Merge branch '3.0' of https://github.com/taosdata/TDengine into refact/code_format
2022-10-13 14:25:51 +08:00
Hongze Cheng
63d9b85631
more code format
2022-10-13 13:59:18 +08:00
Liu Jicong
d507678b35
refactor(stream): set state buffer size
2022-10-13 11:18:02 +08:00
Liu Jicong
db6b0503a1
refactor(stream): change state table name
2022-10-12 14:34:04 +08:00
Liu Jicong
eafe8666f7
merge 3.0
2022-10-09 17:00:18 +08:00
Liu Jicong
2f9aeeb5fc
feat(stream): support define table name
2022-10-09 16:54:27 +08:00
54liuyao
9c170ecfa8
fix(stream): filter error occurred when data was modified
2022-10-09 14:52:39 +08:00
54liuyao
f569355d06
fix(stream):memory leak
2022-10-08 11:04:36 +08:00
Zhiqiang Wang
d05b134a48
os: Mac package ( #17201 )
...
* os: Mac package
* os: Mac package
* os: Mac package
* os: Mac package
* os: Mac package
* os: Mac package
* os: Mac package
* os: Mac package
* os: Mac package
* os: Mac package
* os: Mac package
* os: Mac package
2022-10-08 10:12:17 +08:00
54liuyao
46c99915bc
feat(stream): distribute interval disc buff
2022-09-30 10:01:51 +08:00
Cary Xu
9e49eb03e4
fix: coverity scan for sma
2022-09-28 18:54:39 +08:00
54liuyao
747297bd28
feat(stream): stream fill
2022-09-27 18:11:44 +08:00
Liu Jicong
72fba5a8ce
fix(stream): check delete uid
2022-09-21 11:54:44 +08:00
54liuyao
97ca09689c
Merge branch 'feature/stream' into feature/TD-18820
2022-09-19 19:31:41 +08:00
Liu Jicong
86c0fb56e0
enhance stream backend for sma
2022-09-19 17:27:25 +08:00
54liuyao
955838d1f6
feat(stream): optimize disc buff
2022-09-19 17:13:13 +08:00
Liu Jicong
4c6a8bbc95
feat(stream): stream state support tuple
2022-09-14 16:50:42 +08:00
Liu Jicong
b8a7c8b2aa
feat(stream): support hash suffix and prefix
2022-09-13 15:21:26 +08:00
54liuyao
1f5d9a38e7
feat(stream):change single interval disc buff and interval delete
2022-09-07 14:48:14 +08:00
Liu Jicong
d653da7971
feat(stream): support delete data
2022-09-02 15:46:41 +08:00
54liuyao
83e62c3849
feat(stream):stream partition by column
2022-09-01 15:05:24 +08:00
Minglei Jin
04e5c75bba
fix: cleanup memory with streamLoadTasks
2022-08-26 14:51:30 +08:00
Liu Jicong
24261cc90b
refactor(stream): refine stream backend interface
2022-08-24 15:53:29 +08:00
Liu Jicong
d7b804e02e
fix stream load task
2022-08-24 10:42:34 +08:00
Liu Jicong
c296dd0a63
fix compile
2022-08-24 01:48:00 +08:00
Liu Jicong
2d628491b2
feat(stream): support tdb state backend
2022-08-23 19:30:04 +08:00
Liu Jicong
2b092f6551
fix(query): memory leak
2022-08-18 18:39:21 +08:00
Liu Jicong
963287798d
refactor(mnode): drop stream task
2022-08-17 23:18:39 +08:00
Liu Jicong
853e6e2988
refactor(mnode): drop stream task
2022-08-17 19:19:58 +08:00
Liu Jicong
357b21cfeb
refactor(tmq): use tdb to store check info
2022-08-17 13:58:56 +08:00
Liu Jicong
2ced6c280c
enh(stream): reduce table scan
2022-08-16 12:11:56 +08:00
54liuyao
44123ec8f0
feat(stream):optimzie stream interval
2022-08-11 10:20:42 +08:00
Liu Jicong
51aa9413d7
Merge pull request #15937 from taosdata/feature/stream
...
enh(tmq): speed up consumer recover
2022-08-10 17:19:36 +08:00
Haojun Liao
6250c1b157
Merge pull request #15851 from taosdata/feature/3.0_query_optimize
...
ehn(query): optimize the query performance.
2022-08-10 16:51:46 +08:00
Liu Jicong
e5e82f0cf2
merge 3.0
2022-08-10 16:31:23 +08:00
Liu Jicong
18f6fb6123
enh(tmq): speed up consumer recover
2022-08-10 16:04:03 +08:00
Liu Jicong
a62950b441
Merge pull request #15920 from taosdata/feature/stream
...
enh(stream): recover process
2022-08-09 23:35:03 +08:00
Liu Jicong
fc225a580d
enh(stream): recover process
2022-08-09 21:37:21 +08:00
54liuyao
41e2538ade
scalable bloom filter encode & decode
2022-08-09 16:54:59 +08:00
Liu Jicong
d9a4ea305d
fix(stream): memory error
2022-08-09 14:11:41 +08:00
Haojun Liao
b9c6e0cdf9
refactor: stream invoke previous APIs.
2022-08-09 13:55:51 +08:00
Haojun Liao
a2a1da06dd
other:merge 3.0
2022-08-09 13:45:44 +08:00
Xiaoyu Wang
07ef00e89f
merge 3.0
2022-08-09 11:36:08 +08:00
Liu Jicong
ad032a0a90
enh(stream): stream recover
2022-08-09 10:36:27 +08:00
Liu Jicong
e30b74ad5a
fix(stream): memory leak
2022-08-08 18:53:49 +08:00
Liu Jicong
c411b9aebb
fix(stream): memory leak
2022-08-08 18:09:36 +08:00
Haojun Liao
4d8842c21f
other:merge 3.0
2022-08-08 16:37:37 +08:00
Liu Jicong
bb0ce39511
refactor(stream): add stream meta
2022-08-08 15:05:54 +08:00
Liu Jicong
43026ac31d
refactor(stream)
2022-08-08 11:29:50 +08:00
54liuyao
214d3609b2
fix(stream):set num of stream session child
2022-08-06 15:14:11 +08:00
Liu Jicong
7c9d57bd89
refactor(stream): unify sink and dispatch
2022-08-05 20:16:47 +08:00
Haojun Liao
0e4748771a
enh(query): support combine multi datablock to pass to upstream operators
2022-08-05 14:10:45 +08:00
Liu Jicong
6f8683de7e
enh(tmq): retry consumer close
2022-08-04 20:37:02 +08:00
Liu Jicong
031414001d
fix schedule
2022-08-04 17:46:13 +08:00
Liu Jicong
e64e41679e
fix schedule
2022-08-04 17:00:45 +08:00
Liu Jicong
d6cc88ed4b
refactor(stream): exec scheduler
2022-08-04 16:19:53 +08:00
Liu Jicong
e345023dfd
enh(stream): keep thread from blocking
2022-08-03 15:31:10 +08:00
Liu Jicong
c089d3ba08
merge 3.0
2022-08-02 22:53:49 +08:00
Liu Jicong
d43eec5d16
enh(stream): directly dispatch
2022-08-02 22:23:33 +08:00
Shengliang Guan
56f2e49764
refactor: adjust logs
2022-08-02 17:12:07 +08:00
54liuyao
b3d104349f
feat(stream):optimize stream update scan
2022-08-01 17:09:46 +08:00
Liu Jicong
6c250e75cd
fix(stream): forbid histogram in stream
2022-07-29 21:28:18 +08:00
Liu Jicong
a9d11b58ad
enh(stream): recover
2022-07-28 16:19:50 +08:00
Liu Jicong
904ec81bf9
fix(stream): concurrency dispatch
2022-07-27 21:02:21 +08:00
Liu Jicong
ba0c1b3689
refactor(stream)
2022-07-27 20:11:03 +08:00
Liu Jicong
5e1bbe0e7e
refactor(sma): remove option
2022-07-27 16:55:23 +08:00
Liu Jicong
00acf4520c
refactor(stream): remove option
2022-07-27 16:49:03 +08:00
Liu Jicong
57f9d8b0b0
fix(stream): dispatch
2022-07-27 11:44:01 +08:00
Liu Jicong
3fa5791889
fix(stream): dispatch
2022-07-27 10:52:25 +08:00
jiajingbin
8833a8bdfb
fix: fix bug for TD-17801
2022-07-25 21:39:12 +08:00
54liuyao
b28553395f
feat(stream): adjust stream scan
2022-07-22 20:13:37 +08:00
Liu Jicong
b1f3428c05
refactor(stream): do not merge output
2022-07-22 10:43:49 +08:00
Liu Jicong
81d8d2b937
feat(stream): add version in stream block
2022-07-21 17:27:44 +08:00
54liuyao
f5a326dbf4
feat(stream): optimize update data check
2022-07-21 15:16:57 +08:00
Liu Jicong
edaec52bca
refactor: add debug flag
2022-07-19 19:59:07 +08:00
Liu Jicong
414673db57
Merge branch '3.0' into feature/stream
2022-07-19 19:46:36 +08:00
Liu Jicong
24bc71568e
refactor(stream): batch optimization for submit msg
2022-07-19 18:29:12 +08:00
jiacy-jcy
5200a48107
fix: update
2022-07-19 16:54:19 +08:00
Liu Jicong
bc1af6deaf
refactor(stream): batch optimization for submit msg
2022-07-19 15:52:08 +08:00
54liuyao
8e41fc912b
feat(stream): add num of children
2022-07-19 14:17:53 +08:00
Liu Jicong
b6f55fa09e
refactor(stream): batch optimization for submit msg
2022-07-18 21:32:40 +08:00
Liu Jicong
053786e6b4
fix(stream): data exec
2022-07-18 15:50:36 +08:00
Liu Jicong
500553d581
refactor: add debug log
2022-07-18 11:41:56 +08:00
Liu Jicong
280ed4f65d
feat(stream): pipelined exec for recovering
2022-07-15 21:29:53 +08:00
Liu Jicong
9394e3380f
feat(stream): recover from failure
2022-07-15 17:58:53 +08:00
Liu Jicong
d75e9b8f6a
merge from 3.0
2022-07-14 15:35:00 +08:00
Liu Jicong
9ea0ad57ec
refactor(stream): destroy stream task
2022-07-14 15:32:21 +08:00
Haojun Liao
b23e08db85
Merge pull request #14893 from taosdata/feature/3_liaohj
...
fix(query): set correct fill output column index and fix some memory leaks
2022-07-14 14:25:24 +08:00
Haojun Liao
75aca0b031
fix(query): set correct fill output column index, fix some memory leak, and do some internal refactor,
2022-07-14 13:53:23 +08:00
54liuyao
13519f8fd9
feat(stream): interval offset
2022-07-14 11:24:24 +08:00
Liu Jicong
a717042acf
refactor(stream): simple batch
2022-07-13 17:24:36 +08:00
Liu Jicong
eb49ec97ae
Merge branch 'fix/dnode' into feature/stream
2022-07-13 16:38:32 +08:00
Liu Jicong
8a6e4b877a
refactor(stream): simple batch
2022-07-13 16:37:33 +08:00
Shengliang Guan
c2aebfa322
enh: add stream queue to vnode
2022-07-13 16:26:22 +08:00
Liu Jicong
8e3f5135a6
fix(tsdb): close fd
2022-07-12 17:28:14 +08:00
Liu Jicong
d637ffe22c
refactor(tmq): prepare only needed
2022-07-12 14:10:22 +08:00
Liu Jicong
9fd5ec9020
fix(wal): rollback
2022-07-11 13:38:50 +08:00
Liu Jicong
8c5dbde918
refactor(stream): stream reader created in scanner
2022-07-06 14:20:07 +08:00
Liu Jicong
52d09b4173
refactor(wal)
2022-07-01 14:39:21 +08:00
Liu Jicong
0f0fe6276a
merge from 3.0
2022-06-29 21:33:10 +08:00
Liu Jicong
c2955a807b
feat(tmq): offset support snapshot
2022-06-29 21:04:51 +08:00
Liu Jicong
58803fafcf
fix(query): check datablock should check output flag
2022-06-28 16:05:00 +08:00
Liu Jicong
383e7a495b
fix(query): enable output check
2022-06-28 13:45:50 +08:00
54liuyao
10e90ce973
feat(stream): auto pull data
2022-06-25 16:44:14 +08:00
Liu Jicong
90121ae439
fix(tmq): check stb existence when subscribing stb
2022-06-25 15:26:29 +08:00
Liu Jicong
81ed902d7f
fix(stream): stream rsp to retrieve msg if data is empty
2022-06-25 14:03:06 +08:00
Liu Jicong
5040cb9541
enh(query): window included in serialized retrieve table rsp
2022-06-25 10:43:19 +08:00
Liu Jicong
0964b07229
fix(stream): support none type in submit msg
2022-06-24 21:44:53 +08:00
Liu Jicong
f53521cb8c
test(stream): partition by tbname
2022-06-24 16:50:11 +08:00
Liu Jicong
f2f5d68f3b
fix(stream): memory leak
2022-06-23 22:05:00 +08:00
Liu Jicong
bd64bebb63
Merge branch '3.0' into feature/3_liaohj
2022-06-23 16:00:17 +08:00
Liu Jicong
4ed47a0296
feat(tmq): scan tsdb as snapshot
2022-06-23 13:35:24 +08:00
Haojun Liao
2d31d3cb43
other: merge 3.0
2022-06-23 10:37:07 +08:00
Liu Jicong
14a488c92c
feat(stream): stream support multiple type input
2022-06-22 21:21:39 +08:00
Haojun Liao
ed8002f903
fix(query): fix syntax error.
2022-06-22 20:34:24 +08:00
Haojun Liao
bf0caa2038
Merge branch '3.0' into feature/3_liaohj
2022-06-22 20:32:02 +08:00
Liu Jicong
fb596625d3
feat(stream): support retrieve
2022-06-22 19:12:31 +08:00
Haojun Liao
5c1e7f3114
Merge branch '3.0' into feature/3_liaohj
2022-06-22 17:23:57 +08:00
Haojun Liao
14ddf539e0
refactor(query): do some internal refactor.
2022-06-22 17:21:04 +08:00
Liu Jicong
3f6ce2da73
feat(tmq): support topic with meta
2022-06-21 15:18:09 +08:00
Liu Jicong
c409760f75
feat(stream): drop stream
2022-06-21 11:32:36 +08:00
Liu Jicong
450675f672
feat(stream): support snode
2022-06-20 20:18:34 +08:00
Liu Jicong
53ef66961a
feat(stream): support snode
2022-06-20 14:29:18 +08:00
Liu Jicong
342a1ae42d
fix(stream): build ctb name
2022-06-17 21:00:10 +08:00
Liu Jicong
8eb08fa0d4
feat(stream): trigger mode add max delay
2022-06-15 16:11:20 +08:00
Liu Jicong
0ef33c05bc
enh(tmq): avoid uninitialized memory
2022-06-11 21:36:15 +08:00
Liu Jicong
767b768e51
fix(stream): fix shuffle vg id not initialized
2022-06-11 15:20:59 +08:00
Liu Jicong
73b8f02ac7
fix(stream): set child id
2022-06-10 12:00:38 +08:00
Liu Jicong
0e1328ae7f
fix(stream): set child id
2022-06-10 10:24:56 +08:00
Liu Jicong
9e4b3adc7c
fix(stream): msg dispatch
2022-06-09 11:45:06 +08:00
Liu Jicong
83f5e5eedc
fix(stream): fix no executor stream task
2022-06-09 09:56:45 +08:00
Liu Jicong
cbbf5f5d4d
refactor(stream)
2022-06-07 21:35:49 +08:00
Liu Jicong
46bea47b62
enh(stream): direct sink if not dispatch
2022-06-07 19:58:06 +08:00
Liu Jicong
94d7cbe622
feat(stream): snode process stream msg
2022-06-07 16:24:50 +08:00
Liu Jicong
65900c32c3
enh(stream): use same name rule with schemaless
2022-06-07 15:40:11 +08:00
Liu Jicong
1a84d07188
fix(stream): msg deserialize
2022-06-07 11:36:40 +08:00
Liu Jicong
858868d76a
refactor(stream): distributed execution
2022-06-07 10:54:18 +08:00
Liu Jicong
1b26da1bae
refactor(stream): distributed execution
2022-06-06 22:18:50 +08:00
Liu Jicong
2677a3c8d9
refactor(stream)
2022-06-06 20:15:36 +08:00
Liu Jicong
e1a5000e50
refactor(tmq): tq sink and push
2022-06-01 17:26:15 +08:00
54liuyao
870f24a0c9
feat(stream):adjust bloom filter
2022-05-31 17:15:43 +08:00
54liuyao
901ff9bf18
feat(sma):files factor
2022-05-31 16:14:56 +08:00
Cary Xu
f2b4cca23d
fix: init buffer to avoid invalid write
2022-05-29 01:10:32 +08:00
Liu Jicong
c47827527a
Merge pull request #13167 from taosdata/feature/tq
...
fix(tmq): update tq for auto create table
2022-05-28 20:01:15 +08:00
Liu Jicong
1aa97bc117
fix(tmq): update tq for auto create table
2022-05-28 19:48:17 +08:00
54liuyao
aa20cfedcd
feat(stream): watermark and trigger
2022-05-28 18:19:36 +08:00
Haojun Liao
d87bb5f3fa
refactor(query): set the block groupId for stream block.
2022-05-27 10:03:45 +08:00
Liu Jicong
d5d8581bcf
refactor(stream): remove out-of-date msg
2022-05-26 21:45:59 +08:00
Liu Jicong
d3a2e98d60
fix(stream): double free
2022-05-26 20:52:27 +08:00
Liu Jicong
a0f3138888
fix(stream): tb name error
2022-05-26 11:16:35 +08:00
Liu Jicong
86c9446a84
fix(stream): handle null data
2022-05-25 19:37:52 +08:00
Liu Jicong
79e97271ca
fix(stream): memory error
2022-05-25 18:43:25 +08:00
54liuyao
0778bf8857
stream session operator
2022-05-25 09:05:03 +08:00
Liu Jicong
a393dee9d2
refactor(stream)
2022-05-23 16:51:12 +08:00
54liuyao
42fcb433dc
fix(stream):adjust bloom filter
2022-05-23 11:30:22 +08:00
Liu Jicong
fc9c22b89c
fix(stream): array init error
2022-05-21 17:35:14 +08:00
Liu Jicong
7391a756f6
refactor(stream)
2022-05-20 18:53:21 +08:00
Liu Jicong
71984b4268
refactor(stream): exec
2022-05-20 05:43:36 +08:00
Shengliang Guan
0623514ed1
Merge remote-tracking branch 'origin/3.0' into fix/mnode
2022-05-17 16:12:53 +08:00
Shengliang Guan
36fe62fbd2
refactor: make more object global
2022-05-16 23:23:49 +08:00
Liu Jicong
b3fea32a7e
refactor(stream)
2022-05-16 22:43:04 +08:00
Shengliang Guan
81e89ec7b6
Merge remote-tracking branch 'origin/3.0' into fix/mnode
2022-05-16 20:13:02 +08:00
Shengliang Guan
fc94b71c80
refactor: adjust SRpcMsg
2022-05-16 15:17:11 +08:00
Liu Jicong
f77f910264
refactor(stream)
2022-05-16 02:11:47 +08:00
Liu Jicong
a6015d2f39
refactor(stream)
2022-05-15 08:14:23 +08:00
54liuyao
4b564b2ebd
add stream ci
2022-05-13 15:37:31 +08:00
54liuyao
42f27e99d0
steam reprocess window
2022-05-12 22:15:13 +08:00
Liu Jicong
d17b478e96
feat(stream): auto create ctb
2022-05-08 02:37:23 +08:00
Liu Jicong
db3cbbf22d
fix(query): column match
2022-05-08 00:21:17 +08:00
Liu Jicong
3ed1ab6acb
enh(stream): auto create ctb
2022-05-07 23:19:05 +08:00
Hongze Cheng
a06bf6e5ca
Merge pull request #12206 from taosdata/feature/vnode_refact1
...
refact: vnode
2022-05-07 19:05:25 +08:00
54liuyao
599ea89a53
stream scan
2022-05-07 18:10:45 +08:00
Hongze Cheng
323ce214b6
refact encode APIs
2022-05-07 10:03:06 +00:00
Liu Jicong
a5706ea7e5
feat(stream): insert data
2022-05-05 18:57:09 +08:00
Liu Jicong
de939d589f
fix: memory error
2022-04-29 20:11:58 +08:00
liuyao
a9c159db7a
Merge pull request #12012 from taosdata/feature/TD-15111
...
add unit test
2022-04-28 16:54:00 +08:00
Liu Jicong
ca61066b32
Merge pull request #12006 from taosdata/feature/tq
...
enh(tmq): add rebalance global lock
2022-04-28 16:27:51 +08:00
54liuyao
564f2f188f
add unit test
2022-04-28 16:13:34 +08:00
Liu Jicong
131a1c13c5
fix show
2022-04-28 15:53:12 +08:00
root
fde3f3f68f
stream update
2022-04-28 13:32:11 +08:00
afwerar
2662a3b69d
[TD-13254]<fix>: make 3.0 grant.
2022-04-10 19:08:16 +08:00
Liu Jicong
e163197573
merge from 3.0
2022-03-31 15:55:34 +08:00
Liu Jicong
3e5da8bedb
fix
2022-03-31 15:52:54 +08:00
Haojun Liao
387cfe8d45
[td-13039] fix bug in stream interval query.
2022-03-30 19:38:30 +08:00
Liu Jicong
4fd6f59092
stream set multi input
2022-03-29 15:24:25 +08:00
yihaoDeng
fbf15d45c0
handle execept
2022-03-29 12:26:01 +08:00
Liu Jicong
a5386ee102
refact stream shuffle dispatch
2022-03-28 20:31:05 +08:00
Liu Jicong
71fabef903
stream add shuffle dispatcher
2022-03-28 17:30:32 +08:00
Liu Jicong
b27fa6c8e3
stream add shuffle dispatcher
2022-03-28 17:22:18 +08:00
Liu Jicong
a3b4de6631
stream support sma
2022-03-28 14:40:22 +08:00
Liu Jicong
90e4cab2af
fix stream serialization
2022-03-28 14:16:58 +08:00
Liu Jicong
e0f192046c
multiple level stream schedule
2022-03-28 11:47:39 +08:00
Liu Jicong
25344869a9
merge from 3.0
2022-03-26 14:52:39 +08:00
Liu Jicong
564236f230
refactor stream
2022-03-26 14:50:26 +08:00
afwerar
222db126bc
[TD-13758]<fix>: redefine memory api.
2022-03-26 00:29:53 +08:00
Liu Jicong
03b2162309
refactor stream
2022-03-25 21:03:12 +08:00
Liu Jicong
59a4eec186
stream extract to module
2022-03-25 20:19:09 +08:00