yihaoDeng
|
81fe174aa2
|
fix mem leak
|
2023-06-03 08:19:59 +08:00 |
Haojun Liao
|
f1bd829977
|
refactor: do some internal refactor.
|
2023-06-02 13:10:54 +08:00 |
|
Haojun Liao
|
27b7d1ec88
|
refactor: do some internal refactor.
|
2023-06-02 11:17:44 +08:00 |
|
Haojun Liao
|
91de00597d
|
refactor: do some internal refactor.
|
2023-05-31 22:12:14 +08:00 |
|
Haojun Liao
|
ccc86f9916
|
refactor: do some internal refactor.
|
2023-05-31 19:36:34 +08:00 |
|
Haojun Liao
|
87deb36f8a
|
refactor: do some internal refactor.
|
2023-05-31 19:36:02 +08:00 |
|
Haojun Liao
|
a3abe25539
|
refactor: do some internal refactor.
|
2023-05-31 19:03:37 +08:00 |
liuyao
|
5ebe75599e
|
fix pause issue
|
2023-05-26 14:58:39 +08:00 |
|
Haojun Liao
|
f520de0dab
|
refactor: adjust the module dependency.
|
2023-05-22 10:07:01 +08:00 |
|
Haojun Liao
|
dcb91082f9
|
fix(stream): fix error.
|
2023-05-20 23:37:40 +08:00 |
|
Haojun Liao
|
de44c9160c
|
refactor: do some internal refactor.
|
2023-05-20 18:05:39 +08:00 |
|
Haojun Liao
|
3cef1e7c42
|
fix(stream): add some logs.
|
2023-05-20 15:45:07 +08:00 |
|
Haojun Liao
|
aa7ea60bca
|
fix(stream): update the free strategy.
|
2023-05-20 15:43:48 +08:00 |
|
Haojun Liao
|
84146e6aaa
|
other: merge main.
|
2023-05-20 15:16:51 +08:00 |
|
Haojun Liao
|
6932c59510
|
other: merge main.
|
2023-05-20 15:09:30 +08:00 |
|
Haojun Liao
|
10692fde5e
|
other: merge main.
|
2023-05-20 14:53:28 +08:00 |
|
Haojun Liao
|
afc384bead
|
fix:remove invalid assert.
|
2023-05-20 14:44:34 +08:00 |
|
Haojun Liao
|
484788a60f
|
fix:add null ptr check.
|
2023-05-20 14:29:51 +08:00 |
|
Haojun Liao
|
336102b8c5
|
refactor: do some internal refactor.
|
2023-05-20 13:34:49 +08:00 |
|
Haojun Liao
|
5cbad1da3e
|
refactor: do some internal refactor.
|
2023-05-20 12:20:04 +08:00 |
|
Haojun Liao
|
6ded3284da
|
refactor: do some internal refactor.
|
2023-05-20 11:37:17 +08:00 |
|
Haojun Liao
|
8ab065d01e
|
other: update some logs.
|
2023-05-19 23:53:23 +08:00 |
|
Haojun Liao
|
56e5a483dd
|
other: update log.
|
2023-05-19 20:00:32 +08:00 |
|
Haojun Liao
|
a9b7b8a5fd
|
other: add some logs.
|
2023-05-19 19:26:15 +08:00 |
|
Haojun Liao
|
e2ec8d738c
|
other: add some logs.
|
2023-05-19 18:08:01 +08:00 |
|
Haojun Liao
|
90687bae1c
|
refactor: do some internal refactor.
|
2023-05-19 15:30:50 +08:00 |
Haojun Liao
|
dbd52ecffa
|
Merge pull request #21364 from taosdata/enh/rocksdbSstate
state merge into 3.0
|
2023-05-18 17:25:44 +08:00 |
|
liuyao
|
da3fc5111e
|
fix pause agg task
|
2023-05-18 15:29:41 +08:00 |
yihaoDeng
|
9380b22394
|
merge 3.0
|
2023-05-18 05:46:38 +00:00 |
|
Haojun Liao
|
ffee5ebc61
|
Merge branch '3.0' into feature/3_liaohj
|
2023-05-17 17:47:44 +08:00 |
|
Haojun Liao
|
041ffa91bd
|
other: merge main.
|
2023-05-17 15:42:15 +08:00 |
|
Haojun Liao
|
f3f52c0232
|
fix(stream): add some logs and set the wal offset to be the ended version when finishing the step2 recover stage.
|
2023-05-17 10:43:23 +08:00 |
|
liuyao
|
3c81137ffe
|
pause source task
|
2023-05-16 13:43:46 +08:00 |
|
yihaoDeng
|
4015f544db
|
refactor code
|
2023-05-15 05:45:17 +00:00 |
|
yihaoDeng
|
42562d388f
|
refactor code
|
2023-05-15 05:29:56 +00:00 |
|
liuyao
|
a6570a4327
|
Merge branch 'enh/rocksdbSstate' of https://github.com/taosdata/TDengine into enh/rocksdbSstate
|
2023-05-15 11:19:55 +08:00 |
|
liuyao
|
9258dcd740
|
fix:mem leak
|
2023-05-15 11:19:17 +08:00 |
|
Haojun Liao
|
8e15c64499
|
refactor: do some internal refactor.
|
2023-05-13 23:22:36 +08:00 |
|
Haojun Liao
|
b2d141fe40
|
fix(stream): limit the batch size.
|
2023-05-11 15:07:07 +08:00 |
|
Haojun Liao
|
b02b3117b5
|
refactor: do some internal refactor.
|
2023-05-11 10:14:29 +08:00 |
|
Haojun Liao
|
dbd79cc80c
|
refactor: do some internal refactor.
|
2023-05-10 22:22:01 +08:00 |
|
liuyao
|
62ccd4bf16
|
avoid delete data
|
2023-05-10 09:11:04 +08:00 |
|
Yihao Deng
|
cb223acf82
|
Merge branch 'main' into enh/rocksdbSstate
|
2023-05-08 09:45:27 +08:00 |
|
Haojun Liao
|
31ac1e3eaa
|
fix(stream): revise the input queue capacity.
|
2023-05-08 00:00:55 +08:00 |
|
Haojun Liao
|
da6212bab0
|
other: merge main.
|
2023-05-06 12:51:38 +08:00 |
|
Haojun Liao
|
1fa4327f6c
|
Merge branch 'main' into fix/liaohj_main
|
2023-05-06 10:15:23 +08:00 |
|
liuyao
|
76bf0aea56
|
opt stream input queue
|
2023-05-06 10:14:27 +08:00 |
|
Haojun Liao
|
3afc5bdfcf
|
refactor: add some logs.
|
2023-05-06 10:09:51 +08:00 |
|
Haojun Liao
|
29fcd1b83a
|
refactor: do some internal refactor.
|
2023-05-06 10:08:05 +08:00 |
|
Haojun Liao
|
8b12d4d3da
|
fix(stream): secure the delete task operation. TD-1198
|
2023-05-05 15:02:03 +08:00 |
|
liuyao
|
74ab689719
|
opt batch num
|
2023-05-05 08:59:07 +08:00 |
|
liuyao
|
d8a1f15d10
|
fix resum bug
|
2023-05-04 09:28:06 +08:00 |
|
Haojun Liao
|
3c61932ecc
|
refactor: do some internal refactor.
|
2023-05-01 19:28:54 +08:00 |
|
Haojun Liao
|
b7c8346b44
|
other: merge other branch.
|
2023-04-28 13:06:47 +08:00 |
|
Haojun Liao
|
f9a64cbcd6
|
other: add some logs.
|
2023-04-28 12:58:03 +08:00 |
jiajingbin
|
ebf9a13fe7
|
inc batch num
|
2023-04-27 18:15:17 +08:00 |
|
liuyao
|
863d30e5a9
|
opt tq read
|
2023-04-26 18:58:19 +08:00 |
|
liuyao
|
2533b5c5c2
|
op stream
|
2023-04-26 17:00:33 +08:00 |
|
yihaoDeng
|
917b07348c
|
Merge branch 'fix/rocksdbState' into enh/rocksRevert
|
2023-04-23 02:37:26 +00:00 |
|
Haojun Liao
|
b6f4cac619
|
fix(stream): set the correct offset version.
|
2023-04-21 13:35:24 +08:00 |
|
Haojun Liao
|
5e6c06e253
|
fix(stream): fix the race condition during create new stream tasks.
|
2023-04-20 23:21:18 +08:00 |
|
Haojun Liao
|
8323ad8670
|
enh(stream): add more check to stop stream asap.
|
2023-04-20 17:29:08 +08:00 |
|
Haojun Liao
|
930b267a75
|
fix(stream): set the correct start offset for stream task.
|
2023-04-17 22:59:00 +08:00 |
|
Haojun Liao
|
b57c813681
|
other: merge feature/3_liaohj
|
2023-04-14 10:36:54 +08:00 |
|
Haojun Liao
|
70b45a4cf0
|
fix(stream): all data should be extracted from wal.
|
2023-04-13 23:22:09 +08:00 |
|
Haojun Liao
|
5ab54481f0
|
refactor: do some internal refactor.
|
2023-04-11 19:24:34 +08:00 |
|
yihaoDeng
|
b24b91886a
|
Merge branch 'dev3' into enh/rocksRevert
|
2023-04-11 10:59:00 +00:00 |
|
Haojun Liao
|
18479d8115
|
refactor: do some internall refactor.
|
2023-04-11 15:42:24 +08:00 |
|
Haojun Liao
|
15cceb5a5a
|
refactor: do some internal refactors.
|
2023-04-11 11:53:10 +08:00 |
|
liuyao
|
74da3c05bc
|
feat:set check point id
|
2023-04-11 10:33:10 +08:00 |
|
Haojun Liao
|
a4ba5401f9
|
enh(stream): set the start version of all operators.
|
2023-04-11 10:01:36 +08:00 |
|
Haojun Liao
|
f5b52749c2
|
refactor: do some internal refactor.
|
2023-04-09 01:39:09 +08:00 |
|
liuyao
|
955f8f9f07
|
feat:optimize get patitionby name
|
2023-04-07 18:45:09 +08:00 |
|
yihaoDeng
|
628bb62c8a
|
add backpressure
|
2023-04-04 07:20:05 +00:00 |
|
Haojun Liao
|
3ef7d43dae
|
refactor: do some internal refactor.
|
2023-04-03 17:47:48 +08:00 |
|
54liuyao
|
2185464836
|
fix:scan of fill history ended prematurely
|
2023-03-18 13:38:33 +08:00 |
|
54liuyao
|
25732f7c3c
|
fix:source task needs to wait & stream state window does not handle null
|
2023-03-15 13:15:17 +08:00 |
|
54liuyao
|
0cd871010f
|
fix:fix fill history bug
|
2023-03-07 13:34:26 +08:00 |
|
54liuyao
|
1d58f85a54
|
feat:coverity scan
|
2023-02-22 10:10:04 +08:00 |
Xiaoyu Wang
|
c597de099f
|
merge main
|
2023-02-20 13:41:27 +08:00 |
|
54liuyao
|
2270fed9f7
|
fix:add limit for stream batch
|
2023-02-18 11:57:24 +08:00 |
|
Xiaoyu Wang
|
fdde287ca9
|
merge main
|
2023-01-04 11:43:20 +08:00 |
Liu Jicong
|
66b9fa01f7
|
enh: optimize drop when scan exec
|
2022-12-29 15:51:12 +08:00 |
Shengliang Guan
|
78c14a2c88
|
Merge remote-tracking branch 'origin/3.0' into merge/mainto3.0_1228
|
2022-12-28 14:59:02 +08:00 |
|
Shengliang Guan
|
d342ebcd77
|
Merge pull request #18720 from taosdata/refact/submit_req
Refact/submit req
|
2022-12-28 10:29:00 +08:00 |
|
Liu Jicong
|
39eb62d80d
|
enh: set scan limit
|
2022-12-27 14:52:41 +08:00 |
|
Liu Jicong
|
5826e40aa7
|
enh: drop stream eagerly
|
2022-12-27 11:20:35 +08:00 |
|
Xiaoyu Wang
|
0c269c317b
|
merge 3.0
|
2022-12-23 17:50:05 +08:00 |
|
Liu Jicong
|
b1bd24d15a
|
enh: scan exec set limit
|
2022-12-23 16:35:40 +08:00 |
|
Liu Jicong
|
69d410591f
|
refactor: add debug log
|
2022-12-22 17:14:17 +08:00 |
|
Haojun Liao
|
48f7fc5c3d
|
Merge branch '3.0' into refact/submit_req
|
2022-12-12 18:11:17 +08:00 |
|
Shengliang Guan
|
50b66df39f
|
fix: control rpc qitem memory
|
2022-12-10 14:02:57 +08:00 |
|
Liu Jicong
|
ecbc09663f
|
enh: tolerate exec error
|
2022-12-09 09:35:53 +08:00 |
Shengliang Guan
|
6d94afe48f
|
Revert "refact: adjust some assert cases"
|
2022-12-07 21:51:17 +08:00 |
|
Shengliang Guan
|
d5126d469a
|
refact: replcase ASSERT with tAssert
|
2022-12-07 18:42:48 +08:00 |
|
Shengliang Guan
|
f69a188f7e
|
refact: replcase ASSERT with tAssert
|
2022-12-07 18:37:40 +08:00 |
|
Liu Jicong
|
b133a56219
|
refactor: support submitreq2
|
2022-12-07 15:19:34 +08:00 |
|
Liu Jicong
|
548684e5ac
|
fix(stream): delete multiple row
|
2022-11-29 23:39:58 +08:00 |
|
Liu Jicong
|
5161eca70f
|
fix(stream): stop scan when no output
|
2022-11-17 10:30:05 +08:00 |
|
Liu Jicong
|
bc469f7f7b
|
fix(stream): delete tb should be checked in write thread
|
2022-11-08 11:30:29 +08:00 |
|
Liu Jicong
|
2fbc8e6306
|
refactor(stream): stream deploy and state transfer
|
2022-11-03 13:22:23 +08:00 |
|
Liu Jicong
|
5e253cc8ea
|
refactor(stream): fill history
|
2022-11-01 11:56:14 +08:00 |
|
Liu Jicong
|
75e5e490fd
|
refactor(stream): recover and fill history
|
2022-10-26 00:31:00 +08:00 |
|
54liuyao
|
7f16081e29
|
feat(stream): stream task and meta
|
2022-10-19 10:49:42 +08:00 |
|
Liu Jicong
|
72fba5a8ce
|
fix(stream): check delete uid
|
2022-09-21 11:54:44 +08:00 |
|
Liu Jicong
|
c296dd0a63
|
fix compile
|
2022-08-24 01:48:00 +08:00 |
|
Liu Jicong
|
18f6fb6123
|
enh(tmq): speed up consumer recover
|
2022-08-10 16:04:03 +08:00 |
|
Liu Jicong
|
fc225a580d
|
enh(stream): recover process
|
2022-08-09 21:37:21 +08:00 |
|
Liu Jicong
|
d9a4ea305d
|
fix(stream): memory error
|
2022-08-09 14:11:41 +08:00 |
|
Liu Jicong
|
ad032a0a90
|
enh(stream): stream recover
|
2022-08-09 10:36:27 +08:00 |
|
Liu Jicong
|
c411b9aebb
|
fix(stream): memory leak
|
2022-08-08 18:09:36 +08:00 |
|
Liu Jicong
|
7c9d57bd89
|
refactor(stream): unify sink and dispatch
|
2022-08-05 20:16:47 +08:00 |
|
Liu Jicong
|
031414001d
|
fix schedule
|
2022-08-04 17:46:13 +08:00 |
|
Liu Jicong
|
d6cc88ed4b
|
refactor(stream): exec scheduler
|
2022-08-04 16:19:53 +08:00 |
|
Liu Jicong
|
e345023dfd
|
enh(stream): keep thread from blocking
|
2022-08-03 15:31:10 +08:00 |
|
Shengliang Guan
|
56f2e49764
|
refactor: adjust logs
|
2022-08-02 17:12:07 +08:00 |
|
Liu Jicong
|
a9d11b58ad
|
enh(stream): recover
|
2022-07-28 16:19:50 +08:00 |
|
Liu Jicong
|
ba0c1b3689
|
refactor(stream)
|
2022-07-27 20:11:03 +08:00 |
|
Liu Jicong
|
5e1bbe0e7e
|
refactor(sma): remove option
|
2022-07-27 16:55:23 +08:00 |
|
jiajingbin
|
8833a8bdfb
|
fix: fix bug for TD-17801
|
2022-07-25 21:39:12 +08:00 |
|
Liu Jicong
|
b1f3428c05
|
refactor(stream): do not merge output
|
2022-07-22 10:43:49 +08:00 |
|
Liu Jicong
|
edaec52bca
|
refactor: add debug flag
|
2022-07-19 19:59:07 +08:00 |
jiacy-jcy
|
5200a48107
|
fix: update
|
2022-07-19 16:54:19 +08:00 |
|
Liu Jicong
|
b6f55fa09e
|
refactor(stream): batch optimization for submit msg
|
2022-07-18 21:32:40 +08:00 |
|
Liu Jicong
|
053786e6b4
|
fix(stream): data exec
|
2022-07-18 15:50:36 +08:00 |
|
Liu Jicong
|
500553d581
|
refactor: add debug log
|
2022-07-18 11:41:56 +08:00 |
|
Liu Jicong
|
280ed4f65d
|
feat(stream): pipelined exec for recovering
|
2022-07-15 21:29:53 +08:00 |
|
Liu Jicong
|
9394e3380f
|
feat(stream): recover from failure
|
2022-07-15 17:58:53 +08:00 |
|
Liu Jicong
|
d75e9b8f6a
|
merge from 3.0
|
2022-07-14 15:35:00 +08:00 |
|
Liu Jicong
|
9ea0ad57ec
|
refactor(stream): destroy stream task
|
2022-07-14 15:32:21 +08:00 |
|
Haojun Liao
|
75aca0b031
|
fix(query): set correct fill output column index, fix some memory leak, and do some internal refactor,
|
2022-07-14 13:53:23 +08:00 |
|
Liu Jicong
|
a717042acf
|
refactor(stream): simple batch
|
2022-07-13 17:24:36 +08:00 |
|
Liu Jicong
|
8a6e4b877a
|
refactor(stream): simple batch
|
2022-07-13 16:37:33 +08:00 |
|
Liu Jicong
|
8e3f5135a6
|
fix(tsdb): close fd
|
2022-07-12 17:28:14 +08:00 |
|
Liu Jicong
|
d637ffe22c
|
refactor(tmq): prepare only needed
|
2022-07-12 14:10:22 +08:00 |
|
Liu Jicong
|
52d09b4173
|
refactor(wal)
|
2022-07-01 14:39:21 +08:00 |
|
Liu Jicong
|
0f0fe6276a
|
merge from 3.0
|
2022-06-29 21:33:10 +08:00 |
|
Liu Jicong
|
c2955a807b
|
feat(tmq): offset support snapshot
|
2022-06-29 21:04:51 +08:00 |
|
Liu Jicong
|
383e7a495b
|
fix(query): enable output check
|
2022-06-28 13:45:50 +08:00 |
|
54liuyao
|
10e90ce973
|
feat(stream): auto pull data
|
2022-06-25 16:44:14 +08:00 |
|
Liu Jicong
|
90121ae439
|
fix(tmq): check stb existence when subscribing stb
|
2022-06-25 15:26:29 +08:00 |
|
Liu Jicong
|
81ed902d7f
|
fix(stream): stream rsp to retrieve msg if data is empty
|
2022-06-25 14:03:06 +08:00 |
|
Liu Jicong
|
f2f5d68f3b
|
fix(stream): memory leak
|
2022-06-23 22:05:00 +08:00 |
|
Liu Jicong
|
4ed47a0296
|
feat(tmq): scan tsdb as snapshot
|
2022-06-23 13:35:24 +08:00 |
|
Liu Jicong
|
14a488c92c
|
feat(stream): stream support multiple type input
|
2022-06-22 21:21:39 +08:00 |
|
Liu Jicong
|
fb596625d3
|
feat(stream): support retrieve
|
2022-06-22 19:12:31 +08:00 |
|
Liu Jicong
|
3f6ce2da73
|
feat(tmq): support topic with meta
|
2022-06-21 15:18:09 +08:00 |
|
Liu Jicong
|
c409760f75
|
feat(stream): drop stream
|
2022-06-21 11:32:36 +08:00 |
|
Liu Jicong
|
450675f672
|
feat(stream): support snode
|
2022-06-20 20:18:34 +08:00 |
|
Liu Jicong
|
8eb08fa0d4
|
feat(stream): trigger mode add max delay
|
2022-06-15 16:11:20 +08:00 |
|
Liu Jicong
|
9e4b3adc7c
|
fix(stream): msg dispatch
|
2022-06-09 11:45:06 +08:00 |
|
Liu Jicong
|
83f5e5eedc
|
fix(stream): fix no executor stream task
|
2022-06-09 09:56:45 +08:00 |
|
Liu Jicong
|
858868d76a
|
refactor(stream): distributed execution
|
2022-06-07 10:54:18 +08:00 |
|
Liu Jicong
|
2677a3c8d9
|
refactor(stream)
|
2022-06-06 20:15:36 +08:00 |