Haojun Liao
|
e8549ce511
|
refactor: do some internal refactor.
|
2023-06-05 16:19:37 +08:00 |
|
Haojun Liao
|
27b7d1ec88
|
refactor: do some internal refactor.
|
2023-06-02 11:17:44 +08:00 |
|
Haojun Liao
|
a3abe25539
|
refactor: do some internal refactor.
|
2023-05-31 19:03:37 +08:00 |
|
Haojun Liao
|
65b81a803f
|
refactor: do some internal refactor and add some logs.
|
2023-05-31 18:05:53 +08:00 |
|
Haojun Liao
|
fc20ca8423
|
fix(stream): set the correct rps flag as the dispatch rsp.
|
2023-05-30 18:42:23 +08:00 |
|
Haojun Liao
|
d9cc9f2157
|
fix(stream): remove invalid free.
|
2023-05-30 18:03:21 +08:00 |
|
Haojun Liao
|
937f67f07b
|
fix(stream): fix invalid free.
|
2023-05-30 18:02:42 +08:00 |
|
Haojun Liao
|
e96ed81ec0
|
fix(stream): add input queue capacity check.
|
2023-05-30 17:29:01 +08:00 |
|
Haojun Liao
|
de7231e59e
|
fix(stream): fix memory leak in handling dispatch msg when output buffer is full.
|
2023-05-30 15:35:59 +08:00 |
|
Haojun Liao
|
dcb91082f9
|
fix(stream): fix error.
|
2023-05-20 23:37:40 +08:00 |
|
Haojun Liao
|
de44c9160c
|
refactor: do some internal refactor.
|
2023-05-20 18:05:39 +08:00 |
|
Haojun Liao
|
3cef1e7c42
|
fix(stream): add some logs.
|
2023-05-20 15:45:07 +08:00 |
|
Haojun Liao
|
aa7ea60bca
|
fix(stream): update the free strategy.
|
2023-05-20 15:43:48 +08:00 |
|
Haojun Liao
|
336102b8c5
|
refactor: do some internal refactor.
|
2023-05-20 13:34:49 +08:00 |
|
Haojun Liao
|
6ded3284da
|
refactor: do some internal refactor.
|
2023-05-20 11:37:17 +08:00 |
|
Haojun Liao
|
a9b7b8a5fd
|
other: add some logs.
|
2023-05-19 19:26:15 +08:00 |
|
Haojun Liao
|
90687bae1c
|
refactor: do some internal refactor.
|
2023-05-19 15:30:50 +08:00 |
yihaoDeng
|
9380b22394
|
merge 3.0
|
2023-05-18 05:46:38 +00:00 |
Haojun Liao
|
48dd3753aa
|
Merge pull request #21353 from taosdata/feature/3_liaohj
merge main, and do some internal refactor.
|
2023-05-17 22:34:34 +08:00 |
|
Haojun Liao
|
92feb89a09
|
refactor: do some internal refactor.
|
2023-05-17 18:08:04 +08:00 |
|
Haojun Liao
|
041ffa91bd
|
other: merge main.
|
2023-05-17 15:42:15 +08:00 |
liuyao
|
695de9d3ac
|
fix stream queue mem leak
|
2023-05-17 15:19:14 +08:00 |
|
Haojun Liao
|
e1700d00dc
|
fix(stream): avoid memory leak.
|
2023-05-16 09:26:19 +08:00 |
|
Haojun Liao
|
4c64260a7a
|
refactor: do internal refactor.
|
2023-05-15 14:15:10 +08:00 |
|
Haojun Liao
|
3b6e052c6b
|
enh(stream): avoid clone submit block.
|
2023-05-15 10:11:08 +08:00 |
|
Haojun Liao
|
3d00f6ce54
|
refactor: do some internal refactor.
|
2023-05-14 22:08:17 +08:00 |
|
Haojun Liao
|
8e15c64499
|
refactor: do some internal refactor.
|
2023-05-13 23:22:36 +08:00 |
|
Haojun Liao
|
8277d608f4
|
other: update logs.
|
2023-05-11 16:53:19 +08:00 |
|
Haojun Liao
|
dbd79cc80c
|
refactor: do some internal refactor.
|
2023-05-10 22:22:01 +08:00 |
|
Haojun Liao
|
31ac1e3eaa
|
fix(stream): revise the input queue capacity.
|
2023-05-08 00:00:55 +08:00 |
|
Haojun Liao
|
d026e7ef16
|
refactor: update some logs.
|
2023-05-07 22:55:49 +08:00 |
|
Haojun Liao
|
c141abfbb8
|
fix(stream): set correct msg size;
|
2023-05-06 20:03:07 +08:00 |
|
Haojun Liao
|
13f3ca4226
|
fix(stream): add input queue size limitation.
|
2023-05-06 18:47:29 +08:00 |
|
Haojun Liao
|
da6212bab0
|
other: merge main.
|
2023-05-06 12:51:38 +08:00 |
|
liuyao
|
74ab689719
|
opt batch num
|
2023-05-05 08:59:07 +08:00 |
|
liuyao
|
d8a1f15d10
|
fix resum bug
|
2023-05-04 09:28:06 +08:00 |
|
Haojun Liao
|
3b814f2478
|
fix(stream): do some internal refactor.
|
2023-05-01 23:21:29 +08:00 |
|
Haojun Liao
|
777ed1761f
|
refactor: update logs.
|
2023-04-29 18:24:46 +08:00 |
|
Haojun Liao
|
bbb8aaa0dc
|
refactor: add some logs.
|
2023-04-29 02:37:10 +08:00 |
|
Haojun Liao
|
6780833cd2
|
Merge remote-tracking branch 'origin/enh/rocksdbSstate' into enh/rocksdbSstate
|
2023-04-27 15:08:17 +08:00 |
|
Haojun Liao
|
b7040ed15e
|
enh(stream): support resume from the latest data, and do some internal refactor.
|
2023-04-27 15:07:54 +08:00 |
|
liuyao
|
8b5251004f
|
inc queue cap
|
2023-04-27 14:04:46 +08:00 |
|
liuyao
|
dbdc31539c
|
inc queue cap
|
2023-04-27 10:46:08 +08:00 |
|
liuyao
|
4c4a4775de
|
opt stream
|
2023-04-26 19:13:58 +08:00 |
|
Haojun Liao
|
48c36a8c35
|
Merge branch 'main' into enh/rocksdbSstate
|
2023-04-24 14:44:13 +08:00 |
|
Haojun Liao
|
623ea6df5f
|
fix(stream): add task status check.
|
2023-04-23 17:42:56 +08:00 |
|
yihaoDeng
|
917b07348c
|
Merge branch 'fix/rocksdbState' into enh/rocksRevert
|
2023-04-23 02:37:26 +00:00 |
|
Haojun Liao
|
dc733352db
|
enh(stream): set the max input queue size to be 3000.
|
2023-04-20 17:38:10 +08:00 |
|
Haojun Liao
|
ac137b4b33
|
refactor: do some internal refactor.
|
2023-04-17 09:46:58 +08:00 |
|
Haojun Liao
|
10b3fd9426
|
other: merge main.
|
2023-04-17 09:19:48 +08:00 |
|
Haojun Liao
|
3aa6897738
|
refactor: increase the buffer size
|
2023-04-14 22:56:11 +08:00 |
|
Haojun Liao
|
d0c706ac7c
|
ehn(stream): increase the capacity of input queue to be 2000 items.
|
2023-04-14 18:02:41 +08:00 |
|
Haojun Liao
|
b57c813681
|
other: merge feature/3_liaohj
|
2023-04-14 10:36:54 +08:00 |
|
Haojun Liao
|
70b45a4cf0
|
fix(stream): all data should be extracted from wal.
|
2023-04-13 23:22:09 +08:00 |
|
Haojun Liao
|
5ab54481f0
|
refactor: do some internal refactor.
|
2023-04-11 19:24:34 +08:00 |
|
yihaoDeng
|
b24b91886a
|
Merge branch 'dev3' into enh/rocksRevert
|
2023-04-11 10:59:00 +00:00 |
|
Haojun Liao
|
f5b52749c2
|
refactor: do some internal refactor.
|
2023-04-09 01:39:09 +08:00 |
|
Haojun Liao
|
bd4c33d1c2
|
fix(tmq):fix the invalid read.
|
2023-04-04 15:57:50 +08:00 |
|
yihaoDeng
|
628bb62c8a
|
add backpressure
|
2023-04-04 07:20:05 +00:00 |
|
Haojun Liao
|
d48be5c0ce
|
refactor: do some internal refactor.
|
2023-04-03 18:23:35 +08:00 |
|
Haojun Liao
|
a3ac8b647c
|
refactor: do some internal refactor.
|
2023-04-03 18:20:35 +08:00 |
|
Haojun Liao
|
482c319bee
|
refactor: do some internal refactor.
|
2023-04-03 18:07:28 +08:00 |
|
Haojun Liao
|
3ef7d43dae
|
refactor: do some internal refactor.
|
2023-04-03 17:47:48 +08:00 |
|
54liuyao
|
cf2d169f75
|
feat:coverity scan
|
2023-03-27 16:17:49 +08:00 |
Liu Jicong
|
bfb92457fa
|
refactor: stream dispatch
|
2022-12-29 16:24:30 +08:00 |
|
Liu Jicong
|
dcb71e4af1
|
refactor: stream dispatch
|
2022-12-27 15:17:43 +08:00 |
Shengliang Guan
|
50b66df39f
|
fix: control rpc qitem memory
|
2022-12-10 14:02:57 +08:00 |
|
Liu Jicong
|
015c00aaca
|
fix(stream): timer refer stream task
|
2022-11-16 11:16:32 +08:00 |
|
Liu Jicong
|
bc469f7f7b
|
fix(stream): delete tb should be checked in write thread
|
2022-11-08 11:30:29 +08:00 |
|
Liu Jicong
|
2fbc8e6306
|
refactor(stream): stream deploy and state transfer
|
2022-11-03 13:22:23 +08:00 |
|
Liu Jicong
|
a57a305035
|
fix(stream): memory leak
|
2022-10-14 14:43:22 +08:00 |
|
Liu Jicong
|
72fba5a8ce
|
fix(stream): check delete uid
|
2022-09-21 11:54:44 +08:00 |
|
Liu Jicong
|
853e6e2988
|
refactor(mnode): drop stream task
|
2022-08-17 19:19:58 +08:00 |
|
Liu Jicong
|
fc225a580d
|
enh(stream): recover process
|
2022-08-09 21:37:21 +08:00 |
|
Liu Jicong
|
d9a4ea305d
|
fix(stream): memory error
|
2022-08-09 14:11:41 +08:00 |
|
Liu Jicong
|
c411b9aebb
|
fix(stream): memory leak
|
2022-08-08 18:09:36 +08:00 |
|
Liu Jicong
|
7c9d57bd89
|
refactor(stream): unify sink and dispatch
|
2022-08-05 20:16:47 +08:00 |
|
Liu Jicong
|
6f8683de7e
|
enh(tmq): retry consumer close
|
2022-08-04 20:37:02 +08:00 |
|
Liu Jicong
|
031414001d
|
fix schedule
|
2022-08-04 17:46:13 +08:00 |
|
Liu Jicong
|
e64e41679e
|
fix schedule
|
2022-08-04 17:00:45 +08:00 |
|
Liu Jicong
|
d6cc88ed4b
|
refactor(stream): exec scheduler
|
2022-08-04 16:19:53 +08:00 |
|
Liu Jicong
|
c089d3ba08
|
merge 3.0
|
2022-08-02 22:53:49 +08:00 |
|
Liu Jicong
|
d43eec5d16
|
enh(stream): directly dispatch
|
2022-08-02 22:23:33 +08:00 |
|
Shengliang Guan
|
56f2e49764
|
refactor: adjust logs
|
2022-08-02 17:12:07 +08:00 |
|
Liu Jicong
|
a9d11b58ad
|
enh(stream): recover
|
2022-07-28 16:19:50 +08:00 |
|
Liu Jicong
|
3fa5791889
|
fix(stream): dispatch
|
2022-07-27 10:52:25 +08:00 |
|
Liu Jicong
|
500553d581
|
refactor: add debug log
|
2022-07-18 11:41:56 +08:00 |
|
Liu Jicong
|
9394e3380f
|
feat(stream): recover from failure
|
2022-07-15 17:58:53 +08:00 |
|
Shengliang Guan
|
c2aebfa322
|
enh: add stream queue to vnode
|
2022-07-13 16:26:22 +08:00 |
|
Liu Jicong
|
8e3f5135a6
|
fix(tsdb): close fd
|
2022-07-12 17:28:14 +08:00 |
|
Liu Jicong
|
d637ffe22c
|
refactor(tmq): prepare only needed
|
2022-07-12 14:10:22 +08:00 |
|
Liu Jicong
|
9fd5ec9020
|
fix(wal): rollback
|
2022-07-11 13:38:50 +08:00 |
|
Liu Jicong
|
8c5dbde918
|
refactor(stream): stream reader created in scanner
|
2022-07-06 14:20:07 +08:00 |
|
Liu Jicong
|
81ed902d7f
|
fix(stream): stream rsp to retrieve msg if data is empty
|
2022-06-25 14:03:06 +08:00 |
|
Liu Jicong
|
fb596625d3
|
feat(stream): support retrieve
|
2022-06-22 19:12:31 +08:00 |
|
Liu Jicong
|
c409760f75
|
feat(stream): drop stream
|
2022-06-21 11:32:36 +08:00 |
|
Liu Jicong
|
450675f672
|
feat(stream): support snode
|
2022-06-20 20:18:34 +08:00 |
|
Liu Jicong
|
8eb08fa0d4
|
feat(stream): trigger mode add max delay
|
2022-06-15 16:11:20 +08:00 |
|
Liu Jicong
|
0ef33c05bc
|
enh(tmq): avoid uninitialized memory
|
2022-06-11 21:36:15 +08:00 |
|
Liu Jicong
|
9e4b3adc7c
|
fix(stream): msg dispatch
|
2022-06-09 11:45:06 +08:00 |
|
Liu Jicong
|
83f5e5eedc
|
fix(stream): fix no executor stream task
|
2022-06-09 09:56:45 +08:00 |
|
Liu Jicong
|
cbbf5f5d4d
|
refactor(stream)
|
2022-06-07 21:35:49 +08:00 |
|
Liu Jicong
|
46bea47b62
|
enh(stream): direct sink if not dispatch
|
2022-06-07 19:58:06 +08:00 |
|
Liu Jicong
|
94d7cbe622
|
feat(stream): snode process stream msg
|
2022-06-07 16:24:50 +08:00 |
|
Liu Jicong
|
1a84d07188
|
fix(stream): msg deserialize
|
2022-06-07 11:36:40 +08:00 |
|
Liu Jicong
|
858868d76a
|
refactor(stream): distributed execution
|
2022-06-07 10:54:18 +08:00 |
|
Liu Jicong
|
2677a3c8d9
|
refactor(stream)
|
2022-06-06 20:15:36 +08:00 |