Haojun Liao
|
0bdccd2681
|
refactor: do some internal refactor.
|
2023-07-25 17:31:54 +08:00 |
|
Haojun Liao
|
d29f835a63
|
fix(stream): set the correct step2 scan time window range.
|
2023-07-25 15:09:22 +08:00 |
|
Haojun Liao
|
a2694b9ce9
|
fix(stream): fix the invalid check of step2 .
|
2023-07-24 19:44:28 +08:00 |
wangmm0220
|
9628a9f74e
|
fix:open info log in tmq & ignore wal apply ver when read wal
|
2023-07-24 15:53:02 +08:00 |
|
Haojun Liao
|
1e34f84f78
|
other: merge 3.0
|
2023-07-24 15:23:03 +08:00 |
|
Haojun Liao
|
9bae91bcba
|
fix(stream): add some logs, and remove the invalid loop.
|
2023-07-24 13:37:44 +08:00 |
|
Haojun Liao
|
1367552f38
|
fix(stream): refactor the halt status to check more status.
|
2023-07-24 10:04:15 +08:00 |
|
Haojun Liao
|
0b6e1a12bb
|
refactor: do some internal refactor.
|
2023-07-23 19:09:43 +08:00 |
|
Haojun Liao
|
e387b2f932
|
refactor: do some internal refactor.
|
2023-07-23 18:59:34 +08:00 |
|
Haojun Liao
|
4e0f7ffbf8
|
fix(stream): set the correct flag of pause/resume.
|
2023-07-23 18:49:56 +08:00 |
|
Haojun Liao
|
bfc4a07207
|
fix(stream): fix memory leak.
|
2023-07-22 00:20:02 +08:00 |
|
Haojun Liao
|
1b2636028a
|
fix(stream): fix memory leak.
|
2023-07-21 23:05:42 +08:00 |
|
Haojun Liao
|
16d7707b90
|
fix(stream): align the scan real time data for stream task.
|
2023-07-21 19:33:43 +08:00 |
|
wangmm0220
|
bb86f5c580
|
fix:commit offset should not plus 1
|
2023-07-21 11:13:05 +08:00 |
|
Haojun Liao
|
39ca9b537f
|
fix(stream): fix syntax error
|
2023-07-21 09:43:08 +08:00 |
|
Haojun Liao
|
c9d75eab5a
|
refactor: do some internal refactor.
|
2023-07-21 09:16:13 +08:00 |
|
Haojun Liao
|
db46d31ca5
|
fix(stream): refactor the halt function.
|
2023-07-21 01:32:42 +08:00 |
|
Haojun Liao
|
9353f7c8cf
|
refactor: do some internal refactor.
|
2023-07-20 16:35:02 +08:00 |
|
Haojun Liao
|
c9fa170e65
|
refactor: do some internal refactor.
|
2023-07-20 16:31:46 +08:00 |
|
Haojun Liao
|
45cb478b31
|
refactor: do some internal refactor.
|
2023-07-20 15:36:46 +08:00 |
|
Haojun Liao
|
aed99da6c1
|
refactor: refactor the stream task starting order.
|
2023-07-20 12:14:53 +08:00 |
|
Haojun Liao
|
97c44e7c18
|
refactor: do some internal refactor.
|
2023-07-19 18:42:02 +08:00 |
|
wangmm0220
|
d7d81d82a0
|
feat:add committed & position & commite_offset interface
|
2023-07-19 18:27:19 +08:00 |
|
wangmm0220
|
5cb35f2fa6
|
feat:add committed & position & commite_offset interface
|
2023-07-19 17:29:39 +08:00 |
|
Haojun Liao
|
a32c650248
|
Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2
|
2023-07-19 10:05:48 +08:00 |
|
Haojun Liao
|
2ae95217bd
|
fix(stream): open inputQ by default for task deployed on snode.
|
2023-07-19 10:05:35 +08:00 |
liuyao
|
fd02b9a71e
|
Merge branch '3.0' into enh/triggerCheckPoint2
|
2023-07-19 10:02:06 +08:00 |
|
Haojun Liao
|
9513f76172
|
fix(stream): set downstream task ready state.
|
2023-07-18 19:02:24 +08:00 |
|
Haojun Liao
|
901b7d8ecc
|
fix(stream): if a source task is set to be non-normal, no data should be put into inputQ anymore.
|
2023-07-18 15:18:57 +08:00 |
|
Haojun Liao
|
92106312d2
|
fix(stream): not dispatch checkpoint block result to downstream.
|
2023-07-18 09:43:38 +08:00 |
|
Haojun Liao
|
d7f7a7d6cf
|
fix(stream): fix syntax error
|
2023-07-17 12:53:36 +08:00 |
Haojun Liao
|
b2a905bd91
|
Merge branch '3.0' into enh/triggerCheckPoint2
|
2023-07-17 11:50:12 +08:00 |
|
Haojun Liao
|
a9757637d9
|
Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2
|
2023-07-16 12:47:24 +08:00 |
|
Haojun Liao
|
c6a322e0ef
|
refactor(stream): back pressure is active, which is trigger by dispatch rsp.
|
2023-07-16 12:47:08 +08:00 |
yihaoDeng
|
e18c9ea672
|
add checkpoint
|
2023-07-15 04:26:34 +00:00 |
|
yihaoDeng
|
3c4631ef1f
|
add checkpoint
|
2023-07-14 10:06:24 +00:00 |
|
Haojun Liao
|
eb7e6152ae
|
refactor(stream): do some internal refactor.
|
2023-07-14 17:21:20 +08:00 |
|
Haojun Liao
|
e0ea0f2df4
|
Merge pull request #22020 from taosdata/fix/liaohj
other: merge main
|
2023-07-13 17:55:28 +08:00 |
|
Haojun Liao
|
813f4cb363
|
refactor: do some internal refactor.
|
2023-07-13 16:32:25 +08:00 |
|
Haojun Liao
|
2f90a53548
|
fix(stream): set checkpoint id when expanding task.
|
2023-07-13 10:16:57 +08:00 |
|
wangmm0220
|
cf64d4c9c5
|
fix:set get_assignment offset to first version of response block
|
2023-07-12 17:22:23 +08:00 |
|
Haojun Liao
|
d392bb60ba
|
refactor(stream): set the initial version from the checkpoint.
|
2023-07-12 11:38:13 +08:00 |
|
Haojun Liao
|
fed3803739
|
fix(stream): fix memory leak.
|
2023-07-11 19:29:52 +08:00 |
|
Haojun Liao
|
2e386a6fdf
|
fix(stream): check if stream task is in normal state.
|
2023-07-11 15:23:49 +08:00 |
|
Haojun Liao
|
6d78816d22
|
fix(stream): fix syntax error.
|
2023-07-11 14:06:25 +08:00 |
|
Haojun Liao
|
09b764494d
|
fix(stream): set correct checkpoint version when starting stream tasks.
|
2023-07-11 14:03:43 +08:00 |
|
Haojun Liao
|
3ffdbe923d
|
other: merge 3.0
|
2023-07-11 09:12:57 +08:00 |
|
Haojun Liao
|
04f5bcd23a
|
fix(stream): remove invalid set of task status .
|
2023-07-11 08:51:13 +08:00 |
|
Haojun Liao
|
87bedef2cd
|
fix(stream): fix error in checkpointing.
|
2023-07-10 19:20:05 +08:00 |
|
Haojun Liao
|
385a5c9651
|
fix(stream): fix error in generating checkpoint.
|
2023-07-10 18:20:50 +08:00 |
|
wangmm0220
|
35ba132a29
|
fix:conflicts from main
|
2023-07-09 12:52:18 +08:00 |
|
wangmm0220
|
f9f656b21a
|
fix:return offset stored if get assignment in init mode
|
2023-07-08 13:25:39 +08:00 |
|
Haojun Liao
|
4f534ce6e9
|
fix(stream): fix error in generating checkpoint.
|
2023-07-08 10:29:09 +08:00 |
|
Haojun Liao
|
a5c19427e7
|
fix(stream): send correct rsp to mnode.
|
2023-07-08 09:39:44 +08:00 |
|
Haojun Liao
|
9c30abf95b
|
fix(stream): fix error in generating checkpoint.
|
2023-07-07 21:38:53 +08:00 |
|
wangmm0220
|
4436eb7e0f
|
fix:set commitOffset is send msg success & optimize log & add test cases for TD-25129
|
2023-07-07 19:12:18 +08:00 |
|
Haojun Liao
|
128f67784a
|
fix(stream): fix error in parsing checkpoint msg.
|
2023-07-07 18:17:50 +08:00 |
|
Haojun Liao
|
8298f30e56
|
fix(stream): fix bug in checkpoint.
|
2023-07-07 17:16:08 +08:00 |
|
wangmm0220
|
106e273157
|
fix:bugs in get_assignment
|
2023-07-07 16:12:15 +08:00 |
|
Haojun Liao
|
47877898d0
|
enh(stream): generate the checkpoint framework.
|
2023-07-07 16:07:52 +08:00 |
|
wangmm0220
|
0928bd5510
|
fix:send rsp offset to client if unregister push mgr
|
2023-07-06 19:35:48 +08:00 |
|
Haojun Liao
|
d7101f7109
|
enh(stream): support dispatch checkpoint msg.
|
2023-07-06 18:26:22 +08:00 |
|
wangmm0220
|
11e6856d3e
|
fix:init char array
|
2023-07-06 13:37:58 +08:00 |
|
Haojun Liao
|
5a9461a69a
|
other: merge 3.0
|
2023-07-06 11:52:21 +08:00 |
|
Haojun Liao
|
f4a3567935
|
other: merge 3.0
|
2023-07-06 11:24:30 +08:00 |
|
wangmm0220
|
34a62c3f38
|
fix:vginfo assigment not in same time,we should get vginfo by vg,not all vg
|
2023-07-05 22:55:41 +08:00 |
|
Haojun Liao
|
74f5b3f80e
|
Merge pull request #21959 from taosdata/refact/fillhistory
refactor: do some internal refactor.
|
2023-07-05 17:47:00 +08:00 |
|
wangmm0220
|
bdfeb32923
|
fix:bugs in tmq_get_topic_assignment
|
2023-07-05 16:04:34 +08:00 |
|
Haojun Liao
|
03dbcbf055
|
refactor: do some internal refactor.
|
2023-07-05 15:55:55 +08:00 |
|
Haojun Liao
|
9b3e34d589
|
Merge pull request #21735 from taosdata/refact/fillhistory
refactor: refactor the fill history operation
|
2023-07-05 10:48:51 +08:00 |
|
Haojun Liao
|
ff2bf35603
|
fix(stream): fix error in set the version range for secondary scan.
|
2023-07-04 15:08:39 +08:00 |
|
Haojun Liao
|
20d099dfa6
|
Merge pull request #21901 from taosdata/fix/liaohj
fix: fix coverity issue.
|
2023-07-03 15:15:21 +08:00 |
|
wangmm0220
|
58c7011e0e
|
feat:support only meta in tmq subscriptions
|
2023-06-30 11:42:40 +08:00 |
|
Haojun Liao
|
622e1cb608
|
fix: fix coverity issue.
|
2023-06-29 15:54:09 +08:00 |
liuyao
|
2fc5eeb810
|
session win range
|
2023-06-28 17:20:08 +08:00 |
|
Haojun Liao
|
8867a57262
|
fix(stream): fix syntax error.
|
2023-06-28 14:48:59 +08:00 |
|
Haojun Liao
|
57fcd553f8
|
refactor: do some internal refactor.
|
2023-06-28 13:13:13 +08:00 |
|
Haojun Liao
|
3710ea4aca
|
refactor: do some internal refactor.
|
2023-06-28 09:41:08 +08:00 |
|
Haojun Liao
|
a19e63fd23
|
fix(stream): fix error in handling fill history.
|
2023-06-27 23:00:14 +08:00 |
|
Yihao Deng
|
4de7db06f9
|
Merge branch '3.0' into enh/triggerCheckPoint2
|
2023-06-27 17:57:14 +08:00 |
|
Haojun Liao
|
4bb78df27c
|
fix(stream): reduce the sleep time.
|
2023-06-27 16:44:35 +08:00 |
|
Haojun Liao
|
32fddeff18
|
fix(stream): fix error retrieve data from source task.And optimize the test cases.
|
2023-06-27 16:24:47 +08:00 |
|
Haojun Liao
|
3289ad62be
|
other: merge 3.0
|
2023-06-27 11:33:40 +08:00 |
|
Haojun Liao
|
b73444b291
|
fix(stream): start stream task in case of scan history completing.
|
2023-06-27 09:44:51 +08:00 |
dapan1121
|
4dae9f4eff
|
merge main to 3.0
|
2023-06-26 18:43:00 +08:00 |
|
Haojun Liao
|
402c091df0
|
fix(stream): fix sma error.
|
2023-06-25 19:41:44 +08:00 |
|
liuyao
|
e236bf818c
|
set fill history info
|
2023-06-25 17:47:10 +08:00 |
|
Haojun Liao
|
7c23630fe4
|
fix(stream): set correct stream error code.
|
2023-06-25 09:26:37 +08:00 |
|
Haojun Liao
|
ea7b8e91d3
|
fix(stream): fix memory leak.
|
2023-06-21 12:03:26 +08:00 |
|
liuyao
|
74bea44300
|
stream op transform
|
2023-06-20 17:30:59 +08:00 |
|
liuyao
|
aafbdcb492
|
set task status
|
2023-06-20 15:20:04 +08:00 |
|
liuyao
|
870d75bf82
|
fill history pause&resume
|
2023-06-20 11:34:09 +08:00 |
|
liuyao
|
41c193945f
|
fill history pause&resume
|
2023-06-19 17:28:19 +08:00 |
yihaoDeng
|
fd85a8495a
|
Merge branch 'dev30' into enh/triggerCheckPoint2
|
2023-06-17 14:17:21 +08:00 |
|
Haojun Liao
|
64365666b7
|
fix(stream): update the info, and do some internal refactor.
|
2023-06-16 16:04:43 +08:00 |
|
Haojun Liao
|
4c82558eab
|
Merge remote-tracking branch 'origin/refact/fillhistory' into refact/fillhistory
|
2023-06-16 09:55:24 +08:00 |
|
Haojun Liao
|
933801269a
|
fix(stream): fix memory leak and failed to close vnode.
|
2023-06-16 09:55:11 +08:00 |
|
liuyao
|
0aa141ec77
|
use stream task state
|
2023-06-15 18:24:40 +08:00 |
|
Haojun Liao
|
74e0138f72
|
Merge branch '3.0' into refact/fillhistory
|
2023-06-15 15:25:00 +08:00 |
|
wangmm0220
|
22776e60d5
|
fix:control memory size if consumer group is too much
|
2023-06-15 14:51:04 +08:00 |