Haojun Liao
|
db46d31ca5
|
fix(stream): refactor the halt function.
|
2023-07-21 01:32:42 +08:00 |
|
Haojun Liao
|
aed99da6c1
|
refactor: refactor the stream task starting order.
|
2023-07-20 12:14:53 +08:00 |
yihaoDeng
|
6e5be0d30e
|
fix stream state transfer
|
2023-07-20 03:49:32 +00:00 |
|
Haojun Liao
|
97c44e7c18
|
refactor: do some internal refactor.
|
2023-07-19 18:42:02 +08:00 |
|
Haojun Liao
|
2ae95217bd
|
fix(stream): open inputQ by default for task deployed on snode.
|
2023-07-19 10:05:35 +08:00 |
|
Haojun Liao
|
d2c875e774
|
Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2
|
2023-07-18 15:19:09 +08:00 |
|
Haojun Liao
|
901b7d8ecc
|
fix(stream): if a source task is set to be non-normal, no data should be put into inputQ anymore.
|
2023-07-18 15:18:57 +08:00 |
|
yihaoDeng
|
40d59990d8
|
fix mem leak
|
2023-07-18 04:01:20 +00:00 |
|
Haojun Liao
|
08f43b9d00
|
fix(stream): fix checkpoint block not fetched bug.
|
2023-07-17 15:31:54 +08:00 |
Haojun Liao
|
b2a905bd91
|
Merge branch '3.0' into enh/triggerCheckPoint2
|
2023-07-17 11:50:12 +08:00 |
|
Haojun Liao
|
a9757637d9
|
Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2
|
2023-07-16 12:47:24 +08:00 |
|
Haojun Liao
|
c6a322e0ef
|
refactor(stream): back pressure is active, which is trigger by dispatch rsp.
|
2023-07-16 12:47:08 +08:00 |
|
yihaoDeng
|
e18c9ea672
|
add checkpoint
|
2023-07-15 04:26:34 +00:00 |
|
yihaoDeng
|
ed931c1100
|
Merge branch 'fix/newCheckpoint' into enh/triggerCheckPoint2
|
2023-07-14 10:11:20 +00:00 |
|
yihaoDeng
|
3c4631ef1f
|
add checkpoint
|
2023-07-14 10:06:24 +00:00 |
|
Haojun Liao
|
2b85ea62aa
|
refactor: do some internal refactor.
|
2023-07-14 17:48:47 +08:00 |
|
Haojun Liao
|
eb7e6152ae
|
refactor(stream): do some internal refactor.
|
2023-07-14 17:21:20 +08:00 |
|
Haojun Liao
|
813f4cb363
|
refactor: do some internal refactor.
|
2023-07-13 16:32:25 +08:00 |
|
Haojun Liao
|
2f90a53548
|
fix(stream): set checkpoint id when expanding task.
|
2023-07-13 10:16:57 +08:00 |
|
Haojun Liao
|
fed3803739
|
fix(stream): fix memory leak.
|
2023-07-11 19:29:52 +08:00 |
|
Haojun Liao
|
09b764494d
|
fix(stream): set correct checkpoint version when starting stream tasks.
|
2023-07-11 14:03:43 +08:00 |
|
Haojun Liao
|
87bedef2cd
|
fix(stream): fix error in checkpointing.
|
2023-07-10 19:20:05 +08:00 |
|
Haojun Liao
|
4f534ce6e9
|
fix(stream): fix error in generating checkpoint.
|
2023-07-08 10:29:09 +08:00 |
|
Haojun Liao
|
a5c19427e7
|
fix(stream): send correct rsp to mnode.
|
2023-07-08 09:39:44 +08:00 |
|
Haojun Liao
|
9c30abf95b
|
fix(stream): fix error in generating checkpoint.
|
2023-07-07 21:38:53 +08:00 |
|
Haojun Liao
|
8298f30e56
|
fix(stream): fix bug in checkpoint.
|
2023-07-07 17:16:08 +08:00 |
|
Haojun Liao
|
47877898d0
|
enh(stream): generate the checkpoint framework.
|
2023-07-07 16:07:52 +08:00 |
|
Haojun Liao
|
d7101f7109
|
enh(stream): support dispatch checkpoint msg.
|
2023-07-06 18:26:22 +08:00 |
|
Haojun Liao
|
5a9461a69a
|
other: merge 3.0
|
2023-07-06 11:52:21 +08:00 |
|
Haojun Liao
|
f4a3567935
|
other: merge 3.0
|
2023-07-06 11:24:30 +08:00 |
|
Haojun Liao
|
03dbcbf055
|
refactor: do some internal refactor.
|
2023-07-05 15:55:55 +08:00 |
|
yihaoDeng
|
7d30a6e27a
|
vnode snapshot read
|
2023-06-30 11:48:46 +00:00 |
|
Haojun Liao
|
57fcd553f8
|
refactor: do some internal refactor.
|
2023-06-28 13:13:13 +08:00 |
|
Haojun Liao
|
a19e63fd23
|
fix(stream): fix error in handling fill history.
|
2023-06-27 23:00:14 +08:00 |
|
Haojun Liao
|
b73444b291
|
fix(stream): start stream task in case of scan history completing.
|
2023-06-27 09:44:51 +08:00 |
|
Haojun Liao
|
402c091df0
|
fix(stream): fix sma error.
|
2023-06-25 19:41:44 +08:00 |
liuyao
|
41c193945f
|
fill history pause&resume
|
2023-06-19 17:28:19 +08:00 |
yihaoDeng
|
0eeaab9cd3
|
Merge branch 'refact/fillhistory1' into refact/fillhistory
|
2023-06-19 13:53:37 +08:00 |
|
yihaoDeng
|
b6fe5d917b
|
refactor checkpoint
|
2023-06-17 14:05:49 +08:00 |
|
Haojun Liao
|
64365666b7
|
fix(stream): update the info, and do some internal refactor.
|
2023-06-16 16:04:43 +08:00 |
|
yihaoDeng
|
9f9171719a
|
support fill history
|
2023-06-15 21:29:52 +08:00 |
|
liuyao
|
693942b821
|
trans state
|
2023-06-15 14:13:17 +08:00 |
|
Haojun Liao
|
53377c2c1f
|
fix(stream): wait for stream task completed.
|
2023-06-15 01:14:41 +08:00 |
|
liuyao
|
9a3708e17b
|
pause&resume fill history
|
2023-06-14 15:54:07 +08:00 |
|
Haojun Liao
|
7c6fbd7772
|
enh(stream): do some internal refactor and support secondary scan for history data.
|
2023-06-14 14:10:09 +08:00 |
|
Haojun Liao
|
11f0c3b336
|
refactor: do some internal refactor.
|
2023-06-14 10:46:46 +08:00 |
|
Haojun Liao
|
b44447e6f3
|
enh(stream): support restore from disk.
|
2023-06-14 10:19:03 +08:00 |
|
Haojun Liao
|
97da2a8fac
|
fix(stream): set the fill history status.
|
2023-06-13 16:10:55 +08:00 |
|
Haojun Liao
|
fb24ed161d
|
enh(stream): set correct task status.
|
2023-06-12 22:48:23 +08:00 |
|
Haojun Liao
|
78a240be8f
|
enh(stream): add dispatch msg.
|
2023-06-12 13:12:45 +08:00 |
|
yihaoDeng
|
a2030dc378
|
add trigger checkpoint
|
2023-06-09 12:12:51 +00:00 |
|
Haojun Liao
|
69c9eda7af
|
fix(stream): fix race condition.
|
2023-06-09 11:37:38 +08:00 |
|
Haojun Liao
|
53246ed6bb
|
other: merge other branch.
|
2023-06-09 09:41:10 +08:00 |
|
Haojun Liao
|
6c13491428
|
refactor: do some internal refactor.
|
2023-06-08 16:55:41 +08:00 |
|
yihaoDeng
|
8b91617145
|
Merge branch 'enh/dv3' into enh/triggerCheckpoint
|
2023-06-08 07:20:41 +00:00 |
|
yihaoDeng
|
77f287d9be
|
add trigger checkpoint
|
2023-06-08 07:19:59 +00:00 |
|
Haojun Liao
|
30eba472c3
|
Merge pull request #21602 from taosdata/fix/TD-24600-dv3
fix/td-24600-dv3
|
2023-06-08 13:42:02 +08:00 |
|
Haojun Liao
|
cb26dd9fa2
|
refactor(stream): do some internal refactor.
|
2023-06-08 10:17:21 +08:00 |
|
Haojun Liao
|
06cf3588da
|
refactor: do some internal refactor.
|
2023-06-07 15:03:04 +08:00 |
|
liuyao
|
1e9c4d5fac
|
opt stream block dispatch
|
2023-06-07 10:45:27 +08:00 |
|
Haojun Liao
|
6a3c935b4a
|
fix(stream): fix error in fill history scan.
|
2023-06-07 09:15:55 +08:00 |
|
Haojun Liao
|
0dd933013c
|
enh(stream): make history task for stream running.
|
2023-06-05 17:58:00 +08:00 |
|
Haojun Liao
|
fcc706c45c
|
enh(stream): refactor the fill history task.
|
2023-06-05 15:59:01 +08:00 |
|
yihaoDeng
|
74d5f02969
|
fix invalid free
|
2023-06-05 04:56:07 +00:00 |
|
Haojun Liao
|
077e1a1ed4
|
Merge branch '3.0' into refact/fillhistory
|
2023-06-05 11:41:13 +08:00 |
|
yihaoDeng
|
32c3cfd51a
|
Avoid creating the same ID task multiple times
|
2023-06-01 11:13:27 +00:00 |
|
Haojun Liao
|
eda06081ff
|
enh(stream): refactor and serialize the attributes of history tasks.
|
2023-05-30 16:55:37 +08:00 |
|
Haojun Liao
|
be8fd9e48b
|
enh(stream): create additional task for history data processing.
|
2023-05-30 14:47:10 +08:00 |
|
Haojun Liao
|
3628888ecc
|
refactor: do some internal refactor.
|
2023-05-29 18:02:45 +08:00 |
|
Haojun Liao
|
f2887278e2
|
refactor: do some internal refactor.
|
2023-05-29 15:44:45 +08:00 |
|
Haojun Liao
|
de44c9160c
|
refactor: do some internal refactor.
|
2023-05-20 18:05:39 +08:00 |
|
Haojun Liao
|
6ded3284da
|
refactor: do some internal refactor.
|
2023-05-20 11:37:17 +08:00 |
|
yihaoDeng
|
9380b22394
|
merge 3.0
|
2023-05-18 05:46:38 +00:00 |
|
Haojun Liao
|
ffee5ebc61
|
Merge branch '3.0' into feature/3_liaohj
|
2023-05-17 17:47:44 +08:00 |
|
Haojun Liao
|
041ffa91bd
|
other: merge main.
|
2023-05-17 15:42:15 +08:00 |
|
Haojun Liao
|
e35d145734
|
fix(stream): fix memory leak.
|
2023-05-16 13:59:13 +08:00 |
|
yihaoDeng
|
9c0d2c87c6
|
Merge branch 'enh/3.0' into enh/rocksdbSstateMerge
|
2023-05-15 01:52:42 +00:00 |
|
Haojun Liao
|
8e15c64499
|
refactor: do some internal refactor.
|
2023-05-13 23:22:36 +08:00 |
|
Haojun Liao
|
236926b9ee
|
other: merge enh/rocksdbstate
|
2023-05-13 19:49:28 +08:00 |
|
liuyao
|
8b7b804606
|
opt partition by tbname
|
2023-05-11 18:47:27 +08:00 |
|
yihaoDeng
|
4e8f5f5d32
|
factor code
|
2023-05-11 09:58:53 +00:00 |
|
yihaoDeng
|
afaee9c386
|
factor code
|
2023-05-11 09:51:01 +00:00 |
|
yihaoDeng
|
4715aacd41
|
factor code
|
2023-05-11 09:44:40 +00:00 |
|
yihaoDeng
|
f652f71d68
|
factor code
|
2023-05-11 06:37:57 +00:00 |
|
Haojun Liao
|
dbd79cc80c
|
refactor: do some internal refactor.
|
2023-05-10 22:22:01 +08:00 |
|
yihaoDeng
|
55014aa003
|
Merge branch 'enh/rocksdbSstate' into enh/rocksdbSstateMerge
|
2023-05-09 08:58:51 +00:00 |
|
yihaoDeng
|
08c3a63341
|
Merge branch 'enh/standVer' into enh/rocksdbSstateMerge
|
2023-05-06 12:37:54 +00:00 |
|
Haojun Liao
|
da6212bab0
|
other: merge main.
|
2023-05-06 12:51:38 +08:00 |
|
Haojun Liao
|
8958aabe4b
|
fix(stream): opt task scan performance.
|
2023-05-05 19:33:30 +08:00 |
|
yihaoDeng
|
f7a7743af7
|
fix case failure
|
2023-05-05 08:32:33 +00:00 |
|
Haojun Liao
|
23c49594b7
|
other: merge main.
|
2023-05-04 16:41:53 +08:00 |
|
liuyao
|
d8a1f15d10
|
fix resum bug
|
2023-05-04 09:28:06 +08:00 |
|
Haojun Liao
|
3c61932ecc
|
refactor: do some internal refactor.
|
2023-05-01 19:28:54 +08:00 |
|
yihaoDeng
|
dda1c8803c
|
Merge branch 'enh/rocksdbSstate' into enh/rocksdbSstateMerge
|
2023-04-28 09:17:22 +00:00 |
|
yihaoDeng
|
36a4413bf1
|
merge rocksdb inst
|
2023-04-27 14:38:33 +00:00 |
|
Haojun Liao
|
b7040ed15e
|
enh(stream): support resume from the latest data, and do some internal refactor.
|
2023-04-27 15:07:54 +08:00 |
|
liuyao
|
641c707b37
|
pause&resume
|
2023-04-23 17:37:10 +08:00 |
|
54liuyao
|
5089528a02
|
feat:stream pause&resume
|
2023-04-23 15:08:51 +08:00 |
|
yihaoDeng
|
917b07348c
|
Merge branch 'fix/rocksdbState' into enh/rocksRevert
|
2023-04-23 02:37:26 +00:00 |
|
Haojun Liao
|
5e6c06e253
|
fix(stream): fix the race condition during create new stream tasks.
|
2023-04-20 23:21:18 +08:00 |
|
Haojun Liao
|
fb32ffd960
|
fix(stream): update the reference count value to be int32, insead of int8
|
2023-04-18 18:06:03 +08:00 |
|
Haojun Liao
|
1f3c8c3d80
|
fix(stream): update the ref type.
|
2023-04-18 17:15:31 +08:00 |
|
Haojun Liao
|
ac137b4b33
|
refactor: do some internal refactor.
|
2023-04-17 09:46:58 +08:00 |
|
Haojun Liao
|
be90d2c511
|
fix(stream): disable stream task when no tasks exist.
|
2023-04-16 23:07:54 +08:00 |
|
Haojun Liao
|
ab4b08a4b5
|
Merge branch 'feature/3_liaohj' into enh/rocksRevert
|
2023-04-14 17:44:50 +08:00 |
|
Haojun Liao
|
e0cb8aa534
|
fix(stream): don't the initial task status and do some internal refactor.
|
2023-04-14 17:43:37 +08:00 |
|
Haojun Liao
|
eb0e1f848a
|
fix(stream): remove unused tqreader, do some internal refactor, set the meta value for streamtask.
|
2023-04-14 12:00:09 +08:00 |
|
Haojun Liao
|
b57c813681
|
other: merge feature/3_liaohj
|
2023-04-14 10:36:54 +08:00 |
|
Haojun Liao
|
70b45a4cf0
|
fix(stream): all data should be extracted from wal.
|
2023-04-13 23:22:09 +08:00 |
|
Haojun Liao
|
5ab54481f0
|
refactor: do some internal refactor.
|
2023-04-11 19:24:34 +08:00 |
|
yihaoDeng
|
b24b91886a
|
Merge branch 'dev3' into enh/rocksRevert
|
2023-04-11 10:59:00 +00:00 |
|
Haojun Liao
|
18479d8115
|
refactor: do some internall refactor.
|
2023-04-11 15:42:24 +08:00 |
|
Haojun Liao
|
15cceb5a5a
|
refactor: do some internal refactors.
|
2023-04-11 11:53:10 +08:00 |
|
Haojun Liao
|
a4ba5401f9
|
enh(stream): set the start version of all operators.
|
2023-04-11 10:01:36 +08:00 |
|
Haojun Liao
|
7419c0bfe9
|
enh(stream): the stream will start after vnode restore being completed.
|
2023-04-10 16:56:14 +08:00 |
|
Haojun Liao
|
f5b52749c2
|
refactor: do some internal refactor.
|
2023-04-09 01:39:09 +08:00 |
|
yihaoDeng
|
628bb62c8a
|
add backpressure
|
2023-04-04 07:20:05 +00:00 |
|
Haojun Liao
|
a3ac8b647c
|
refactor: do some internal refactor.
|
2023-04-03 18:20:35 +08:00 |
|
Haojun Liao
|
482c319bee
|
refactor: do some internal refactor.
|
2023-04-03 18:07:28 +08:00 |
|
Haojun Liao
|
3ef7d43dae
|
refactor: do some internal refactor.
|
2023-04-03 17:47:48 +08:00 |
|
Haojun Liao
|
9992942a7a
|
Merge pull request #20658 from taosdata/feat/TD-22418
feat:coverity scan
|
2023-03-29 10:44:53 +08:00 |
|
Haojun Liao
|
68f310dd48
|
refactor: do some internal refactor.
|
2023-03-28 15:05:10 +08:00 |
|
54liuyao
|
cf2d169f75
|
feat:coverity scan
|
2023-03-27 16:17:49 +08:00 |
|
54liuyao
|
1d58f85a54
|
feat:coverity scan
|
2023-02-22 10:10:04 +08:00 |
Xiaoyu Wang
|
c597de099f
|
merge main
|
2023-02-20 13:41:27 +08:00 |
Liu Jicong
|
2a4708d82a
|
fix: save fill history state
|
2023-02-16 17:01:09 +08:00 |
|
Xiaoyu Wang
|
eb86f5ae71
|
merge main
|
2023-01-28 18:10:08 +08:00 |
|
Xiaoyu Wang
|
24157e78d6
|
merge main
|
2023-01-28 17:52:58 +08:00 |
|
Liu Jicong
|
9913ed1dd1
|
fix: concurrency issue
|
2023-01-12 14:28:34 +08:00 |
|
Liu Jicong
|
bfb92457fa
|
refactor: stream dispatch
|
2022-12-29 16:24:30 +08:00 |
Shengliang Guan
|
d342ebcd77
|
Merge pull request #18720 from taosdata/refact/submit_req
Refact/submit req
|
2022-12-28 10:29:00 +08:00 |
|
Liu Jicong
|
dcb71e4af1
|
refactor: stream dispatch
|
2022-12-27 15:17:43 +08:00 |
|
Liu Jicong
|
74a253eac4
|
refactor
|
2022-12-08 13:34:42 +08:00 |
Shengliang Guan
|
6d94afe48f
|
Revert "refact: adjust some assert cases"
|
2022-12-07 21:51:17 +08:00 |
|
Shengliang Guan
|
d5126d469a
|
refact: replcase ASSERT with tAssert
|
2022-12-07 18:42:48 +08:00 |
|
Liu Jicong
|
b133a56219
|
refactor: support submitreq2
|
2022-12-07 15:19:34 +08:00 |
Minglei Jin
|
6cb65f336d
|
Merge branch 'v3.0' into feat/async_commit
|
2022-12-02 14:49:58 +08:00 |
|
Liu Jicong
|
3424b184d3
|
refactor(stream): distributed checkpoint
|
2022-12-02 03:48:45 +08:00 |
|
Minglei Jin
|
506554b5d2
|
Merge branch 'v3.0' into fix/tdb-async-commit
|
2022-11-28 16:20:48 +08:00 |
|
Liu Jicong
|
48894c8bdb
|
enh(stream): new api for stream queue
|
2022-11-25 18:03:40 +08:00 |
|
Minglei Jin
|
78335f83d2
|
tdb/api: migrate txn related api changes of meta, sma, tq, and stream meta/state
|
2022-11-17 20:02:13 +08:00 |
|
Liu Jicong
|
a9bf05bc01
|
refactor: stream meta ref count
|
2022-11-15 19:11:42 +08:00 |
|
Liu Jicong
|
bc469f7f7b
|
fix(stream): delete tb should be checked in write thread
|
2022-11-08 11:30:29 +08:00 |
|
Liu Jicong
|
2fbc8e6306
|
refactor(stream): stream deploy and state transfer
|
2022-11-03 13:22:23 +08:00 |
|
Liu Jicong
|
2e640c38a2
|
refactor: stream and tmq message
|
2022-10-31 18:37:28 +08:00 |
|
Liu Jicong
|
8d8fd2b2bc
|
refactor(stream): recover and fill history
|
2022-10-26 10:20:33 +08:00 |
|
Liu Jicong
|
75e5e490fd
|
refactor(stream): recover and fill history
|
2022-10-26 00:31:00 +08:00 |
|
Liu Jicong
|
e0b5b9263e
|
refactor: remove unused code
|
2022-10-21 10:42:24 +08:00 |
|
Liu Jicong
|
035e6b13c8
|
enh(stream): internal optimize
|
2022-10-21 10:29:05 +08:00 |
|
Liu Jicong
|
72fba5a8ce
|
fix(stream): check delete uid
|
2022-09-21 11:54:44 +08:00 |