Haojun Liao
5a9461a69a
other: merge 3.0
2023-07-06 11:52:21 +08:00
Haojun Liao
f4a3567935
other: merge 3.0
2023-07-06 11:24:30 +08:00
Haojun Liao
03dbcbf055
refactor: do some internal refactor.
2023-07-05 15:55:55 +08:00
yihaoDeng
247d3ac7ee
vnode snapshot read
2023-06-30 12:05:05 +00:00
yihaoDeng
7d30a6e27a
vnode snapshot read
2023-06-30 11:48:46 +00:00
Haojun Liao
57fcd553f8
refactor: do some internal refactor.
2023-06-28 13:13:13 +08:00
Haojun Liao
a19e63fd23
fix(stream): fix error in handling fill history.
2023-06-27 23:00:14 +08:00
Haojun Liao
402c091df0
fix(stream): fix sma error.
2023-06-25 19:41:44 +08:00
yihaoDeng
0eeaab9cd3
Merge branch 'refact/fillhistory1' into refact/fillhistory
2023-06-19 13:53:37 +08:00
yihaoDeng
fd85a8495a
Merge branch 'dev30' into enh/triggerCheckPoint2
2023-06-17 14:17:21 +08:00
yihaoDeng
b6fe5d917b
refactor checkpoint
2023-06-17 14:05:49 +08:00
yihaoDeng
1e05f5c693
support fill history
2023-06-16 10:00:16 +08:00
yihaoDeng
0ef8afbdaa
support fill history
2023-06-16 09:32:38 +08:00
yihaoDeng
9f9171719a
support fill history
2023-06-15 21:29:52 +08:00
Haojun Liao
74e0138f72
Merge branch '3.0' into refact/fillhistory
2023-06-15 15:25:00 +08:00
yihaoDeng
52ca94ea6d
trigger checkpoint
2023-06-14 16:20:14 +08:00
Haojun Liao
b44447e6f3
enh(stream): support restore from disk.
2023-06-14 10:19:03 +08:00
Haojun Liao
53246ed6bb
other: merge other branch.
2023-06-09 09:41:10 +08:00
yihaoDeng
9828ca9d7f
add trigger checkpoint
2023-06-08 09:28:34 +00:00
Haojun Liao
06cf3588da
refactor: do some internal refactor.
2023-06-07 15:03:04 +08:00
yihaoDeng
66f483e51a
fix invalid free
2023-06-06 02:32:06 +00:00
Haojun Liao
0dd933013c
enh(stream): make history task for stream running.
2023-06-05 17:58:00 +08:00
Haojun Liao
fcc706c45c
enh(stream): refactor the fill history task.
2023-06-05 15:59:01 +08:00
yihaoDeng
74d5f02969
fix invalid free
2023-06-05 04:56:07 +00:00
yihaoDeng
1571ea844a
Avoid creating the same ID task multiple times
2023-06-01 11:25:55 +00:00
yihaoDeng
0315e89591
Avoid creating the same ID task multiple times
2023-06-01 11:13:01 +00:00
Haojun Liao
1e845acabe
fix(tmq): allow seek before get assignment
2023-05-26 11:34:12 +08:00
Haojun Liao
899e4d3350
refactor: do some internal refactor.
2023-05-20 18:13:58 +08:00
Haojun Liao
6ded3284da
refactor: do some internal refactor.
2023-05-20 11:37:17 +08:00
yihaoDeng
9c0d2c87c6
Merge branch 'enh/3.0' into enh/rocksdbSstateMerge
2023-05-15 01:52:42 +00:00
Haojun Liao
236926b9ee
other: merge enh/rocksdbstate
2023-05-13 19:49:28 +08:00
yihaoDeng
6cf1adf1b1
factor code
2023-05-11 13:01:45 +00:00
yihaoDeng
0710fc39af
factor code
2023-05-11 09:04:14 +00:00
yihaoDeng
f652f71d68
factor code
2023-05-11 06:37:57 +00:00
Haojun Liao
2b736ffd60
fix(stream): avoid duplicated task id in task id list.
2023-05-11 11:47:57 +08:00
Yihao Deng
c6e5879f44
Merge branch 'main' into enh/rocksdbSstate
2023-05-10 10:04:28 +08:00
yihaoDeng
8356533eb1
Merge branch 'enh/standVer' into enh/rocksdbSstateMerge
2023-05-09 12:13:16 +00:00
liuyao
8224d49702
fix:after restarting taosd, stream does not work.
2023-05-09 17:24:11 +08:00
yihaoDeng
55014aa003
Merge branch 'enh/rocksdbSstate' into enh/rocksdbSstateMerge
2023-05-09 08:58:51 +00:00
yihaoDeng
b5fdaa327d
avoid deadlock
2023-05-09 07:00:29 +00:00
yihaoDeng
08c3a63341
Merge branch 'enh/standVer' into enh/rocksdbSstateMerge
2023-05-06 12:37:54 +00:00
yihaoDeng
8be29dc98e
failed to open rocksdb cf
2023-05-06 10:35:23 +00:00
Haojun Liao
aca5760ceb
fix(query): fix syntax error.
2023-05-06 13:17:31 +08:00
Haojun Liao
da6212bab0
other: merge main.
2023-05-06 12:51:38 +08:00
Haojun Liao
8958aabe4b
fix(stream): opt task scan performance.
2023-05-05 19:33:30 +08:00
yihaoDeng
f7a7743af7
fix case failure
2023-05-05 08:32:33 +00:00
Haojun Liao
8b12d4d3da
fix(stream): secure the delete task operation. TD-1198
2023-05-05 15:02:03 +08:00
Haojun Liao
2b7a816b86
fix(tmq): fix syntax error.
2023-05-04 16:59:26 +08:00
Haojun Liao
23c49594b7
other: merge main.
2023-05-04 16:41:53 +08:00
yihaoDeng
c27d01a510
Merge branch 'enh/addTtlToStream' into enh/rocksdbSstateMerge
2023-05-04 08:22:31 +00:00
Haojun Liao
3c61932ecc
refactor: do some internal refactor.
2023-05-01 19:28:54 +08:00
Haojun Liao
b69137df44
refactor(log): add some logs.
2023-04-29 00:00:25 +08:00
yihaoDeng
dda1c8803c
Merge branch 'enh/rocksdbSstate' into enh/rocksdbSstateMerge
2023-04-28 09:17:22 +00:00
yihaoDeng
36a4413bf1
merge rocksdb inst
2023-04-27 14:38:33 +00:00
Haojun Liao
b7040ed15e
enh(stream): support resume from the latest data, and do some internal refactor.
2023-04-27 15:07:54 +08:00
yihaoDeng
917b07348c
Merge branch 'fix/rocksdbState' into enh/rocksRevert
2023-04-23 02:37:26 +00:00
Haojun Liao
6c641cff39
fix(stream): fix error in start stream tasks.
2023-04-21 09:37:16 +08:00
Haojun Liao
5e6c06e253
fix(stream): fix the race condition during create new stream tasks.
2023-04-20 23:21:18 +08:00
Haojun Liao
b60b1796f7
fix(stream): add lock during check wal to create new stream task.
2023-04-20 15:53:41 +08:00
Haojun Liao
9f16802451
fix(stream): set the initial value.
2023-04-18 16:42:40 +08:00
Haojun Liao
76becf59b7
Merge pull request #20947 from taosdata/feature/3_liaohj
...
fix(stream): set the correct initial checkpoint versions.
2023-04-18 11:26:48 +08:00
Haojun Liao
930b267a75
fix(stream): set the correct start offset for stream task.
2023-04-17 22:59:00 +08:00
liuyao
27d14f742d
fix:stream memory leak
2023-04-17 17:27:02 +08:00
Haojun Liao
a3b02a80c0
fix(stream): update the version when open stream tasks.
2023-04-15 00:10:08 +08:00
Haojun Liao
e05d61456a
fix(stream): disable the status check.
2023-04-14 22:45:22 +08:00
Haojun Liao
e0cb8aa534
fix(stream): don't the initial task status and do some internal refactor.
2023-04-14 17:43:37 +08:00
Haojun Liao
eb0e1f848a
fix(stream): remove unused tqreader, do some internal refactor, set the meta value for streamtask.
2023-04-14 12:00:09 +08:00
Haojun Liao
f8b672f09f
other: merge main.
2023-04-14 09:07:18 +08:00
Haojun Liao
70b45a4cf0
fix(stream): all data should be extracted from wal.
2023-04-13 23:22:09 +08:00
Haojun Liao
5ab54481f0
refactor: do some internal refactor.
2023-04-11 19:24:34 +08:00
Haojun Liao
18479d8115
refactor: do some internall refactor.
2023-04-11 15:42:24 +08:00
Haojun Liao
a4ba5401f9
enh(stream): set the start version of all operators.
2023-04-11 10:01:36 +08:00
Haojun Liao
7419c0bfe9
enh(stream): the stream will start after vnode restore being completed.
2023-04-10 16:56:14 +08:00
Haojun Liao
f5b52749c2
refactor: do some internal refactor.
2023-04-09 01:39:09 +08:00
yihaoDeng
e2646734ad
enh: add queue limit
2023-03-15 12:01:16 +00:00
yihaoDeng
ef092c1cce
enh: add queue limit
2023-03-15 11:54:36 +00:00
Haojun Liao
22aa03307c
fix(query): fix syntax errors on centos.
2023-02-24 11:38:54 +08:00
54liuyao
1d58f85a54
feat:coverity scan
2023-02-22 10:10:04 +08:00
Liu Jicong
2a4708d82a
fix: save fill history state
2023-02-16 17:01:09 +08:00
Liu Jicong
0cd6bd3d86
Merge branch 'main' into enh/stream_buffer_param
2023-02-13 09:48:02 +08:00
Liu Jicong
c8acfc4d54
fix: stream meta
2023-02-10 10:48:26 +08:00
Liu Jicong
98906bb272
remove assert
2023-01-29 15:24:31 +08:00
Liu Jicong
0c6f6d3a42
fix: task db
2023-01-28 10:59:09 +08:00
Benguang Zhao
4031dc1af4
Merge branch main into FIX/TD-21043-main
2023-01-02 16:41:46 +08:00
Benguang Zhao
3edde0eadf
fix: tdbAbort on metaClose or streamMetaClose instead of tdbTxnClose
2023-01-01 21:07:32 +08:00
Liu Jicong
4601e67e67
fix: reset stream status when load from disk
2022-12-30 16:59:48 +08:00
Benguang Zhao
6fc47beb71
enh: streamMetaCommit in sync with vnodeCommit
2022-12-28 14:34:23 +08:00
Minglei Jin
6cb65f336d
Merge branch 'v3.0' into feat/async_commit
2022-12-02 14:49:58 +08:00
Liu Jicong
3424b184d3
refactor(stream): distributed checkpoint
2022-12-02 03:48:45 +08:00
Minglei Jin
78335f83d2
tdb/api: migrate txn related api changes of meta, sma, tq, and stream meta/state
2022-11-17 20:02:13 +08:00
Liu Jicong
015c00aaca
fix(stream): timer refer stream task
2022-11-16 11:16:32 +08:00
Liu Jicong
a9bf05bc01
refactor: stream meta ref count
2022-11-15 19:11:42 +08:00
Liu Jicong
64f22d560c
refactor(stream): drop stream task
2022-11-10 16:36:49 +08:00
Minglei Jin
1a4cf6964b
fix: add post commit to tq & stream
2022-11-07 20:34:23 +08:00
Liu Jicong
8d8fd2b2bc
refactor(stream): recover and fill history
2022-10-26 10:20:33 +08:00
Liu Jicong
52b4b510a8
merge 3.0
2022-10-26 09:18:29 +08:00
Liu Jicong
75e5e490fd
refactor(stream): recover and fill history
2022-10-26 00:31:00 +08:00
Liu Jicong
5571ebee0f
Merge pull request #17542 from taosdata/feature/stream
...
enh(stream): internal optimize
2022-10-21 14:31:42 +08:00
Liu Jicong
26d4af6968
fix: memory leak
2022-10-21 11:42:30 +08:00
Liu Jicong
e0b5b9263e
refactor: remove unused code
2022-10-21 10:42:24 +08:00
Liu Jicong
035e6b13c8
enh(stream): internal optimize
2022-10-21 10:29:05 +08:00
54liuyao
86a858e04d
fix(stream): coverity scan
2022-10-20 11:41:20 +08:00
Hongze Cheng
eb7de2e571
Merge pull request #17443 from taosdata/fix/commit_txn
...
fix: commit txn
2022-10-19 13:15:15 +08:00
54liuyao
7f16081e29
feat(stream): stream task and meta
2022-10-19 10:49:42 +08:00
Minglei Jin
82132cdfdd
meta: new metaFinishCommit api & rollback parameter with metaOpen
2022-10-18 18:34:39 +08:00
Liu Jicong
a57a305035
fix(stream): memory leak
2022-10-14 14:43:22 +08:00
Zhiqiang Wang
d05b134a48
os: Mac package ( #17201 )
...
* os: Mac package
* os: Mac package
* os: Mac package
* os: Mac package
* os: Mac package
* os: Mac package
* os: Mac package
* os: Mac package
* os: Mac package
* os: Mac package
* os: Mac package
* os: Mac package
2022-10-08 10:12:17 +08:00
Minglei Jin
04e5c75bba
fix: cleanup memory with streamLoadTasks
2022-08-26 14:51:30 +08:00
Liu Jicong
d7b804e02e
fix stream load task
2022-08-24 10:42:34 +08:00
Liu Jicong
c296dd0a63
fix compile
2022-08-24 01:48:00 +08:00
Liu Jicong
2d628491b2
feat(stream): support tdb state backend
2022-08-23 19:30:04 +08:00
Liu Jicong
963287798d
refactor(mnode): drop stream task
2022-08-17 23:18:39 +08:00
Liu Jicong
853e6e2988
refactor(mnode): drop stream task
2022-08-17 19:19:58 +08:00
Liu Jicong
357b21cfeb
refactor(tmq): use tdb to store check info
2022-08-17 13:58:56 +08:00
Liu Jicong
ad032a0a90
enh(stream): stream recover
2022-08-09 10:36:27 +08:00
Liu Jicong
bb0ce39511
refactor(stream): add stream meta
2022-08-08 15:05:54 +08:00
Liu Jicong
43026ac31d
refactor(stream)
2022-08-08 11:29:50 +08:00
Liu Jicong
7c9d57bd89
refactor(stream): unify sink and dispatch
2022-08-05 20:16:47 +08:00
Liu Jicong
d43eec5d16
enh(stream): directly dispatch
2022-08-02 22:23:33 +08:00