7f93ec2c53
fix(stream): update the checkpoint info for followers, and some internal refactor.
2024-05-11 09:37:02 +08:00
04e78d0ce7
Merge branch 'feat/3.0' into feat/compress_3.0
2024-04-17 03:23:02 +00:00
e947a2fb0d
catalog cache get stream progress
2024-04-16 14:18:10 +08:00
ea9385912f
Merge branch '3.0' into feat/compress_3.0
2024-04-15 09:06:30 +00:00
4948bd690d
3.0 merge compress
2024-04-15 11:38:44 +08:00
6eb014e32b
Merge branch 'feat/TS-4243-3.0' into enh/TD-28945-pk
2024-04-09 19:11:46 +08:00
a407f76165
Merge branch '3.0' into enh/TD-28945
2024-04-08 10:55:47 +08:00
d5e9169769
cos/multi-write: dnode part including mnode/vnode/tsdb
2024-04-08 10:31:49 +08:00
b649a73a19
feat: pk insert/drop last cache
2024-04-07 17:30:54 +08:00
9ddc0b51cb
merge
2024-03-29 10:37:59 +08:00
fb2667d92d
fix: sys table scan and meta query
2024-03-22 10:33:46 +08:00
f607cd60e3
tsdb support compress
2024-03-15 10:22:57 +00:00
69741d6e10
fix/TS-4535
2024-03-07 06:33:45 +00:00
9762c53cf9
Merge pull request #24895 from taosdata/fix/nullcheck
...
enh(stream):rsp the checkpoint ready msg.
2024-02-27 14:42:00 +08:00
aee0460daf
enh(stream):rsp the checkpoint ready msg.
2024-02-27 11:15:09 +08:00
dafac591f7
enh(stream): add rsp for req-checkpoint
2024-02-27 10:53:25 +08:00
271e997438
Merge pull request #24823 from taosdata/3.0
...
merge 3.0
2024-02-22 12:47:42 +08:00
606aa61c4f
remove errors and delete
2024-02-21 08:06:45 +00:00
b361eb4a7c
fix(stream): add hb rsp handle function for vnode and snode.
2024-02-21 15:16:07 +08:00
6d2d37d964
Merge pull request #24751 from taosdata/3.0
...
merge 3.0
2024-02-06 19:16:53 +08:00
e5dcef0794
forward client directly
2024-02-06 08:29:09 +00:00
16aef66260
ci case fail
2024-02-05 01:34:20 +00:00
d59b767af3
enh(tsdb/cache): flag empty table when creating
2024-02-01 17:40:32 +08:00
8d683983e0
interface name
2024-01-29 10:11:17 +00:00
ac08f659c3
refactor: remove invalid procedure in fill-history.
2024-01-26 16:20:43 +08:00
d9af07de6f
new table structure
2024-01-24 09:44:44 +00:00
76e6c453e7
enh(stream): send msg to mnode when the transferring state completed.
2024-01-18 15:43:36 +08:00
a7c8563c06
fix: remove useless code
2023-12-25 16:13:30 +08:00
b175a4b7b3
refactor(stream): async stop tasks, and do some internal refactor.
2023-12-22 17:56:16 +08:00
39ea7d7567
Merge pull request #23980 from taosdata/fix/3_liaohj
...
fix(tsdb): opt read stt file
2023-12-09 21:28:52 +08:00
9c72ce846e
fix(tsdb): add more condition for not load data.
2023-12-08 14:23:37 +08:00
6c419423de
feat: impl tsdb snapshot reader and writer for raw files
2023-12-07 15:29:42 +08:00
fe258e226d
feat: add data type of SNAP_DATA_RAW for snap replication
2023-12-07 15:29:42 +08:00
f06117dbc9
fix:[TD-27644]heartbeat closed before snode close leading to snode is hanged
2023-12-01 17:32:29 +08:00
0bfa86f188
Merge pull request #23864 from taosdata/feat/TD-27461-3.0
...
feat: backgroud task priority
2023-11-30 13:51:57 +08:00
130614c938
Merge pull request #23831 from taosdata/fix/3_liaohj
...
enh(stream/tsdb): do multiple optimization and fix some bugs.
2023-11-30 09:20:15 +08:00
66f25712fd
fix(tsdb): fix bugs in suspend/resume. adjust code to conduct the test more easily. td-27579
2023-11-29 18:07:15 +08:00
65ccc4aa48
feat: backgroud task priority
2023-11-29 18:01:31 +08:00
06e2fbfb1c
fix:conflicts from 3.0
2023-11-27 17:53:53 +08:00
0a90c33b4d
fix(stream): drop the related fill-history task & set the task to be ready, if the drop fill-history task msg is missing due to the vnode restarting.
2023-11-23 15:49:07 +08:00
9a09e318ca
opti:common message process logic in vnode and snode
2023-11-22 16:53:33 +08:00
572eb691fb
enh: support delete msg for rsma
2023-11-09 19:51:01 +08:00
9cf154543f
chore: merge 3.0
2023-11-09 15:09:30 +08:00
74cddda24b
Merge branch '3.0' into enh/TD-25601-3.0
2023-11-09 14:37:13 +08:00
b9f389a49f
Merge branch '3.0' into enh/TD-23769-3.0x
2023-11-08 08:36:35 +08:00
2674698b36
fix(stream): restart tasks in stream threads, instead of write thread.
2023-11-07 18:51:46 +08:00
1530fe0c49
Merge branch '3.0' into enh/TD-23769-3.0x
2023-11-01 09:52:16 +08:00
e6684fa5de
enh: rsma retetion and stream state
2023-10-31 20:26:42 +08:00
0b18192b23
fix(stream): fix error in finishing event handling.
2023-10-31 16:40:16 +08:00
959f8105ee
enh: require command to trigger repairing vnodes on replaced disks
2023-10-19 18:55:12 +08:00
c1f1709d59
fix: add rsmaSnapWriterPrepareClose
2023-10-19 11:18:57 +08:00
74185b8b9c
feat: exchange snapshot info for rsma tsdbs
2023-10-19 11:18:57 +08:00
b80f8201ce
feat: detect fs incompleteness of RSMA tsdbs
2023-10-19 11:04:39 +08:00
29bbebc323
enh: refactor a func name as tsdbSnapGetDetails
2023-10-19 11:04:39 +08:00
0c41fa56dc
feat: filter pExclude in tsdbFSCreateCopyRangedSnapshot
2023-10-19 11:00:44 +08:00
4d55488495
feat: use SSnapshotParam as a parameter to vnodeSnapReaderOpen
2023-10-19 10:37:34 +08:00
f8c6e8744a
refact: change field name of pExclude in SVSnapReader
2023-10-19 10:37:34 +08:00
1446b44733
fixup: remove minVer and maxVer in FSetWriterConfig
2023-10-19 10:17:34 +08:00
ab7a20c117
enh: write stt and data files with minVer and maxVer
2023-10-19 10:17:34 +08:00
1be2835fc1
enh: exclude a list of snap ranges in tsdbSnapReaderOpen
2023-10-19 10:17:34 +08:00
eb4449999f
other: merge 3.0
2023-10-12 10:33:48 +08:00
ee6516f3c4
enh(stream): add trans to reset task status to avoid being frozen in checkpoint status due to doing checkpoint failure of partial tasks.
2023-10-09 10:13:53 +08:00
ff44539468
fix(stream): drop related fill-history task when dropping stream tasks.
2023-09-28 23:00:29 +08:00
31acbc6fe2
refactor: do some internal refactor (discard the checkpoint source msg during restoring).
2023-09-28 22:44:13 +08:00
f2d8431619
fix(stream): enable new time range for stream task.
2023-09-28 18:26:52 +08:00
f6134b42d7
Merge pull request #23036 from taosdata/feat/TS-4011-3.0
...
feat/TS-4011: adjust config 'keep_time_offset' level from dnode to db
2023-09-26 14:25:54 +08:00
f3f18b0fa3
fix(stream): add new status for meta.
2023-09-26 12:15:12 +08:00
743a5b0640
feat: add db config item keep_time_offset
2023-09-25 15:46:08 +08:00
7d5f76c6f1
fix(stream): disable auto rsp for checkpoint source.
2023-09-23 11:31:14 +08:00
8f828e052b
enh: timeseries calculation optimization
2023-09-22 20:07:51 +08:00
7445b9ff50
Merge branch '3.0' into enh/TS-3812-3.0
2023-09-21 16:25:06 +08:00
a9d30f25d2
enh: rsma support delete raw data
2023-09-20 10:11:03 +08:00
01144c58a7
fix(stream): fix stream task id error.
2023-09-17 01:19:59 +08:00
03aea454d7
chore: more code
2023-09-15 14:33:35 +08:00
39fb5f4334
fix:add vnode snaphot for tmq
2023-09-13 18:09:47 +08:00
c86eeb3938
fix(stream): add task status check when waiting for the table create.
2023-09-06 10:58:33 +08:00
e53b5d4392
refactor: do some internal refactor.
2023-08-31 11:01:53 +08:00
d99d8875e1
fix(stream): if stream task is running, do not recheck its status.
2023-08-30 17:24:13 +08:00
0a72e576bd
op stream pause
...
pause data dispatch
opt stream pause
2023-08-30 14:53:49 +08:00
9310d138a6
Merge branch 'enh/3.0' into enh/triggerCheckPoint2
2023-08-24 17:30:35 +08:00
458fd07976
enh: ttl split flush and drop table
...
config:
1. ttlFlushThreshold: maximum number of dirty items in memory
2. tsTtlBatchDropNum: number of tables dropped per batch
3. tsTrimVDbIntervalSec: interval of trimming db in all vgroups
2023-08-23 11:13:34 +08:00
87c65f3b68
Merge remote-tracking branch 'origin/3.0' into enh/triggerCheckPoint2
2023-08-18 15:27:02 +08:00
85d1dbe00a
Merge branch '3.0' of github.com:taosdata/TDengine into szhou/select-tags-scan
2023-08-17 16:27:37 +08:00
4a9391929c
fix: select tags - ctb cursor pause/unlock and lock/resume
2023-08-17 14:59:17 +08:00
6746339609
Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2
...
# Conflicts:
# source/libs/stream/src/streamSnapshot.c
2023-08-17 00:08:44 +08:00
ea6574b3c7
other: merge 3.0
2023-08-17 00:07:55 +08:00
ad9f3cbc43
other: merge main.
2023-08-16 09:14:10 +08:00
39079ab64a
fix(stream): load term from sync model to decide if the node is restart or not
2023-08-15 15:52:06 +08:00
b1d35f43ba
enh(stream): using term from sync module to denote the upstream node is restarted/replica-modified/vnode-transferred or not.
2023-08-15 09:25:05 +08:00
246efd83c6
refactor chpt transfer
2023-08-14 02:03:41 +00:00
0d38f389ab
refactor: do some internal refactor.
2023-08-13 16:25:35 +08:00
6e6eb05d5c
Merge branch 'enh/triggerCheckPoint2' into enh/chkpTransfer
2023-08-11 08:03:02 +00:00
e984affe90
fix(stream): disable the stream in the followers nodes.
2023-08-11 15:58:15 +08:00
ba4ce9db02
Merge branch 'enh/triggerCheckPoint2' into enh/chkpTransfer
2023-08-11 02:15:07 +00:00
b2e615d4e7
enhance: tag scan cursor based block
2023-08-10 17:30:01 +08:00
eeb97351e8
support reopen stream state
2023-08-07 08:51:01 +00:00
f9d0874e45
support reopen stream state
2023-08-03 08:24:50 +00:00
13543f7daa
feature(stream): handle task update in tq module.
2023-08-02 10:33:41 +08:00
8dfef8768a
other: merge 3.0
2023-07-29 22:54:16 +08:00
b145771a1b
other: merge 3.0
2023-07-27 16:38:57 +08:00
Haojun Liao
Yihao Deng
wangjiaming0909
yihaoDeng
Minglei Jin
Shungang Li
factosea
kailixu
dmchen
Haojun Liao
Hongze Cheng
Benguang Zhao
wangmm0220
wade zhang
liuyao
yihaoDeng
slzhou