Commit Graph

461 Commits

Author SHA1 Message Date
Haojun Liao 2674698b36 fix(stream): restart tasks in stream threads, instead of write thread. 2023-11-07 18:51:46 +08:00
Haojun Liao 0b18192b23 fix(stream): fix error in finishing event handling. 2023-10-31 16:40:16 +08:00
Benguang Zhao 959f8105ee enh: require command to trigger repairing vnodes on replaced disks 2023-10-19 18:55:12 +08:00
Benguang Zhao c1f1709d59 fix: add rsmaSnapWriterPrepareClose 2023-10-19 11:18:57 +08:00
Benguang Zhao 74185b8b9c feat: exchange snapshot info for rsma tsdbs 2023-10-19 11:18:57 +08:00
Benguang Zhao b80f8201ce feat: detect fs incompleteness of RSMA tsdbs 2023-10-19 11:04:39 +08:00
Benguang Zhao 29bbebc323 enh: refactor a func name as tsdbSnapGetDetails 2023-10-19 11:04:39 +08:00
Benguang Zhao 0c41fa56dc feat: filter pExclude in tsdbFSCreateCopyRangedSnapshot 2023-10-19 11:00:44 +08:00
Benguang Zhao 4d55488495 feat: use SSnapshotParam as a parameter to vnodeSnapReaderOpen 2023-10-19 10:37:34 +08:00
Benguang Zhao f8c6e8744a refact: change field name of pExclude in SVSnapReader 2023-10-19 10:37:34 +08:00
Benguang Zhao 1446b44733 fixup: remove minVer and maxVer in FSetWriterConfig 2023-10-19 10:17:34 +08:00
Benguang Zhao ab7a20c117 enh: write stt and data files with minVer and maxVer 2023-10-19 10:17:34 +08:00
Benguang Zhao 1be2835fc1 enh: exclude a list of snap ranges in tsdbSnapReaderOpen 2023-10-19 10:17:34 +08:00
Haojun Liao eb4449999f other: merge 3.0 2023-10-12 10:33:48 +08:00
Haojun Liao ee6516f3c4 enh(stream): add trans to reset task status to avoid being frozen in checkpoint status due to doing checkpoint failure of partial tasks. 2023-10-09 10:13:53 +08:00
Haojun Liao ff44539468 fix(stream): drop related fill-history task when dropping stream tasks. 2023-09-28 23:00:29 +08:00
Haojun Liao 31acbc6fe2 refactor: do some internal refactor (discard the checkpoint source msg during restoring). 2023-09-28 22:44:13 +08:00
Haojun Liao f2d8431619 fix(stream): enable new time range for stream task. 2023-09-28 18:26:52 +08:00
wade zhang f6134b42d7
Merge pull request #23036 from taosdata/feat/TS-4011-3.0
feat/TS-4011: adjust config 'keep_time_offset' level from dnode to db
2023-09-26 14:25:54 +08:00
Haojun Liao f3f18b0fa3 fix(stream): add new status for meta. 2023-09-26 12:15:12 +08:00
Shungang Li 743a5b0640 feat: add db config item keep_time_offset 2023-09-25 15:46:08 +08:00
Haojun Liao 7d5f76c6f1 fix(stream): disable auto rsp for checkpoint source. 2023-09-23 11:31:14 +08:00
kailixu 8f828e052b enh: timeseries calculation optimization 2023-09-22 20:07:51 +08:00
kailixu 7445b9ff50 Merge branch '3.0' into enh/TS-3812-3.0 2023-09-21 16:25:06 +08:00
Haojun Liao 01144c58a7 fix(stream): fix stream task id error. 2023-09-17 01:19:59 +08:00
kailixu 03aea454d7 chore: more code 2023-09-15 14:33:35 +08:00
wangmm0220 39fb5f4334 fix:add vnode snaphot for tmq 2023-09-13 18:09:47 +08:00
Haojun Liao c86eeb3938 fix(stream): add task status check when waiting for the table create. 2023-09-06 10:58:33 +08:00
Haojun Liao e53b5d4392 refactor: do some internal refactor. 2023-08-31 11:01:53 +08:00
Haojun Liao d99d8875e1 fix(stream): if stream task is running, do not recheck its status. 2023-08-30 17:24:13 +08:00
liuyao 0a72e576bd op stream pause
pause data dispatch

opt stream pause
2023-08-30 14:53:49 +08:00
yihaoDeng 9310d138a6 Merge branch 'enh/3.0' into enh/triggerCheckPoint2 2023-08-24 17:30:35 +08:00
Shungang Li 458fd07976 enh: ttl split flush and drop table
config:
1. ttlFlushThreshold: maximum number of dirty items in memory
2. tsTtlBatchDropNum: number of tables dropped per batch
3. tsTrimVDbIntervalSec: interval of trimming db in all vgroups
2023-08-23 11:13:34 +08:00
liuyao 87c65f3b68 Merge remote-tracking branch 'origin/3.0' into enh/triggerCheckPoint2 2023-08-18 15:27:02 +08:00
slzhou 85d1dbe00a Merge branch '3.0' of github.com:taosdata/TDengine into szhou/select-tags-scan 2023-08-17 16:27:37 +08:00
shenglian zhou 4a9391929c fix: select tags - ctb cursor pause/unlock and lock/resume 2023-08-17 14:59:17 +08:00
Haojun Liao 6746339609 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2
# Conflicts:
#	source/libs/stream/src/streamSnapshot.c
2023-08-17 00:08:44 +08:00
Haojun Liao ea6574b3c7 other: merge 3.0 2023-08-17 00:07:55 +08:00
Haojun Liao ad9f3cbc43 other: merge main. 2023-08-16 09:14:10 +08:00
Haojun Liao 39079ab64a fix(stream): load term from sync model to decide if the node is restart or not 2023-08-15 15:52:06 +08:00
Haojun Liao b1d35f43ba enh(stream): using term from sync module to denote the upstream node is restarted/replica-modified/vnode-transferred or not. 2023-08-15 09:25:05 +08:00
yihaoDeng 246efd83c6 refactor chpt transfer 2023-08-14 02:03:41 +00:00
Haojun Liao 0d38f389ab refactor: do some internal refactor. 2023-08-13 16:25:35 +08:00
yihaoDeng 6e6eb05d5c Merge branch 'enh/triggerCheckPoint2' into enh/chkpTransfer 2023-08-11 08:03:02 +00:00
Haojun Liao e984affe90 fix(stream): disable the stream in the followers nodes. 2023-08-11 15:58:15 +08:00
yihaoDeng ba4ce9db02 Merge branch 'enh/triggerCheckPoint2' into enh/chkpTransfer 2023-08-11 02:15:07 +00:00
shenglian zhou b2e615d4e7 enhance: tag scan cursor based block 2023-08-10 17:30:01 +08:00
yihaoDeng eeb97351e8 support reopen stream state 2023-08-07 08:51:01 +00:00
yihaoDeng f9d0874e45 support reopen stream state 2023-08-03 08:24:50 +00:00
Haojun Liao 13543f7daa feature(stream): handle task update in tq module. 2023-08-02 10:33:41 +08:00