c1f1709d59
fix: add rsmaSnapWriterPrepareClose
2023-10-19 11:18:57 +08:00
74185b8b9c
feat: exchange snapshot info for rsma tsdbs
2023-10-19 11:18:57 +08:00
b80f8201ce
feat: detect fs incompleteness of RSMA tsdbs
2023-10-19 11:04:39 +08:00
29bbebc323
enh: refactor a func name as tsdbSnapGetDetails
2023-10-19 11:04:39 +08:00
0c41fa56dc
feat: filter pExclude in tsdbFSCreateCopyRangedSnapshot
2023-10-19 11:00:44 +08:00
4d55488495
feat: use SSnapshotParam as a parameter to vnodeSnapReaderOpen
2023-10-19 10:37:34 +08:00
f8c6e8744a
refact: change field name of pExclude in SVSnapReader
2023-10-19 10:37:34 +08:00
1446b44733
fixup: remove minVer and maxVer in FSetWriterConfig
2023-10-19 10:17:34 +08:00
ab7a20c117
enh: write stt and data files with minVer and maxVer
2023-10-19 10:17:34 +08:00
1be2835fc1
enh: exclude a list of snap ranges in tsdbSnapReaderOpen
2023-10-19 10:17:34 +08:00
eb4449999f
other: merge 3.0
2023-10-12 10:33:48 +08:00
ee6516f3c4
enh(stream): add trans to reset task status to avoid being frozen in checkpoint status due to doing checkpoint failure of partial tasks.
2023-10-09 10:13:53 +08:00
ff44539468
fix(stream): drop related fill-history task when dropping stream tasks.
2023-09-28 23:00:29 +08:00
31acbc6fe2
refactor: do some internal refactor (discard the checkpoint source msg during restoring).
2023-09-28 22:44:13 +08:00
f2d8431619
fix(stream): enable new time range for stream task.
2023-09-28 18:26:52 +08:00
f6134b42d7
Merge pull request #23036 from taosdata/feat/TS-4011-3.0
...
feat/TS-4011: adjust config 'keep_time_offset' level from dnode to db
2023-09-26 14:25:54 +08:00
f3f18b0fa3
fix(stream): add new status for meta.
2023-09-26 12:15:12 +08:00
743a5b0640
feat: add db config item keep_time_offset
2023-09-25 15:46:08 +08:00
7d5f76c6f1
fix(stream): disable auto rsp for checkpoint source.
2023-09-23 11:31:14 +08:00
8f828e052b
enh: timeseries calculation optimization
2023-09-22 20:07:51 +08:00
7445b9ff50
Merge branch '3.0' into enh/TS-3812-3.0
2023-09-21 16:25:06 +08:00
a9d30f25d2
enh: rsma support delete raw data
2023-09-20 10:11:03 +08:00
01144c58a7
fix(stream): fix stream task id error.
2023-09-17 01:19:59 +08:00
03aea454d7
chore: more code
2023-09-15 14:33:35 +08:00
39fb5f4334
fix:add vnode snaphot for tmq
2023-09-13 18:09:47 +08:00
c86eeb3938
fix(stream): add task status check when waiting for the table create.
2023-09-06 10:58:33 +08:00
e53b5d4392
refactor: do some internal refactor.
2023-08-31 11:01:53 +08:00
d99d8875e1
fix(stream): if stream task is running, do not recheck its status.
2023-08-30 17:24:13 +08:00
0a72e576bd
op stream pause
...
pause data dispatch
opt stream pause
2023-08-30 14:53:49 +08:00
9310d138a6
Merge branch 'enh/3.0' into enh/triggerCheckPoint2
2023-08-24 17:30:35 +08:00
458fd07976
enh: ttl split flush and drop table
...
config:
1. ttlFlushThreshold: maximum number of dirty items in memory
2. tsTtlBatchDropNum: number of tables dropped per batch
3. tsTrimVDbIntervalSec: interval of trimming db in all vgroups
2023-08-23 11:13:34 +08:00
87c65f3b68
Merge remote-tracking branch 'origin/3.0' into enh/triggerCheckPoint2
2023-08-18 15:27:02 +08:00
85d1dbe00a
Merge branch '3.0' of github.com:taosdata/TDengine into szhou/select-tags-scan
2023-08-17 16:27:37 +08:00
4a9391929c
fix: select tags - ctb cursor pause/unlock and lock/resume
2023-08-17 14:59:17 +08:00
6746339609
Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2
...
# Conflicts:
# source/libs/stream/src/streamSnapshot.c
2023-08-17 00:08:44 +08:00
ea6574b3c7
other: merge 3.0
2023-08-17 00:07:55 +08:00
ad9f3cbc43
other: merge main.
2023-08-16 09:14:10 +08:00
39079ab64a
fix(stream): load term from sync model to decide if the node is restart or not
2023-08-15 15:52:06 +08:00
b1d35f43ba
enh(stream): using term from sync module to denote the upstream node is restarted/replica-modified/vnode-transferred or not.
2023-08-15 09:25:05 +08:00
246efd83c6
refactor chpt transfer
2023-08-14 02:03:41 +00:00
0d38f389ab
refactor: do some internal refactor.
2023-08-13 16:25:35 +08:00
6e6eb05d5c
Merge branch 'enh/triggerCheckPoint2' into enh/chkpTransfer
2023-08-11 08:03:02 +00:00
e984affe90
fix(stream): disable the stream in the followers nodes.
2023-08-11 15:58:15 +08:00
ba4ce9db02
Merge branch 'enh/triggerCheckPoint2' into enh/chkpTransfer
2023-08-11 02:15:07 +00:00
b2e615d4e7
enhance: tag scan cursor based block
2023-08-10 17:30:01 +08:00
eeb97351e8
support reopen stream state
2023-08-07 08:51:01 +00:00
f9d0874e45
support reopen stream state
2023-08-03 08:24:50 +00:00
13543f7daa
feature(stream): handle task update in tq module.
2023-08-02 10:33:41 +08:00
8dfef8768a
other: merge 3.0
2023-07-29 22:54:16 +08:00
b145771a1b
other: merge 3.0
2023-07-27 16:38:57 +08:00
3d403dca5a
other: merge main.
2023-07-27 16:23:41 +08:00
1e34f84f78
other: merge 3.0
2023-07-24 15:23:03 +08:00
321be1f83f
Merge pull request #22135 from taosdata/fix/3_liaohj
...
refactor: do some internal refactor.
2023-07-22 15:06:28 +08:00
16d7707b90
fix(stream): align the scan real time data for stream task.
2023-07-21 19:33:43 +08:00
5cb35f2fa6
feat:add committed & position & commite_offset interface
2023-07-19 17:29:39 +08:00
4b96bc7147
Merge branch '3.0' into enh/tsdb_optimize
2023-07-19 11:15:57 +08:00
fd02b9a71e
Merge branch '3.0' into enh/triggerCheckPoint2
2023-07-19 10:02:06 +08:00
6b6b7d8d8f
enh: alloc disk of vnode primary dir in vmAllocPrimaryDisk
2023-07-18 11:32:23 +08:00
b2a905bd91
Merge branch '3.0' into enh/triggerCheckPoint2
2023-07-17 11:50:12 +08:00
b21e603481
enh: add the field diskPrimary to vnodeGetPrimaryDir, and entries of vnodes.json
2023-07-17 11:48:48 +08:00
eb7e6152ae
refactor(stream): do some internal refactor.
2023-07-14 17:21:20 +08:00
25120cede4
fix sma merge error
2023-07-14 13:46:01 +08:00
466f1037b4
Merge branch '3.0' into enh/TD-23769-3.0
2023-07-12 18:50:16 +08:00
cf64d4c9c5
fix:set get_assignment offset to first version of response block
2023-07-12 17:22:23 +08:00
9484f3da94
Merge branch '3.0' into enh/triggerCheckPoint2
2023-07-12 10:20:18 +08:00
f282acbc4c
chore: rsma refactor
2023-07-12 10:13:50 +08:00
fed3803739
fix(stream): fix memory leak.
2023-07-11 19:29:52 +08:00
9c30abf95b
fix(stream): fix error in generating checkpoint.
2023-07-07 21:38:53 +08:00
128f67784a
fix(stream): fix error in parsing checkpoint msg.
2023-07-07 18:17:50 +08:00
47877898d0
enh(stream): generate the checkpoint framework.
2023-07-07 16:07:52 +08:00
cb8b10f6a2
Merge branch '3.0' into enh/TD-23769-3.0
2023-07-07 10:19:43 +08:00
64ef48e0dd
Merge branch '3.0' into enh/TD-23769-3.0
2023-07-07 10:17:25 +08:00
d7101f7109
enh(stream): support dispatch checkpoint msg.
2023-07-06 18:26:22 +08:00
a31e054146
fix: ttlmgr convert in metaUpgrade
2023-07-06 15:47:32 +08:00
a1a2b8331f
fix: ttl fill cache only in initialization
2023-07-06 15:47:32 +08:00
84740e96ee
Merge pull request #21939 from luckeverda/fix/TD-25074
...
fix/TD-25074
2023-07-06 15:44:22 +08:00
5a9461a69a
other: merge 3.0
2023-07-06 11:52:21 +08:00
e8cdf132fb
chore: rsma code refactor
2023-07-06 11:32:20 +08:00
f4a3567935
other: merge 3.0
2023-07-06 11:24:30 +08:00
df7866e9f6
chore: refactor
2023-07-05 19:08:43 +08:00
e6e52c3641
fix: ttlmgr convert in metaUpgrade
2023-07-05 17:44:17 +08:00
03dbcbf055
refactor: do some internal refactor.
2023-07-05 15:55:55 +08:00
dbf47f5fc1
fix: ttl fill cache only in initialization
2023-07-03 21:30:53 -04:00
6b6e237079
add checkpoint
2023-06-28 09:57:08 +00:00
871f66565d
add checkpoint
2023-06-28 07:02:20 +00:00
f6d5d0c8ca
add checkpoint
2023-06-28 02:39:01 +00:00
a824db4fd5
add checkpoint
2023-06-27 07:46:30 +00:00
04ab8e19d0
Merge branch 'enh/dev30' into enh/triggerCheckPoint2
2023-06-25 19:58:45 +08:00
6857881742
Merge branch '3.0' into refact/fillhistory
2023-06-25 10:41:32 +08:00
254a20bdf3
Merge pull request #21660 from luckeverda/feat/TD-23739
...
feat/TD-23739: enhance ttl, deletetime modified by writing-op
2023-06-25 09:06:57 +08:00
b93f653d7e
feat: enhance ttl, deletetime modified by writing-ops
...
new config item: ttlChangeOnWrite (default 0)
ttl delete time changes on last write if true
2023-06-19 19:03:35 +08:00
fd85a8495a
Merge branch 'dev30' into enh/triggerCheckPoint2
2023-06-17 14:17:21 +08:00
64365666b7
fix(stream): update the info, and do some internal refactor.
2023-06-16 16:04:43 +08:00
74e0138f72
Merge branch '3.0' into refact/fillhistory
2023-06-15 15:25:00 +08:00
1b9eca5ce0
other: merge main.
2023-06-15 13:03:17 +08:00
b44447e6f3
enh(stream): support restore from disk.
2023-06-14 10:19:03 +08:00
fb24ed161d
enh(stream): set correct task status.
2023-06-12 22:48:23 +08:00
78a240be8f
enh(stream): add dispatch msg.
2023-06-12 13:12:45 +08:00
53246ed6bb
other: merge other branch.
2023-06-09 09:41:10 +08:00
1f1f37312d
add trigger checkpoint
2023-06-07 14:32:48 +00:00
6a3c935b4a
fix(stream): fix error in fill history scan.
2023-06-07 09:15:55 +08:00
c4418046e1
Merge branch '3.0' into fix/TS-3247
2023-06-05 18:17:18 +08:00
f2ee657b62
fix:check wal not exist again before register to push & move push logic from write thread to query thread
2023-06-05 17:21:47 +08:00
d02746d86f
fix(query/sys): pause/resume with sys scan operator
2023-06-05 15:24:39 +08:00
fb2f367aac
meta/split: trim invalidated uids
2023-06-01 08:13:32 +08:00
8f61e2d6ef
refactor: do some internal refactor.
2023-05-29 10:50:50 +08:00
953a69a829
refactor: do some internal refactor.
2023-05-29 10:12:27 +08:00
cea8334427
Merge pull request #21449 from taosdata/refact/fillhistory
...
refactor: remove the module dependency. TD-24279
2023-05-26 09:01:45 +08:00
1f7f326bed
refactor: do some internal refactor and set the api function ptr.
2023-05-24 13:22:05 +08:00
208c9756cf
Merge pull request #21331 from taosdata/fix/TD-24097
...
enh(cache/batchread): load columns in one trip
2023-05-19 10:20:47 +08:00
81f821a6fc
refactor: do some internal refactor.
2023-05-18 10:51:43 +08:00
041ffa91bd
other: merge main.
2023-05-17 15:42:15 +08:00
b892b1fdfe
cache/flag: fix cache flag compiling issue
2023-05-17 15:26:10 +08:00
5e16db4e19
fix(stream):extract delete msg from wal.
2023-05-16 08:54:03 +08:00
170c603995
other: merge 3.0
2023-05-13 20:16:55 +08:00
7ef16e1922
other: merge main.
2023-05-12 11:49:53 +08:00
5708fcb5cb
Merge branch 'enh/3.0' into enh/rocksdbSstateMerge
2023-05-10 08:02:16 +00:00
2eec395720
cache/commit: flush cache when tsdb commits data
2023-05-08 11:14:59 +08:00
08c3a63341
Merge branch 'enh/standVer' into enh/rocksdbSstateMerge
2023-05-06 12:37:54 +00:00
29fcd1b83a
refactor: do some internal refactor.
2023-05-06 10:08:05 +08:00
23c49594b7
other: merge main.
2023-05-04 16:41:53 +08:00
09a04052ec
refactor: do some internal refactor.
2023-05-04 16:15:14 +08:00
1ee1b0422c
fix:change push mgr from SArray to Hash
2023-04-27 23:44:27 +08:00
f8bf98f6dc
Merge branch '3.0' into fix/TD-23623
2023-04-24 14:28:49 +08:00
057cc2d30d
Merge pull request #21018 from taosdata/feature/3_liaohj
...
fix(stream): set the correct start offset for stream task.
2023-04-24 12:02:20 +08:00
77e03bfd78
opti:change push mgr to consume msg for subscribe
2023-04-23 20:14:49 +08:00
5089528a02
feat:stream pause&resume
2023-04-23 15:08:51 +08:00
917b07348c
Merge branch 'fix/rocksdbState' into enh/rocksRevert
2023-04-23 02:37:26 +00:00
3dbe208712
enh(tmq): fix memory error and add retrieve wal info as required.
2023-04-22 15:34:46 +08:00
9918d326cc
Merge branch '3.0' into fix/TD-23623
2023-04-21 18:39:07 +08:00
f9801ba9c5
enh(stream): stop stream asap.
2023-04-20 18:58:07 +08:00
1e51b2d781
Merge branch '3.0' into fix/TD-23623
2023-04-20 16:32:43 +08:00
a21e0fe75e
enh: propose vnode commit synchronously
2023-04-20 14:28:56 +08:00
c654f1145d
enh(stream): add new msg for seek, and do some internal refactor.
2023-04-20 10:59:16 +08:00
ec4ea9cf5d
enh(cache/rocks): base for rocks put/get
2023-04-14 18:28:15 +08:00
f8b672f09f
other: merge main.
2023-04-14 09:07:18 +08:00
70b45a4cf0
fix(stream): all data should be extracted from wal.
2023-04-13 23:22:09 +08:00
7419c0bfe9
enh(stream): the stream will start after vnode restore being completed.
2023-04-10 16:56:14 +08:00
e9d7a099cc
merge main
2023-04-04 14:50:58 +08:00
4fd3064fd9
refactor: do some internal refactor.
2023-03-28 14:43:37 +08:00
5b02af6a91
fix: merge main to 3.0
2023-03-22 16:08:16 +08:00
731a2138df
fix(tmq): fix error in tmq.
2023-03-13 17:08:17 +08:00
564e9bb833
Merge branch 'main' into fix/liaohj
2023-03-12 14:38:38 +08:00
03aa391859
fix(tmq): add lock before close the tsdbreader.
2023-03-09 23:03:51 +08:00
89281ee488
compact with time range
2023-03-07 21:46:34 +08:00
424a37fd3a
some code
2023-03-07 10:20:48 +08:00
8e3084ecc0
feat: auto retention
2023-02-27 18:09:51 +08:00
1ab144609e
merge main
2023-02-23 14:58:22 +08:00
319dfd8f06
merge 3.0
2023-02-20 17:21:37 +08:00
c597de099f
merge main
2023-02-20 13:41:27 +08:00
Benguang Zhao
Haojun Liao
wade zhang
Shungang Li
kailixu
wangmm0220
liuyao
yihaoDeng
slzhou
yihaoDeng
Haojun Liao
Minglei Jin
liuyao
Hongze Cheng
Minglei Jin
Xiaoyu Wang
dapan1121