Commit Graph

1473 Commits

Author SHA1 Message Date
Haojun Liao c86eeb3938 fix(stream): add task status check when waiting for the table create. 2023-09-06 10:58:33 +08:00
Haojun Liao e8294ed8dc fix(stream): fix bug in multi-replica vnode redistribute. 2023-09-01 03:10:12 +08:00
Haojun Liao e2bb64eb18 refactor: do some internal refactor. 2023-08-31 14:23:46 +08:00
Haojun Liao e53b5d4392 refactor: do some internal refactor. 2023-08-31 11:01:53 +08:00
Haojun Liao d99d8875e1 fix(stream): if stream task is running, do not recheck its status. 2023-08-30 17:24:13 +08:00
Haojun Liao c5b279f045 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-08-30 16:01:08 +08:00
Haojun Liao 24b1a050fc other: merge 3.0 2023-08-30 16:00:14 +08:00
liuyao 0a72e576bd op stream pause
pause data dispatch

opt stream pause
2023-08-30 14:53:49 +08:00
Haojun Liao 204fb97f68 fix(stream): fix error in snode, fix memory leaks, fix repeatly create bug in sink task. 2023-08-29 17:34:31 +08:00
Shungang Li df2b2484df fix: ttl cache entry record the original information for deletion 2023-08-29 17:18:22 +08:00
yihaoDeng 9310d138a6 Merge branch 'enh/3.0' into enh/triggerCheckPoint2 2023-08-24 17:30:35 +08:00
Shungang Li 458fd07976 enh: ttl split flush and drop table
config:
1. ttlFlushThreshold: maximum number of dirty items in memory
2. tsTtlBatchDropNum: number of tables dropped per batch
3. tsTrimVDbIntervalSec: interval of trimming db in all vgroups
2023-08-23 11:13:34 +08:00
dm chen dda51d8019
Merge branch '3.0' into feat/TD-22970 2023-08-21 10:50:45 +08:00
yihaoDeng 6fe649c458 Merge branch 'enh/3.0' into enh/triggerCheckPoint2 2023-08-21 09:12:40 +08:00
Minglei Jin 7b4bb72392 fix(vnode/destroy): delete objects 2023-08-18 16:38:26 +08:00
Haojun Liao c26d625152
Merge branch '3.0' into enh/triggerCheckPoint2 2023-08-18 15:51:07 +08:00
liuyao 87c65f3b68 Merge remote-tracking branch 'origin/3.0' into enh/triggerCheckPoint2 2023-08-18 15:27:02 +08:00
dapan1121 9b953707b8 Merge remote-tracking branch 'origin/main' into fix/mainto3.0 2023-08-18 14:42:43 +08:00
dm chen e393a98ee9
Merge branch '3.0' into feat/TD-22970 2023-08-18 13:37:18 +08:00
slzhou 85d1dbe00a Merge branch '3.0' of github.com:taosdata/TDengine into szhou/select-tags-scan 2023-08-17 16:27:37 +08:00
shenglian zhou 4a9391929c fix: select tags - ctb cursor pause/unlock and lock/resume 2023-08-17 14:59:17 +08:00
Haojun Liao 6746339609 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2
# Conflicts:
#	source/libs/stream/src/streamSnapshot.c
2023-08-17 00:08:44 +08:00
Haojun Liao ea6574b3c7 other: merge 3.0 2023-08-17 00:07:55 +08:00
Haojun Liao 80506b564b
Merge pull request #22461 from taosdata/fix/liaohj
refactor: do some internal refactcor
2023-08-16 19:26:39 +08:00
Haojun Liao cbd24bb254 refactor: do some internal refactor 2023-08-16 18:20:34 +08:00
yihaoDeng ab7e2b3122 Merge branch 'enh/chkpTransfer' into enh/triggerCheckPoint2 2023-08-16 09:00:30 +00:00
dm chen e020c4e8c5
Merge pull request #22456 from taosdata/3.0
merge 3.0 to feat/TD-22970
2023-08-16 16:49:43 +08:00
Haojun Liao 6609882f9f fix(tsdb): add stt statistics block buffer, and do some internal refactor. 2023-08-16 10:55:07 +08:00
Haojun Liao ad9f3cbc43 other: merge main. 2023-08-16 09:14:10 +08:00
dapan1121 df13c6fa3e
Merge pull request #22410 from taosdata/szhou/tag-scan-opt
enhance: tag scan optimization
2023-08-16 08:58:17 +08:00
wade zhang 1a1a12b7b8
Merge pull request #22327 from taosdata/fix/TD-25010-3
feat(tsdb/cos): s3 migration
2023-08-16 08:02:20 +08:00
Haojun Liao 39079ab64a fix(stream): load term from sync model to decide if the node is restart or not 2023-08-15 15:52:06 +08:00
Minglei Jin bd758e0269 retention: remove old files last 2023-08-15 15:14:34 +08:00
Haojun Liao b1d35f43ba enh(stream): using term from sync module to denote the upstream node is restarted/replica-modified/vnode-transferred or not. 2023-08-15 09:25:05 +08:00
Haojun Liao ff17763ed6
Merge pull request #22417 from taosdata/mark/tmq
opti:wal logic
2023-08-15 09:16:29 +08:00
slzhou 646e52ae7f Merge branch '3.0' of github.com:taosdata/TDengine into szhou/tag-scan-opt 2023-08-14 10:19:36 +08:00
yihaoDeng 246efd83c6 refactor chpt transfer 2023-08-14 02:03:41 +00:00
Haojun Liao 01ac99a651
Merge pull request #22413 from taosdata/fix/liaohj
refactor: refactor the transfer state procedure.
2023-08-13 23:28:18 +08:00
Haojun Liao 0d38f389ab refactor: do some internal refactor. 2023-08-13 16:25:35 +08:00
wangmm0220 deda4b9eed opti:wal logic 2023-08-11 19:26:17 +08:00
wangmm0220 7b22d37f12 fix:lost data when consumer db 2023-08-11 17:25:43 +08:00
yihaoDeng 6e6eb05d5c Merge branch 'enh/triggerCheckPoint2' into enh/chkpTransfer 2023-08-11 08:03:02 +00:00
Haojun Liao e984affe90 fix(stream): disable the stream in the followers nodes. 2023-08-11 15:58:15 +08:00
wangmm0220 25e32bbf7c fix:offset error in tmq & add test cases 2023-08-11 14:25:12 +08:00
yihaoDeng ba4ce9db02 Merge branch 'enh/triggerCheckPoint2' into enh/chkpTransfer 2023-08-11 02:15:07 +00:00
shenglian zhou b2e615d4e7 enhance: tag scan cursor based block 2023-08-10 17:30:01 +08:00
wangmm0220 78fd70202c fix:offset error in tmq & add test cases 2023-08-10 16:18:53 +08:00
yihaoDeng eeb97351e8 support reopen stream state 2023-08-07 08:51:01 +00:00
Minglei Jin fac7e521e9 s3/evict: fetch atime from stat file 2023-08-07 15:59:37 +08:00
Haojun Liao 8a11a0418f other: merge 3.0 2023-08-07 09:19:26 +08:00