Commit Graph

811 Commits

Author SHA1 Message Date
kailixu 74cddda24b Merge branch '3.0' into enh/TD-25601-3.0 2023-11-09 14:37:13 +08:00
kailixu 3495efaac7 enh: rsma exception process 2023-11-09 10:49:40 +08:00
dm chen dffc4d317f
Merge branch '3.0' into feat/TD-26529-3.0 2023-11-03 13:57:08 +08:00
wangmm0220 0a1f1085fc Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26060 2023-11-03 11:33:50 +08:00
dm chen 0371064acc
Merge branch '3.0' into feat/TD-26529-3.0 2023-11-03 10:20:54 +08:00
wangmm0220 159873692c feat:checkpoint bakeup using rsync 2023-11-02 20:13:29 +08:00
Minglei Jin 221afff9ee vnode/write: remove keep modify code block 2023-11-01 11:00:47 +08:00
Minglei Jin 64644d673b
Merge branch '3.0' into fix/TD-26189-last-tier-write 2023-11-01 10:53:55 +08:00
Haojun Liao a1aa2380ae other: merge 3.0 2023-10-31 16:42:51 +08:00
dmchen ffb1e1e8c3 end point 2023-10-30 12:05:20 +00:00
dmchen fe044051c8 memory leak 2023-10-30 19:36:27 +08:00
dmchen 5120d25297 memory leak 2023-10-30 11:34:34 +00:00
dmchen 0f40e1dbb9 memory leak 2023-10-30 16:59:12 +08:00
dmchen 40c9622df5 memory leak 2023-10-30 08:57:07 +00:00
dmchen be0a85a0ff memory leak 2023-10-30 15:22:54 +08:00
dmchen 6172b820ac memory leak 2023-10-30 07:19:08 +00:00
dmchen 43e6dec6c2 TD-26971 2023-10-27 17:39:50 +08:00
dmchen 34c4ffde26 TD-26971 2023-10-27 09:30:30 +00:00
Minglei Jin 8c6f452f09 tsdb/write: make last tier writable to mem 2023-10-27 15:51:52 +08:00
Haojun Liao dcca6b0868 other: merge 3.0. 2023-10-27 11:41:28 +08:00
Haojun Liao 9c9d02b181 fix(stream): disable follower nodes exec reset. 2023-10-27 09:59:52 +08:00
dmchen ca5e252c0c atomic init 2023-10-27 01:20:33 +00:00
dmchen 21dd6f70a9 atomic init 2023-10-27 01:16:53 +00:00
dmchen 9af7b7b178 init error 2023-10-26 11:50:34 +00:00
wade zhang 951442e3db
Merge pull request #23381 from taosdata/fix/TD-26884-main
TD-26884
2023-10-26 16:59:39 +08:00
dmchen 14be9c81e2 create table user and clusterid 2023-10-25 14:53:06 +08:00
dmchen 7ef019d105 create table user and clusterid 2023-10-25 06:49:23 +00:00
Haojun Liao f36b24ed24 fix(stream): disable follower nodes exec reset. 2023-10-25 14:16:36 +08:00
dmchen 162066235b create table 2023-10-24 14:31:27 +08:00
dmchen ae728ab412 create table 2023-10-24 06:17:13 +00:00
dmchen dec257ff59 TD-26529 2023-10-23 08:59:54 +00:00
Haojun Liao eb4449999f other: merge 3.0 2023-10-12 10:33:48 +08:00
Haojun Liao ee6516f3c4 enh(stream): add trans to reset task status to avoid being frozen in checkpoint status due to doing checkpoint failure of partial tasks. 2023-10-09 10:13:53 +08:00
Haojun Liao ff44539468 fix(stream): drop related fill-history task when dropping stream tasks. 2023-09-28 23:00:29 +08:00
Haojun Liao 31acbc6fe2 refactor: do some internal refactor (discard the checkpoint source msg during restoring). 2023-09-28 22:44:13 +08:00
Haojun Liao f2d8431619 fix(stream): enable new time range for stream task. 2023-09-28 18:26:52 +08:00
Haojun Liao f3f18b0fa3 fix(stream): add new status for meta. 2023-09-26 12:15:12 +08:00
Shungang Li 743a5b0640 feat: add db config item keep_time_offset 2023-09-25 15:46:08 +08:00
Haojun Liao dbc53069db
Merge branch 'main' into fix/liaohj 2023-09-25 10:41:18 +08:00
Haojun Liao 7d5f76c6f1 fix(stream): disable auto rsp for checkpoint source. 2023-09-23 11:31:14 +08:00
Haojun Liao 55d4a9686c log(tsdb): remove some logs. 2023-09-20 13:18:42 +08:00
Haojun Liao 392aaeb592 log(stream): remove logs. 2023-09-20 10:49:18 +08:00
kailixu a9d30f25d2 enh: rsma support delete raw data 2023-09-20 10:11:03 +08:00
dmchen e36ff1282c revert dependency 2023-09-19 13:42:02 +08:00
slzhou 900aacd428 fix: fix sanitizer error 2023-09-19 09:40:00 +08:00
dmchen b473122dac break dependency 2023-09-18 12:29:08 +08:00
dm chen fda32dcc51
Merge branch 'main' into feat/TD-26127-audit-sql 2023-09-18 09:41:47 +08:00
dmchen c674e025e2 skip auto create tb 2023-09-18 09:29:51 +08:00
Benguang Zhao bbcbe460d4 enh: ignore compact req during restoring 2023-09-14 16:17:17 +08:00
Benguang Zhao 2886913fd8 enh: ignore compact req during restoring 2023-09-14 16:09:00 +08:00
dapan1121 5c21f1ca22 fix: remove incorrect assert 2023-09-11 15:16:22 +08:00
Haojun Liao 372747cc23
Merge pull request #22818 from taosdata/fix/3_liaohj
fix(stream): fix error in fill history and check quit status of vnode.
2023-09-10 20:47:06 +08:00
Haojun Liao 47fd144447 other: add some logs. 2023-09-09 11:19:51 +08:00
Haojun Liao b317c8ebff fix(stream): disable merge submit blocks. 2023-09-08 12:46:15 +08:00
Shungang Li a6ba7e678f fix: search memory in ttlMgrFindExpired 2023-09-07 09:33:26 +08:00
dmchen 231ba12f70 feat/TD-26127 2023-09-06 11:00:24 +08:00
Haojun Liao c86eeb3938 fix(stream): add task status check when waiting for the table create. 2023-09-06 10:58:33 +08:00
dapan1121 cc17848b78 fix: merge 3.0 to main 2023-09-01 13:24:47 +08:00
wade zhang 68e4a72021
Merge pull request #22643 from taosdata/feat/audit-user-typestr
alter user type to str
2023-08-31 07:59:31 +08:00
dmchen 3d9274d713 create table db name 2023-08-30 17:28:03 +08:00
Haojun Liao 24b1a050fc other: merge 3.0 2023-08-30 16:00:14 +08:00
dmchen 1372cede48 init 2023-08-28 17:44:10 +08:00
yihaoDeng 20b037d9cc Merge branch 'enh/3.0' into enh/triggerCheckPoint2 2023-08-28 10:46:00 +08:00
dmchen 06083e1eb9 init 2023-08-28 09:15:51 +08:00
Haojun Liao 7ceb8dc627 fix(stream): disable the follower to execute the stop/resume instruction. 2023-08-25 19:20:49 +08:00
dapan1121 e24498b0fd enh: add task notify 2023-08-25 14:59:34 +08:00
yihaoDeng 9310d138a6 Merge branch 'enh/3.0' into enh/triggerCheckPoint2 2023-08-24 17:30:35 +08:00
Haojun Liao 230d8c2d80 fix(stream): fix error in stream computing after vnode is transferred to other dnodes. 2023-08-23 17:50:44 +08:00
Shungang Li 458fd07976 enh: ttl split flush and drop table
config:
1. ttlFlushThreshold: maximum number of dirty items in memory
2. tsTtlBatchDropNum: number of tables dropped per batch
3. tsTrimVDbIntervalSec: interval of trimming db in all vgroups
2023-08-23 11:13:34 +08:00
Haojun Liao af80d94a88 refactor: do some internal refactor. 2023-08-22 15:43:50 +08:00
Haojun Liao 64556c9f1d Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-08-22 10:47:02 +08:00
Haojun Liao def0877980 fix(stream): add timer to check stream task status. 2023-08-22 10:46:49 +08:00
yihaoDeng 1531e2d7d3 Merge branch 'enh/3.0' into enh/triggerCheckPoint2 2023-08-22 09:51:38 +08:00
dm chen dda51d8019
Merge branch '3.0' into feat/TD-22970 2023-08-21 10:50:45 +08:00
Minglei Jin c4a3a5da35 vnode: fix write to s3 last tier 2023-08-18 18:02:53 +08:00
Haojun Liao ea6574b3c7 other: merge 3.0 2023-08-17 00:07:55 +08:00
dm chen e020c4e8c5
Merge pull request #22456 from taosdata/3.0
merge 3.0 to feat/TD-22970
2023-08-16 16:49:43 +08:00
Haojun Liao 01ac99a651
Merge pull request #22413 from taosdata/fix/liaohj
refactor: refactor the transfer state procedure.
2023-08-13 23:28:18 +08:00
Haojun Liao 0d38f389ab refactor: do some internal refactor. 2023-08-13 16:25:35 +08:00
Haojun Liao e984affe90 fix(stream): disable the stream in the followers nodes. 2023-08-11 15:58:15 +08:00
Haojun Liao 6a9826cf6e enh(stream): update the stream task epset. 2023-08-11 10:37:25 +08:00
dm chen 70a598f072
Merge pull request #22355 from taosdata/3.0
merge 3.0 to TD-22970
2023-08-08 09:53:07 +08:00
Haojun Liao f8ee055641 other: merge 3.0 2023-08-08 00:19:08 +08:00
Haojun Liao 8a11a0418f other: merge 3.0 2023-08-07 09:19:26 +08:00
dm chen 5b03ab1705
Merge branch '3.0' into feat/TD-22970 2023-08-03 17:43:51 +08:00
Haojun Liao 13543f7daa feature(stream): handle task update in tq module. 2023-08-02 10:33:41 +08:00
wangmm0220 68ae64cdb2 fix:add committed & seek process logic 2023-07-31 18:53:25 +08:00
wangmm0220 cddf27e8b4 fix:add committed & seek process logic 2023-07-31 18:48:50 +08:00
wangmm0220 6179618b17 fix:add committed & seek process logic 2023-07-31 17:56:04 +08:00
Haojun Liao 8dfef8768a other: merge 3.0 2023-07-29 22:54:16 +08:00
Haojun Liao b145771a1b other: merge 3.0 2023-07-27 16:38:57 +08:00
Haojun Liao 3d403dca5a other: merge main. 2023-07-27 16:23:41 +08:00
Haojun Liao 1e34f84f78 other: merge 3.0 2023-07-24 15:23:03 +08:00
Haojun Liao 321be1f83f
Merge pull request #22135 from taosdata/fix/3_liaohj
refactor: do some internal refactor.
2023-07-22 15:06:28 +08:00
Haojun Liao 16d7707b90 fix(stream): align the scan real time data for stream task. 2023-07-21 19:33:43 +08:00
wangmm0220 5cb35f2fa6 feat:add committed & position & commite_offset interface 2023-07-19 17:29:39 +08:00
dmchen 3711fdd865 feat/TD-22970 2023-07-18 16:09:38 +08:00
Haojun Liao b2a905bd91
Merge branch '3.0' into enh/triggerCheckPoint2 2023-07-17 11:50:12 +08:00
Haojun Liao eb7e6152ae refactor(stream): do some internal refactor. 2023-07-14 17:21:20 +08:00
Hongze Cheng 145c43e346 little fix 2023-07-14 16:38:35 +08:00
Hongze Cheng 1fad69df3b Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-07-14 10:13:15 +08:00
Haojun Liao e0ea0f2df4
Merge pull request #22020 from taosdata/fix/liaohj
other: merge main
2023-07-13 17:55:28 +08:00
Hongze Cheng d81d2790ea Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-07-13 17:20:45 +08:00
Haojun Liao 2f90a53548 fix(stream): set checkpoint id when expanding task. 2023-07-13 10:16:57 +08:00
wangmm0220 cf64d4c9c5 fix:set get_assignment offset to first version of response block 2023-07-12 17:22:23 +08:00
Haojun Liao fed3803739 fix(stream): fix memory leak. 2023-07-11 19:29:52 +08:00
Haojun Liao 3ffdbe923d other: merge 3.0 2023-07-11 09:12:57 +08:00
Haojun Liao 9c30abf95b fix(stream): fix error in generating checkpoint. 2023-07-07 21:38:53 +08:00
Haojun Liao 128f67784a fix(stream): fix error in parsing checkpoint msg. 2023-07-07 18:17:50 +08:00
Haojun Liao 47877898d0 enh(stream): generate the checkpoint framework. 2023-07-07 16:07:52 +08:00
Hongze Cheng 090ca39132 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-07-07 10:38:04 +08:00
Haojun Liao d7101f7109 enh(stream): support dispatch checkpoint msg. 2023-07-06 18:26:22 +08:00
Haojun Liao 5a9461a69a other: merge 3.0 2023-07-06 11:52:21 +08:00
Haojun Liao f4a3567935 other: merge 3.0 2023-07-06 11:24:30 +08:00
Haojun Liao 03dbcbf055 refactor: do some internal refactor. 2023-07-05 15:55:55 +08:00
Hongze Cheng 1304c08cdd Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-07-05 10:57:55 +08:00
Haojun Liao 200575647c
Merge branch '3.0' into refact/fillhistory 2023-07-03 15:16:18 +08:00
Hongze Cheng 5390732f42 fix: coverity scan 2023-07-03 14:13:01 +08:00
Hongze Cheng 214c92264c Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-07-03 11:27:26 +08:00
Shungang Li 8f164a7922 fix: ttl compatibility 2023-06-30 14:57:34 +08:00
yihaoDeng 9eb6d8cf1e vnode snapshot read 2023-06-29 09:35:09 +00:00
Yihao Deng 4de7db06f9
Merge branch '3.0' into enh/triggerCheckPoint2 2023-06-27 17:57:14 +08:00
Haojun Liao 1ad05a06d6
Merge branch '3.0' into enh/tsdb_optimize 2023-06-27 11:46:37 +08:00
Haojun Liao 3289ad62be other: merge 3.0 2023-06-27 11:33:40 +08:00
dapan1121 4dae9f4eff merge main to 3.0 2023-06-26 18:43:00 +08:00
yihaoDeng 04ab8e19d0 Merge branch 'enh/dev30' into enh/triggerCheckPoint2 2023-06-25 19:58:45 +08:00
Haojun Liao 6857881742 Merge branch '3.0' into refact/fillhistory 2023-06-25 10:41:32 +08:00
Hongze Cheng 3582046129 fix coredump 2023-06-25 09:45:58 +08:00
Haojun Liao 3099ec31cb fix(tsdb): fix syntax error. 2023-06-25 09:36:43 +08:00
Haojun Liao dad1854cbb other: merge 3.0 2023-06-25 09:33:37 +08:00
wade zhang 254a20bdf3
Merge pull request #21660 from luckeverda/feat/TD-23739
feat/TD-23739: enhance ttl, deletetime modified by writing-op
2023-06-25 09:06:57 +08:00
Haojun Liao ceb78fdad2
Merge branch '3.0' into refact/fillhistory 2023-06-24 18:53:48 +08:00
Hongze Cheng 8855659534 more code 2023-06-20 18:23:58 +08:00
Shungang Li b93f653d7e feat: enhance ttl, deletetime modified by writing-ops
new config item: ttlChangeOnWrite (default 0)
ttl delete time changes on last write if true
2023-06-19 19:03:35 +08:00
yihaoDeng fd85a8495a Merge branch 'dev30' into enh/triggerCheckPoint2 2023-06-17 14:17:21 +08:00
kailixu 4097b860d3 enh: support delete tsma interval 2023-06-16 19:04:12 +08:00
Haojun Liao 64365666b7 fix(stream): update the info, and do some internal refactor. 2023-06-16 16:04:43 +08:00
Haojun Liao 74e0138f72 Merge branch '3.0' into refact/fillhistory 2023-06-15 15:25:00 +08:00
Haojun Liao 1b9eca5ce0 other: merge main. 2023-06-15 13:03:17 +08:00
Haojun Liao 844a23225a
Merge pull request #21600 from taosdata/mark/tmq
fix:check wal not exist again before register to push & move push log…
2023-06-14 10:18:39 +08:00
Haojun Liao 97da2a8fac fix(stream): set the fill history status. 2023-06-13 16:10:55 +08:00
Haojun Liao fb24ed161d enh(stream): set correct task status. 2023-06-12 22:48:23 +08:00
Haojun Liao 78a240be8f enh(stream): add dispatch msg. 2023-06-12 13:12:45 +08:00
Haojun Liao 53246ed6bb other: merge other branch. 2023-06-09 09:41:10 +08:00
Minglei Jin cab07b2736 vnode/svr: fix missing colon post vgId 2023-06-09 08:21:45 +08:00
yihaoDeng 77f287d9be add trigger checkpoint 2023-06-08 07:19:59 +00:00
Minglei Jin a6968485a8 enh(vnd/sync): refine invalid message log 2023-06-08 14:45:02 +08:00
Haojun Liao 6a3c935b4a fix(stream): fix error in fill history scan. 2023-06-07 09:15:55 +08:00
Haojun Liao 0dd933013c enh(stream): make history task for stream running. 2023-06-05 17:58:00 +08:00
wangmm0220 f2ee657b62 fix:check wal not exist again before register to push & move push logic from write thread to query thread 2023-06-05 17:21:47 +08:00