Commit Graph

12065 Commits

Author SHA1 Message Date
Haojun Liao 2ee3319611
Merge pull request #23360 from taosdata/fix/liaohj
fix(tsdb): apply the window range when building blocks from stt files.
2023-10-23 12:45:42 +08:00
Haojun Liao a882c639be fix(stream): remove invalid assert. 2023-10-22 16:16:59 +08:00
Haojun Liao 825195b351 refactor: do some internal refactor. 2023-10-21 16:38:46 +08:00
Haojun Liao 74572dd6a7 refactor: do some internal refactor. 2023-10-21 15:21:02 +08:00
Haojun Liao 49014d4b68 fix(stream): update the nodeEp even during checkpoint trans. 2023-10-21 01:42:43 +08:00
Haojun Liao f1207d8d42 fix(tsdb): apply the window range when building blocks from stt files. 2023-10-20 18:18:58 +08:00
Haojun Liao c4268ca395 fix(stream): fix bugs caused by refactor. 2023-10-20 15:54:30 +08:00
Haojun Liao 3b8c85f632 fix(stream): fix bugs caused by refactor sm. 2023-10-20 14:19:57 +08:00
yihaoDeng 1bc7e5eb85 enh gen first tag name 2023-10-20 14:02:13 +08:00
yihaoDeng e13fb887b8 enh gen first tag name 2023-10-20 10:47:27 +08:00
yihaoDeng 08fc4814cb enh gen first tag name 2023-10-20 10:43:44 +08:00
Haojun Liao 270a847809 fix(stream): fix bugs caused by refactor sm. 2023-10-20 10:23:48 +08:00
yihaoDeng 9f6dd2b405 change gen first tag name 2023-10-20 09:42:11 +08:00
Haojun Liao d5059826a8 fix(stream): fix bugs caused by refactor. 2023-10-19 17:59:04 +08:00
Haojun Liao c1cebae6ba fix(stream): fix error in stream. 2023-10-19 16:20:27 +08:00
Haojun Liao 402aefd95d refactor(stream): do some internal refactor. 2023-10-19 15:09:47 +08:00
Haojun Liao f4caeca24a refactor(stream): add state machine to manage the state of stream tasks. 2023-10-19 10:34:20 +08:00
Haojun Liao 54ec679b58 refactor(stream): do some internal refactor. 2023-10-18 15:34:53 +08:00
Haojun Liao df07443379
Merge pull request #23288 from taosdata/fix/liaohj
fix(stream):add more check for test cases.
2023-10-18 08:13:15 +08:00
Haojun Liao 531f478ade refactor: do some internal refactor W.R.T. global configurations. 2023-10-17 08:17:49 +08:00
yihaoDeng b793c92fed fix stream snap deadlock 2023-10-16 22:00:34 +08:00
yihaoDeng f1186be19a fix stream snap deadlock 2023-10-16 19:38:55 +08:00
yihaoDeng 0adefd5e59 fix stream snap deadlock 2023-10-16 19:26:33 +08:00
yihaoDeng 252b90bfab fix stream snap deadlock 2023-10-16 19:20:09 +08:00
Haojun Liao a1aa2c9e0c fix(stream):add more check for test cases. 2023-10-16 18:47:01 +08:00
Haojun Liao 8f2c1944c0 fix(tdsb): adjust the log level. 2023-10-16 11:55:57 +08:00
Haojun Liao ccecf05ff8 fix(tsdb): record the pinned block iter. 2023-10-16 11:48:57 +08:00
Haojun Liao 18bb27cdff fix(stream): fix syntax error. 2023-10-16 10:16:39 +08:00
Haojun Liao 67bee17e5e other: merge main. 2023-10-16 09:55:41 +08:00
Haojun Liao f751f2bb3d fix(tsdb): enable pin stt datablock. 2023-10-16 09:49:51 +08:00
Haojun Liao f90cf54714 fix(stream): fix error in creating update node trans. 2023-10-15 21:56:49 +08:00
wade zhang 0f9da01c88
Merge pull request #23264 from taosdata/3.0_main_merge.2
3.0 main merge
2023-10-14 09:45:49 +08:00
Haojun Liao 6611f216ac enh(stream): add some logs. 2023-10-13 19:45:29 +08:00
Haojun Liao bd72d080a9
Merge pull request #23242 from taosdata/fix/liaohj
refactor: do some internal refactor.
2023-10-13 16:40:14 +08:00
dapan1121 a418307570
Merge pull request #23236 from taosdata/fix/TD-26658-3.0
enh: close stt before untake read snap
2023-10-13 14:16:47 +08:00
Haojun Liao 0240ae87c3
Merge pull request #23241 from taosdata/3.0_main_merge
3.0 branch to main merge
2023-10-13 10:22:48 +08:00
Alex Duan 35fced8796
Merge pull request #23234 from taosdata/main_3_merge
other: merge main into 3.0
2023-10-12 07:48:20 -05:00
Haojun Liao 506c55001d fix(tsdb): fix race condition. 2023-10-12 17:57:03 +08:00
Haojun Liao b782af2534 fix(stream): avoid double free. 2023-10-12 17:56:42 +08:00
Haojun Liao 90f866352b
Merge pull request #23221 from taosdata/feat/TD-26052
fix:[TD-26671] judge if pointer is null to avoid core dump
2023-10-12 17:23:41 +08:00
kailixu 3d32d55ea5 enh: close stt before untake read snap 2023-10-12 16:44:55 +08:00
Haojun Liao eb4449999f other: merge 3.0 2023-10-12 10:33:48 +08:00
Hongze Cheng 11aa9326b9 fix more 2023-10-11 20:15:46 +08:00
dmchen c1e22eff1a fix/pr-23223-ci-core 2023-10-11 10:25:28 +00:00
Hongze Cheng 38b036ff36 fix: possible race condition 2023-10-11 17:39:58 +08:00
Haojun Liao ea6ffac403 refactor: do some internal refactor. 2023-10-11 16:51:27 +08:00
wangmm0220 f7d1e0ea82 fix:[TD-26671] judge if pointer is null to avoid core dump 2023-10-11 11:08:14 +08:00
Haojun Liao 15debda7cd refactor: update some logs. 2023-10-11 11:04:57 +08:00
Haojun Liao d58d663a36 refactor: update some logs. 2023-10-11 10:38:15 +08:00
Haojun Liao a03f09c00f refactor: update some logs. 2023-10-11 10:32:31 +08:00
Shungang Li 2c66f44b31 fix(tsdb): ensure sst trigger array size for upgrade 2023-10-10 21:07:08 +08:00
Haojun Liao b4d7e66f19 other: add some logs. 2023-10-10 19:57:17 +08:00
Haojun Liao 56147120b9 fix(tsdb): remove invalid assert, and do some internal refactor. 2023-10-10 17:04:12 +08:00
Haojun Liao 5f9b858fc1 other: merge main. 2023-10-10 15:38:46 +08:00
Haojun Liao adf6f65d09 fix(stream): set initial version for fill-history task. disable reentry of scan-history task function. 2023-10-10 14:00:30 +08:00
Alex Duan 9da96ebf63
Merge pull request #23017 from taosdata/case/TD-26408-MAIN
fix: add case for lost data after  split vgroup (main)
2023-10-10 00:54:34 -05:00
Hongze Cheng 1b559a0254
Merge pull request #23180 from taosdata/fix/TS-4121-main
fix(tsdb/cache reader): reset current fileset in cache reader
2023-10-09 20:46:33 -05:00
Hongze Cheng 4224f90661
Merge pull request #23184 from taosdata/enh/TS-4107
enh: clear files fset by fset
2023-10-09 20:05:12 -05:00
yihaoDeng 0fc6ffe6b6 change test case 2023-10-09 20:51:26 +08:00
kailixu f180a6e6f3 chore: remove macro for grant notify 2023-10-09 19:26:16 +08:00
Hongze Cheng cd61dd39fa
Merge pull request #23176 from taosdata/enh/TS-4103
enh: control number of stt files
2023-10-09 05:08:01 -05:00
kailixu 5dd277248e fix: alter active code for different server 2023-10-09 17:16:56 +08:00
Hongze Cheng e3525dba6e enh: clear files fset by fset 2023-10-09 17:11:50 +08:00
Hongze Cheng 258181e387 change block commit factor 2023-10-09 16:03:42 +08:00
wade zhang 7c738cbe0c
Merge pull request #23168 from taosdata/feat/TS-4036-main
feat: alter local/dnode asynclog
2023-10-09 15:44:39 +08:00
Haojun Liao 8266c4ff77 fix(stream): remove invalid clear of rspmsg list. 2023-10-09 15:26:42 +08:00
Minglei Jin 93438ed838 fix(tsdb/carch reader): reset current fileset in cache reader 2023-10-09 15:24:24 +08:00
Hongze Cheng 2c9a0dbcda enh: control stt max level 2023-10-09 14:00:11 +08:00
liuyao 1fbfdb5ab4 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26174 2023-10-09 11:40:27 +08:00
wade zhang 40ff071243
Merge pull request #23164 from taosdata/fix/TD-26587
fix(tsdb/retention): free fopArr & fs snapshot resources
2023-10-09 10:22:25 +08:00
Haojun Liao 74ff0c5b50 Merge branch 'main' into fix/liaohj 2023-10-09 10:14:53 +08:00
Haojun Liao ee6516f3c4 enh(stream): add trans to reset task status to avoid being frozen in checkpoint status due to doing checkpoint failure of partial tasks. 2023-10-09 10:13:53 +08:00
Haojun Liao 0fda1793e7 fix(stream): fix error in fill-history process. 2023-10-09 10:08:48 +08:00
liuyao 731d4fff27 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26174 2023-10-09 08:58:27 +08:00
Haojun Liao 167484ab3a
Merge pull request #23145 from taosdata/mark/tmq
opti:set default offset to latest in subscription
2023-10-08 18:56:37 +08:00
Hongze Cheng 880e8c1941 fix: block commit when there are too many stt file 2023-10-08 18:27:19 +08:00
Shungang Li a7507d26b0 feat: alter local/dnode asynclog 2023-10-08 18:26:25 +08:00
Minglei Jin ca809924cd fix(tsdb/retention): free fopArr & fs snapshot resources 2023-10-08 15:10:54 +08:00
dapan1121 9b207b9b3e
Merge pull request #23133 from taosdata/fix/TD-26474-3.0
fix: mutex init for trans
2023-10-08 15:07:47 +08:00
Hongze Cheng ba27cc0605 fix: fid overflow 2023-10-08 14:54:24 +08:00
liuyao ed8cad22cb Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26174 2023-10-08 13:31:51 +08:00
wade zhang a9db1ed8e0
Merge pull request #23116 from taosdata/fix/TD-26539
fix(keep0-duration): force keep0 at least thrice of duration
2023-10-08 13:07:05 +08:00
yihaoDeng 9d430c39ae fix mem leak 2023-10-08 11:47:06 +08:00
wangmm0220 fb3197ea89 fix:test case error for reset=latest 2023-10-08 10:55:35 +08:00
kailixu a2e3109447 chore: add grant method for community 2023-10-08 09:47:57 +08:00
liuyao c75506b271 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26174 2023-10-08 09:02:51 +08:00
dapan1121 61382c0793
Merge pull request #23126 from taosdata/fix/TD-26426-3.0
fix: support check/merge active code
2023-10-07 19:31:36 +08:00
Haojun Liao ab17bfdf09 refactor: do some internal refactor. 2023-10-07 19:16:55 +08:00
liuyao c088ee7f91 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26174 2023-10-07 19:13:07 +08:00
yihaoDeng 97fdcbc60b fix mem leak 2023-10-07 17:48:24 +08:00
kailixu b9767707cb chore: code optimization for array size 2023-10-07 15:57:26 +08:00
wangmm0220 9c470e9297 opti:set default offset to latest in subscription & return error if use snapshot when consume column 2023-10-07 15:25:24 +08:00
Hongze Cheng d1e59b9e0e enh: optimize merge strategy 2023-10-07 15:18:08 +08:00
Haojun Liao 7ce3d2c200 fix(stream): quit from loop when input queue is full. 2023-10-07 14:54:11 +08:00
Haojun Liao 115a284ac0 enh(stream): update the checkpoint interval 2023-10-07 09:56:03 +08:00
kailixu 85226d05a3 chore: code refactor for time series 2023-10-07 09:30:32 +08:00
Haojun Liao f542a8c786 fix(stream): update the sink data. 2023-10-07 09:22:25 +08:00
Haojun Liao 798f559b62 refactor(stream): revised the display info. 2023-10-07 09:04:38 +08:00
kailixu 6efe3845d4 chore: more logic 2023-10-07 07:02:16 +08:00
Haojun Liao c20dd002fb enh(stream): add more info for sink task. 2023-10-07 01:14:00 +08:00
kailixu c70a1b77e6 chore: code optimization for time series 2023-10-07 00:17:21 +08:00
kailixu c59498d90a chore: code refactor for time series statis 2023-10-06 07:37:18 +08:00
kailixu e4a86aa70a chore: remove obsolete codes 2023-10-05 23:52:50 +08:00
kailixu 07f043f143 enh: exclude sys tbl for time series 2023-10-05 23:48:52 +08:00
kailixu 47e79ff5b7 enh: exclude sys tbl for time series 2023-10-05 23:45:54 +08:00
kailixu d0a046c7a3 enh: exclude sys tbl for time series 2023-10-05 23:30:30 +08:00
kailixu 88fdeca5cf enh: dnode notify logic 2023-10-05 22:31:25 +08:00
kailixu dbfd282b13 Merge branch 'enh/TD-26532-3.0' of github.com:taosdata/TDengine into enh/TD-26532-3.0 2023-10-05 21:36:18 +08:00
kailixu 086213a6c2 enh: dnode notify logic 2023-10-05 21:35:57 +08:00
kailixu c339f3552a fix: mutex init for trans 2023-10-05 09:19:44 +08:00
Haojun Liao 5bf8d16ee1 refactor(stream): idle for 100ms when starting next round scan wal. 2023-10-04 23:33:03 +08:00
Haojun Liao 41ef1a45c1 enh(stream): optimize the scan wal perf 2023-10-04 22:06:46 +08:00
kailixu 578c9ad57d Merge branch '3.0' into enh/TD-26532-3.0 2023-10-03 23:29:02 +08:00
Haojun Liao 45e413f8d5 refactor: wait for 100ms before scan wal again. 2023-10-03 20:57:19 +08:00
Haojun Liao 132fb8e82e refactor: wait for more time for future data 2023-10-03 15:42:00 +08:00
Haojun Liao 58f410a9df refactor: do some internal refactor. 2023-10-03 02:37:52 +08:00
Haojun Liao a543f4ca97 refactor: do some internal refactor. 2023-10-03 01:52:03 +08:00
Haojun Liao 5564eb215c fix(stream): fix invalid check. 2023-10-03 00:38:24 +08:00
kailixu 53c4c56206 chore: code optimization 2023-10-02 09:23:51 +08:00
Haojun Liao 5718158fc0 refactor: do some internal refactor. 2023-10-01 22:27:29 +08:00
kailixu a19efd266e chore: more code 2023-10-01 21:55:17 +08:00
kailixu 5067eb8cc5 chore: more code for check active code 2023-09-30 16:00:14 +08:00
kailixu e677e41573 fix: support check and merge activeCode 2023-09-30 12:29:44 +08:00
Haojun Liao f3275f76e8 fix(stream): fix invalid param. 2023-09-28 23:31:07 +08:00
Haojun Liao c14873401f fix(stream): fix invalid param. 2023-09-28 23:26:46 +08:00
Haojun Liao ff44539468 fix(stream): drop related fill-history task when dropping stream tasks. 2023-09-28 23:00:29 +08:00
Haojun Liao 31acbc6fe2 refactor: do some internal refactor (discard the checkpoint source msg during restoring). 2023-09-28 22:44:13 +08:00
Haojun Liao f2d8431619 fix(stream): enable new time range for stream task. 2023-09-28 18:26:52 +08:00
Haojun Liao 0047d1e1a6 Merge branch 'main' into fix/liaohj 2023-09-28 14:35:14 +08:00
Haojun Liao 0a8f4530f7 fix(tsdb): replace destroy with reset. 2023-09-28 11:42:19 +08:00
Haojun Liao 80ec77cbb6 enh(stream): optimize the stream status when creating without fill-history option. 2023-09-28 11:23:03 +08:00
kailixu b1a0912a61 enh: exclude systables in log/audit db 2023-09-28 10:15:34 +08:00
wade zhang 10ad4600e4
Merge pull request #23104 from taosdata/fix/TD-26527
fix/TD-26527: alter database keep_time_offset can't changed
2023-09-28 09:33:00 +08:00
Haojun Liao 22e485d132 fix(stream): opt perf. 2023-09-28 09:25:23 +08:00
Haojun Liao 0f4e38faf7
Merge pull request #23094 from taosdata/fix/fixIpWhitelistAddUser
fix ip white for all users
2023-09-28 09:15:38 +08:00
Haojun Liao cc9b9d1054
Merge pull request #23102 from taosdata/fix/liaohj
fix(stream): fix several bugs and do some internal refactor for stream processing.
2023-09-28 09:12:39 +08:00
yihaoDeng 5a684f2a26 fix invalid read 2023-09-27 22:32:54 +08:00
Shungang Li 63ce2f6f2f fix: alter database keep_time_offset can't changed 2023-09-27 19:04:01 +08:00
yihaoDeng 28dbe36b91 fix ip white for all users 2023-09-27 16:41:29 +08:00
dapan1121 1088b80a46
Merge pull request #23062 from taosdata/enh/TD-25879-3.0x
enh: update dnode module
2023-09-27 16:18:38 +08:00
wade zhang 7b20090977
Merge pull request #23089 from taosdata/fix/TD-26489
fix(vnode/cos): use EIO as object put errno
2023-09-27 16:16:21 +08:00
yihaoDeng 62e1d4cb65 fix ip white for all users 2023-09-27 16:10:02 +08:00
yihaoDeng d0e1aec270 fix ip white for all users 2023-09-27 16:08:09 +08:00
yihaoDeng 48be800639 fix ip white for all users 2023-09-27 15:46:25 +08:00
Minglei Jin cd811577f3 fix(vnode/cos): use EIO as object put errno 2023-09-27 15:10:34 +08:00
Minglei Jin 5ce1dd6284 fix(tsdb/readerwriter): fix fd writing 2023-09-27 14:02:37 +08:00
Haojun Liao e13efd5b04 refactor: optimize the fill-history task launch policy, and do some other internal refactor. 2023-09-27 14:00:48 +08:00
wade zhang e6b0592629
Merge pull request #23081 from taosdata/fix/TD-26478-2
fix(tsdb/readerwriter): fix var shadowing
2023-09-27 08:37:17 +08:00
Haojun Liao c50e9c7b35
Merge pull request #23073 from taosdata/fix/ipWhiteListfix
fix ip white list
2023-09-26 21:39:50 +08:00
Minglei Jin e6287c1a89 fix(tsdb/readerwriter): fix var shadowing 2023-09-26 19:18:10 +08:00