Commit Graph

12266 Commits

Author SHA1 Message Date
Haojun Liao 5f9b858fc1 other: merge main. 2023-10-10 15:38:46 +08:00
Haojun Liao adf6f65d09 fix(stream): set initial version for fill-history task. disable reentry of scan-history task function. 2023-10-10 14:00:30 +08:00
Alex Duan 9da96ebf63
Merge pull request #23017 from taosdata/case/TD-26408-MAIN
fix: add case for lost data after  split vgroup (main)
2023-10-10 00:54:34 -05:00
wangmm0220 9113c3c3b6 fix:rollback removed code 2023-10-10 11:53:54 +08:00
Hongze Cheng 1b559a0254
Merge pull request #23180 from taosdata/fix/TS-4121-main
fix(tsdb/cache reader): reset current fileset in cache reader
2023-10-09 20:46:33 -05:00
Hongze Cheng 4224f90661
Merge pull request #23184 from taosdata/enh/TS-4107
enh: clear files fset by fset
2023-10-09 20:05:12 -05:00
yihaoDeng 0fc6ffe6b6 change test case 2023-10-09 20:51:26 +08:00
Haojun Liao af4618f958 fix(stream): remove invalid clear of rspmsg list. 2023-10-09 20:10:27 +08:00
Haojun Liao 21fb502690 enh(stream): add trans to reset task status to avoid being frozen in checkpoint status due to doing checkpoint failure of partial tasks. 2023-10-09 20:10:26 +08:00
Haojun Liao c5ee299d01 fix(stream): fix error in fill-history process. 2023-10-09 20:10:26 +08:00
Haojun Liao af2c0c95e9 refactor: do some internal refactor. 2023-10-09 20:10:22 +08:00
Haojun Liao 59e284c332 fix(stream): quit from loop when input queue is full. 2023-10-09 20:10:21 +08:00
Haojun Liao 9d5a3b8d78 other: merge stream fix. 2023-10-09 20:10:13 +08:00
Haojun Liao 11d8c8da39 fix(stream): update the sink data. 2023-10-09 20:09:23 +08:00
Haojun Liao f0c5b5a970 refactor(stream): revised the display info. 2023-10-09 20:09:22 +08:00
Haojun Liao 28008f8263 enh(stream): add more info for sink task. 2023-10-09 20:09:22 +08:00
Haojun Liao 65daf38715 refactor(stream): idle for 100ms when starting next round scan wal. 2023-10-09 20:09:22 +08:00
Haojun Liao cf14772dd9 enh(stream): optimize the scan wal perf 2023-10-09 20:09:21 +08:00
Haojun Liao d2160efa05 refactor: wait for 100ms before scan wal again. 2023-10-09 20:09:21 +08:00
Haojun Liao 932d93ab35 refactor: wait for more time for future data 2023-10-09 20:09:21 +08:00
Haojun Liao 0ab5d4b342 refactor: do some internal refactor. 2023-10-09 20:09:20 +08:00
Haojun Liao c295ec322a refactor: do some internal refactor. 2023-10-09 20:09:20 +08:00
Haojun Liao d5abb21335 fix(stream): fix invalid check. 2023-10-09 20:09:20 +08:00
Haojun Liao 583ac1fc45 refactor: do some internal refactor. 2023-10-09 20:09:20 +08:00
Haojun Liao 19042cdea6 fix(stream): fix invalid param. 2023-10-09 20:09:19 +08:00
Haojun Liao f9113ab7b0 fix(stream): fix invalid param. 2023-10-09 20:09:11 +08:00
Haojun Liao b0a4ed3217 fix(stream): drop related fill-history task when dropping stream tasks. 2023-10-09 20:09:10 +08:00
Haojun Liao 83f84d92bc refactor: do some internal refactor (discard the checkpoint source msg during restoring). 2023-10-09 20:09:10 +08:00
Haojun Liao bb4ba54f28 fix(stream): enable new time range for stream task. 2023-10-09 20:09:09 +08:00
Haojun Liao 6fbcf4b3d7 fix(tsdb): replace destroy with reset. 2023-10-09 20:09:09 +08:00
Haojun Liao c759d90bf6 enh(stream): optimize the stream status when creating without fill-history option. 2023-10-09 20:09:09 +08:00
Haojun Liao db897fb03a fix(stream): opt perf. 2023-10-09 20:09:09 +08:00
Haojun Liao dfe8641c0c refactor: optimize the fill-history task launch policy, and do some other internal refactor. 2023-10-09 20:08:52 +08:00
Haojun Liao a248f3d088 refactor: do some internal refactor. 2023-10-09 20:08:12 +08:00
Haojun Liao 0db357401d fix(stream): add new status for meta. 2023-10-09 20:08:12 +08:00
Haojun Liao 3912d80c02 fix(stream): do some internal refactor. 2023-10-09 20:08:11 +08:00
Haojun Liao feb09c8361 fix(stream): fix error in pause scan-history data. 2023-10-09 20:08:11 +08:00
Haojun Liao 6a98b11bef fix(stream): fix invalid read and memory leak. 2023-10-09 20:08:11 +08:00
Haojun Liao 65f66f0986 fix(stream): transfer state when all downstream rsp already. 2023-10-09 20:08:11 +08:00
Haojun Liao 4af7812f0b fix(stream): fix the invalid counter for ready tasks in vnode, fix an invalid read. 2023-10-09 20:08:10 +08:00
Haojun Liao 4fe1382cd9 fix(stream): adjust nodeUpdate check interval. 2023-10-09 20:08:09 +08:00
Haojun Liao f4f55fcbce fix(stream): record the tasks started info, and do some internal refactor. 2023-10-09 20:08:09 +08:00
Haojun Liao 68b003c804 fix(stream): fix race condition. 2023-10-09 20:08:09 +08:00
Haojun Liao 52763ca2a3 refactor: do some internal refactor. 2023-10-09 20:08:07 +08:00
Haojun Liao 012ddadf25 fix(stream): update logs. 2023-10-09 20:08:07 +08:00
Haojun Liao c05a8de3e8 fix(stream): rsp when checkpoint source failed. 2023-10-09 20:08:06 +08:00
Haojun Liao b4bc4fac98 fix(stream): disable auto rsp for checkpoint source. 2023-10-09 20:08:06 +08:00
Haojun Liao e671e87234 fix(stream): fix invalid assert. 2023-10-09 20:08:06 +08:00
Haojun Liao d1a6b8bd22 refactor: do some internal refactor. 2023-10-09 20:08:06 +08:00
Haojun Liao 46b17aa9f1 fix(stream): fix race condition. 2023-10-09 20:08:06 +08:00
Haojun Liao 5eee76df65 fix(stream): add msg identifier check. 2023-10-09 20:08:05 +08:00
Haojun Liao 2b16976902 refactor(stream): refactor send msg. 2023-10-09 20:08:03 +08:00
Haojun Liao 498519c94d fix(stream): remove invalid node. 2023-10-09 20:08:02 +08:00
Haojun Liao 27e00b1f19 fix(stream): add some logs, and remove invalid assert. 2023-10-09 20:08:02 +08:00
Haojun Liao 124e1ed1ab enh(stream): add stage info for streamt tasks. 2023-10-09 20:08:02 +08:00
Haojun Liao 12687eb287 fix(stream): add check info detailed information. 2023-10-09 20:08:02 +08:00
Haojun Liao ab7c18f604 refactor: do some internal refactor. 2023-10-09 20:08:01 +08:00
Haojun Liao e5535fa1f5 fix(stream): handle dispatch checkpoint-trigger failure. 2023-10-09 20:08:01 +08:00
Haojun Liao 7f4d9b6e41 fix(stream): wait for the task checkpoint before stop. 2023-10-09 20:07:53 +08:00
Haojun Liao 04405b84c5 fix(stream): update logs. 2023-10-09 20:07:53 +08:00
Haojun Liao 118e078f4a log(stream): update log. 2023-10-09 20:07:53 +08:00
Haojun Liao ef9efc8a8e refactor: do refactor the sink task. 2023-10-09 20:07:53 +08:00
Haojun Liao a3d13d6634 fix(stream): remove invalid cached task info in buffer. 2023-10-09 20:07:08 +08:00
Haojun Liao 1f45bd82d2 other: merge stream fix in main. 2023-10-09 20:07:01 +08:00
Haojun Liao 02610f5546 fix(stream): avoid invalid read. 2023-10-09 20:06:11 +08:00
Haojun Liao f5da458c77 fix(stream): unlock when returning. 2023-10-09 20:06:11 +08:00
Haojun Liao 36dcdad1a5 fix(stream): return if failed. 2023-10-09 20:06:10 +08:00
Haojun Liao d76e3ac718 fix(stream): add task status check. 2023-10-09 20:06:10 +08:00
Haojun Liao 29e1efb757 fix(stream): fix obj. 2023-10-09 20:06:10 +08:00
Haojun Liao a997fa5552 fix(stream): fix deadlock caused by streamTaskHalt function. 2023-10-09 20:06:09 +08:00
Haojun Liao dff4bd3c8d log(tsdb): remove some logs. 2023-10-09 20:06:09 +08:00
Haojun Liao 53237c34d1 enh(stream): add info in log. 2023-10-09 20:06:09 +08:00
Haojun Liao 8af76d28c8 log(stream): remove logs. 2023-10-09 20:06:09 +08:00
Haojun Liao e27111ecd1 enh(stream): add node stage check. 2023-10-09 20:06:09 +08:00
Haojun Liao 927f2d896c fix(stream): limit the max scan times. 2023-10-09 20:06:08 +08:00
Haojun Liao 1a86ee6517 refactor: update the log level. 2023-10-09 20:06:06 +08:00
Haojun Liao ff3ea366e2 fix(stream): keep the status entry in hash table, instead entry index. 2023-10-09 20:06:05 +08:00
Haojun Liao b95ad74c7f fix(stream): not handle the check msg for follower tasks. 2023-10-09 20:06:04 +08:00
Haojun Liao 38bf2d24e7 fix(stream): remove stream in buf. 2023-10-09 20:05:39 +08:00
Haojun Liao 636eccc160 fix(stream): add null check 2023-10-09 20:05:37 +08:00
Haojun Liao 57bf1cadc4 fix(stream): fix error in decode stream task. 2023-10-09 20:05:37 +08:00
Haojun Liao 0459a4628c fix(stream): fix stream task id error. 2023-10-09 20:05:36 +08:00
Haojun Liao 7ccc273206 other: merge stream fix in main. 2023-10-09 20:05:29 +08:00
Haojun Liao 98ef566eb4 fix(stream): remove fill-history sink task. 2023-10-09 20:04:17 +08:00
Haojun Liao e84eeee6b8 refactor: do some internal refactor. 2023-10-09 20:04:17 +08:00
Haojun Liao fe7864b976 fix(stream): fix error in drop task. 2023-10-09 20:04:17 +08:00
Haojun Liao c33e521aa1 fix(stream): update some logs. 2023-10-09 20:04:17 +08:00
Haojun Liao 5f1146d415 fix(stream): fix memory leak. 2023-10-09 20:04:17 +08:00
Haojun Liao 39e0c57323 fix(stream): set the correct guard flag. 2023-10-09 20:04:16 +08:00
Haojun Liao 3d1f29ff21 fix(stream): fix memory leak. 2023-10-09 20:04:16 +08:00
Haojun Liao 6fa54789cb fix(stream): disable follower send hb to mnode. and do some internal refactor. 2023-10-09 19:59:31 +08:00
Haojun Liao 1256eafddb other: merge stream fix. 2023-10-09 19:59:24 +08:00
Haojun Liao c6355fcc2f fix(tsdb): check return code. 2023-10-09 19:56:18 +08:00
Haojun Liao be09c173ab fix:fix coverity issue and remove unnecessary files. 2023-10-09 19:56:17 +08:00
Haojun Liao aaa12ed4f8 refactor: do some internal refactor about the sched status set 2023-10-09 19:56:17 +08:00
kailixu f180a6e6f3 chore: remove macro for grant notify 2023-10-09 19:26:16 +08:00
wangmm0220 3e2e924e98 feat:[TD-26056] add replay logic 2023-10-09 18:36:39 +08:00
dapan1121 d229492616 Merge remote-tracking branch 'origin/3.0' into feat/TD-25204 2023-10-09 18:34:08 +08:00
Hongze Cheng cd61dd39fa
Merge pull request #23176 from taosdata/enh/TS-4103
enh: control number of stt files
2023-10-09 05:08:01 -05:00
wangmm0220 33045e63ae feat:[TD-26056] add replay logic 2023-10-09 17:35:40 +08:00
dapan1121 6c8db261f3 feat: support show views command 2023-10-09 17:19:36 +08:00
kailixu 5dd277248e fix: alter active code for different server 2023-10-09 17:16:56 +08:00
Hongze Cheng e3525dba6e enh: clear files fset by fset 2023-10-09 17:11:50 +08:00
Hongze Cheng 258181e387 change block commit factor 2023-10-09 16:03:42 +08:00
wade zhang 7c738cbe0c
Merge pull request #23168 from taosdata/feat/TS-4036-main
feat: alter local/dnode asynclog
2023-10-09 15:44:39 +08:00
Haojun Liao 8266c4ff77 fix(stream): remove invalid clear of rspmsg list. 2023-10-09 15:26:42 +08:00
Minglei Jin 93438ed838 fix(tsdb/carch reader): reset current fileset in cache reader 2023-10-09 15:24:24 +08:00
Hongze Cheng 2c9a0dbcda enh: control stt max level 2023-10-09 14:00:11 +08:00
liuyao 1fbfdb5ab4 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26174 2023-10-09 11:40:27 +08:00
wade zhang 40ff071243
Merge pull request #23164 from taosdata/fix/TD-26587
fix(tsdb/retention): free fopArr & fs snapshot resources
2023-10-09 10:22:25 +08:00
Haojun Liao 74ff0c5b50 Merge branch 'main' into fix/liaohj 2023-10-09 10:14:53 +08:00
Haojun Liao ee6516f3c4 enh(stream): add trans to reset task status to avoid being frozen in checkpoint status due to doing checkpoint failure of partial tasks. 2023-10-09 10:13:53 +08:00
Haojun Liao 0fda1793e7 fix(stream): fix error in fill-history process. 2023-10-09 10:08:48 +08:00
liuyao 731d4fff27 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26174 2023-10-09 08:58:27 +08:00
wangmm0220 5f7b6f19ba feat:[TD-26056] add replay logic 2023-10-08 19:05:59 +08:00
Haojun Liao 167484ab3a
Merge pull request #23145 from taosdata/mark/tmq
opti:set default offset to latest in subscription
2023-10-08 18:56:37 +08:00
dapan1121 5b639a172d feat: support query from view 2023-10-08 18:36:06 +08:00
Hongze Cheng 880e8c1941 fix: block commit when there are too many stt file 2023-10-08 18:27:19 +08:00
Shungang Li a7507d26b0 feat: alter local/dnode asynclog 2023-10-08 18:26:25 +08:00
wangmm0220 b04d57fcc3 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26056 2023-10-08 16:15:19 +08:00
wangmm0220 3f2d890560 feat:[TD-26056] add replay logic 2023-10-08 16:06:15 +08:00
Minglei Jin ca809924cd fix(tsdb/retention): free fopArr & fs snapshot resources 2023-10-08 15:10:54 +08:00
dapan1121 9b207b9b3e
Merge pull request #23133 from taosdata/fix/TD-26474-3.0
fix: mutex init for trans
2023-10-08 15:07:47 +08:00
Hongze Cheng ba27cc0605 fix: fid overflow 2023-10-08 14:54:24 +08:00
liuyao ed8cad22cb Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26174 2023-10-08 13:31:51 +08:00
wade zhang a9db1ed8e0
Merge pull request #23116 from taosdata/fix/TD-26539
fix(keep0-duration): force keep0 at least thrice of duration
2023-10-08 13:07:05 +08:00
yihaoDeng 9d430c39ae fix mem leak 2023-10-08 11:47:06 +08:00
wangmm0220 fb3197ea89 fix:test case error for reset=latest 2023-10-08 10:55:35 +08:00
kailixu a2e3109447 chore: add grant method for community 2023-10-08 09:47:57 +08:00
liuyao c75506b271 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26174 2023-10-08 09:02:51 +08:00
dapan1121 61382c0793
Merge pull request #23126 from taosdata/fix/TD-26426-3.0
fix: support check/merge active code
2023-10-07 19:31:36 +08:00
Haojun Liao ab17bfdf09 refactor: do some internal refactor. 2023-10-07 19:16:55 +08:00
liuyao c088ee7f91 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26174 2023-10-07 19:13:07 +08:00
yihaoDeng 97fdcbc60b fix mem leak 2023-10-07 17:48:24 +08:00
kailixu b9767707cb chore: code optimization for array size 2023-10-07 15:57:26 +08:00
wangmm0220 9c470e9297 opti:set default offset to latest in subscription & return error if use snapshot when consume column 2023-10-07 15:25:24 +08:00
Hongze Cheng d1e59b9e0e enh: optimize merge strategy 2023-10-07 15:18:08 +08:00
Haojun Liao 7ce3d2c200 fix(stream): quit from loop when input queue is full. 2023-10-07 14:54:11 +08:00
dapan1121 deb9a6875b feat: mnode processing view meta request 2023-10-07 10:40:00 +08:00
Haojun Liao 115a284ac0 enh(stream): update the checkpoint interval 2023-10-07 09:56:03 +08:00
kailixu 85226d05a3 chore: code refactor for time series 2023-10-07 09:30:32 +08:00
Haojun Liao f542a8c786 fix(stream): update the sink data. 2023-10-07 09:22:25 +08:00
Haojun Liao 798f559b62 refactor(stream): revised the display info. 2023-10-07 09:04:38 +08:00
kailixu 6efe3845d4 chore: more logic 2023-10-07 07:02:16 +08:00
Haojun Liao c20dd002fb enh(stream): add more info for sink task. 2023-10-07 01:14:00 +08:00
kailixu c70a1b77e6 chore: code optimization for time series 2023-10-07 00:17:21 +08:00
kailixu c59498d90a chore: code refactor for time series statis 2023-10-06 07:37:18 +08:00
kailixu e4a86aa70a chore: remove obsolete codes 2023-10-05 23:52:50 +08:00
kailixu 07f043f143 enh: exclude sys tbl for time series 2023-10-05 23:48:52 +08:00
kailixu 47e79ff5b7 enh: exclude sys tbl for time series 2023-10-05 23:45:54 +08:00
kailixu d0a046c7a3 enh: exclude sys tbl for time series 2023-10-05 23:30:30 +08:00
kailixu 88fdeca5cf enh: dnode notify logic 2023-10-05 22:31:25 +08:00
kailixu dbfd282b13 Merge branch 'enh/TD-26532-3.0' of github.com:taosdata/TDengine into enh/TD-26532-3.0 2023-10-05 21:36:18 +08:00
kailixu 086213a6c2 enh: dnode notify logic 2023-10-05 21:35:57 +08:00
kailixu c339f3552a fix: mutex init for trans 2023-10-05 09:19:44 +08:00
Haojun Liao 5bf8d16ee1 refactor(stream): idle for 100ms when starting next round scan wal. 2023-10-04 23:33:03 +08:00
Haojun Liao 41ef1a45c1 enh(stream): optimize the scan wal perf 2023-10-04 22:06:46 +08:00
kailixu 578c9ad57d Merge branch '3.0' into enh/TD-26532-3.0 2023-10-03 23:29:02 +08:00
Haojun Liao 45e413f8d5 refactor: wait for 100ms before scan wal again. 2023-10-03 20:57:19 +08:00
Haojun Liao 132fb8e82e refactor: wait for more time for future data 2023-10-03 15:42:00 +08:00
Haojun Liao 58f410a9df refactor: do some internal refactor. 2023-10-03 02:37:52 +08:00
Haojun Liao a543f4ca97 refactor: do some internal refactor. 2023-10-03 01:52:03 +08:00
Haojun Liao 5564eb215c fix(stream): fix invalid check. 2023-10-03 00:38:24 +08:00
kailixu 53c4c56206 chore: code optimization 2023-10-02 09:23:51 +08:00
Haojun Liao 5718158fc0 refactor: do some internal refactor. 2023-10-01 22:27:29 +08:00
kailixu a19efd266e chore: more code 2023-10-01 21:55:17 +08:00
kailixu 5067eb8cc5 chore: more code for check active code 2023-09-30 16:00:14 +08:00
kailixu e677e41573 fix: support check and merge activeCode 2023-09-30 12:29:44 +08:00
Haojun Liao f3275f76e8 fix(stream): fix invalid param. 2023-09-28 23:31:07 +08:00
Haojun Liao c14873401f fix(stream): fix invalid param. 2023-09-28 23:26:46 +08:00
Haojun Liao ff44539468 fix(stream): drop related fill-history task when dropping stream tasks. 2023-09-28 23:00:29 +08:00
Haojun Liao 31acbc6fe2 refactor: do some internal refactor (discard the checkpoint source msg during restoring). 2023-09-28 22:44:13 +08:00
Haojun Liao f2d8431619 fix(stream): enable new time range for stream task. 2023-09-28 18:26:52 +08:00
Haojun Liao 0047d1e1a6 Merge branch 'main' into fix/liaohj 2023-09-28 14:35:14 +08:00
dapan1121 0a0f512023 feat: add view meta processing 2023-09-28 11:44:38 +08:00
Haojun Liao 0a8f4530f7 fix(tsdb): replace destroy with reset. 2023-09-28 11:42:19 +08:00
Haojun Liao 80ec77cbb6 enh(stream): optimize the stream status when creating without fill-history option. 2023-09-28 11:23:03 +08:00
kailixu b1a0912a61 enh: exclude systables in log/audit db 2023-09-28 10:15:34 +08:00
wade zhang 10ad4600e4
Merge pull request #23104 from taosdata/fix/TD-26527
fix/TD-26527: alter database keep_time_offset can't changed
2023-09-28 09:33:00 +08:00
Haojun Liao 22e485d132 fix(stream): opt perf. 2023-09-28 09:25:23 +08:00
Haojun Liao 0f4e38faf7
Merge pull request #23094 from taosdata/fix/fixIpWhitelistAddUser
fix ip white for all users
2023-09-28 09:15:38 +08:00
Haojun Liao cc9b9d1054
Merge pull request #23102 from taosdata/fix/liaohj
fix(stream): fix several bugs and do some internal refactor for stream processing.
2023-09-28 09:12:39 +08:00
yihaoDeng 5a684f2a26 fix invalid read 2023-09-27 22:32:54 +08:00
Shungang Li 63ce2f6f2f fix: alter database keep_time_offset can't changed 2023-09-27 19:04:01 +08:00
yihaoDeng 28dbe36b91 fix ip white for all users 2023-09-27 16:41:29 +08:00
dapan1121 1088b80a46
Merge pull request #23062 from taosdata/enh/TD-25879-3.0x
enh: update dnode module
2023-09-27 16:18:38 +08:00
wade zhang 7b20090977
Merge pull request #23089 from taosdata/fix/TD-26489
fix(vnode/cos): use EIO as object put errno
2023-09-27 16:16:21 +08:00
yihaoDeng 62e1d4cb65 fix ip white for all users 2023-09-27 16:10:02 +08:00
yihaoDeng d0e1aec270 fix ip white for all users 2023-09-27 16:08:09 +08:00
yihaoDeng 48be800639 fix ip white for all users 2023-09-27 15:46:25 +08:00
Minglei Jin cd811577f3 fix(vnode/cos): use EIO as object put errno 2023-09-27 15:10:34 +08:00
Minglei Jin 5ce1dd6284 fix(tsdb/readerwriter): fix fd writing 2023-09-27 14:02:37 +08:00
Haojun Liao e13efd5b04 refactor: optimize the fill-history task launch policy, and do some other internal refactor. 2023-09-27 14:00:48 +08:00
wade zhang e6b0592629
Merge pull request #23081 from taosdata/fix/TD-26478-2
fix(tsdb/readerwriter): fix var shadowing
2023-09-27 08:37:17 +08:00
Haojun Liao c50e9c7b35
Merge pull request #23073 from taosdata/fix/ipWhiteListfix
fix ip white list
2023-09-26 21:39:50 +08:00
Minglei Jin e6287c1a89 fix(tsdb/readerwriter): fix var shadowing 2023-09-26 19:18:10 +08:00
dmchen a4c1611755 TD-26432 2023-09-26 11:06:44 +00:00
liuyao ebf4283e91 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26174 2023-09-26 17:19:41 +08:00
yihaoDeng 3b885f4faf fix ip white list 2023-09-26 17:04:25 +08:00
kailixu e1cd54a1b3 fix: rwlock reentrant problem on windows 2023-09-26 15:44:35 +08:00
kailixu c680180894 fix: rwlock reentrant problem on windows 2023-09-26 15:37:29 +08:00
kailixu e523d3d6a4 chore: remove obsolete codes 2023-09-26 14:34:42 +08:00
wade zhang f6134b42d7
Merge pull request #23036 from taosdata/feat/TS-4011-3.0
feat/TS-4011: adjust config 'keep_time_offset' level from dnode to db
2023-09-26 14:25:54 +08:00
Haojun Liao 890d658aea refactor: do some internal refactor. 2023-09-26 14:11:45 +08:00
Haojun Liao 525ee369d3
Merge pull request #23032 from taosdata/fix/liaohj
fix(stream): fix several stability-related bugs in stream framework.
2023-09-26 14:10:58 +08:00
Haojun Liao d5621b52d7
Merge pull request #23053 from taosdata/fix/26475
Fix/26475
2023-09-26 13:42:53 +08:00
kailixu 93bf7da254 chore: dm update 2023-09-26 13:22:38 +08:00
Haojun Liao f3f18b0fa3 fix(stream): add new status for meta. 2023-09-26 12:15:12 +08:00
Ping Xiao 4f23ea2a8c enh: dmodule logic 2023-09-26 11:47:53 +08:00
liuyao ca2325f886 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26174 2023-09-26 10:41:31 +08:00
Haojun Liao d214a2f6bd fix(stream): do some internal refactor. 2023-09-26 09:32:57 +08:00
Hongze Cheng 03456ce443 fix: upgrade error when has tomb data 2023-09-26 09:23:22 +08:00
wade zhang 92f5803303
Merge pull request #23050 from taosdata/fix/TD-26478
fix(cos): use EIO as failed code
2023-09-26 09:02:59 +08:00
Haojun Liao 6cc3618ed9 fix(stream): fix error in pause scan-history data. 2023-09-26 01:09:55 +08:00
Haojun Liao 5a4a0aa0e3 fix(stream): fix invalid read and memory leak. 2023-09-25 23:10:33 +08:00
wade zhang f2a7795cd6
Merge pull request #23037 from taosdata/enh/TS-3812-3.0
grant: enable update cluster info
2023-09-25 19:27:44 +08:00
yihaoDeng b134365d08 Merge branch '3.0' of https://github.com/taosdata/TDengine into 3.0 2023-09-25 18:40:10 +08:00
yihaoDeng 40a3c778f0 disable ip on community 2023-09-25 18:39:49 +08:00
Minglei Jin 7fd7902dda fix(cos): use EIO as failed code 2023-09-25 18:38:55 +08:00
Haojun Liao c9576d7a85 fix(stream): transfer state when all downstream rsp already. 2023-09-25 17:31:38 +08:00
Benguang Zhao 5d588cb7d2 enh: trigger failover if tsdbMerge failure 2023-09-25 17:22:38 +08:00
kailixu 126a371170 chore: more code 2023-09-25 16:24:03 +08:00
kailixu 0632fb838a chore: code refactor 2023-09-25 16:17:57 +08:00
kailixu 68fb1b296f chore: code refactor 2023-09-25 16:16:12 +08:00
Haojun Liao 966ce4f30e Merge remote-tracking branch 'origin/fix/liaohj' into fix/liaohj 2023-09-25 16:00:02 +08:00
Haojun Liao fcf4cc7169 fix(stream): fix the invalid counter for ready tasks in vnode, fix an invalid read. 2023-09-25 15:58:24 +08:00
kailixu b0b4d782fc chore: code refactor 2023-09-25 15:57:54 +08:00
Alex Duan c9af9eb15b
Merge pull request #22915 from lx1zhong/3.0
add TSZ and ADT-FSE algorithm
2023-09-25 15:48:30 +08:00
Shungang Li 8f0d700fe8 feat: rm dnode config item keepTimeOffset 2023-09-25 15:46:12 +08:00
Shungang Li 743a5b0640 feat: add db config item keep_time_offset 2023-09-25 15:46:08 +08:00
kailixu f689ef8fe4 chore: make jenkins happy 2023-09-25 15:41:23 +08:00
kailixu 4e0a5cb91a chore: macOS compile 2023-09-25 14:46:59 +08:00
kailixu 3083189f4d grant: enable update cluster info 2023-09-25 12:35:18 +08:00
Haojun Liao dbc53069db
Merge branch 'main' into fix/liaohj 2023-09-25 10:41:18 +08:00
Haojun Liao 1af95969b2 fix(stream): adjust nodeUpdate check interval. 2023-09-25 10:40:30 +08:00
Haojun Liao eb4078b7f3 fix(stream): record the tasks started info, and do some internal refactor. 2023-09-25 09:59:05 +08:00
Haojun Liao c987f61300 fix(stream): fix race condition. 2023-09-25 01:37:27 +08:00
kailixu 7b4ef6df96 fix: memory leak 2023-09-24 13:50:20 +08:00
kailixu c69b9e0197 chore: make jenkins happy 2023-09-24 09:45:19 +08:00
kailixu 986788d4fe enh: timeseries calculation 2023-09-24 09:14:52 +08:00
kailixu e50b8a3a0d chore: make jenkins happy for community 2023-09-24 08:48:14 +08:00
kailixu ff3e36e679 enh: timeseries calculation 2023-09-24 08:41:45 +08:00
kailixu 53a9459c20 enh: update timeseries 2023-09-24 07:52:27 +08:00
Haojun Liao 4ea737571d refactor: do some internal refactor. 2023-09-24 01:26:51 +08:00
kailixu bc8ebf1562 Merge branch '3.0' into enh/TS-3812-3.0 2023-09-23 18:19:08 +08:00
kailixu a4b92760f0 enh: grant notify optimize 2023-09-23 18:10:08 +08:00
Haojun Liao b58ec1ee57 fix(stream): update logs. 2023-09-23 15:22:48 +08:00
Haojun Liao acd3321494 fix(stream): rsp when checkpoint source failed. 2023-09-23 14:13:33 +08:00
Haojun Liao 7d5f76c6f1 fix(stream): disable auto rsp for checkpoint source. 2023-09-23 11:31:14 +08:00
Haojun Liao 5155519559 fix(stream): fix invalid assert. 2023-09-22 23:06:48 +08:00
Haojun Liao cf6c255f22 refactor: do some internal refactor. 2023-09-22 22:50:21 +08:00
kailixu 8f828e052b enh: timeseries calculation optimization 2023-09-22 20:07:51 +08:00
Haojun Liao fcbd747afc fix(stream): fix race condition. 2023-09-22 19:35:12 +08:00
liuyao 0d983e28ef Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26174 2023-09-22 19:25:41 +08:00
Haojun Liao 5b12e276cf fix(stream): add msg identifier check. 2023-09-22 18:13:18 +08:00
wade zhang 849b05a09b
Merge pull request #22927 from taosdata/fix/TD-26189
s3/block_cache: new tsdb block cache
2023-09-22 16:15:07 +08:00
liuyao 4f8e6d7795 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26174 2023-09-22 15:00:52 +08:00
Haojun Liao 898aea5cfb refactor(stream): refactor send msg. 2023-09-22 14:52:18 +08:00
Minglei Jin 4c151f2031 tsdb/readerwriter: remove size with download 2023-09-22 14:06:06 +08:00
Haojun Liao 7e4410f094
Merge pull request #22992 from taosdata/feat/TD-26052
feat:support vnode split in tmq
2023-09-22 13:57:21 +08:00
Haojun Liao 7380151322 fix(stream): remove invalid node. 2023-09-22 11:45:46 +08:00
Haojun Liao 87ea745861 fix(stream): add some logs, and remove invalid assert. 2023-09-22 10:53:03 +08:00
Haojun Liao 198e6bb023 enh(stream): add stage info for streamt tasks. 2023-09-22 10:36:15 +08:00
Haojun Liao f7bcff862d fix(stream): add check info detailed information. 2023-09-22 10:23:56 +08:00
wangmm0220 19806cbcab fix:memory leak 2023-09-22 10:12:11 +08:00
wangmm0220 5555371fbc fix:memory leak 2023-09-22 10:04:53 +08:00
wangmm0220 86a4bfe28d fix:memory leak 2023-09-22 10:02:16 +08:00
liuyao dc2f7872f8 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26174 2023-09-22 09:41:15 +08:00
wangmm0220 803b17a2db fix:memory leak 2023-09-22 09:31:58 +08:00
Haojun Liao b1ba716299 refactor: do some internal refactor. 2023-09-22 09:24:36 +08:00
Haojun Liao b075b4438b fix(stream): handle dispatch checkpoint-trigger failure. 2023-09-21 23:15:18 +08:00
Haojun Liao 3c921ba66e
Merge pull request #23006 from taosdata/fix/3_liaohj
fix(tsdb): set the correct scaninfo to load the tomb data.
2023-09-21 22:13:16 +08:00
kailixu 3beb9c5c84 Merge branch '3.0' into enh/TS-3812-3.0 2023-09-21 19:38:27 +08:00
dapan1121 a67b0c99fc feat: support create/drop view 2023-09-21 19:28:07 +08:00
Cary Xu 1bbb812557
Merge branch '3.0' into enh/TS-3934-3.0 2023-09-21 17:32:51 +08:00
Haojun Liao f93df639c1 fix(tsdb): set the correct scaninfo to load the tomb data. 2023-09-21 17:32:21 +08:00
dapan1121 64da3f4ef9
Merge pull request #22978 from taosdata/szhou/show-db-table
enhance: show normal/child tables and show user/system databases
2023-09-21 16:55:26 +08:00
Minglei Jin ce1f866416 tsdb/reader: use pTsdb handle instead of pgsz to open file 2023-09-21 16:36:17 +08:00
kailixu 7445b9ff50 Merge branch '3.0' into enh/TS-3812-3.0 2023-09-21 16:25:06 +08:00
Haojun Liao 2efd155adf fix(stream): wait for the task checkpoint before stop. 2023-09-21 15:53:21 +08:00
Haojun Liao 0f97a21163 fix(tsdb): set the correct scaninfo to load the tomb data. 2023-09-21 15:21:01 +08:00
Haojun Liao e4073bd9a8 fix(stream): update logs. 2023-09-21 14:03:14 +08:00
Haojun Liao 09accc71d2 log(stream): update log. 2023-09-21 14:01:41 +08:00
Haojun Liao 17586af0ce refactor: do refactor the sink task. 2023-09-21 13:32:57 +08:00
kailixu e7dd0caeb9 Merge branch '3.0' into enh/TS-3934-3.0 2023-09-21 10:21:45 +08:00
liuyao 3b3c5d7cb8 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26174 2023-09-21 10:11:36 +08:00
wangmm0220 ce2fc8b319 fix:memory leak 2023-09-21 10:05:52 +08:00
kailixu 2b25982495 enh: user dropped notification 2023-09-21 09:53:45 +08:00
wangmm0220 f9c5aa01af fix:enable split if there are topics & fix memory leak 2023-09-21 09:20:34 +08:00
dapan1121 cc08a5ee87 fix: add query sql 2023-09-20 19:30:40 +08:00
Haojun Liao 92f18989df fix(stream): remove invalid cached task info in buffer. 2023-09-20 19:19:04 +08:00
wangmm0220 d3f54e678f feat:support vnode split in tmq 2023-09-20 18:27:43 +08:00
Haojun Liao 6633fb971b fix(stream): update logs. 2023-09-20 18:18:31 +08:00
Minglei Jin f206fa07d0 s3/put: use put2 2023-09-20 15:59:58 +08:00
Haojun Liao 2418f509ea fix(stream): avoid invalid read. 2023-09-20 15:47:09 +08:00
Haojun Liao 1d1d9a1b0b fix(stream): unlock when returning. 2023-09-20 15:45:15 +08:00
Haojun Liao c8ab761d2a fix(stream): return if failed. 2023-09-20 15:38:49 +08:00
Haojun Liao 2a781c509f fix(stream): add task status check. 2023-09-20 15:32:15 +08:00
Minglei Jin d155cfcf0f tsdb/readerwriter: use tsdb's s3 block cache to read file page 2023-09-20 15:24:54 +08:00
liuyao 1cebda368a session&state operator buff 2023-09-20 15:06:08 +08:00