Commit Graph

4326 Commits

Author SHA1 Message Date
Haojun Liao 0280f129bd fix(stream):add some logs. 2024-01-16 18:21:29 +08:00
Haojun Liao 882b916940 fix(stream): adjust stream trans conflict check. 2024-01-16 16:11:04 +08:00
Haojun Liao 8ede6d87ce refactor: do some internal refactor. 2024-01-16 15:40:40 +08:00
Hongze Cheng c40a87ab0e
Merge pull request #24319 from taosdata/ENH/TD-28135-3.0
enh: use learner in redistribute vgroup
2024-01-16 15:04:52 +08:00
Yihao Deng 7a09ba2630 fix pause/resume error 2024-01-15 11:56:38 +00:00
Haojun Liao 1296700092
Merge pull request #24433 from taosdata/fix/TD-28188
fix:[TD-28188]the epset of snode is error because epset is not initil…
2024-01-15 17:05:11 +08:00
kailixu 414e15a810 chore: merge 3.0 2024-01-15 10:42:45 +08:00
Haojun Liao 59ee690301
Merge pull request #24450 from taosdata/fix/3_liaohj
fix(stream): set error code for return.
2024-01-12 16:04:14 +08:00
Haojun Liao bc7434e2b5 fix(stream): set error code for return. 2024-01-12 14:49:16 +08:00
Haojun Liao ea0ea09b0f
Merge pull request #24409 from taosdata/opt/optMsgOnMnode
opt msg on mnd
2024-01-12 09:36:37 +08:00
Haojun Liao fe839527f3
Merge pull request #24435 from taosdata/fix/TD-28202
fix:[TD-28202]move tq timer to write thread in mnode
2024-01-12 09:35:45 +08:00
kailixu ddefc5f46a chore: merge 3.0 2024-01-11 20:05:23 +08:00
wangmm0220 d3659db2ff fix:[TD-28202]move tq timer to write thread in mnode 2024-01-11 19:22:54 +08:00
wangmm0220 89ca3418af fix:[TD-28188]the epset of snode is error because epset is not initilized 2024-01-11 17:38:15 +08:00
Haojun Liao 9703018f56 fix(stream): add checkpoint status check. 2024-01-11 16:47:51 +08:00
Haojun Liao 5f7ce21530 refactor: do some internal refactor. 2024-01-11 11:59:29 +08:00
Haojun Liao 58694c67dd refactor: do some internal refactor. 2024-01-11 11:50:52 +08:00
Yihao Deng b5e5167b8f split sync/status channel 2024-01-10 09:57:08 +00:00
Yihao Deng 2537adb728 opt msg on mnode 2024-01-10 06:00:44 +00:00
yihaoDeng 9dbddeed16 opt msg on mnd 2024-01-10 10:03:38 +08:00
Haojun Liao 9d0d0d9ddc Merge branch '3.0' into fix/3_liaohj 2024-01-10 09:57:46 +08:00
Yihao Deng 220cef4a61 opt msg on mnode 2024-01-09 11:02:10 +00:00
Yihao Deng 1eee7b44e0 fix crash found on 3.1 2024-01-08 07:31:35 +00:00
Haojun Liao f7ab55fb71
Merge pull request #24342 from taosdata/fix/TD-28155
fix:[TD-28155] set consumer lost if all current topic is 0
2024-01-08 11:39:16 +08:00
wangmm0220 f2a1d24ab1 fix:[TD-28155] set consumer lost if all current topic is 0 2024-01-05 19:28:40 +08:00
dmchen 8ddff2eecb fix/TD-28073 2024-01-05 07:02:16 +00:00
wade zhang a4f68411ed
Merge pull request #24332 from taosdata/ENH/TD-25112-3.0
enh: use learner in split vgroup
2024-01-05 14:26:27 +08:00
kailixu 1169fe357a feat: uniq grant 2024-01-05 00:53:38 +08:00
wangmm0220 bd64a78094 fix:[TD-28155] set consumer lost if all current topic is 0 2024-01-04 18:53:37 +08:00
dm chen 39f2e75a9e
Merge branch '3.0' into feat/TD-26529-3.0 2024-01-04 15:46:23 +08:00
Benguang Zhao b85f36bcea enh: allow to drop an empty dnode, no matter online or not 2024-01-04 12:00:49 +08:00
Benguang Zhao f4ad4ea998 enh: use learner in split vgroup 2024-01-04 10:01:05 +08:00
Haojun Liao 3fea717373 fix(stream): discard the orphan tasks. 2024-01-03 19:28:49 +08:00
Haojun Liao b06ccc0ca7 fix(stream): cleanup the checkpoint trans & task info in execInfo 2024-01-03 19:18:06 +08:00
Haojun Liao 185fa75376 enh(stream): add task into timer to be idle during exec when the corresponding output queue is full. 2024-01-03 17:59:42 +08:00
Haojun Liao 284ef7d085 fix(stream): remove the related checkpoint trans when trying to drop stream. 2024-01-03 14:44:04 +08:00
Benguang Zhao de5f9b351f enh: use learner in redistribute vgroup 2024-01-03 11:49:05 +08:00
Haojun Liao e7a0044502 Merge branch '3.0' into fix/3_liaohj 2024-01-02 13:02:55 +08:00
Haojun Liao 59642c674d
Merge pull request #24254 from taosdata/fix/TS-3491-3.0
fix:[TS-4391] rebalance cnt always 1 if msg lost
2024-01-02 10:34:41 +08:00
Haojun Liao 7abeb5a27a fix(stream): update the stream error code. 2023-12-29 17:44:10 +08:00
wangmm0220 d158ca74d8 fix:[TS-4391] rebalance cnt always 1 if msg lost 2023-12-29 17:22:27 +08:00
wangmm0220 c83989754f fix:[TS-4391] rebalance cnt always 1 if msg lost 2023-12-29 14:09:49 +08:00
wangmm0220 b58a23df49 fix:[TS-4391] rebalance cnt always 1 if msg lost 2023-12-29 13:57:13 +08:00
wangmm0220 10e86fc733 fix:[TS-4391] rebalance cnt always 1 if msg lost 2023-12-27 19:25:08 +08:00
54liuyao ccf861dec8 Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/3_liaohj 2023-12-26 18:36:18 +08:00
wade zhang 1a215daefa
Merge pull request #24176 from taosdata/FIX/TD-27916-3.0
enh: demarcate top and bottom halves of task trans execution
2023-12-26 18:00:41 +08:00
Haojun Liao b74e98b25c fix(stream): set the correct split timestamp for session/state window. 2023-12-26 14:17:46 +08:00
Haojun Liao 62cfcefbb0 refactor: remove stream-scan-history event for stream task. 2023-12-26 00:34:04 +08:00
Benguang Zhao 7edfbf8023 fix: set commit log for mndAddCompactDetailToTran 2023-12-25 09:47:17 +08:00
Benguang Zhao 4f29500f74 fix: set commit log for mndDropSubByTopic 2023-12-25 09:46:55 +08:00
Haojun Liao 0877e0bfad other: merge 3.0 2023-12-25 09:13:31 +08:00
Haojun Liao b175a4b7b3 refactor(stream): async stop tasks, and do some internal refactor. 2023-12-22 17:56:16 +08:00
Benguang Zhao 2de6d6c81d enh: add TSDB_CODE_MND_TRANS_CTX_SWITCH 2023-12-22 16:06:59 +08:00
Haojun Liao c9475060de fix(stream): fix race condition. 2023-12-22 09:34:49 +08:00
Haojun Liao 0fab9a1827 other: fix syntax error. 2023-12-22 00:29:49 +08:00
kailixu 3005ab1953 chore: more code 2023-12-21 19:45:09 +08:00
Haojun Liao 84583580e2 fix(stream): transfer the checkpoint trans id. 2023-12-21 19:12:49 +08:00
kailixu 47fedce263 chore: more code 2023-12-21 12:11:00 +08:00
Haojun Liao ad5d78a6ca fix(stream): fix deadlock. 2023-12-20 19:12:47 +08:00
Haojun Liao 64eee4bbd2 fix(stream): add conflict check for nodeUpdate 2023-12-20 19:06:32 +08:00
Benguang Zhao e06f355143 enh: improve logging msg of mndPostMgmtCode 2023-12-19 20:16:33 +08:00
Benguang Zhao f7ab8e99b5 enh: demarcate top and bottom halves of task trans execution to ensure a consistent order 2023-12-19 19:52:11 +08:00
Haojun Liao 92045f5485 fix(stream): add snode check, and handle the task status reset from checkpoint when it is in the snode. 2023-12-19 18:34:30 +08:00
wade zhang 8bbf03a695
Merge pull request #24116 from taosdata/fix/release-mem-check-3.0
release mem check
2023-12-19 18:13:53 +08:00
kailixu 1f5384ad40 feat: support uniq active code 2023-12-19 18:02:53 +08:00
Haojun Liao bba5a4f08b other: merge main into 3.0 2023-12-18 18:26:42 +08:00
dmchen 19637fd148 release mem check 2023-12-18 09:32:31 +00:00
kailixu 70006bb711 feat: support alter cluster 2023-12-18 16:34:31 +08:00
kailixu 9fa90fc953 Merge branch '3.0' into feat/TD-27463-3.0 2023-12-18 14:20:10 +08:00
Benguang Zhao 25ab03e5d3 refact: improve info logging msg in mmProcessWriteMsg 2023-12-18 13:35:21 +08:00
Haojun Liao 93f3a3135f
Merge pull request #24104 from taosdata/fix/3_liaohj
fix(stream): avoid invalid read.
2023-12-18 11:03:37 +08:00
Haojun Liao edc3841a2c fix(stream): avoid invalid read. 2023-12-18 09:26:56 +08:00
dmchen dd317d6738 add more log 2023-12-17 11:03:25 +00:00
dmchen 6347792a93 TD-27906 2023-12-17 08:47:51 +00:00
wade zhang 967a259219
Merge pull request #24092 from taosdata/fix/TD-27902
fix/TD-27902
2023-12-17 12:31:15 +08:00
Haojun Liao 0526e619ad
Merge pull request #24095 from taosdata/fix/3_liaohj
fix(tsdb): add desc check for clean file block.
2023-12-16 18:10:15 +08:00
Haojun Liao f9a5485d52 fix(stream): refactor the stream trans conflict detection strategy. 2023-12-16 01:46:29 +08:00
dmchen 62672b84a2 fix/TD-27902 2023-12-15 11:39:45 +00:00
Haojun Liao a847bf468a
Merge pull request #24088 from taosdata/fix/3_liaohj
fix(query): add rows info if blocks exist.
2023-12-15 18:24:45 +08:00
Haojun Liao aedc5e6b05 fix(stream): set the correct dst stable name. 2023-12-15 17:16:25 +08:00
dmchen 5e7aead4d8 keep killed compact 2023-12-15 01:43:24 +00:00
dmchen 7183fd66a1 keep killed compact 2023-12-15 00:59:56 +00:00
dmchen 7bb3d43f4e kill compact 2023-12-14 11:22:07 +00:00
dm chen 81767dfa32
Merge branch '3.0' into feat/TS-4229 2023-12-14 17:02:51 +08:00
Haojun Liao 0449b5f1bd other: add some logs. 2023-12-14 15:43:59 +08:00
dmchen 1ca0858a97 compact detail log 2023-12-14 07:11:00 +00:00
dmchen 606a6fe891 field encode 2023-12-14 03:24:53 +00:00
kailixu d7e16bb91d chore: merge 3.0 2023-12-14 10:09:32 +08:00
Haojun Liao 26af397431
Merge pull request #24052 from taosdata/fix/3_liaohj
fix(tsdb): fix error in tsdb read.
2023-12-13 22:35:08 +08:00
Haojun Liao 105542bb21 fix(stream):handle the case of delete orphaned tasks. 2023-12-13 17:44:00 +08:00
dmchen e9cf639adb db is null 2023-12-13 01:04:34 +00:00
dmchen 71020e4812 show command db field is null 2023-12-13 00:53:33 +00:00
dmchen 4c9763d2c1 mem leak 2023-12-12 13:12:04 +00:00
dmchen 7e2ce6381f ci case 2023-12-12 07:24:13 +00:00
dmchen ea9eba5621 fix ci case 2023-12-12 05:34:41 +00:00
facetosea 33897447cb ctest on linux exclude 2023-12-12 10:37:39 +08:00
dmchen e8617812ae update progress rsp 2023-12-08 10:17:04 +00:00
kailixu 2309e577c6 feat: support uniq grant 2023-12-07 19:50:16 +08:00
kailixu f850ccbfd4 feat: support uniq grant 2023-12-07 16:00:13 +08:00
kailixu 4adce7ed52 feat: support uniq grant 2023-12-07 14:11:41 +08:00
kailixu 780f3d9cad Merge branch '3.0' into feat/TD-27463-3.0 2023-12-06 19:14:24 +08:00
kailixu b015077120 feat: support uniq grant 2023-12-06 19:13:54 +08:00
factosea f01241f720 Merge branch 'fix/xsren/TD-22212/taosQueryParam3.0' into enh/xsren/TD-22212/taosQueryParam3.0 2023-12-06 17:39:25 +08:00
Hongze Cheng 04e84ba152 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TS-4229 2023-12-06 16:43:00 +08:00
kailixu 67fd9993b0 feat: support uniq grant 2023-12-06 15:30:26 +08:00
kailixu e623c9c3c8 feat: support machine id 2023-12-04 11:44:02 +08:00
kailixu 042291c35b feat: support machine id 2023-12-01 18:15:47 +08:00
Haojun Liao 4d9211dcf1
Merge pull request #23899 from taosdata/fix/liaohj
other: merge the patch of stream from 3.0 branch.
2023-12-01 15:49:54 +08:00
Haojun Liao d7a19a9179 fix(stream): fix invalid decode hbmsg and memory leaks caused by invalid hb msg. 2023-12-01 14:45:18 +08:00
Haojun Liao 7e63943c4e
Merge pull request #23860 from taosdata/fix/TD-27455
fix:tmqVnodeSplit-column.py failed in arm64 because of rebalance after unsubscribe while split vnode
2023-12-01 14:18:58 +08:00
Haojun Liao 33ad05e2c8 fix(stream): fix syntax error. 2023-12-01 13:08:25 +08:00
Haojun Liao 12f32f0ae7 fix(stream): fix syntax error. 2023-12-01 11:57:16 +08:00
Haojun Liao dba58f5e38 fix(stream): fix syntax error. 2023-12-01 11:54:13 +08:00
Haojun Liao 18273b8d1b fix(stream): ignore the in_progress code. 2023-12-01 10:20:45 +08:00
Haojun Liao 2972f5f420 fix(stream):return the error code if create stream failed. 2023-12-01 10:20:45 +08:00
Haojun Liao 86618ffd97 refactor: do some internal refactor. 2023-12-01 10:20:38 +08:00
Haojun Liao 31ae46925d fix(stream): fix invalid free. 2023-12-01 10:20:32 +08:00
Haojun Liao c937f42d88 fix(stream): fix deadlock. 2023-12-01 10:19:54 +08:00
Haojun Liao 8515a2f9b6 fix(stream): fix status check for stream-scan-history status when drop stream task msg is missing. 2023-12-01 10:19:18 +08:00
Haojun Liao 9d735e7f8b fix(stream): reduce the sink throughput. and fix the bug in status check. 2023-12-01 10:18:25 +08:00
Haojun Liao 523573844a fix(stream): fix syntax error. 2023-12-01 10:18:24 +08:00
Haojun Liao eb2f5ad074 fix(stream): fix error. 2023-12-01 10:18:22 +08:00
Haojun Liao 2b03d64850 fix(stream): drop the related fill-history task & set the task to be ready, if the drop fill-history task msg is missing due to the vnode restarting. 2023-12-01 10:18:15 +08:00
Haojun Liao 60fa7cccbf fix(stream): fix memory leak. 2023-12-01 10:17:14 +08:00
dapan1121 32030ca130
Merge pull request #23886 from taosdata/revert-23730-enh/TD-26976-3.0
Revert "enh:  grant and active codes"
2023-11-30 19:04:50 +08:00
wangmm0220 4fc19a6343 fix:snode can only be created 1 2023-11-30 15:49:31 +08:00
Haojun Liao 999afd97e5 other: merge 3.0 2023-11-30 14:36:18 +08:00
Haojun Liao de82aba2e5 fix(stream): ignore the in_progress code. 2023-11-30 14:32:14 +08:00
Haojun Liao 71860bfb46 fix(stream):return the error code if create stream failed. 2023-11-30 13:57:00 +08:00
Cary Xu f96044e09f
Revert "enh: grant and active codes" 2023-11-30 13:39:54 +08:00
yihaoDeng 5c32680cd8 Merge branch '3.0' into enh/refactorBackend 2023-11-30 10:31:27 +08:00
WANG MINGMING 9b72d890c8
Merge branch '3.0' into fix/TD-27455 2023-11-30 09:37:23 +08:00
Haojun Liao 130614c938
Merge pull request #23831 from taosdata/fix/3_liaohj
enh(stream/tsdb): do multiple optimization and fix some bugs.
2023-11-30 09:20:15 +08:00
wangmm0220 4f168b4b2d fix:tmqVnodeSplit-column.py failed in arm64 because of rebalance after unsubscribe while split vnode 2023-11-29 17:22:43 +08:00
kailixu b54f5b47ad fix: reserve enough buffer for user 2023-11-28 17:58:54 +08:00
yihaoDeng 786383118c fix drop stream case 2023-11-28 10:39:17 +08:00
Haojun Liao 6bb30822c2 refactor: do some internal refactor. 2023-11-28 10:04:22 +08:00
Haojun Liao 9649db9003 fix(stream): fix invalid free. 2023-11-28 10:04:14 +08:00
Haojun Liao 8b406c0a19
Merge pull request #23830 from taosdata/fix/liaohj
fix(stream): fix invalid free.
2023-11-28 09:52:28 +08:00
Haojun Liao b419650116 refactor: do some internal refactor. 2023-11-27 18:51:30 +08:00
Haojun Liao 91eea02258 fix(stream): fix invalid free. 2023-11-27 18:49:22 +08:00
wangmm0220 02575e0f28 Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/TD-27455 2023-11-27 18:15:53 +08:00
wangmm0220 d007d31c4d fix:process snode when drop stream 2023-11-27 18:15:09 +08:00
yihaoDeng 630f4f9d80 Merge branch '3.0' into enh/refactorBackend 2023-11-27 13:53:33 +08:00
yihaoDeng e483570cd7 Merge branch '3.0' into enh/refactorBackend 2023-11-27 11:10:56 +08:00
Haojun Liao e85c6349a4
Merge pull request #23818 from taosdata/fix/TD-27455
fix:add O_CLOSEXEC for .running & process snode when drop stream
2023-11-27 11:01:24 +08:00
yihaoDeng e9bec34c44 Merge branch '3.0' into enh/refactorBackend 2023-11-27 10:01:12 +08:00
dapan1121 d3ac79aeb7
Merge pull request #23808 from taosdata/fix/PI-23-3.0
fix: add check in mnode/vnode when alter table col/tag
2023-11-26 17:31:38 +08:00
Haojun Liao 788194c748 fix(stream): fix deadlock. 2023-11-24 22:53:55 +08:00
wangmm0220 ff0828fcc2 fix:add O_CLOSEXEC for .running & process snode when drop stream 2023-11-24 18:30:58 +08:00