Commit Graph

684 Commits

Author SHA1 Message Date
Haojun Liao fabb986aa8 fix(stream): fix stack overflow, caused by print epset. 2024-04-10 19:54:33 +08:00
54liuyao 204c5acefe Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/ly-TS-4243-3.0 2024-04-02 09:10:52 +08:00
yihaoDeng 53ecfe511a Merge branch '3.0' into feature/compressData 2024-04-01 08:04:16 +00:00
yihaoDeng 9e11fe45a9 fix ci error 2024-03-31 00:08:23 +00:00
wangmm0220 8e2a2414c0 fix:same subtable same partition by leads to same table name in stream 2024-03-28 13:48:46 +08:00
Haojun Liao e776cde461 fix(stream):fix unrelease stream obj. 2024-03-27 09:02:21 +08:00
Haojun Liao f3c306d582 fix(stream): add some comments. 2024-03-26 23:28:20 +08:00
Haojun Liao 3c7fe5fd01 fix(stream): check null ptr. 2024-03-26 23:27:38 +08:00
Haojun Liao 46280bfee9 fix(stream): add some comments. 2024-03-26 19:40:47 +08:00
Haojun Liao 530e0133b9 fix(stream): acquire the stream task in exec buffer if not in mnode store. 2024-03-26 19:39:58 +08:00
54liuyao a02535c3ab Merge branch 'feat/TS-4243-3.0' of https://github.com/taosdata/TDengine into feat/ly-TS-4243-3.0 2024-03-25 11:15:21 +08:00
54liuyao a60f390cdc stream primary key 2024-03-21 10:50:07 +08:00
Haojun Liao a9ba534f48 fix(stream): adjust conflict level when creating stream. 2024-03-20 18:31:57 +08:00
Haojun Liao 7bdabc309b Merge branch '3.0' into fix/3_liaohj 2024-03-18 14:16:15 +08:00
Haojun Liao a576be6ae5 fix(stream): set the correct rows info for stream tasks when retreiving task info. 2024-03-15 15:19:20 +08:00
Haojun Liao 3aa2e24d78
Merge pull request #25006 from taosdata/fix/nullcheck
fix(stream): set the dest epset from mnode, and set the retry error
2024-03-05 19:46:41 +08:00
Haojun Liao cdfbbc2985 fix(stream): set the dest epset from mnode, and set the retry error code for trans. 2024-03-05 13:28:34 +08:00
Haojun Liao 8791a163f8 other: merge 3.0 2024-02-29 22:31:52 +08:00
Haojun Liao db92bf84d8 other: merge 3.0 2024-02-29 22:21:50 +08:00
Haojun Liao dafac591f7 enh(stream): add rsp for req-checkpoint 2024-02-27 10:53:25 +08:00
Haojun Liao 6e891b0145 fix(stream): add into buffer before start the create stream trans. 2024-02-26 10:22:34 +08:00
Haojun Liao 1cf7790b1c
Merge pull request #24816 from taosdata/fix/nullcheck
fix(stream): send hb correctly after the leader of mnode switching in a cluster.
2024-02-22 08:45:34 +08:00
Haojun Liao 8740c3cb4a fix(stream): send hb rsp explicitly. 2024-02-21 16:17:06 +08:00
wangmm0220 2049fa688a fix:add log 2024-02-21 16:01:02 +08:00
wangmm0220 22b1db5191 fix:stream load error 2024-02-20 14:49:52 +08:00
Haojun Liao 13c3654bf5 other: merge 3.0 2024-02-20 10:51:04 +08:00
Hongze Cheng ffedfbaf1e
Merge pull request #24777 from taosdata/feat/TD-27463-3.0
fix: grant check for stream/topic/subscription
2024-02-19 19:36:22 +08:00
kailixu 5b69e22e9b fix: grant check for streams 2024-02-19 16:29:40 +08:00
wangmm0220 ac9582b24a fix:[TD-28567] do not add md5 to the end of subtable if create stream by sma 2024-02-19 13:58:58 +08:00
wangmm0220 a8e45440c0 fix:conflicts from 3.0 2024-02-18 18:02:14 +08:00
Haojun Liao c4f9bee629 fix(stream): add into buffer pool before start trans, to avoid false alarm on orphan task. 2024-02-18 15:46:37 +08:00
kailixu f76a61c777 feat: support uniq grant 2024-02-13 23:17:05 +08:00
Haojun Liao ecdcc6dee1
Merge pull request #24738 from taosdata/fix/3_liaohj
test(stream): add unit test case for the mnode stream module.
2024-02-05 13:32:46 +08:00
Haojun Liao 3533f7ecea Merge branch '3.0' into fix/3_liaohj 2024-02-05 09:23:29 +08:00
Haojun Liao 739485a419 test(stream): add unit test case for the mnode stream module. 2024-02-05 09:10:04 +08:00
kailixu 231cf000da Merge branch 'feat/TD-27463-3.0a' into feat/TD-27463-3.0 2024-02-02 00:07:15 +08:00
kailixu adee720128 feat: support uniq grant 2024-02-01 17:48:29 +08:00
Haojun Liao 0fe9c05c5f
Merge pull request #24704 from taosdata/fix/3_liaohj
fix(stream): take ver snapshot for all vgroups
2024-02-01 17:07:36 +08:00
Haojun Liao 88f246b988 fix(stream): fix syntax error on windows, and add null ptr check for pTrans obj. 2024-02-01 15:08:06 +08:00
Haojun Liao cb2ea4a721 fix(stream): take ver snapshot for all vgroups before launching stream with fill-history option opened. 2024-02-01 11:37:57 +08:00
wangmm0220 a9fcc67321 fix:conflicts from 3.0 2024-02-01 11:13:03 +08:00
kailixu 2b1a0cdbfe feat: support uniq grant 2024-01-31 08:53:45 +08:00
Haojun Liao 4c22e03c1b
Merge pull request #24642 from taosdata/feat/TD-28247
feat:[TD-28247]add grant for subscribe and stream
2024-01-30 17:48:05 +08:00
Haojun Liao 11c9c7d936 refactor: do some internal refactor. 2024-01-30 09:17:02 +08:00
wangmm0220 51b7cd99d6 feat:[TD-28247]add grant for subscribe and stream 2024-01-29 14:28:48 +08:00
Haojun Liao b714c70434 refactor: do some internal refactor. 2024-01-29 13:46:33 +08:00
Haojun Liao 9087a0d9d0 feat(stream): drop orphan tasks. 2024-01-29 11:03:50 +08:00
wangmm0220 35e2b681c7 fix:conflicts from 3.0 2024-01-26 16:32:40 +08:00
Haojun Liao ac08f659c3 refactor: remove invalid procedure in fill-history. 2024-01-26 16:20:43 +08:00
Haojun Liao 50b59ad936 fix(stream): add null ptr check. 2024-01-26 16:08:01 +08:00
wangmm0220 ce2a3e4be2 fix:test case error 2024-01-26 15:35:29 +08:00
wangmm0220 bd2bef2428 fix:add test case 2024-01-26 15:05:31 +08:00
Haojun Liao 649d26ce72 fix(stream): seek to right place to start wal read. 2024-01-26 14:14:04 +08:00
Haojun Liao 49aff4571b fix(stream): fix memory leak. 2024-01-26 11:33:07 +08:00
Haojun Liao 9b3b03caab refactor: do some internal refactor. 2024-01-26 10:22:16 +08:00
Haojun Liao bc7fe1fe6a refactor: do some internal refactor. 2024-01-26 10:08:20 +08:00
Haojun Liao bd1d1cddaf refactor: do some internal refactor. 2024-01-26 10:03:54 +08:00
Haojun Liao d4bab8c09b refactor: do some internal refactor. 2024-01-25 16:53:30 +08:00
wangmm0220 2798ff824c feat:[TD-28247]add grant for subscribe and stream 2024-01-25 16:07:09 +08:00
Haojun Liao dc1ea9f9a1 fix(stream): clear htask info when unregistering the task. 2024-01-24 16:23:47 +08:00
Haojun Liao 8a7e38ad15 fix(stream): fix checkpoint failure check. 2024-01-24 13:10:53 +08:00
Haojun Liao 0cd84aa587 fix(stream): gen checkpoint for single task. 2024-01-23 17:51:50 +08:00
kailixu 5208829f23 Merge branch '3.0' into feat/TD-27463-3.0 2024-01-22 13:20:00 +08:00
Haojun Liao db474626e6 fix(stream): fix memory leak. 2024-01-22 11:49:16 +08:00
Haojun Liao 2cc584ff44 fix(stream): fix error in check vgId. 2024-01-22 11:05:42 +08:00
Haojun Liao 4a5ab10b3d fix(stream): fix memory leak. 2024-01-19 20:28:43 +08:00
Haojun Liao d973f66cea fix(stream): do checkpoint after fill-history task completed. 2024-01-19 16:18:02 +08:00
wangmm0220 7246fedfef Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/ly_multi_marks 2024-01-18 19:08:35 +08:00
Haojun Liao 996e2939a9 refactor: do some internal refactor. 2024-01-18 15:58:46 +08:00
Haojun Liao 76e6c453e7 enh(stream): send msg to mnode when the transferring state completed. 2024-01-18 15:43:36 +08:00
Haojun Liao f8d0c52483 fix(stream): remove this unused drop history task msg and corresponding functions. 2024-01-18 14:32:48 +08:00
kailixu bf0205b54d Merge branch '3.0' into feat/TD-27463-3.0 2024-01-17 11:29:47 +08:00
Haojun Liao 3d98fc6a67 other: merge 3.0 2024-01-16 18:29:33 +08:00
Haojun Liao 0280f129bd fix(stream):add some logs. 2024-01-16 18:21:29 +08:00
Haojun Liao 882b916940 fix(stream): adjust stream trans conflict check. 2024-01-16 16:11:04 +08:00
Haojun Liao 8ede6d87ce refactor: do some internal refactor. 2024-01-16 15:40:40 +08:00
Yihao Deng 7a09ba2630 fix pause/resume error 2024-01-15 11:56:38 +00:00
Haojun Liao 1296700092
Merge pull request #24433 from taosdata/fix/TD-28188
fix:[TD-28188]the epset of snode is error because epset is not initil…
2024-01-15 17:05:11 +08:00
wangmm0220 2ab54a1335 fix:conflicts from 3.0 2024-01-15 16:54:52 +08:00
kailixu 414e15a810 chore: merge 3.0 2024-01-15 10:42:45 +08:00
kailixu ddefc5f46a chore: merge 3.0 2024-01-11 20:05:23 +08:00
wangmm0220 89ca3418af fix:[TD-28188]the epset of snode is error because epset is not initilized 2024-01-11 17:38:15 +08:00
Haojun Liao 9703018f56 fix(stream): add checkpoint status check. 2024-01-11 16:47:51 +08:00
Haojun Liao 5f7ce21530 refactor: do some internal refactor. 2024-01-11 11:59:29 +08:00
Haojun Liao 58694c67dd refactor: do some internal refactor. 2024-01-11 11:50:52 +08:00
Haojun Liao 3fea717373 fix(stream): discard the orphan tasks. 2024-01-03 19:28:49 +08:00
Haojun Liao b06ccc0ca7 fix(stream): cleanup the checkpoint trans & task info in execInfo 2024-01-03 19:18:06 +08:00
Haojun Liao 185fa75376 enh(stream): add task into timer to be idle during exec when the corresponding output queue is full. 2024-01-03 17:59:42 +08:00
Haojun Liao 284ef7d085 fix(stream): remove the related checkpoint trans when trying to drop stream. 2024-01-03 14:44:04 +08:00
Haojun Liao e7a0044502 Merge branch '3.0' into fix/3_liaohj 2024-01-02 13:02:55 +08:00
Haojun Liao 7abeb5a27a fix(stream): update the stream error code. 2023-12-29 17:44:10 +08:00
Haojun Liao 62cfcefbb0 refactor: remove stream-scan-history event for stream task. 2023-12-26 00:34:04 +08:00
Haojun Liao b175a4b7b3 refactor(stream): async stop tasks, and do some internal refactor. 2023-12-22 17:56:16 +08:00
Haojun Liao 0fab9a1827 other: fix syntax error. 2023-12-22 00:29:49 +08:00
kailixu 3005ab1953 chore: more code 2023-12-21 19:45:09 +08:00
Haojun Liao 84583580e2 fix(stream): transfer the checkpoint trans id. 2023-12-21 19:12:49 +08:00
Haojun Liao ad5d78a6ca fix(stream): fix deadlock. 2023-12-20 19:12:47 +08:00
Haojun Liao 64eee4bbd2 fix(stream): add conflict check for nodeUpdate 2023-12-20 19:06:32 +08:00
wangmm0220 dd0afef6f2 fix:set triggerParams=0 in mid interval 2023-12-20 11:00:25 +08:00
Haojun Liao 92045f5485 fix(stream): add snode check, and handle the task status reset from checkpoint when it is in the snode. 2023-12-19 18:34:30 +08:00