Commit Graph

2637 Commits

Author SHA1 Message Date
Haojun Liao 190b02dd1a fix(stream):set correct version for sink/agg tasks. 2024-03-14 10:04:43 +08:00
54liuyao ef32863f07 stream event window mem leak 2024-03-13 19:44:59 +08:00
54liuyao c13338d965 stream event window mem leak 2024-03-13 16:16:44 +08:00
Haojun Liao aef11bf3a8 fix(stream): add one more status for check. 2024-03-08 00:25:08 +08:00
yihaoDeng 3416d68433 add coverity scan 2024-03-05 21:02:20 +08:00
Haojun Liao 3aa2e24d78
Merge pull request #25006 from taosdata/fix/nullcheck
fix(stream): set the dest epset from mnode, and set the retry error
2024-03-05 19:46:41 +08:00
Haojun Liao 45e779d464 refactor: do some internal refactor. 2024-03-05 15:48:58 +08:00
Haojun Liao cdfbbc2985 fix(stream): set the dest epset from mnode, and set the retry error code for trans. 2024-03-05 13:28:34 +08:00
Haojun Liao 4d10f28a00
Merge pull request #24999 from taosdata/fix/nullcheck
fix(stream): remove related fill-history if task in stop status.
2024-03-05 09:15:21 +08:00
Haojun Liao a38161299b fix(stream): add clear msgData buf impl. 2024-03-04 19:51:01 +08:00
Haojun Liao ad1780dbdc fix(stream): reset the pData after transferring state. 2024-03-04 19:32:22 +08:00
Haojun Liao 80fd3e0445 fix(stream): remove related fill-history if task in stop status. 2024-03-04 19:31:47 +08:00
54liuyao 9859e86d5a Merge branch '3.0' of https://github.com/taosdata/TDengine into 3.0 2024-03-04 09:10:41 +08:00
Haojun Liao daa6eab287 Merge branch '3.0' into fix/nullcheck 2024-03-03 16:49:43 +08:00
Haojun Liao 550d0fe5ae fix(stream): add an assert. 2024-03-03 16:46:13 +08:00
54liuyao 3febcb96a0 reset flush state 2024-03-01 10:57:57 +08:00
Haojun Liao 8791a163f8 other: merge 3.0 2024-02-29 22:31:52 +08:00
Haojun Liao db92bf84d8 other: merge 3.0 2024-02-29 22:21:50 +08:00
54liuyao 4c47332098 opt bloom filter 2024-02-29 11:17:29 +08:00
54liuyao 6619175fde opt bloom filter 2024-02-29 11:17:29 +08:00
Hongze Cheng d9095d80de
Merge pull request #24916 from taosdata/addBackendTest
Add backend test
2024-02-28 19:16:14 +08:00
yihaoDeng 17e9f1d747 add test case 2024-02-28 09:33:48 +00:00
yihaoDeng 8c46c71c98 add test case 2024-02-28 09:02:55 +00:00
yihaoDeng 249141a9a2 add compress dict 2024-02-28 08:16:02 +00:00
yihaoDeng d5c5dc7026 add test case 2024-02-28 06:45:35 +00:00
yihaoDeng d7f14e916d add test case 2024-02-28 06:01:50 +00:00
yihaoDeng 9f983a07d7 add test case 2024-02-28 10:48:24 +08:00
yihaoDeng e1f11d1639 add test case to stream backend 2024-02-28 00:48:20 +00:00
yihaoDeng b3c18c31da add test case to stream backend 2024-02-27 12:19:37 +00:00
yihaoDeng 6b6f5aa5d1 add test case 2024-02-27 05:51:32 +00:00
yihaoDeng 8d36445bb5 add stream backend test 2024-02-27 05:29:58 +00:00
Haojun Liao aee0460daf enh(stream):rsp the checkpoint ready msg. 2024-02-27 11:15:09 +08:00
Haojun Liao dafac591f7 enh(stream): add rsp for req-checkpoint 2024-02-27 10:53:25 +08:00
yihaoDeng e41e10bf35 add stream backend test 2024-02-26 11:51:46 +00:00
Haojun Liao 2800454c35 Merge branch '3.0' into fix/nullcheck 2024-02-24 01:46:15 +08:00
Haojun Liao df2488431e fix(stream): add logs. 2024-02-24 00:40:26 +08:00
Haojun Liao 98ff21c879
Merge pull request #24840 from taosdata/fix/nullcheck
fix(stream): fix the compatible issue when the fill-history exists.
2024-02-24 00:40:09 +08:00
yihaoDeng c54e4aeaad add test case 2024-02-23 09:30:53 +00:00
Haojun Liao d8ffa65b62 fix(stream): fix the compatible issue when the fill-history exists. 2024-02-23 09:12:27 +08:00
54liuyao c7a50acd63 rebuild sliding window 2024-02-23 09:05:30 +08:00
Haojun Liao af1f61cd39 fix(stream): fix the compatible issue when the fill-history exists. 2024-02-22 19:05:30 +08:00
54liuyao 8c6ea4079c delete invalid result 2024-02-22 14:15:35 +08:00
Haojun Liao b27b635c10 fix(stream): allow hb message rsp. 2024-02-21 13:55:06 +08:00
Haojun Liao d6f5ae226b refactor: do some internal refactor. 2024-02-21 09:42:23 +08:00
Haojun Liao 8d848a5bf0 fix(stream): add null ptr check. 2024-02-21 09:40:22 +08:00
Haojun Liao 13c3654bf5 other: merge 3.0 2024-02-20 10:51:04 +08:00
54liuyao 0e8170de49 remove invalid code 2024-02-20 10:17:47 +08:00
Alex Duan 2eb33b6ee6
Merge pull request #24759 from taosdata/coverage/TD-28602-3.0
coverage: add schUtil.c and schedulerTest
2024-02-20 09:14:03 +08:00
Haojun Liao 46b1fe520f
Merge pull request #24538 from taosdata/feat/TD-22023
stream count window
2024-02-20 08:50:25 +08:00
54liuyao af1893d109 merge 3.0 2024-02-19 18:30:12 +08:00
Haojun Liao 931b9f0b51 other: merge 3.0 2024-02-19 18:27:18 +08:00
dapan1121 1bf885d810
Merge pull request #24771 from taosdata/fix/TD-28567
fix:[TD-28567] do not add md5 to the end of subtable if create stream…
2024-02-19 17:23:09 +08:00
Alex Duan ba306043bb Merge branch '3.0' into coverage/TD-28602-3.0 2024-02-19 16:06:57 +08:00
Haojun Liao bf242a4f64 fix(stream): handle pause event in waiting list. 2024-02-19 15:57:21 +08:00
wangmm0220 ac9582b24a fix:[TD-28567] do not add md5 to the end of subtable if create stream by sma 2024-02-19 13:58:58 +08:00
Haojun Liao c5b26b406f fix(stream): fix syntax error. 2024-02-19 13:38:56 +08:00
Haojun Liao 730edf24f9 fix(stream): fix syntax error. 2024-02-19 13:38:14 +08:00
Haojun Liao d3e8adf2eb enh(stream): async handle pause event 2024-02-19 13:36:57 +08:00
54liuyao 94542dfcd3 free close window sbf 2024-02-19 13:30:26 +08:00
Haojun Liao 7e866c5527 refactor: do some internal refactor. 2024-02-19 11:32:04 +08:00
54liuyao b53dc5602e Merge branch '3.0' of https://github.com/taosdata/TDengine into 3.0 2024-02-19 10:58:20 +08:00
Haojun Liao e62dd2ff5c refactor: do some internal refactor. 2024-02-19 10:31:25 +08:00
54liuyao 637ac543c8 free close window sbf 2024-02-19 10:29:59 +08:00
Haojun Liao cf571e4f1f refactor: do some internal refactor. 2024-02-19 09:52:22 +08:00
Haojun Liao d5b316839d refactor: do some internal refactor. 2024-02-19 09:14:21 +08:00
54liuyao 05eaa90c11 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-22023 2024-02-19 08:59:15 +08:00
wangmm0220 a8e45440c0 fix:conflicts from 3.0 2024-02-18 18:02:14 +08:00
Haojun Liao 245f0ef806 fix(stream): fix deadlock. 2024-02-18 17:05:00 +08:00
Haojun Liao dbea34ce0e fix(stream): set the callback function for handle event. 2024-02-18 14:34:42 +08:00
Haojun Liao 472020a2b9 enh(stream): handle event async function. 2024-02-18 14:07:15 +08:00
Alex Duan 524ebca16a coverage: add schUtil.c and schedulerTest 2024-02-18 11:35:08 +08:00
Alex Duan 22595e6432 coverage: delete checkpointTest since ci failed 2024-02-17 11:33:11 +08:00
Alex Duan 818e9254ad fix: need cleanup 2024-02-15 22:48:51 +08:00
Alex Duan 2287317da2 coverage: add checkpointTest uint test 2024-02-15 22:38:27 +08:00
54liuyao eaf10fcb43 count window fill history 2024-02-05 18:37:24 +08:00
Haojun Liao 2bba011e4e Merge remote-tracking branch 'origin/feat/TD-22023' into feat/TD-22023 2024-02-05 17:51:23 +08:00
Haojun Liao 7a18e5910c enh(stream): halt the initial stream tasks when fill-history is set for count window agg 2024-02-05 17:51:09 +08:00
54liuyao 08cb46ac3e stream count window check point 2024-02-05 15:10:03 +08:00
54liuyao b16fc7d9df Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-22023 2024-02-05 10:15:59 +08:00
54liuyao ea9353b9fd merge 3.0 2024-02-04 16:04:23 +08:00
Haojun Liao 3236ef7bae feat(stream): return the stream source task exec delay, and do some internal refactor. 2024-02-02 11:26:47 +08:00
Haojun Liao 87e543c824 fix(stream): pass down the transId of checkpoint, to make sure the downstream task can report the error transId successfully. 2024-02-01 17:14:36 +08:00
Haojun Liao cb2ea4a721 fix(stream): take ver snapshot for all vgroups before launching stream with fill-history option opened. 2024-02-01 11:37:57 +08:00
wangmm0220 a9fcc67321 fix:conflicts from 3.0 2024-02-01 11:13:03 +08:00
Haojun Liao 556baed25d other: merge 3.0 2024-01-30 18:35:59 +08:00
Haojun Liao 1d110953c9 refactor: do some internal refactor. 2024-01-30 15:23:54 +08:00
Haojun Liao 4970040459 refactor: do some internal refactor. 2024-01-30 15:22:49 +08:00
Haojun Liao 45891babd3
Merge pull request #24655 from taosdata/fix/3_liaohj
refactor: do some internal refactor.
2024-01-30 09:15:10 +08:00
Haojun Liao 3730e43f0e refactor: disable some logs. 2024-01-29 17:24:58 +08:00
54liuyao d7fb8db086 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-22023 2024-01-29 16:13:39 +08:00
Haojun Liao bfbd61a02f
Merge pull request #24634 from taosdata/fix/3_liaohj
refactor: do some internal refactor.
2024-01-26 18:08:54 +08:00
Haojun Liao ac08f659c3 refactor: remove invalid procedure in fill-history. 2024-01-26 16:20:43 +08:00
54liuyao bc4f3d1296 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-22023 2024-01-26 15:55:06 +08:00
Haojun Liao db117a3ac7
Merge pull request #24628 from taosdata/fix/3_liaohj
refactor: do some internal refactor.
2024-01-26 09:09:44 +08:00
Haojun Liao 3751e11394 fix(stream): fix dead lock. 2024-01-25 17:11:16 +08:00
Haojun Liao d4bab8c09b refactor: do some internal refactor. 2024-01-25 16:53:30 +08:00
Haojun Liao 834f08a2e0
Merge pull request #24552 from taosdata/fix/3_liaohj
fix(stream): do checkpoint after fill-history task completed.
2024-01-25 16:53:11 +08:00
Haojun Liao 49bc3924fb fix(stream): update the check order. 2024-01-25 15:17:14 +08:00
Haojun Liao 2ecc202cb3 fix(stream): remove invalid assert. 2024-01-24 17:10:45 +08:00
Haojun Liao dc1ea9f9a1 fix(stream): clear htask info when unregistering the task. 2024-01-24 16:23:47 +08:00
Haojun Liao 1a45d40607 fix(stream): fix deadlock. 2024-01-24 14:37:46 +08:00
Haojun Liao b8856931d8 fix(stream): fix syntax error. 2024-01-24 13:11:36 +08:00
Haojun Liao 8a7e38ad15 fix(stream): fix checkpoint failure check. 2024-01-24 13:10:53 +08:00
yihaoDeng b1ac1deedb change db opt 2024-01-19 17:39:02 +08:00
Haojun Liao d973f66cea fix(stream): do checkpoint after fill-history task completed. 2024-01-19 16:18:02 +08:00
54liuyao bbabf91566 Merge branch '3.0' of https://github.com/taosdata/TDengine into 3.0 2024-01-19 14:50:16 +08:00
54liuyao 5a7d72d6ef Merge branch '3.0' of https://github.com/taosdata/TDengine into 3.0 2024-01-19 10:39:11 +08:00
wangmm0220 7246fedfef Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/ly_multi_marks 2024-01-18 19:08:35 +08:00
54liuyao ff8908dede ignore invalid state 2024-01-18 18:30:21 +08:00
Haojun Liao 76e6c453e7 enh(stream): send msg to mnode when the transferring state completed. 2024-01-18 15:43:36 +08:00
Haojun Liao 719d1d1b90 refactor: do some internal refactor. 2024-01-18 14:34:18 +08:00
Haojun Liao 8620e88965 fix(stream): enable wait for timer for meta quit safely. 2024-01-18 14:17:08 +08:00
Yihao Deng 06c9b8974b rebuild stream backen from locak 2024-01-18 04:06:25 +00:00
Haojun Liao 4a2cd87de7
Merge pull request #24503 from taosdata/fix/3_liaohj
fix(tsdb): fix race condition.
2024-01-17 18:27:54 +08:00
Haojun Liao ba8ec6fc7b
Merge pull request #24498 from taosdata/fix/fixDebugLogError
fix debug log err
2024-01-17 16:55:10 +08:00
Haojun Liao 56eac88349 Merge branch '3.0' into fix/3_liaohj 2024-01-17 15:14:52 +08:00
Haojun Liao 1ea671e373 enh(stream): remove time controller. 2024-01-17 14:55:15 +08:00
Haojun Liao fc16d26da2
Merge pull request #24488 from taosdata/fix/3_liaohj
fix(stream): fix some errors and do some internal refactor.
2024-01-17 14:25:32 +08:00
54liuyao 3bbfb26e09 stream count window 2024-01-17 14:22:19 +08:00
Yihao Deng f27b69f0c2 fix debug log err 2024-01-17 04:46:54 +00:00
Haojun Liao 3d98fc6a67 other: merge 3.0 2024-01-16 18:29:33 +08:00
Haojun Liao 8ede6d87ce refactor: do some internal refactor. 2024-01-16 15:40:40 +08:00
jiajingbin d59ede5196 Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/TD-28032 2024-01-16 15:05:13 +08:00
Haojun Liao 80793c94c2 fix(stream): reset the tasks status before start all tasks, and do some other internal refactor. 2024-01-16 14:32:45 +08:00
Haojun Liao dfe959eb28
Merge pull request #24468 from taosdata/fix/3_liaohj
fix(stream): fix deadlock in pause.
2024-01-16 12:58:27 +08:00
Haojun Liao b1c6ba467b Merge remote-tracking branch 'origin/fix/3_liaohj' into fix/3_liaohj 2024-01-16 10:28:20 +08:00
Haojun Liao 63494de7f9 refactor: do some internal refactor. 2024-01-16 10:28:07 +08:00
Yihao Deng 60c984a865 Merge branch 'fix/3_liaohj' of https://github.com/taosdata/TDengine into fix/3_liaohj 2024-01-15 11:33:16 +00:00
Yihao Deng 52b9c09d6c fix mem leak 2024-01-15 11:33:03 +00:00
Haojun Liao 5307a98f5d Merge remote-tracking branch 'origin/fix/3_liaohj' into fix/3_liaohj 2024-01-15 17:41:05 +08:00
Haojun Liao cacbb4e369 fix(stream): save the checkpoint info for sink tasks. 2024-01-15 17:40:35 +08:00
54liuyao 2e543d950a set delete for session op 2024-01-15 17:36:23 +08:00
Yihao Deng 8a2e431094 add hard link 2024-01-15 09:03:56 +00:00
wangmm0220 2ab54a1335 fix:conflicts from 3.0 2024-01-15 16:54:52 +08:00
Yihao Deng edbbd2282c Merge branch 'fix/3_liaohj' of https://github.com/taosdata/TDengine into fix/3_liaohj 2024-01-15 08:27:55 +00:00
Yihao Deng f55c93b969 add hard link 2024-01-15 08:27:35 +00:00
Haojun Liao bc657dc2d8 Merge remote-tracking branch 'origin/fix/3_liaohj' into fix/3_liaohj 2024-01-15 16:16:43 +08:00
Haojun Liao 43081b540b fix(stream): reset restart counter to be 0 if all tasks are ready. 2024-01-15 16:16:28 +08:00
Yihao Deng 14a7fe114d Merge branch 'fix/3_liaohj' of https://github.com/taosdata/TDengine into fix/3_liaohj 2024-01-15 07:47:25 +00:00
Yihao Deng 8d24a34015 add hard link 2024-01-15 07:46:30 +00:00
Haojun Liao 143e6a13af fix(stream): fix deadlock in pause. 2024-01-15 14:37:24 +08:00
Haojun Liao e012bc4bde refactor: do some internal refactor. 2024-01-15 11:28:36 +08:00
Haojun Liao d46b5e6c9a fix(stream): enable sink tasks handle the checkpoint. 2024-01-15 09:53:15 +08:00
Haojun Liao ce855bc493 refactor: do some internal refactor. 2024-01-15 09:21:31 +08:00
Haojun Liao dc1a0821a7 refactor: do some internal refactor. 2024-01-13 00:19:46 +08:00
Haojun Liao 98758862cf refactor: do some internal refactor. 2024-01-13 00:17:29 +08:00
Haojun Liao 44208925f9 refactor: do some internal refactor. 2024-01-13 00:10:47 +08:00
Haojun Liao 00e2bdec23 refactor: do some internal refactor. 2024-01-12 19:08:46 +08:00
wangmm0220 00e0da15a3 fix:[TD-28032]groupid = 0 & modify test case in sim 2024-01-12 17:37:22 +08:00
Haojun Liao 5fa8f85c42 fix(stream): remove invalid release. 2024-01-12 11:28:41 +08:00
Haojun Liao b36cc97236 fix(stream): close the inputQ of the related stream task when the fill-history task recv the trans-state msg from upstream. 2024-01-12 10:44:49 +08:00
Haojun Liao 9703018f56 fix(stream): add checkpoint status check. 2024-01-11 16:47:51 +08:00
Haojun Liao d4fd544c74 refactor: remove sleep. 2024-01-11 15:18:11 +08:00
Haojun Liao 58694c67dd refactor: do some internal refactor. 2024-01-11 11:50:52 +08:00
Haojun Liao bff0ad89a4 other: merge 3.0 2024-01-11 09:51:12 +08:00
Haojun Liao 1c562bd535 refactor: enable the restart of stream tasks. 2024-01-11 09:41:40 +08:00
54liuyao 3b36dbbe18 opt recover buff 2024-01-11 09:40:54 +08:00
Haojun Liao 9294c8d4ee fix(stream): enable the hb to mnode for stream meta when it becomes the leader. 2024-01-11 09:20:34 +08:00
Haojun Liao dcbe963d32 fix(stream): keep the previous status in stack object. 2024-01-10 19:19:53 +08:00
wangmm0220 df69a89da2 fix:[TD-28185]add pause & resume logic for snode 2024-01-10 18:46:10 +08:00
Haojun Liao 9d0d0d9ddc Merge branch '3.0' into fix/3_liaohj 2024-01-10 09:57:46 +08:00
Haojun Liao dc0c5539a0 fix(stream): remove invalid timer controllers. 2024-01-10 08:48:49 +08:00
Haojun Liao f9d5c0d403 fix(stream): fix error in tq timer. 2024-01-09 09:13:53 +08:00
Haojun Liao bbaaad6f1f fix(stream): add null ptr check. 2024-01-08 18:45:36 +08:00
Haojun Liao af9dc441b2 fix(stream): reset the saved value for fill-history task. 2024-01-08 18:40:06 +08:00
Haojun Liao 70c1e66959 fix(stream): release task after launch stream tasks. 2024-01-08 18:19:31 +08:00
Yihao Deng 4c5441da7e refactor stream code 2024-01-08 08:38:16 +00:00
Yihao Deng 1c28f53525 refactor stream code 2024-01-08 08:28:00 +00:00
Haojun Liao bb9edde79e fix(stream): add some logs. 2024-01-08 11:33:54 +08:00
Haojun Liao 5e32aea1f9 fix(stream): jump out of loop when downstream is blocking. 2024-01-07 00:27:18 +08:00
Haojun Liao 02f6c971fd fix(stream): check for not ready task when rsp returned. 2024-01-06 19:43:39 +08:00
Haojun Liao 522e688387 fix(stream): check if in restart procedure in call back. 2024-01-05 22:16:58 +08:00
Haojun Liao 2386f842fb enh(stream): remove sleep to opt perf. 2024-01-05 18:46:15 +08:00
Haojun Liao 33253cbb54 fix(stream): add null ptr check. 2024-01-05 18:13:35 +08:00
Haojun Liao 0c4b91dc72 enh(stream): start task async. 2024-01-05 17:55:39 +08:00
54liuyao 0b9e3c9871 fix stream state buff issue 2024-01-05 16:20:55 +08:00
Haojun Liao 1912de9b49 enh(stream): scan wal by using timer to trigger it. 2024-01-05 14:49:33 +08:00
Haojun Liao 0c8d5e3586 fix(stream): fix syntax error. 2024-01-04 19:20:50 +08:00
Haojun Liao 356b7093f5 fix(stream): fix syntax error. 2024-01-04 19:18:10 +08:00
Haojun Liao 14e90eb16e fix(stream): fix syntax error. 2024-01-04 19:15:51 +08:00
Haojun Liao 4df83e92cd fix(stream): fix syntax error. 2024-01-04 19:14:24 +08:00
Haojun Liao 6286e42f5c refactor: do some internal refactor. 2024-01-04 19:11:50 +08:00
Haojun Liao 33f698e926 fix(stream): remove invalid assert and add check for task status before launching related fill-history task. 2024-01-04 19:09:45 +08:00
Haojun Liao 6d37e596ec refactor: do some internal refactor. 2024-01-04 18:47:49 +08:00
Haojun Liao c494252002 fix(stream): record the related fill-history task failure. 2024-01-04 17:44:05 +08:00
Haojun Liao 74df121cf5 fix(stream): fix the deadlock. 2024-01-03 22:29:46 +08:00
wangmm0220 b200e6807f fix:[TD-28032]concat subtable and hash val as new subtable name to avoid data from multi time line write to one time line 2024-01-03 19:44:30 +08:00
wangmm0220 317f0c6a39 fix:[TD-28032]concat subtable and hash val as new subtable name to avoid data from multi time line write to one time line 2024-01-03 18:48:54 +08:00
Haojun Liao 4138692cea fix(stream): scan wal data files. 2024-01-03 18:16:18 +08:00
Haojun Liao 185fa75376 enh(stream): add task into timer to be idle during exec when the corresponding output queue is full. 2024-01-03 17:59:42 +08:00
wangmm0220 9ba2f71487 fix:[TD-28032]concat subtable and hash val as new subtable name to avoid data from multi time line write to one time line 2024-01-03 10:16:43 +08:00
wangmm0220 8add4dc177 fix:[TD-28032]concat subtable and hash val as new subtable name to avoid data from multi time line write to one time line 2024-01-02 18:37:29 +08:00
Haojun Liao 2387d5bade refactor: do some internal refactor. 2024-01-02 17:10:12 +08:00
Haojun Liao e7a0044502 Merge branch '3.0' into fix/3_liaohj 2024-01-02 13:02:55 +08:00
54liuyao c787535693 fix session state issue 2024-01-02 10:11:22 +08:00
Alex Duan 28238fa7dc coverage: no call function with BUILD_NO_CALL MACRO define 2023-12-31 18:29:37 +08:00
Haojun Liao 646f24659e fix(stream): fix syntax error. 2023-12-27 22:58:08 +08:00
Haojun Liao 7eb0e42bb9 fix(stream): handle error when checkpoint is interrupted by nodeUpdate. 2023-12-27 22:57:58 +08:00
Haojun Liao e553b84904 fix(stream): fix syntax error. 2023-12-26 19:16:49 +08:00
Haojun Liao 5592e11235 fix(stream): handle error when checkpoint is interrupted by nodeUpdate. 2023-12-26 19:02:52 +08:00
54liuyao e2564a6189 fix issue 2023-12-26 18:35:49 +08:00
Haojun Liao 62cfcefbb0 refactor: remove stream-scan-history event for stream task. 2023-12-26 00:34:04 +08:00
Haojun Liao f14c3b93c1 refactor: do some internal refactor. 2023-12-25 18:22:36 +08:00
Haojun Liao 60977d56bd refactor: set attribute only on Linux 2023-12-25 12:47:16 +08:00
Haojun Liao 0877e0bfad other: merge 3.0 2023-12-25 09:13:31 +08:00
Haojun Liao cd85dae3fd fix(stream): fix the dead lock. 2023-12-24 23:30:00 +08:00
Haojun Liao bf895fadcb fix(stream): fix invalid read. 2023-12-24 03:05:29 +08:00
Haojun Liao 30498a4028 refactor: do some internal refactor. 2023-12-24 02:24:46 +08:00
Haojun Liao 25f798e42f fix(stream): record the start failure tasks 2023-12-23 23:29:30 +08:00
Haojun Liao c61203b55a fix: fix deadlock. 2023-12-23 16:37:21 +08:00
Haojun Liao 8a714db17d fix: fix deadlock. 2023-12-23 15:33:50 +08:00
Haojun Liao 5c1ff76082 fix(stream): set rwlock attr. 2023-12-23 00:58:52 +08:00
Haojun Liao 66bdace9eb fix(stream): check rsp. 2023-12-23 00:09:55 +08:00
Haojun Liao 80604ec8e2 fix(stream): init rwlock. 2023-12-22 23:31:51 +08:00
Haojun Liao b175a4b7b3 refactor(stream): async stop tasks, and do some internal refactor. 2023-12-22 17:56:16 +08:00
Haojun Liao 7ce545bcd4 refactor: refactor the lock type. 2023-12-22 16:14:49 +08:00
Haojun Liao dce0a6c74a fix(stream): remove invalid assert 2023-12-22 15:24:37 +08:00
Haojun Liao e91afa7df2 fix(stream): fix deadlock. 2023-12-22 14:51:04 +08:00
Haojun Liao 90898a16e0 refactor: do some internal refactor. 2023-12-22 13:57:15 +08:00
Haojun Liao c9475060de fix(stream): fix race condition. 2023-12-22 09:34:49 +08:00
Haojun Liao 84583580e2 fix(stream): transfer the checkpoint trans id. 2023-12-21 19:12:49 +08:00
Haojun Liao 2acc8423c5 fix(stream): send msg to mnode before closing all tasks. 2023-12-21 16:00:50 +08:00
Haojun Liao 8a8ddf5699 fix(stream): record the checkpoint failure when nodeEp changed. 2023-12-21 10:30:44 +08:00
Haojun Liao 32ce4b6a4c fix(stream): fix race condition. 2023-12-20 23:12:59 +08:00
Haojun Liao 64eee4bbd2 fix(stream): add conflict check for nodeUpdate 2023-12-20 19:06:32 +08:00
Haojun Liao 849aaf8d4f fix(stream): avoid dead lock. 2023-12-20 18:07:53 +08:00
yihaoDeng d6297e26ce init backend mutex 2023-12-20 16:56:12 +08:00
Haojun Liao 43fb7cf14a other: add log info. 2023-12-20 16:04:20 +08:00
wangmm0220 de8ce3f7ec fix:send stream retrieve msg to source task 2023-12-20 16:01:17 +08:00
Haojun Liao 1a8583887f fix(stream): remove clear backendcache. 2023-12-20 15:35:43 +08:00
Haojun Liao 94b260a1f9 refactor: do some internal refactor. 2023-12-20 10:29:04 +08:00
Haojun Liao 17e9e84aa9 Merge branch '3.0' into fix/3_liaohj 2023-12-19 16:43:08 +08:00
Haojun Liao fee198f9ad refactor: do some internal refactor. 2023-12-19 16:21:11 +08:00
wangmm0220 81b5f59fa5 Merge branch 'feat/ly_multi_marks' of https://github.com/taosdata/TDengine into feat/ly_multi_marks 2023-12-19 10:54:12 +08:00
wangmm0220 3a0af1ea49 fix:aggCnt must bigger than 1 & move msg code to the end to be compatible with old version 2023-12-19 10:53:46 +08:00
Haojun Liao ec3183b6a8 other: merge 3.0 2023-12-18 23:16:37 +08:00
Haojun Liao 612b50c4cd
Merge pull request #24097 from taosdata/fix/TD-27834
fix stream backend crash when transfer
2023-12-18 23:13:08 +08:00
Haojun Liao e734569de0 fix(stream): fix dead lock. 2023-12-18 18:42:57 +08:00
Haojun Liao bba5a4f08b other: merge main into 3.0 2023-12-18 18:26:42 +08:00
Haojun Liao ea6e78cbaa fix(stream): add async call restart, instead of sync wait. 2023-12-18 16:33:44 +08:00
Haojun Liao 79672f8e5f
Merge pull request #24107 from taosdata/fix/3_liaohj
fix(stream): add check for null ptr and leader .
2023-12-18 16:24:07 +08:00
yihaoDeng 1dea66d4f5 fix stream backend crash when transfer 2023-12-18 15:48:01 +08:00
Haojun Liao b4a1907fb7 fix(stream): add check for null ptr and leader . 2023-12-18 11:52:59 +08:00
yihaoDeng 0840e6a0d8 fix stream backend crash when transfer 2023-12-18 11:19:15 +08:00
Haojun Liao ef0cab18cb
Merge pull request #24098 from taosdata/fix/3_liaohj
fix(stream): send checkpoint complete msg to mnode when dropping it.
2023-12-17 11:03:04 +08:00
Haojun Liao 4f852704f5 fix(stream): send checkpoint complete msg to mnode when dropping it. 2023-12-17 02:06:01 +08:00
Haojun Liao 9bd80cf0f8
Merge pull request #24094 from taosdata/fix/TD-27905
Fix/td 27905
2023-12-16 18:07:17 +08:00
yihaoDeng 5aa575acfa fix stream backend crash when transfer 2023-12-16 18:03:32 +08:00
yihaoDeng 6f4fb506a0 fix stream backend crash when transfer 2023-12-16 17:43:41 +08:00
yihaoDeng 8045d2bda7 fix stream backend crash when transfer 2023-12-16 15:20:38 +08:00
yihaoDeng 547d797a26 fix stream backend crash when transfer 2023-12-16 15:05:27 +08:00
Haojun Liao 9978d8cbfd
Merge pull request #24089 from taosdata/fix/TD-27880
Fix/td 27880
2023-12-16 13:13:48 +08:00
yihaoDeng 7ab7a64eb3 Merge branch '3.0' into fix/snodeBackendCrash 2023-12-15 18:16:14 +08:00
yihaoDeng 73c7e17033 fix error case 2023-12-15 18:02:14 +08:00
yihaoDeng d8093d9f21 not do chkp when pbackend not inited 2023-12-15 11:47:44 +08:00
yihaoDeng 5189f3d15b not do chkp when pbackend not inited 2023-12-15 09:18:37 +08:00
Haojun Liao 05ca8f1784
Merge pull request #24056 from taosdata/fix/3_liaohj
refactor: do some internal refactor.
2023-12-14 13:52:04 +08:00
Haojun Liao 81f96603b0 refactor: do some internal refactor. 2023-12-14 09:33:51 +08:00
Minglei Jin 2dbb718101 Merge branch '3.0' into enh/TD-27119 2023-12-08 14:48:17 +08:00
yihaoDeng a82856dff7 fix mem leak 2023-12-05 20:28:12 +08:00
yihaoDeng c692f8c21c add stream backend copy 2023-12-05 18:03:58 +08:00
yihaoDeng 87c78919a9 add stream backend copy 2023-12-05 17:09:03 +08:00
54liuyao 38900d672e Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-27419 2023-12-04 09:12:53 +08:00
Haojun Liao 48af3a9559
Merge pull request #23909 from taosdata/fix/TD-27455
fix:[TD-27644]heartbeat closed before snode close leading to snode is…
2023-12-04 09:10:00 +08:00
wangmm0220 f06117dbc9 fix:[TD-27644]heartbeat closed before snode close leading to snode is hanged 2023-12-01 17:32:29 +08:00
Haojun Liao d7a19a9179 fix(stream): fix invalid decode hbmsg and memory leaks caused by invalid hb msg. 2023-12-01 14:45:18 +08:00
Haojun Liao 4e5853d9fe refactor: do some internal refactor. 2023-12-01 12:09:49 +08:00
Haojun Liao dba58f5e38 fix(stream): fix syntax error. 2023-12-01 11:54:13 +08:00
Haojun Liao eac3cbf564 fix(stream): merge 3.0 2023-12-01 11:12:57 +08:00
Haojun Liao e753d631af fix(stream): make sure open operator only once for scan-history task. 2023-12-01 10:21:07 +08:00
Haojun Liao 1df29b5d6c fix(stream): disable the time slice usage limitation for stream task. 2023-12-01 10:20:15 +08:00
Haojun Liao 57b8388dad fix(stream): fix error. 2023-12-01 10:20:00 +08:00
Haojun Liao 468094c86a fix(stream):set failure for the related fill-history task. 2023-12-01 10:19:45 +08:00
Haojun Liao 9d735e7f8b fix(stream): reduce the sink throughput. and fix the bug in status check. 2023-12-01 10:18:25 +08:00
Haojun Liao 2b03d64850 fix(stream): drop the related fill-history task & set the task to be ready, if the drop fill-history task msg is missing due to the vnode restarting. 2023-12-01 10:18:15 +08:00
Haojun Liao f54fe2d6ef refactor: do some internal refactor. 2023-12-01 10:17:15 +08:00
Haojun Liao fee9d751d4 fix(stream): fix the race condition in dispatching data. 2023-12-01 10:17:14 +08:00
Minglei Jin 49ecb1093f cos/put: new arg withcp to control resumable uploading 2023-11-30 17:20:21 +08:00
Haojun Liao 30d78c6be1 fix(stream): make sure open operator only once for scan-history task. 2023-11-30 16:10:09 +08:00
54liuyao 271311a770 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-27419 2023-11-30 14:33:48 +08:00
yihaoDeng 5c32680cd8 Merge branch '3.0' into enh/refactorBackend 2023-11-30 10:31:27 +08:00
Haojun Liao 130614c938
Merge pull request #23831 from taosdata/fix/3_liaohj
enh(stream/tsdb): do multiple optimization and fix some bugs.
2023-11-30 09:20:15 +08:00
yihaoDeng 08cc976975 fix crash 2023-11-29 19:57:30 +08:00
yihaoDeng 03b698d8ae change default config 2023-11-29 14:50:07 +08:00
54liuyao ae386c6e34 opt expired data 2023-11-29 11:16:56 +08:00
yihaoDeng cc1eb2769f fix crash while quit 2023-11-28 20:29:42 +08:00
yihaoDeng 08eeee0794 Merge branch '3.0' into enh/refactorBackend 2023-11-28 11:52:49 +08:00
Haojun Liao c5aba60899 fix(stream): disable the time slice usage limitation for stream task. 2023-11-28 09:28:43 +08:00
yihaoDeng a4d475b582 fix rsma 2023-11-27 20:27:53 +08:00
wangmm0220 06e2fbfb1c fix:conflicts from 3.0 2023-11-27 17:53:53 +08:00
wangmm0220 70c5d36103 opti:extract common logic from snode & vnode to tqCommon 2023-11-27 17:49:09 +08:00
Haojun Liao 6111138567 fix(stream): fix error. 2023-11-27 17:23:34 +08:00
yihaoDeng e9bec34c44 Merge branch '3.0' into enh/refactorBackend 2023-11-27 10:01:12 +08:00
yihaoDeng 6416a6153a Merge branch '3.0' into enh/refactorBackend 2023-11-24 16:29:09 +08:00
Haojun Liao 3deab3cfbf fix(stream):set failure for the related fill-history task. 2023-11-24 15:37:30 +08:00
yihaoDeng 23ae62d268 Merge branch '3.0' into enh/refactorBackend 2023-11-24 11:10:39 +08:00
yihaoDeng 50f996bbf7 Merge branch '3.0' into enh/refactorBackend 2023-11-23 21:07:58 +08:00
wangmm0220 d249892b2a fix:conflicts from 3.0 2023-11-23 20:29:46 +08:00
Haojun Liao 2e922fefc6 fix(stream): reduce the sink throughput. and fix the bug in status check. 2023-11-23 18:04:09 +08:00
yihaoDeng 6129ebc294 Merge branch '3.0' into enh/refactorBackend 2023-11-23 17:41:37 +08:00
Haojun Liao 0a90c33b4d fix(stream): drop the related fill-history task & set the task to be ready, if the drop fill-history task msg is missing due to the vnode restarting. 2023-11-23 15:49:07 +08:00
Haojun Liao de47ea6c81 other: merge 3.0. 2023-11-23 15:42:40 +08:00
Haojun Liao 1a1319908d refactor: do some internal refactor. 2023-11-23 14:25:52 +08:00
yihaoDeng 6a0501967d Merge branch '3.0' into fix/fixChkpRespMemleak 2023-11-23 14:06:04 +08:00
Haojun Liao 8ad071e69a other: merge main. 2023-11-23 10:25:51 +08:00
Haojun Liao f3355000a3 refactor: do some internal refactor. 2023-11-23 09:34:20 +08:00
Haojun Liao 00f8103262 fix(stream): fix error in generating token in bucket. 2023-11-23 09:34:19 +08:00
Haojun Liao b7347a1d64 fix(stream): remove invalid assert 2023-11-23 09:33:41 +08:00
Haojun Liao 466c80e370 fix(stream): fix bug in delay send. 2023-11-23 09:33:38 +08:00
Haojun Liao 957ce07dc4 fix(stream): fix syntax error. 2023-11-23 09:33:38 +08:00
Haojun Liao 298755cc4e fix(stream): wait for task to be normal and then send data block. 2023-11-23 09:33:37 +08:00
Haojun Liao 7b1f586d4f
Merge pull request #23762 from taosdata/fix/3_liaohj
fix(stream): fix error in generating token in bucket.
2023-11-23 09:32:14 +08:00
wangmm0220 15d75a0497 fix:spelling errors 2023-11-23 09:17:54 +08:00
Haojun Liao 4ea49fe285 fix(stream): fix the race condition in dispatching data. 2023-11-22 23:49:16 +08:00
wangmm0220 9a09e318ca opti:common message process logic in vnode and snode 2023-11-22 16:53:33 +08:00
Haojun Liao 91e7000433 Merge branch 'enh/refactorBackend' of github.com:taosdata/tdengine into enh/refactorBackend 2023-11-22 15:29:31 +08:00
Haojun Liao c96f7cf182 fix(stream): scheduler the checkpoint generating. 2023-11-22 15:17:21 +08:00
yihaoDeng 0eba15b4a4 Merge branch '3.0' into enh/refactorBackend 2023-11-22 10:57:41 +08:00
yihaoDeng 0c0d9cdd2c Merge branch '3.0' into fix/fixChkpRespMemleak 2023-11-22 10:42:30 +08:00
Haojun Liao 81d3e5737e fix(stream): fix send msg error. 2023-11-22 08:41:55 +08:00
Haojun Liao c70c54a099 fix(stream): add missing pushed data. 2023-11-22 08:41:35 +08:00
Haojun Liao b712f5e7dc refactor: do some internal refactor. 2023-11-22 08:41:17 +08:00
Haojun Liao d355b78884 fix(stream): fix invalid read. 2023-11-22 08:40:28 +08:00
Haojun Liao 75420bfefb fix(stream): fix the checkpoint msg failure. 2023-11-22 08:40:01 +08:00
yihaoDeng 947775155b fix transfer crash 2023-11-21 20:51:11 +08:00
Haojun Liao 785d91c17b
Merge pull request #23661 from taosdata/feat/TD-26060
fix: errors in snode in conditions like fill history/checkpoint/restart
2023-11-21 19:02:38 +08:00
yihaoDeng a92602b667 fix mem leak 2023-11-21 15:23:28 +08:00
Haojun Liao 2b099b11dd refactor: do some internal refactor. 2023-11-21 10:09:59 +08:00
yihaoDeng 939aa7a3cc Merge branch '3.0' into enh/refactorBackend 2023-11-20 17:33:30 +08:00
yihaoDeng 0d724244dc Merge branch '3.0' into enh/refactorBackend 2023-11-20 16:55:14 +08:00
Haojun Liao 9f8a63099c fix(stream): fix error in generating token in bucket. 2023-11-20 15:26:50 +08:00
Haojun Liao 7cfa45e95e enh(stream): add sink_quota/scan-history-idle-duration column for stream tasks. 2023-11-20 11:59:49 +08:00
yihaoDeng 734bf07317 Merge branch '3.0' into enh/refactorBackend 2023-11-20 10:48:49 +08:00
Haojun Liao 1b4f187ded
Merge pull request #23743 from taosdata/fix/pause_stream
fix(stream): remove invalid assert
2023-11-17 23:48:47 +08:00
Haojun Liao 709502ba9e fix(stream): record the check downstream failure. 2023-11-17 22:05:36 +08:00
wangmm0220 3241f9bda5 fix:memory leak 2023-11-17 17:26:52 +08:00
yihaoDeng 20de2f3cb5 Merge branch '3.0' into enh/refactorBackend 2023-11-17 17:15:14 +08:00
yihaoDeng e7830bfdfd fix stream backend convert 2023-11-17 16:50:45 +08:00
Haojun Liao 753716f1e6 fix(stream): remove invalid assert 2023-11-17 16:36:17 +08:00
yihaoDeng 286413abbb fix stream backend convert 2023-11-17 16:14:51 +08:00
Haojun Liao b12e5050ea fix(stream): remove invalid assert 2023-11-17 15:57:46 +08:00
yihaoDeng ccc74ef558 fix stream backend convert 2023-11-17 15:39:03 +08:00
yihaoDeng 1dbdb32dd7 fix stream backend convert 2023-11-17 11:56:22 +08:00
yihaoDeng c7c1bdef6e fix stream backend convert 2023-11-17 11:44:21 +08:00
yihaoDeng e455c4799d fix stream backend convert 2023-11-17 10:33:43 +08:00
yihaoDeng b6994413d0 fix stream backend convert 2023-11-17 10:13:39 +08:00
Haojun Liao 27f3723cd3
Merge pull request #23723 from taosdata/fix/3_liaohj
fix(stream): wait for task to be normal and then send data block.
2023-11-16 22:58:50 +08:00
yihaoDeng 52d7a26c10 fix stream backend convert 2023-11-16 21:22:47 +08:00
wangmm0220 a5de1b032b fix:snode upport stream task 2023-11-16 21:19:58 +08:00
Haojun Liao 3100edae5d
Merge pull request #23727 from taosdata/fix/pause_stream
fix(stream): wait for task to be normal and then send data block.
2023-11-16 19:51:33 +08:00