xxq250
/
homework-jianmu
1
0
Fork 0
Code Issues Pull Requests 1 Actions Packages Projects Releases Wiki Activity
72,539 Commits 3 Branches 0 Tags 479 MiB
Commit Graph

705 Commits

Author SHA1 Message Date
Haojun Liao 815d12fd77 fix(stream): set check downstream completed for sink task. 2024-04-18 18:36:02 +08:00
Haojun Liao e7dee4ac63 refactor(stream): refactor check msg retry procedure and be tolerant to the dnode disconnection during check downstream tasks. 2024-04-18 15:55:21 +08:00
Haojun Liao ac84a5f82b refactor: do some internal refactor. 2024-04-17 21:57:09 +08:00
Haojun Liao 8bdd43c305 fix(stream): wait for 50ms when no token in bucket for sink task. 2024-04-16 14:42:21 +08:00
Haojun Liao 1ac192c069 fix(stream): keep the original tsdb scan version range. 2024-04-15 18:41:38 +08:00
Haojun Liao 665107ad3a enh(stream): add more info in meta table. 2024-04-15 14:23:37 +08:00
Haojun Liao f23a8a37bc refactor: do some internal refactor. 2024-04-10 16:43:02 +08:00
Haojun Liao dcc97472d3 fix(stream): add strict check for checkpoint-trigger msg dispatach rsp confirmation flag. 2024-04-02 21:53:50 +08:00
wangmm0220 8e2a2414c0 fix:same subtable same partition by leads to same table name in stream 2024-03-28 13:48:46 +08:00
Haojun Liao 4d10f28a00
Merge pull request #24999 from taosdata/fix/nullcheck 
fix(stream): remove related fill-history if task in stop status.
 2024-03-05 09:15:21 +08:00
Haojun Liao 80fd3e0445 fix(stream): remove related fill-history if task in stop status. 2024-03-04 19:31:47 +08:00
Haojun Liao 5554362399 fix(stream):remove unused def. 2024-03-03 16:41:16 +08:00
Haojun Liao db92bf84d8 other: merge 3.0 2024-02-29 22:21:50 +08:00
Haojun Liao 13c3654bf5 other: merge 3.0 2024-02-20 10:51:04 +08:00
54liuyao 0e8170de49 remove invalid code 2024-02-20 10:17:47 +08:00
Haojun Liao 46b1fe520f
Merge pull request #24538 from taosdata/feat/TD-22023 
stream count window
 2024-02-20 08:50:25 +08:00
54liuyao af1893d109 merge 3.0 2024-02-19 18:30:12 +08:00
Haojun Liao 931b9f0b51 other: merge 3.0 2024-02-19 18:27:18 +08:00
Haojun Liao bf242a4f64 fix(stream): handle pause event in waiting list. 2024-02-19 15:57:21 +08:00
wangmm0220 ac9582b24a fix:[TD-28567] do not add md5 to the end of subtable if create stream by sma 2024-02-19 13:58:58 +08:00
54liuyao b53dc5602e Merge branch '3.0' of https://github.com/taosdata/TDengine into 3.0 2024-02-19 10:58:20 +08:00
Haojun Liao e62dd2ff5c refactor: do some internal refactor. 2024-02-19 10:31:25 +08:00
Haojun Liao cf571e4f1f refactor: do some internal refactor. 2024-02-19 09:52:22 +08:00
wangmm0220 a8e45440c0 fix:conflicts from 3.0 2024-02-18 18:02:14 +08:00
Haojun Liao 472020a2b9 enh(stream): handle event async function. 2024-02-18 14:07:15 +08:00
Haojun Liao 2bba011e4e Merge remote-tracking branch 'origin/feat/TD-22023' into feat/TD-22023 2024-02-05 17:51:23 +08:00
Haojun Liao 7a18e5910c enh(stream): halt the initial stream tasks when fill-history is set for count window agg 2024-02-05 17:51:09 +08:00
Haojun Liao 739485a419 test(stream): add unit test case for the mnode stream module. 2024-02-05 09:10:04 +08:00
Haojun Liao 3236ef7bae feat(stream): return the stream source task exec delay, and do some internal refactor. 2024-02-02 11:26:47 +08:00
Haojun Liao cb2ea4a721 fix(stream): take ver snapshot for all vgroups before launching stream with fill-history option opened. 2024-02-01 11:37:57 +08:00
wangmm0220 a9fcc67321 fix:conflicts from 3.0 2024-02-01 11:13:03 +08:00
Haojun Liao 4970040459 refactor: do some internal refactor. 2024-01-30 15:22:49 +08:00
Haojun Liao ac08f659c3 refactor: remove invalid procedure in fill-history. 2024-01-26 16:20:43 +08:00
Haojun Liao d4bab8c09b refactor: do some internal refactor. 2024-01-25 16:53:30 +08:00
Haojun Liao 1a45d40607 fix(stream): fix deadlock. 2024-01-24 14:37:46 +08:00
Haojun Liao 8a7e38ad15 fix(stream): fix checkpoint failure check. 2024-01-24 13:10:53 +08:00
Haojun Liao d973f66cea fix(stream): do checkpoint after fill-history task completed. 2024-01-19 16:18:02 +08:00
wangmm0220 7246fedfef Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/ly_multi_marks 2024-01-18 19:08:35 +08:00
Haojun Liao 76e6c453e7 enh(stream): send msg to mnode when the transferring state completed. 2024-01-18 15:43:36 +08:00
Haojun Liao 56eac88349 Merge branch '3.0' into fix/3_liaohj 2024-01-17 15:14:52 +08:00
Haojun Liao 1ea671e373 enh(stream): remove time controller. 2024-01-17 14:55:15 +08:00
Haojun Liao fc16d26da2
Merge pull request #24488 from taosdata/fix/3_liaohj 
fix(stream): fix some errors and do some internal refactor.
 2024-01-17 14:25:32 +08:00
Haojun Liao 8ede6d87ce refactor: do some internal refactor. 2024-01-16 15:40:40 +08:00
jiajingbin d59ede5196 Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/TD-28032 2024-01-16 15:05:13 +08:00
Haojun Liao 80793c94c2 fix(stream): reset the tasks status before start all tasks, and do some other internal refactor. 2024-01-16 14:32:45 +08:00
Haojun Liao 63494de7f9 refactor: do some internal refactor. 2024-01-16 10:28:07 +08:00
wangmm0220 2ab54a1335 fix:conflicts from 3.0 2024-01-15 16:54:52 +08:00
Haojun Liao 43081b540b fix(stream): reset restart counter to be 0 if all tasks are ready. 2024-01-15 16:16:28 +08:00
Haojun Liao 143e6a13af fix(stream): fix deadlock in pause. 2024-01-15 14:37:24 +08:00
Haojun Liao e012bc4bde refactor: do some internal refactor. 2024-01-15 11:28:36 +08:00
Haojun Liao 00e2bdec23 refactor: do some internal refactor. 2024-01-12 19:08:46 +08:00
Haojun Liao b36cc97236 fix(stream): close the inputQ of the related stream task when the fill-history task recv the trans-state msg from upstream. 2024-01-12 10:44:49 +08:00
Haojun Liao 58694c67dd refactor: do some internal refactor. 2024-01-11 11:50:52 +08:00
Haojun Liao af9dc441b2 fix(stream): reset the saved value for fill-history task. 2024-01-08 18:40:06 +08:00
Haojun Liao 02f6c971fd fix(stream): check for not ready task when rsp returned. 2024-01-06 19:43:39 +08:00
Haojun Liao 0c4b91dc72 enh(stream): start task async. 2024-01-05 17:55:39 +08:00
Haojun Liao 1912de9b49 enh(stream): scan wal by using timer to trigger it. 2024-01-05 14:49:33 +08:00
Haojun Liao fa9df2a495 refactor: do some internal refactor. 2024-01-04 18:48:19 +08:00
Haojun Liao 185fa75376 enh(stream): add task into timer to be idle during exec when the corresponding output queue is full. 2024-01-03 17:59:42 +08:00
wangmm0220 8add4dc177 fix:[TD-28032]concat subtable and hash val as new subtable name to avoid data from multi time line write to one time line 2024-01-02 18:37:29 +08:00
Haojun Liao 2387d5bade refactor: do some internal refactor. 2024-01-02 17:10:12 +08:00
Haojun Liao 62cfcefbb0 refactor: remove stream-scan-history event for stream task. 2023-12-26 00:34:04 +08:00
Haojun Liao b175a4b7b3 refactor(stream): async stop tasks, and do some internal refactor. 2023-12-22 17:56:16 +08:00
Haojun Liao 7ce545bcd4 refactor: refactor the lock type. 2023-12-22 16:14:49 +08:00
Haojun Liao e91afa7df2 fix(stream): fix deadlock. 2023-12-22 14:51:04 +08:00
Haojun Liao 84583580e2 fix(stream): transfer the checkpoint trans id. 2023-12-21 19:12:49 +08:00
Haojun Liao 2acc8423c5 fix(stream): send msg to mnode before closing all tasks. 2023-12-21 16:00:50 +08:00
wangmm0220 de8ce3f7ec fix:send stream retrieve msg to source task 2023-12-20 16:01:17 +08:00
Haojun Liao d25a323a4c fix(stream): record the launch failure. 2023-12-20 13:55:12 +08:00
Haojun Liao 17e9e84aa9 Merge branch '3.0' into fix/3_liaohj 2023-12-19 16:43:08 +08:00
Haojun Liao bba5a4f08b other: merge main into 3.0 2023-12-18 18:26:42 +08:00
Haojun Liao ea6e78cbaa fix(stream): add async call restart, instead of sync wait. 2023-12-18 16:33:44 +08:00
Haojun Liao f2bba670d8 fix(stream): remove unused attribution. 2023-12-18 11:26:49 +08:00
Haojun Liao 239b2d4f00 refactor: do some internal refactor. 2023-12-14 09:51:27 +08:00
Haojun Liao 81f96603b0 refactor: do some internal refactor. 2023-12-14 09:33:51 +08:00
Haojun Liao 48af3a9559
Merge pull request #23909 from taosdata/fix/TD-27455 
fix:[TD-27644]heartbeat closed before snode close leading to snode is…
 2023-12-04 09:10:00 +08:00
wangmm0220 f06117dbc9 fix:[TD-27644]heartbeat closed before snode close leading to snode is hanged 2023-12-01 17:32:29 +08:00
Haojun Liao d7a19a9179 fix(stream): fix invalid decode hbmsg and memory leaks caused by invalid hb msg. 2023-12-01 14:45:18 +08:00
Haojun Liao eac3cbf564 fix(stream): merge 3.0 2023-12-01 11:12:57 +08:00
Haojun Liao e753d631af fix(stream): make sure open operator only once for scan-history task. 2023-12-01 10:21:07 +08:00
Haojun Liao 8515a2f9b6 fix(stream): fix status check for stream-scan-history status when drop stream task msg is missing. 2023-12-01 10:19:18 +08:00
Haojun Liao eb2f5ad074 fix(stream): fix error. 2023-12-01 10:18:22 +08:00
Haojun Liao 2b03d64850 fix(stream): drop the related fill-history task & set the task to be ready, if the drop fill-history task msg is missing due to the vnode restarting. 2023-12-01 10:18:15 +08:00
Haojun Liao fee9d751d4 fix(stream): fix the race condition in dispatching data. 2023-12-01 10:17:14 +08:00
Haojun Liao 30d78c6be1 fix(stream): make sure open operator only once for scan-history task. 2023-11-30 16:10:09 +08:00
yihaoDeng 5c32680cd8 Merge branch '3.0' into enh/refactorBackend 2023-11-30 10:31:27 +08:00
Haojun Liao 130614c938
Merge pull request #23831 from taosdata/fix/3_liaohj 
enh(stream/tsdb): do multiple optimization and fix some bugs.
 2023-11-30 09:20:15 +08:00
yihaoDeng 08eeee0794 Merge branch '3.0' into enh/refactorBackend 2023-11-28 11:52:49 +08:00
yihaoDeng a4d475b582 fix rsma 2023-11-27 20:27:53 +08:00
wangmm0220 06e2fbfb1c fix:conflicts from 3.0 2023-11-27 17:53:53 +08:00
wangmm0220 70c5d36103 opti:extract common logic from snode & vnode to tqCommon 2023-11-27 17:49:09 +08:00
yihaoDeng e9bec34c44 Merge branch '3.0' into enh/refactorBackend 2023-11-27 10:01:12 +08:00
Haojun Liao f28cf740b0 fix(stream): fix status check for stream-scan-history status when drop stream task msg is missing. 2023-11-24 14:44:00 +08:00
wangmm0220 d249892b2a fix:conflicts from 3.0 2023-11-23 20:29:46 +08:00
yihaoDeng 6129ebc294 Merge branch '3.0' into enh/refactorBackend 2023-11-23 17:41:37 +08:00
Haojun Liao de4cc2009d fix(stream): fix error. 2023-11-23 16:04:06 +08:00
Haojun Liao 0a90c33b4d fix(stream): drop the related fill-history task & set the task to be ready, if the drop fill-history task msg is missing due to the vnode restarting. 2023-11-23 15:49:07 +08:00
yihaoDeng 6a0501967d Merge branch '3.0' into fix/fixChkpRespMemleak 2023-11-23 14:06:04 +08:00
Haojun Liao 8ad071e69a other: merge main. 2023-11-23 10:25:51 +08:00
Haojun Liao 7b1f586d4f
Merge pull request #23762 from taosdata/fix/3_liaohj 
fix(stream): fix error in generating token in bucket.
 2023-11-23 09:32:14 +08:00
wangmm0220 15d75a0497 fix:spelling errors 2023-11-23 09:17:54 +08:00
Haojun Liao 4ea49fe285 fix(stream): fix the race condition in dispatching data. 2023-11-22 23:49:16 +08:00
Haojun Liao b35c971278 fix(stream):remove unused function. 2023-11-22 17:29:19 +08:00
wangmm0220 9a09e318ca opti:common message process logic in vnode and snode 2023-11-22 16:53:33 +08:00
yihaoDeng 0eba15b4a4 Merge branch '3.0' into enh/refactorBackend 2023-11-22 10:57:41 +08:00
yihaoDeng 0c0d9cdd2c Merge branch '3.0' into fix/fixChkpRespMemleak 2023-11-22 10:42:30 +08:00
Haojun Liao 785d91c17b
Merge pull request #23661 from taosdata/feat/TD-26060 
fix: errors in snode in conditions like fill history/checkpoint/restart
 2023-11-21 19:02:38 +08:00
yihaoDeng a92602b667 fix mem leak 2023-11-21 15:23:28 +08:00
Haojun Liao 1b4f187ded
Merge pull request #23743 from taosdata/fix/pause_stream 
fix(stream): remove invalid assert
 2023-11-17 23:48:47 +08:00
Haojun Liao 709502ba9e fix(stream): record the check downstream failure. 2023-11-17 22:05:36 +08:00
yihaoDeng 20de2f3cb5 Merge branch '3.0' into enh/refactorBackend 2023-11-17 17:15:14 +08:00
wangmm0220 a5de1b032b fix:snode upport stream task 2023-11-16 21:19:58 +08:00
yihaoDeng 77261068e0 fix stream backend convert 2023-11-16 11:06:55 +08:00
dapan1121 dc71252096 Merge remote-tracking branch 'origin/3.0' into merge/32m 2023-11-15 19:43:19 +08:00
wangmm0220 a16189d2a9 fix:confilct from 3.0 2023-11-15 19:14:27 +08:00
Haojun Liao 6529e56020 fix(stream): check the status before pause 2023-11-15 18:06:16 +08:00
Haojun Liao 115246c877 fix(stream): check the status before pause 2023-11-15 16:46:09 +08:00
Haojun Liao 1b1ad3068d fix(stream): check node status before start pause trans. 2023-11-15 16:02:56 +08:00
yihaoDeng f4d6cf7c74 Merge branch '3.0' into enh/refactorBackend 2023-11-14 18:12:48 +08:00
Haojun Liao f99e22b91f fix(stream): fix deadlock. 2023-11-13 23:56:42 +08:00
wangmm0220 56381dea90 fix:conflict from 3.0 2023-11-13 18:42:59 +08:00
wangmm0220 1cbe568be7 fix:add logic when snode restart 2023-11-13 18:39:42 +08:00
Haojun Liao aad8a2eb87 fix(stream): fix deadlock. 2023-11-13 18:20:30 +08:00
yihaoDeng de7f2a2d1a Merge branch '3.0' into enh/refactorBackend 2023-11-13 11:11:28 +08:00
Haojun Liao 9ee9174608 other: merge 3.0 2023-11-11 15:48:31 +08:00
Haojun Liao 5fcef5bd89 refactor:add some logs. 2023-11-11 15:40:32 +08:00
Haojun Liao 97772e9aab fix(stream): the checkpoint version can only be updated when generating checkpoint. 2023-11-11 15:40:05 +08:00
Haojun Liao 0b36081158 refactor:add some logs. 2023-11-10 14:36:18 +08:00
wangmm0220 8a05bad899 fix:snode error 2023-11-10 14:14:22 +08:00
yihaoDeng 5f9b922a04 support s3 2023-11-09 20:15:08 +08:00
yihaoDeng 757425bff8 Merge branch '3.0' into enh/refactorBackend 2023-11-09 17:58:49 +08:00
Haojun Liao 13c6d1b23a fix(stream): the checkpoint version can only be updated when generating checkpoint. 2023-11-09 17:11:37 +08:00
yihaoDeng 3abf0ae4b2 Merge branch 'feat/TD-26060' into enh/refactorBackend 2023-11-08 17:31:16 +08:00
Haojun Liao 470f244032 Merge remote-tracking branch 'origin/enh/refactorBackend' into enh/refactorBackend 
# Conflicts:
#	include/libs/stream/tstream.h
 2023-11-08 15:21:21 +08:00
Haojun Liao 99dbbe61d7 refactor(stream): do some internal refactor. 2023-11-08 15:20:47 +08:00
yihaoDeng 7b0891981e merge 3.0 2023-11-08 14:14:01 +08:00
kailixu b9f389a49f Merge branch '3.0' into enh/TD-23769-3.0x 2023-11-08 08:36:35 +08:00
kailixu 6b738884a4 chore: rsma checkpoint 2023-11-07 19:59:05 +08:00
Haojun Liao e558d8e497 fix: fix syntax error. 2023-11-07 18:53:21 +08:00
Haojun Liao 1301b92844 fix(stream): fix errors in scan-history, introduced by refactor 2023-11-07 16:41:15 +08:00
Haojun Liao 8c2f6bab0e fix(stream): exec scan-history in timer. 2023-11-07 16:40:03 +08:00
Haojun Liao 7370daa6e0 fix(stream): record the start failure tasks. 2023-11-07 16:39:56 +08:00
Haojun Liao e38e526dda fix(stream):reset the starting flag for the followers. 2023-11-07 16:39:12 +08:00
Haojun Liao 207b53f3f6 fix(stream): fix errors in scan-history, introduced by refactor 2023-11-07 16:19:09 +08:00
Haojun Liao 4d8548e938 refactor: do some internal refactor. 2023-11-06 23:42:16 +08:00
Haojun Liao d9474016fc fix(stream): exec scan-history in timer. 2023-11-06 18:55:53 +08:00
Haojun Liao 6b1889284b fix(stream): record the start failure tasks. 2023-11-06 15:45:44 +08:00
Haojun Liao 69863febe6 fix(stream):reset the starting flag for the followers. 2023-11-06 13:17:13 +08:00
Haojun Liao d41fd27189 fix(stream): restart tasks in stream threads, instead of write thread. 2023-11-06 11:57:21 +08:00
Haojun Liao 0e44950a37 enh(stream): execute scan history by using time slice 1s. 2023-11-06 09:21:33 +08:00