xxq250
/
homework-jianmu
1
0
Fork 0
Code Issues Pull Requests 1 Actions Packages Projects Releases Wiki Activity
58,593 Commits 3 Branches 0 Tags 479 MiB
Commit Graph

1674 Commits

Author SHA1 Message Date
Haojun Liao 477f57aa0e refactor: do some internal refactor. 2023-10-09 20:08:08 +08:00
Haojun Liao 52763ca2a3 refactor: do some internal refactor. 2023-10-09 20:08:07 +08:00
Haojun Liao 3baddbe67a fix(stream): update the checkpoint record start time. 2023-10-09 20:08:07 +08:00
Haojun Liao a6ffb845c8 fix(stream): fix invalid checkpoint start time. 2023-10-09 20:08:07 +08:00
Haojun Liao c05a8de3e8 fix(stream): rsp when checkpoint source failed. 2023-10-09 20:08:06 +08:00
Haojun Liao b4bc4fac98 fix(stream): disable auto rsp for checkpoint source. 2023-10-09 20:08:06 +08:00
Haojun Liao e671e87234 fix(stream): fix invalid assert. 2023-10-09 20:08:06 +08:00
Haojun Liao d1a6b8bd22 refactor: do some internal refactor. 2023-10-09 20:08:06 +08:00
Haojun Liao 46b17aa9f1 fix(stream): fix race condition. 2023-10-09 20:08:06 +08:00
Haojun Liao e49409a11e fix(stream): add some logs. 2023-10-09 20:08:05 +08:00
Haojun Liao 5eee76df65 fix(stream): add msg identifier check. 2023-10-09 20:08:05 +08:00
Haojun Liao 192c47a7c2 fix(stream): add some logs. 2023-10-09 20:08:05 +08:00
Haojun Liao 693254f602 fix(stream): remove invalid free. 2023-10-09 20:08:04 +08:00
Haojun Liao f3bd5c411d fix(stream): remove the blocking flag after successfully retry sending msg. 2023-10-09 20:08:04 +08:00
Haojun Liao ed9e035095 fix(stream): clear the failure vnode id list before send msg. 2023-10-09 20:08:04 +08:00
Haojun Liao 3726aa723e fix(stream): fix invalid read. 2023-10-09 20:08:04 +08:00
Haojun Liao e0d19af000 fix(stream): refactor re-try dispatch msg for stream tasks. 2023-10-09 20:08:03 +08:00
Haojun Liao 2b16976902 refactor(stream): refactor send msg. 2023-10-09 20:08:03 +08:00
Haojun Liao 27e00b1f19 fix(stream): add some logs, and remove invalid assert. 2023-10-09 20:08:02 +08:00
Haojun Liao 12687eb287 fix(stream): add check info detailed information. 2023-10-09 20:08:02 +08:00
Haojun Liao ab7c18f604 refactor: do some internal refactor. 2023-10-09 20:08:01 +08:00
Haojun Liao e5535fa1f5 fix(stream): handle dispatch checkpoint-trigger failure. 2023-10-09 20:08:01 +08:00
Haojun Liao 65cc4040f3 fix(stream): update logs. 2023-10-09 20:08:00 +08:00
Haojun Liao 6d3a134077 fix(stream): ignore the dispatch failure, and set the correct rsp counter. 2023-10-09 20:07:54 +08:00
Haojun Liao 7f4d9b6e41 fix(stream): wait for the task checkpoint before stop. 2023-10-09 20:07:53 +08:00
Haojun Liao ef9efc8a8e refactor: do refactor the sink task. 2023-10-09 20:07:53 +08:00
Haojun Liao e4ac835554 fix(stream): disable token bucket. 2023-10-09 20:07:53 +08:00
Haojun Liao a3d13d6634 fix(stream): remove invalid cached task info in buffer. 2023-10-09 20:07:08 +08:00
Haojun Liao 1f45bd82d2 other: merge stream fix in main. 2023-10-09 20:07:01 +08:00
Haojun Liao d752fb1ed6 fix(stream): exec task in task queuee threads. 2023-10-09 20:06:11 +08:00
Haojun Liao 1ebafe4a1f fix(stream): add more check. 2023-10-09 20:06:11 +08:00
Haojun Liao c403a15f36 fix(stream): check the status before exec stream task when handling the dispatch requests. 2023-10-09 20:06:11 +08:00
Haojun Liao d76e3ac718 fix(stream): add task status check. 2023-10-09 20:06:10 +08:00
Haojun Liao e27111ecd1 enh(stream): add node stage check. 2023-10-09 20:06:09 +08:00
Haojun Liao ce85945583 fix(stream): set correct size for results generated by scan history stream tasks. 2023-10-09 20:06:05 +08:00
Haojun Liao 053643be19 fix(stream): add timestamp. 2023-10-09 20:06:05 +08:00
Haojun Liao b38f9e0288 fix(stream): update logs. 2023-10-09 20:06:05 +08:00
Haojun Liao 5c0b8ea804 enh(stream): log the checkpoint time. 2023-10-09 20:06:04 +08:00
Haojun Liao b95ad74c7f fix(stream): not handle the check msg for follower tasks. 2023-10-09 20:06:04 +08:00
Haojun Liao e6fb9ee46c fix(stream): reset task counter. 2023-10-09 20:06:04 +08:00
Haojun Liao c3a3cf21fb fix(stream): add some logs. 2023-10-09 20:05:39 +08:00
Haojun Liao 08b37dfc13 fix(stream): fix memory leak. 2023-10-09 20:05:38 +08:00
Haojun Liao 734f648891 fix(stream): set the output normal for stream dispatch when encountering the transfer state. 2023-10-09 20:05:38 +08:00
Haojun Liao 636eccc160 fix(stream): add null check 2023-10-09 20:05:37 +08:00
Haojun Liao 57bf1cadc4 fix(stream): fix error in decode stream task. 2023-10-09 20:05:37 +08:00
Haojun Liao 9d6199adf7 fix(stream): fix invalid read. 2023-10-09 20:05:37 +08:00
Haojun Liao 0459a4628c fix(stream): fix stream task id error. 2023-10-09 20:05:36 +08:00
Haojun Liao 7ccc273206 other: merge stream fix in main. 2023-10-09 20:05:29 +08:00
Haojun Liao 98ef566eb4 fix(stream): remove fill-history sink task. 2023-10-09 20:04:17 +08:00
Haojun Liao e84eeee6b8 refactor: do some internal refactor. 2023-10-09 20:04:17 +08:00
Haojun Liao fe7864b976 fix(stream): fix error in drop task. 2023-10-09 20:04:17 +08:00
Haojun Liao c33e521aa1 fix(stream): update some logs. 2023-10-09 20:04:17 +08:00
Haojun Liao 39e0c57323 fix(stream): set the correct guard flag. 2023-10-09 20:04:16 +08:00
Haojun Liao 3d1f29ff21 fix(stream): fix memory leak. 2023-10-09 20:04:16 +08:00
yihaoDeng c6e9134cea add sess iter 2023-10-09 20:02:23 +08:00
Haojun Liao 6fa54789cb fix(stream): disable follower send hb to mnode. and do some internal refactor. 2023-10-09 19:59:31 +08:00
Haojun Liao 1256eafddb other: merge stream fix. 2023-10-09 19:59:24 +08:00
Haojun Liao 283118bf68 fix(stream):fix missing unlock. 2023-10-09 19:56:17 +08:00
Haojun Liao aaa12ed4f8 refactor: do some internal refactor about the sched status set 2023-10-09 19:56:17 +08:00
Haojun Liao 01d104706e refactor(stream): remove unnecessary streamschedTask function to improve the performance. 2023-10-09 19:56:17 +08:00
Haojun Liao a678e722ce fix(stream): limit the token bucket capacity 2023-10-09 19:56:17 +08:00
Haojun Liao b0ef091430 fix(stream): retry when error occurs during timer. 2023-10-09 16:40:05 +08:00
Haojun Liao be0a2e4573 fix(stream): disable retrieving results during checkpoint procedure 2023-10-09 16:33:28 +08:00
Haojun Liao 8266c4ff77 fix(stream): remove invalid clear of rspmsg list. 2023-10-09 15:26:42 +08:00
Haojun Liao d87db2f829 fix(stream): fix the pause failure bug. 2023-10-09 14:48:11 +08:00
yihaoDeng 28b546a4ad fix mem leak 2023-10-09 14:25:57 +08:00
yihaoDeng be42143362 Merge branch '3.0' into case/TD-26408-3.0 2023-10-09 14:24:31 +08:00
yihaoDeng 3f9784f475 fix mem leak 2023-10-09 14:07:22 +08:00
Haojun Liao 74ff0c5b50 Merge branch 'main' into fix/liaohj 2023-10-09 10:14:53 +08:00
Haojun Liao ee6516f3c4 enh(stream): add trans to reset task status to avoid being frozen in checkpoint status due to doing checkpoint failure of partial tasks. 2023-10-09 10:13:53 +08:00
Haojun Liao 4b8cd3bccd fix(stream): not idle for sink task when no tokens are available. 2023-10-09 10:07:19 +08:00
liuyao 1cbb8ef444 init bloomfilter array 2023-10-08 14:43:44 +08:00
yihaoDeng b5994b31e2 fix mem leak 2023-10-08 13:33:02 +08:00
yihaoDeng e3f18495e0 fix mem leak 2023-10-08 11:22:26 +08:00
Haojun Liao 23fb26798f fix(stream): sleep for 10ms 2023-10-07 19:47:49 +08:00
Haojun Liao e4e4c5a36e fix(stream): wait for a while when no available token. 2023-10-07 19:41:49 +08:00
Haojun Liao 45bb3f50d7 fix(stream): continue 2023-10-07 19:25:40 +08:00
liuyao 95ffe6fa23 stream recover 2023-10-07 19:24:21 +08:00
Haojun Liao 62cdcbc7e3 refactor: inc the dump batch. 2023-10-07 19:20:48 +08:00
Haojun Liao 4d6f143146 fix(stream): add missing refactor. 2023-10-07 19:18:26 +08:00
Haojun Liao ab17bfdf09 refactor: do some internal refactor. 2023-10-07 19:16:55 +08:00
Haojun Liao 0e8a8aabc1 fix(stream): check items in queue and qall, stead of only the queue items. 2023-10-07 19:16:25 +08:00
liuyao 1e323c0408 fix issue 2023-10-07 19:11:46 +08:00
liuyao 19bbf10579 fix issue 2023-10-07 17:59:53 +08:00
yihaoDeng 97fdcbc60b fix mem leak 2023-10-07 17:48:24 +08:00
liuyao 1aaf873134 fix issue 2023-10-07 17:43:50 +08:00
Haojun Liao d11c0a113c fix(stream): fix syntax error. 2023-10-07 14:56:09 +08:00
Haojun Liao 7ce3d2c200 fix(stream): quit from loop when input queue is full. 2023-10-07 14:54:11 +08:00
liuyao 460ee86fdf fix issue 2023-10-07 11:55:40 +08:00
liuyao 59d47e1e1f fix issuse 2023-10-07 10:34:35 +08:00
Haojun Liao 115a284ac0 enh(stream): update the checkpoint interval 2023-10-07 09:56:03 +08:00
Haojun Liao 011627d50a fix(stream): update the current processing version. 2023-10-07 09:07:44 +08:00
Haojun Liao c20dd002fb enh(stream): add more info for sink task. 2023-10-07 01:14:00 +08:00
Haojun Liao 98659ad323 fix(stream): fix the invalid check. 2023-10-05 00:09:47 +08:00
Haojun Liao 41ef1a45c1 enh(stream): optimize the scan wal perf 2023-10-04 22:06:46 +08:00
Haojun Liao 45e413f8d5 refactor: wait for 100ms before scan wal again. 2023-10-03 20:57:19 +08:00
Haojun Liao 132fb8e82e refactor: wait for more time for future data 2023-10-03 15:42:00 +08:00
Haojun Liao 38aff641ee fix(stream): add null check. 2023-10-03 02:39:57 +08:00
Haojun Liao 58f410a9df refactor: do some internal refactor. 2023-10-03 02:37:52 +08:00
Haojun Liao a543f4ca97 refactor: do some internal refactor. 2023-10-03 01:52:03 +08:00
Haojun Liao 5564eb215c fix(stream): fix invalid check. 2023-10-03 00:38:24 +08:00
Haojun Liao 5718158fc0 refactor: do some internal refactor. 2023-10-01 22:27:29 +08:00
Haojun Liao 31acbc6fe2 refactor: do some internal refactor (discard the checkpoint source msg during restoring). 2023-09-28 22:44:13 +08:00
Haojun Liao f2d8431619 fix(stream): enable new time range for stream task. 2023-09-28 18:26:52 +08:00
Haojun Liao 80ec77cbb6 enh(stream): optimize the stream status when creating without fill-history option. 2023-09-28 11:23:03 +08:00
Haojun Liao 22e485d132 fix(stream): opt perf. 2023-09-28 09:25:23 +08:00
Haojun Liao f525778aef fix(stream): fix syntax error. 2023-09-28 00:53:36 +08:00
Haojun Liao 8c998673ad fix(stream): fix dead lock. 2023-09-27 17:15:49 +08:00
Haojun Liao 2dade996bb log(stream): update logs. 2023-09-27 15:37:12 +08:00
Haojun Liao 8f2d217834 log: update logs. 2023-09-27 14:48:53 +08:00
Haojun Liao 11641e1115 refactor: do some internal refactor. 2023-09-27 14:18:01 +08:00
Haojun Liao 34d547bfff fix(stream): avoid repeatly free obj. 2023-09-27 14:05:14 +08:00
Haojun Liao ae020fcd2d log(stream): update the log. 2023-09-27 14:03:57 +08:00
Haojun Liao e13efd5b04 refactor: optimize the fill-history task launch policy, and do some other internal refactor. 2023-09-27 14:00:48 +08:00
Haojun Liao a7e6933ce7 refactor: do some internal refactor. 2023-09-27 09:46:15 +08:00
Haojun Liao 37bf387453 fix(stream): reduce the counter when remove stream tasks. 2023-09-27 09:36:20 +08:00
Haojun Liao 9ab9de0ad3 fix(stream): limit sink quota. 2023-09-27 00:30:38 +08:00
Haojun Liao 27dcbcb96f fix(stream): update the retry interval. 2023-09-26 23:42:02 +08:00
Haojun Liao aec15ae39f enh(stream): add quota limitation for sink task. 2023-09-26 23:29:54 +08:00
liuyao c95dc167b7 add ci 2023-09-26 17:19:21 +08:00
Haojun Liao 890d658aea refactor: do some internal refactor. 2023-09-26 14:11:45 +08:00
Haojun Liao f3f18b0fa3 fix(stream): add new status for meta. 2023-09-26 12:15:12 +08:00
liuyao 82e18e32b0 add ci 2023-09-26 10:41:12 +08:00
Haojun Liao d214a2f6bd fix(stream): do some internal refactor. 2023-09-26 09:32:57 +08:00
Haojun Liao 6cc3618ed9 fix(stream): fix error in pause scan-history data. 2023-09-26 01:09:55 +08:00
Haojun Liao 5a4a0aa0e3 fix(stream): fix invalid read and memory leak. 2023-09-25 23:10:33 +08:00
Haojun Liao c9576d7a85 fix(stream): transfer state when all downstream rsp already. 2023-09-25 17:31:38 +08:00
Haojun Liao c615c513e8 fix(stream): fix memory leak. 2023-09-25 16:01:17 +08:00
Haojun Liao fcf4cc7169 fix(stream): fix the invalid counter for ready tasks in vnode, fix an invalid read. 2023-09-25 15:58:24 +08:00
Haojun Liao 1af95969b2 fix(stream): adjust nodeUpdate check interval. 2023-09-25 10:40:30 +08:00
Haojun Liao eb4078b7f3 fix(stream): record the tasks started info, and do some internal refactor. 2023-09-25 09:59:05 +08:00
Haojun Liao c987f61300 fix(stream): fix race condition. 2023-09-25 01:37:27 +08:00
Haojun Liao da82a5f19e fix(stream): do not wait for the checkpoint finish before stop tasks. 2023-09-24 22:03:07 +08:00
Haojun Liao a74b462ffb fix(stream): add new timer for each task. 2023-09-24 02:25:53 +08:00
Haojun Liao b7dcd94c64 refactor: do some internal refactor. 2023-09-24 01:56:52 +08:00
Haojun Liao 3a75c21e66 refactor: do some internal refactor. 2023-09-24 01:55:59 +08:00
Haojun Liao 4ea737571d refactor: do some internal refactor. 2023-09-24 01:26:51 +08:00
Haojun Liao 7f265e181d fix(stream): update the checkpoint record start time. 2023-09-23 18:05:14 +08:00
Haojun Liao 6ef68fdf06 fix(stream): fix invalid checkpoint start time. 2023-09-23 17:57:09 +08:00
Haojun Liao acd3321494 fix(stream): rsp when checkpoint source failed. 2023-09-23 14:13:33 +08:00
Haojun Liao 7d5f76c6f1 fix(stream): disable auto rsp for checkpoint source. 2023-09-23 11:31:14 +08:00
Haojun Liao 5155519559 fix(stream): fix invalid assert. 2023-09-22 23:06:48 +08:00
Haojun Liao cf6c255f22 refactor: do some internal refactor. 2023-09-22 22:50:21 +08:00
Haojun Liao fcbd747afc fix(stream): fix race condition. 2023-09-22 19:35:12 +08:00
liuyao 5cc1ae1266 fix issue 2023-09-22 19:25:19 +08:00
Haojun Liao 1ca05fb3af fix(stream): add some logs. 2023-09-22 18:56:31 +08:00
Haojun Liao 5b12e276cf fix(stream): add msg identifier check. 2023-09-22 18:13:18 +08:00
Haojun Liao bb1a2322ca fix(stream): add some logs. 2023-09-22 17:27:10 +08:00
Haojun Liao 07ec6f38b8 fix(stream): remove invalid free. 2023-09-22 16:53:22 +08:00
Haojun Liao 5a695f632c fix(stream): remove the blocking flag after successfully retry sending msg. 2023-09-22 16:44:55 +08:00
Haojun Liao 6c357104a5 fix(stream): clear the failure vnode id list before send msg. 2023-09-22 16:19:25 +08:00
Haojun Liao 0f5f21ba09 fix(stream): fix invalid read. 2023-09-22 16:05:12 +08:00
Haojun Liao 619a9f6d08 fix(stream): refactor re-try dispatch msg for stream tasks. 2023-09-22 15:57:55 +08:00
liuyao 4f8e6d7795 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26174 2023-09-22 15:00:52 +08:00
liuyao 410a177637 fix issue 2023-09-22 15:00:26 +08:00
Haojun Liao 898aea5cfb refactor(stream): refactor send msg. 2023-09-22 14:52:18 +08:00
Haojun Liao 87ea745861 fix(stream): add some logs, and remove invalid assert. 2023-09-22 10:53:03 +08:00
Haojun Liao f7bcff862d fix(stream): add check info detailed information. 2023-09-22 10:23:56 +08:00
wangmm0220 5555371fbc fix:memory leak 2023-09-22 10:04:53 +08:00
liuyao 4979fc5283 fix issue 2023-09-22 09:40:08 +08:00
wangmm0220 803b17a2db fix:memory leak 2023-09-22 09:31:58 +08:00
Haojun Liao b1ba716299 refactor: do some internal refactor. 2023-09-22 09:24:36 +08:00
Haojun Liao b075b4438b fix(stream): handle dispatch checkpoint-trigger failure. 2023-09-21 23:15:18 +08:00
Haojun Liao 50d5fb6641 fix(stream): update logs. 2023-09-21 19:14:34 +08:00
Haojun Liao 4925b67d4a fix(stream): ignore the dispatch failure, and set the correct rsp counter. 2023-09-21 17:22:09 +08:00
Haojun Liao 2efd155adf fix(stream): wait for the task checkpoint before stop. 2023-09-21 15:53:21 +08:00
Haojun Liao 17586af0ce refactor: do refactor the sink task. 2023-09-21 13:32:57 +08:00
yihaoDeng 77ef632233 refactor code 2023-09-21 01:36:12 +00:00
Haojun Liao 9f9b712332 fix(stream): disable token bucket. 2023-09-21 01:19:58 +08:00
Haojun Liao 92f18989df fix(stream): remove invalid cached task info in buffer. 2023-09-20 19:19:04 +08:00
Haojun Liao 6633fb971b fix(stream): update logs. 2023-09-20 18:18:31 +08:00
liuyao b4be5fe895 fix mem leak 2023-09-20 17:35:11 +08:00
Haojun Liao 619b377dd9 fix(stream): exec task in task queuee threads. 2023-09-20 17:30:41 +08:00
Haojun Liao 49165f8c3c fix(stream): add more check. 2023-09-20 16:49:55 +08:00
Haojun Liao 8329ec79f2 fix(stream): check the status before exec stream task when handling the dispatch requests. 2023-09-20 16:32:27 +08:00
Haojun Liao 2a781c509f fix(stream): add task status check. 2023-09-20 15:32:15 +08:00
liuyao 1cebda368a session&state operator buff 2023-09-20 15:06:08 +08:00
Haojun Liao b4419bda65 enh(stream): add node stage check. 2023-09-20 10:35:01 +08:00
Haojun Liao 1decaaee1e fix(stream): set correct size for results generated by scan history stream tasks. 2023-09-19 16:49:04 +08:00
Haojun Liao 309630eb11 fix(stream): add timestamp. 2023-09-19 14:22:05 +08:00
Haojun Liao 38b3a7c1bd fix(stream): update logs. 2023-09-19 11:05:49 +08:00
Haojun Liao b7efedf4aa enh(stream): log the checkpoint time. 2023-09-19 09:53:33 +08:00
Haojun Liao e76bab7122 fix(stream): not handle the check msg for follower tasks. 2023-09-19 09:43:14 +08:00
Haojun Liao 9a9fffa577 fix(stream): reset task counter. 2023-09-19 00:52:35 +08:00
Haojun Liao 377fdfacf6 fix(stream): add some logs. 2023-09-18 23:51:08 +08:00
Haojun Liao 2c9d54af37 fix(stream): fix memory leak. 2023-09-18 19:58:46 +08:00
Haojun Liao c7b8d572f6 fix(stream): set the output normal for stream dispatch when encountering the transfer state. 2023-09-18 18:25:22 +08:00
Haojun Liao c33ef4ce88 fix(stream): add null check 2023-09-18 15:14:51 +08:00
Haojun Liao 8aa9960760
Merge pull request #22944 from taosdata/fix/liaohj 
refactor: do some internal refactor, and fix some bugs.
 2023-09-17 21:25:33 +08:00
Haojun Liao 3dfdda3283 fix(stream): fix error in decode stream task. 2023-09-17 18:07:26 +08:00
Haojun Liao 301258784a fix(stream): fix invalid read. 2023-09-17 13:59:06 +08:00
Haojun Liao 01144c58a7 fix(stream): fix stream task id error. 2023-09-17 01:19:59 +08:00
Haojun Liao 4846194bbb refactor: do some internal refactor, remove the related fill-history task by sending mesg to replay it in follower node. 2023-09-16 21:37:30 +08:00
Haojun Liao caa7542cea
Merge pull request #22913 from taosdata/fix/liaohj 
fix(stream): fix error in drop task.
 2023-09-16 21:36:38 +08:00
Haojun Liao 91e3d70796 fix(stream): remove fill-history sink task. 2023-09-15 17:46:17 +08:00
yihaoDeng e958e18726 fix race crash and add log 2023-09-15 15:02:05 +08:00
yihaoDeng 6820fb0c5d fix race crash and add log 2023-09-15 14:59:44 +08:00
Haojun Liao 2bfd6e3355 refactor: do some internal refactor. 2023-09-15 09:25:22 +08:00
Haojun Liao 117de7ab7d fix(stream): fix error in drop task. 2023-09-15 00:51:13 +08:00
Haojun Liao 500fcad36c
Merge pull request #22892 from taosdata/fix/liaohj 
refactor: do some internal refactor.
 2023-09-15 00:46:46 +08:00