floraachy
/
console
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
955 Commits 5 Branches 5 Tags 48 MiB
Commit Graph

319 Commits

Author SHA1 Message Date
Kassian Sun d0706f460d [migration] handle dump_hash/index_diff pending_stop 2023-05-17 17:43:44 +08:00
Kassian Sun 8d27425fc0 [migration] fix GetChildTasks 2023-05-17 16:58:38 +08:00
Kassian Sun 556a3d49d8 [migration] extract UpdateStoppedChildTasksToReady 2023-05-17 16:44:27 +08:00
Kassian Sun 7e79c509b2 [comparison] initial implementation 
- handle new task types: cluster_comparison, index_comparison
- handle new pipeline tasks: dump_hash, index_diff
- split common task APIs
- add cluster_comparison task creation API
- optimize & clean migration codes
 2023-05-17 15:43:34 +08:00
liugq d1ef70d8d1 fix no index,node metadata after console setup 2023-05-17 12:03:31 +08:00
Kassian Sun e8a0b43fba [migration][pipeline] filter duplicated logs 2023-05-16 14:34:47 +08:00
Kassian Sun 9f48efe45c [migration] split cluster_migration 2023-05-16 12:13:39 +08:00
Kassian Sun ba409072c8 [migration] split scheduler/index_migration 2023-05-16 11:09:00 +08:00
silenceqi 38d2a746f2 Merge pull request '[migration] mark task as stopped if pipeline not found' (#83) from fix/migration into master 2023-05-15 14:42:35 +08:00
Kassian Sun 205744cd44 [migration] mark task as stopped if pipeline not found 2023-05-15 14:37:55 +08:00
silenceqi 4a269acf22 move topn api from framework to console (#82) 
move topn api from framework to console

Co-authored-by: liugq <silenceqi@hotmail.com>
 2023-05-10 23:33:35 +08:00
liugq c37380c009 move insight model from framework to console 2023-05-08 16:23:36 +08:00
liugq 75b912426b add websocket proxy 2023-05-06 14:53:07 +08:00
Kassian Sun 7c375a8d73 [migration] get es configs dynamically before creating pipeline 2023-04-28 16:13:30 +08:00
liugq 9b3005e005 add refresh index api 2023-04-24 19:41:43 +08:00
Kassian Sun 17a5ad6daa [migration] scroll pipeline only check last run pipeline log 2023-04-24 16:57:16 +08:00
Kassian Sun d1e947f826 [migration] check finished pipeline logs by updated time 2023-04-24 16:52:51 +08:00
Kassian Sun 99cf8b769f [migration] check STOPPED logs after pending_stop 2023-04-24 16:31:44 +08:00
Kassian Sun cbfe890982 [migration] scroll/bulk support manually retry 2023-04-24 15:58:51 +08:00
liugq 00c48bf9d5 Merge branch 'master' of ssh://git.infini.ltd:64221/infini/console 2023-04-24 14:38:04 +08:00
liugq 0ac40751cd return pipeline task info 2023-04-24 14:37:57 +08:00
Kassian Sun b1d3e67954 [migration] index migration skip retrying scroll if possible 2023-04-24 14:22:40 +08:00
Kassian Sun 06554054af [migration] remove default sleep, schedule by task type & status 2023-04-24 14:19:39 +08:00
Kassian Sun 20498e2e76 [migration] tune cleaning gateway error logs 2023-04-22 15:36:47 +08:00
Kassian Sun da908cebfb [migration] fix missing return 2023-04-22 15:23:55 +08:00
Kassian Sun b263c480c7 [migration] add back instance init error check 2023-04-22 15:02:05 +08:00
Kassian Sun 28a6c55671 [migration] refresh instance state after major task stopped 2023-04-22 14:48:53 +08:00
Kassian Sun c1ed375813 [migration] print instance task limit in debug level 2023-04-21 18:28:41 +08:00
Kassian Sun 651c86feff [migration] batch task by task type 2023-04-21 18:21:01 +08:00
sunjiacheng 5ad2e042a9 [migration] remove unused log (#71) 
[migration] remove unused log

Co-authored-by: Kassian Sun <kassiansun@outlook.com>
 2023-04-21 16:02:13 +08:00
Kassian Sun 52ff99af0c [migration] use different error message for old-version tasks 2023-04-20 17:44:45 +08:00
Kassian Sun e27a51f884 [migration] fix wrong pending_stop notification 2023-04-20 17:44:45 +08:00
Kassian Sun c691bbc607 [migration] move disk queue clean up to index_migration level 2023-04-20 17:44:45 +08:00
Kassian Sun ae9134afd5 [migration] fail cluster migration if docs count unmatch 2023-04-20 17:44:45 +08:00
Kassian Sun 57e1fb0844 [migration] optimize major task progress calculation 2023-04-20 17:44:45 +08:00
Kassian Sun 1f95d4af48 [migration] fix major task state handling 2023-04-20 17:44:45 +08:00
Kassian Sun 1bca4335f1 [migration] fix progress when index task is running 2023-04-20 17:44:45 +08:00
Kassian Sun 7d675ba3d1 [migration] optimize scroll/bulk error handling and status resetting 2023-04-20 17:44:45 +08:00
Kassian Sun c89c8616b1 [migration] clean all business_id checks 2023-04-20 17:44:45 +08:00
Kassian Sun d37649faa2 [migration] update code review issues 2023-04-20 17:44:45 +08:00
Kassian Sun 527c3c9e46 [migration] delete ready1 state 2023-04-20 17:44:45 +08:00
Kassian Sun 7472052d90 [migration] optimze bulk error message 2023-04-20 17:44:45 +08:00
Kassian Sun cd85d21ef0 [migration] split es_scroll/bulk_indexing pipeline task 2023-04-20 17:44:44 +08:00
liugq dd68300ab2 layout search support filtering with param is_fixed 2023-04-20 10:49:24 +08:00
Kassian Sun 1634640134 [migration] fix partion query nil check 2023-04-19 11:34:01 +08:00
Kassian Sun ff219a211b [migration] fix query_string json field name 2023-04-19 10:33:16 +08:00
liugq c6b9f30277 update mapping with specify type 2023-04-18 18:16:27 +08:00
liugq c32d6b76a1 adding api of delete data migration task 2023-04-18 15:53:07 +08:00
liugq f18a2bc054 Merge branch 'master' into init_indices 2023-04-17 13:57:49 +08:00
Kassian Sun eced674817 [migration] cleanup unused target config 2023-04-17 12:41:34 +08:00