Commit Graph

10 Commits

Author SHA1 Message Date
sunjiacheng 0f0794aca7 [migration] support repeating task & incremental index (#108)
[migration] return error info for comparison/migration task

[migration] list api returns running_children

[migration] add pause/resume and repeating info

mark invalid repeat as done

[migration] fix doc count

revert unneeded changes

cleanup marshals & unmarshals

update apis

v2, unify repeat & incremental configuration

[migration] support repeating task & incremental index

Co-authored-by: Kassian Sun <kassiansun@outlook.com>
Co-authored-by: silenceqi <silenceqi@infini.ltd>
Co-authored-by: liugq <silenceqi@hotmail.com>
Co-authored-by: hardy <luohf@infinilabs.com>
2023-06-05 16:21:00 +08:00
Kassian Sun 09ba88c411 [migration] get instance from scheduler, initialize instance automatically 2023-05-30 11:41:53 +08:00
Kassian Sun 1789d74ece [migration] add option to skip scroll/bulk count check 2023-05-19 19:15:11 +08:00
Kassian Sun b95b1ff703 [comparison] add info APIs
- add comparison task info & by index info API
- update comparison task permission control
- unify migration task progress calculation
- cluster migration/comparison set start time
- add split task utilities
- clear index migration/comparison state before running
2023-05-18 17:06:34 +08:00
Kassian Sun 7e79c509b2 [comparison] initial implementation
- handle new task types: cluster_comparison, index_comparison
- handle new pipeline tasks: dump_hash, index_diff
- split common task APIs
- add cluster_comparison task creation API
- optimize & clean migration codes
2023-05-17 15:43:34 +08:00
Kassian Sun 9f48efe45c [migration] split cluster_migration 2023-05-16 12:13:39 +08:00
Kassian Sun ba409072c8 [migration] split scheduler/index_migration 2023-05-16 11:09:00 +08:00
Kassian Sun b1d3e67954 [migration] index migration skip retrying scroll if possible 2023-04-24 14:22:40 +08:00
Kassian Sun 57e1fb0844 [migration] optimize major task progress calculation 2023-04-20 17:44:45 +08:00
Kassian Sun cd85d21ef0 [migration] split es_scroll/bulk_indexing pipeline task 2023-04-20 17:44:44 +08:00