Kassian Sun
|
7e79c509b2
|
[comparison] initial implementation
- handle new task types: cluster_comparison, index_comparison
- handle new pipeline tasks: dump_hash, index_diff
- split common task APIs
- add cluster_comparison task creation API
- optimize & clean migration codes
|
2023-05-17 15:43:34 +08:00 |
|
Kassian Sun
|
e8a0b43fba
|
[migration][pipeline] filter duplicated logs
|
2023-05-16 14:34:47 +08:00 |
|
Kassian Sun
|
205744cd44
|
[migration] mark task as stopped if pipeline not found
|
2023-05-15 14:37:55 +08:00 |
|
Kassian Sun
|
7c375a8d73
|
[migration] get es configs dynamically before creating pipeline
|
2023-04-28 16:13:30 +08:00 |
|
Kassian Sun
|
17a5ad6daa
|
[migration] scroll pipeline only check last run pipeline log
|
2023-04-24 16:57:16 +08:00 |
|
Kassian Sun
|
d1e947f826
|
[migration] check finished pipeline logs by updated time
|
2023-04-24 16:52:51 +08:00 |
|
Kassian Sun
|
99cf8b769f
|
[migration] check STOPPED logs after pending_stop
|
2023-04-24 16:31:44 +08:00 |
|
Kassian Sun
|
cbfe890982
|
[migration] scroll/bulk support manually retry
|
2023-04-24 15:58:51 +08:00 |
|
Kassian Sun
|
b1d3e67954
|
[migration] index migration skip retrying scroll if possible
|
2023-04-24 14:22:40 +08:00 |
|
Kassian Sun
|
06554054af
|
[migration] remove default sleep, schedule by task type & status
|
2023-04-24 14:19:39 +08:00 |
|
Kassian Sun
|
20498e2e76
|
[migration] tune cleaning gateway error logs
|
2023-04-22 15:36:47 +08:00 |
|
Kassian Sun
|
c691bbc607
|
[migration] move disk queue clean up to index_migration level
|
2023-04-20 17:44:45 +08:00 |
|
Kassian Sun
|
7d675ba3d1
|
[migration] optimize scroll/bulk error handling and status resetting
|
2023-04-20 17:44:45 +08:00 |
|
Kassian Sun
|
7472052d90
|
[migration] optimze bulk error message
|
2023-04-20 17:44:45 +08:00 |
|
Kassian Sun
|
cd85d21ef0
|
[migration] split es_scroll/bulk_indexing pipeline task
|
2023-04-20 17:44:44 +08:00 |