Commit Graph

6 Commits

Author SHA1 Message Date
Medcl f43e453c7f
chore: update license header (#14)
Co-authored-by: Hardy <luohoufu@163.com>
2024-12-02 23:24:44 +08:00
medcl ad05f229af refactoring processors, simplicity queue consumation 2023-07-21 18:52:01 +08:00
medcl 241c9f57fb sleep when no message was found in queue 2023-05-26 12:02:39 +08:00
sunjiacheng 69cf1d67a9 migration_v2 (#38)
bulk write after docs was scrolled complete

update default config with migration dispatcher

add bulk parameter idle_timeout_in_seconds, slice_size

clear queue before creating pipeline

check instance available when task state is running

add check_instance_available config for migration dispatcher

get migration task progress info by index_name_unique(index_name+doctype)

get instance list only by gateway

get migration task progress info from es and instance pipeline context

rewrite logic of handling running migration major task

calc complete time in api getDataMigrationTaskOfIndex

init

Co-authored-by: liugq <silenceqi@hotmail.com>
2023-03-28 17:54:35 +08:00
medcl c1739df13b remove unused parameters 2023-02-09 14:14:24 +08:00
medcl 02adb4d121 refactoring pipelines 2023-01-27 12:09:09 +08:00