Commit Graph

21 Commits

Author SHA1 Message Date
sunjiacheng 69cf1d67a9 migration_v2 (#38)
bulk write after docs was scrolled complete

update default config with migration dispatcher

add bulk parameter idle_timeout_in_seconds, slice_size

clear queue before creating pipeline

check instance available when task state is running

add check_instance_available config for migration dispatcher

get migration task progress info by index_name_unique(index_name+doctype)

get instance list only by gateway

get migration task progress info from es and instance pipeline context

rewrite logic of handling running migration major task

calc complete time in api getDataMigrationTaskOfIndex

init

Co-authored-by: liugq <silenceqi@hotmail.com>
2023-03-28 17:54:35 +08:00
medcl 02adb4d121 refactoring pipelines 2023-01-27 12:09:09 +08:00
liugq b93fb2f3c2 refactoring orm.Delete 2022-12-13 14:26:40 +08:00
liugq c17359adb3 add orm.Context 2022-12-08 20:48:59 +08:00
liugq b88ec94082 add param refresh to method orm.save 2022-12-08 19:12:07 +08:00
liugq 2609e51623 migration log fixed 2022-10-25 20:47:41 +08:00
liugq 71f0871e5a add host field in getExecutionNodes api 2022-10-25 19:38:35 +08:00
liugq 0922db5024 update getExecutionNodes api 2022-10-25 17:20:28 +08:00
liugq 516e7462ac fixed merge master conflicts 2022-10-25 16:07:43 +08:00
liugq 8977808d30 init migration 2022-10-14 16:55:48 +08:00
liugq fcf6fab9b6 refactor gateway proxy request api 2022-08-19 10:43:24 +08:00
liugq f403f8d8f9 update es version require to 7.3+ in comment 2022-04-08 12:11:30 +08:00
liugq fefcaf6b6d add elasticsearch version check 2022-04-01 17:08:47 +08:00
liugq 4fe61e21f9 add param refresh for index api of elastic 2022-03-31 09:52:57 +08:00
liugq 24e1c81d51 return error when connected gateway api /_framework/api/_info 404 2022-03-11 15:52:51 +08:00
liugq 351e94c256 update gateway instance status api 2022-02-25 19:31:54 +08:00
liugq 949c781562 update gateway instance api 2022-02-24 17:12:40 +08:00
liugq 3c229077f8 add gateway proxy api 2022-02-16 20:15:20 +08:00
liugq e1559b0e85 add gateway instance status api 2022-02-15 12:10:32 +08:00
liugq 7d94108600 change group to tags field 2022-02-14 18:09:09 +08:00
liugq a7b8646378 add gateway instance api 2022-02-14 16:45:00 +08:00