Commit Graph

19 Commits

Author SHA1 Message Date
liugq 272f29403d fix getting alerting rule 404 2023-04-03 18:05:27 +08:00
liugq abe7acf177 add privilege control of migration 2023-04-03 11:57:06 +08:00
Kassian Sun b29dc9ca0f [migration] check status before start/stop task 2023-04-03 10:04:16 +08:00
sunjiacheng 8fddcdaf09 [notification] add /notification/read, add message_type (#47)
[notification] add /notification/read, add message_type

Co-authored-by: Kassian Sun <kassiansun@outlook.com>
2023-04-02 15:02:30 +08:00
sunjiacheng 55ac534b02 [api] add list notification api (#35)
[api] add list notification api

Co-authored-by: Kassian Sun <kassiansun@outlook.com>
Co-authored-by: liugq <silenceqi@hotmail.com>
Co-authored-by: medcl <m@medcl.net>
Co-authored-by: silenceqi <silenceqi@infini.ltd>
2023-04-01 18:52:02 +08:00
liugq 9bd5682122 save cluster distribution in major magration task 2023-04-01 11:35:20 +08:00
sunjiacheng e75a566f03 [plugin][migration] add more logs (#46)
[plugin][migration] add more logs

Co-authored-by: Kassian Sun <kassiansun@outlook.com>
2023-03-30 18:24:26 +08:00
Kassian Sun 6de2e14235 [plugin][migration] add error loggings 2023-03-30 17:18:24 +08:00
liugq 6d537bb798 set es_scroll partition_size default value to 1 2023-03-29 18:41:20 +08:00
liugq 4871fbcb12 checking instance is avaiable when there is no pipeline logs 2023-03-29 16:17:19 +08:00
sunjiacheng 0f5626c41d [migration] fix source filter dsl (#43)
[migration] fix source filter dsl

Co-authored-by: Kassian Sun <kassiansun@outlook.com>
2023-03-29 13:03:15 +08:00
liugq 305a11ec40 update api url of getting task info with index level 2023-03-29 10:26:05 +08:00
sunjiacheng 633d0333f2 [plugins][migration] status_log -> logging (#40)
[plugins][migration] status_log -> logging

Co-authored-by: Kassian Sun <kassiansun@outlook.com>
2023-03-28 20:12:23 +08:00
sunjiacheng 69cf1d67a9 migration_v2 (#38)
bulk write after docs was scrolled complete

update default config with migration dispatcher

add bulk parameter idle_timeout_in_seconds, slice_size

clear queue before creating pipeline

check instance available when task state is running

add check_instance_available config for migration dispatcher

get migration task progress info by index_name_unique(index_name+doctype)

get instance list only by gateway

get migration task progress info from es and instance pipeline context

rewrite logic of handling running migration major task

calc complete time in api getDataMigrationTaskOfIndex

init

Co-authored-by: liugq <silenceqi@hotmail.com>
2023-03-28 17:54:35 +08:00
liugq 6bcca588cb fixed error output of parsing migration config 2023-02-08 11:37:33 +08:00
liugq aaf0822593 remove src from import path 2023-02-08 10:55:16 +08:00
liugq c22bf646f3 fixed compile error of migration code 2023-02-08 10:51:12 +08:00
liugq fa9ae1c465 code optimize after code review 2023-02-06 16:51:30 +08:00
medcl 02adb4d121 refactoring pipelines 2023-01-27 12:09:09 +08:00