Commit Graph

1410 Commits

Author SHA1 Message Date
liugq 3fafe39b0d add alerting notification 2023-04-06 16:16:44 +08:00
liugq c8cd0b80a4 Merge branch 'master' of ssh://git.infini.ltd:64221/infini/console 2023-04-06 12:04:12 +08:00
liugq db1c7322f1 update migration notifaction link url 2023-04-06 12:04:07 +08:00
silenceqi aea050b412 Merge pull request '[notification] support search by keyword' (#56) from feature/notification into master 2023-04-06 11:10:38 +08:00
Kassian Sun 8c623870e3 [notification] support search by keyword 2023-04-06 11:02:34 +08:00
liugq 8b2a87ef83 Merge branch 'master' of ssh://git.infini.ltd:64221/infini/console 2023-04-06 10:25:59 +08:00
liugq aeea55a941 add lookup metadata template func 2023-04-06 10:25:54 +08:00
silenceqi 11b9d8511a Merge pull request '[migration] track user actions in task logging' (#55) from feature/migration into master 2023-04-04 16:22:11 +08:00
Kassian Sun b16ff4e888 [migration] track user actions in task logging 2023-04-04 16:18:13 +08:00
silenceqi ba7bda70db Merge pull request '[migration] fix pending_stop checking logic' (#54) from fix/migration into master 2023-04-04 16:06:51 +08:00
Kassian Sun 87d28c9cfc [migration] fix pending_stop checking logic 2023-04-04 16:02:31 +08:00
sunjiacheng 400bd2d002 [notification] update _search defaults, fix /read (#53)
[notification] update _search defaults, fix /read

Co-authored-by: Kassian Sun <kassiansun@outlook.com>
2023-04-04 14:49:56 +08:00
liugq 061b528309 Merge branch 'master' of ssh://git.infini.ltd:64221/infini/console 2023-04-04 11:57:38 +08:00
liugq be533cd609 add resource_id 2023-04-04 11:57:30 +08:00
silenceqi bae99585c1 Merge pull request '[notification] update enum & list API' (#52) from feature/notification into master 2023-04-04 10:24:42 +08:00
silenceqi 0eb1fec6dd Merge pull request '[migration] update logging logic' (#50) from feature/migration into master 2023-04-04 10:22:45 +08:00
Kassian Sun c3a1d418d5 [notification] update enum & list API 2023-04-04 10:18:45 +08:00
Kassian Sun d5d46de854 [migration] improve pending_stop & es error handling 2023-04-03 20:25:45 +08:00
Kassian Sun b31bb6c090 [migration] update logging logic 2023-04-03 20:25:07 +08:00
silenceqi 325022cc1e Merge pull request '[notification] /read add types param' (#51) from feature/notification into master 2023-04-03 19:00:14 +08:00
Kassian Sun 97f5b958b3 [notification] /read add types param 2023-04-03 18:45:34 +08:00
liugq 272f29403d fix getting alerting rule 404 2023-04-03 18:05:27 +08:00
liugq abe7acf177 add privilege control of migration 2023-04-03 11:57:06 +08:00
silenceqi 6c32fb3a3d Merge pull request '[migration] check status before start/stop task' (#49) from feature/migration into master 2023-04-03 10:11:15 +08:00
Kassian Sun b29dc9ca0f [migration] check status before start/stop task 2023-04-03 10:04:16 +08:00
liaosy 7106aaeeda Merge pull request '[notification] update API endpoint' (#48) from feature/notifications into master
LGTM
2023-04-02 15:29:27 +08:00
Kassian Sun f9f60b23e7 [notification] update API endpoint 2023-04-02 15:27:51 +08:00
sunjiacheng 8fddcdaf09 [notification] add /notification/read, add message_type (#47)
[notification] add /notification/read, add message_type

Co-authored-by: Kassian Sun <kassiansun@outlook.com>
2023-04-02 15:02:30 +08:00
sunjiacheng 55ac534b02 [api] add list notification api (#35)
[api] add list notification api

Co-authored-by: Kassian Sun <kassiansun@outlook.com>
Co-authored-by: liugq <silenceqi@hotmail.com>
Co-authored-by: medcl <m@medcl.net>
Co-authored-by: silenceqi <silenceqi@infini.ltd>
2023-04-01 18:52:02 +08:00
liugq 1a645a655a support cardinality agg 2023-04-01 12:25:06 +08:00
liugq 9bd5682122 save cluster distribution in major magration task 2023-04-01 11:35:20 +08:00
liugq 3987c5db37 Merge branch 'master' of ssh://git.infini.ltd:64221/infini/console 2023-03-31 14:26:50 +08:00
liugq f716e2acf5 filter overview cluster 2023-03-31 14:26:11 +08:00
medcl bdbb6a0b95 remove repos from scopes 2023-03-30 20:44:08 +08:00
sunjiacheng e75a566f03 [plugin][migration] add more logs (#46)
[plugin][migration] add more logs

Co-authored-by: Kassian Sun <kassiansun@outlook.com>
2023-03-30 18:24:26 +08:00
silenceqi 060d53d5ca Merge pull request '[plugin][migration] add error loggings, don't failed if task handler failed' (#45) from feature/logging into master 2023-03-30 17:20:18 +08:00
Kassian Sun 6de2e14235 [plugin][migration] add error loggings 2023-03-30 17:18:24 +08:00
medcl 09f93d5190 add jenkinsfile for build linux-amd64 only 2023-03-29 21:17:06 +08:00
silenceqi 082bed8aa4 Merge pull request 'set es_scroll partition_size default value to 1' (#44) from fix_partition_size into master 2023-03-29 18:42:19 +08:00
liugq 6d537bb798 set es_scroll partition_size default value to 1 2023-03-29 18:41:20 +08:00
liugq 4871fbcb12 checking instance is avaiable when there is no pipeline logs 2023-03-29 16:17:19 +08:00
sunjiacheng 0f5626c41d [migration] fix source filter dsl (#43)
[migration] fix source filter dsl

Co-authored-by: Kassian Sun <kassiansun@outlook.com>
2023-03-29 13:03:15 +08:00
sunjiacheng 08a1673c1a [plugin] fix naming (#42)
[plugin] fix naming

Co-authored-by: Kassian Sun <kassiansun@outlook.com>
2023-03-29 13:02:55 +08:00
silenceqi 24ca0c91a5 Merge pull request 'add field type and reserved' (#41) from layout_api1 into master 2023-03-29 11:40:45 +08:00
liugq f187bbe499 add field type and reserved 2023-03-29 11:37:16 +08:00
liugq 305a11ec40 update api url of getting task info with index level 2023-03-29 10:26:05 +08:00
sunjiacheng 633d0333f2 [plugins][migration] status_log -> logging (#40)
[plugins][migration] status_log -> logging

Co-authored-by: Kassian Sun <kassiansun@outlook.com>
2023-03-28 20:12:23 +08:00
medcl df6b4a1737 update config 2023-03-28 19:02:55 +08:00
medcl 05cc6fd9d2 add context to pipeline 2023-03-28 19:01:58 +08:00
sunjiacheng 69cf1d67a9 migration_v2 (#38)
bulk write after docs was scrolled complete

update default config with migration dispatcher

add bulk parameter idle_timeout_in_seconds, slice_size

clear queue before creating pipeline

check instance available when task state is running

add check_instance_available config for migration dispatcher

get migration task progress info by index_name_unique(index_name+doctype)

get instance list only by gateway

get migration task progress info from es and instance pipeline context

rewrite logic of handling running migration major task

calc complete time in api getDataMigrationTaskOfIndex

init

Co-authored-by: liugq <silenceqi@hotmail.com>
2023-03-28 17:54:35 +08:00