Commit Graph

811 Commits

Author SHA1 Message Date
sunjiacheng 69cf1d67a9 migration_v2 (#38)
bulk write after docs was scrolled complete

update default config with migration dispatcher

add bulk parameter idle_timeout_in_seconds, slice_size

clear queue before creating pipeline

check instance available when task state is running

add check_instance_available config for migration dispatcher

get migration task progress info by index_name_unique(index_name+doctype)

get instance list only by gateway

get migration task progress info from es and instance pipeline context

rewrite logic of handling running migration major task

calc complete time in api getDataMigrationTaskOfIndex

init

Co-authored-by: liugq <silenceqi@hotmail.com>
2023-03-28 17:54:35 +08:00
sunjiacheng cd56a4ff24 Merge pull request '[plugin][api] visualization/data supports latest statistics' (#36) from feature/top_hits into master 2023-03-28 10:28:25 +08:00
Kassian Sun 845d77508b return null if _source is empty 2023-03-23 09:00:07 +08:00
Kassian Sun 17abd00e20 [plugin][api] visualization/data supports top_hits 2023-03-22 19:04:34 +08:00
silenceqi 2e3593cbf3 Merge pull request 'filter empty group of alerting rule' (#37) from filter_empty_group into master 2023-03-22 10:52:26 +08:00
liugq bc024bcfce filter empty group of alerting rule 2023-03-22 10:46:26 +08:00
silenceqi 157fc43ee8 Merge pull request 'add elastic status overview api' (#34) from status_overview_api into master 2023-03-16 10:56:30 +08:00
liugq 99f03fc574 add elastic status overview api 2023-03-16 10:55:21 +08:00
silenceqi 85e881101d Merge pull request 'add gateway layout' (#33) from setup_conf into master 2023-03-14 17:58:29 +08:00
liugq 0ab537ef43 add gateway layout 2023-03-14 17:57:18 +08:00
silenceqi 6d2f02af9c Merge pull request 'Elasticsearch, easysearch, opensearch compatibility update' (#32) from es_distribution into master 2023-03-11 19:11:06 +08:00
liugq eba379eade test update 2023-03-11 19:09:25 +08:00
liugq f27c7a2951 elasticsearch distribution judgement logic update 2023-03-11 13:30:59 +08:00
liugq c8f7927821 use default distribution with Elasticsarch 2023-03-08 18:01:53 +08:00
liugq 50e8f7fc79 sync cluster distribution to config file while setup 2023-03-08 12:18:08 +08:00
liugq d37da4679e use total value instead of doc_value agg as doc count 2023-03-06 15:00:14 +08:00
liugq 1a1b00d5f8 add initialization template file for es 5.x, 6.x 2023-03-06 11:59:31 +08:00
liugq d57e9cf476 change es cluster version of system cluster support from 7.3 to 5.3 2023-03-06 10:59:52 +08:00
silenceqi b7d6e3bf87 Merge pull request 'add layout management api' (#31) from layout_api into master 2023-03-03 16:36:31 +08:00
liugq 2c8ee843f1 refactoring elastic.GetDateHistogramIntervalField 2023-03-02 20:54:21 +08:00
liugq 5d0e745012 support setup with easysearch and opensearch 2023-03-02 17:28:51 +08:00
liugq 662205c540 add layout api permission 2023-02-28 12:27:26 +08:00
liugq f1c18797b0 add query arg view_id for layout search api 2023-02-27 18:04:07 +08:00
liugq 5637c65977 add view layout api 2023-02-24 19:32:10 +08:00
silenceqi a6b44b63f3 Merge pull request 'clear code of builtin user' (#30) from clear_builtin_user into master 2023-02-24 14:07:00 +08:00
liugq ce4a056efa clear code of builtin user 2023-02-24 12:31:17 +08:00
silenceqi 1b5b9444b7 Merge pull request 'add search scroll path to permission file' (#29) from add_search_scroll_path into master 2023-02-24 11:02:19 +08:00
liugq b799dca934 add search scroll path to permission file 2023-02-24 10:59:28 +08:00
silenceqi 8431144dca Merge pull request 'add credential management capabilities' (#28) from credential into master 2023-02-23 11:30:05 +08:00
liugq 0cd198b805 rename tempID to GlobalSystemElasticsearchID 2023-02-23 11:10:38 +08:00
liugq 67382361a1 use orm.Create replace orm.Save method 2023-02-23 09:15:05 +08:00
sunjiacheng fc8a47373a [build] fix src/* imports (#27)
[build] fix src/* imports

Co-authored-by: Kassian Sun <kassiansun@outlook.com>
2023-02-21 21:48:20 +08:00
liugq 5d002145b9 add credential change callback for updating password of system cluster 2023-02-21 15:39:26 +08:00
liugq cc4f824ff5 remove register keystore resolver 2023-02-20 09:47:07 +08:00
liugq a820e0d52f handle err 2023-02-15 11:55:49 +08:00
liugq 46432da7aa Merge branch 'master' into credential 2023-02-13 11:35:49 +08:00
silenceqi 34feba31a6 Merge pull request 'release070_bugfix' (#26) from release070_bugfix into master 2023-02-10 18:17:38 +08:00
liugq 4495de8ae9 initialize bug fixed 2023-02-10 18:16:05 +08:00
liugq 31e314ec87 initialize bug fixed 2023-02-10 18:13:56 +08:00
liugq e11207dbc0 init credential secret 2023-02-10 09:51:42 +08:00
medcl 844969c5c1 Merge branch 'master' of ssh://git.infini.ltd:64221/infini/console 2023-02-09 14:14:29 +08:00
medcl c1739df13b remove unused parameters 2023-02-09 14:14:24 +08:00
silenceqi c62e0e9920 Merge pull request 'fixed error output of parsing migration config' (#25) from mi_bug into master 2023-02-08 11:38:39 +08:00
liugq 6bcca588cb fixed error output of parsing migration config 2023-02-08 11:37:33 +08:00
silenceqi 5f4cbb5fcd Merge pull request 'fixed compile error of migration code' (#24) from mi_bug into master 2023-02-08 10:55:57 +08:00
liugq aaf0822593 remove src from import path 2023-02-08 10:55:16 +08:00
liugq c22bf646f3 fixed compile error of migration code 2023-02-08 10:51:12 +08:00
medcl f9245a5c3b Merge branch 'master' of ssh://git.infini.ltd:64221/infini/console 2023-02-08 10:18:43 +08:00
medcl cda6a72c9e update default template 2023-02-08 10:18:41 +08:00
silenceqi 4403c822bb Merge pull request 'code optimize after code review' (#23) from mi_refactoring into master 2023-02-06 16:53:18 +08:00