Commit Graph

1518 Commits

Author SHA1 Message Date
Kassian Sun 5000deefa9 [migration] fix missing partition for running sub tasks 2023-05-19 19:12:37 +08:00
Kassian Sun 86c8615537 [comparison] always clean queue after task ended 2023-05-19 18:35:04 +08:00
silenceqi 6e98f7287b Merge pull request '[migration] pipeline_task use execution_instance_id from labels' (#97) from feature/pipeline_task into master 2023-05-19 15:41:36 +08:00
Kassian Sun a00bc59d6b [migration] pipeline_task use execution_instance_id from labels 2023-05-19 15:31:42 +08:00
Kassian Sun be09c69212 [comparison] fill execution_instance_id for pipeline tasks 2023-05-19 15:25:32 +08:00
Kassian Sun 02243264e8 [comparison] merge source/target dump partitions 2023-05-19 14:42:23 +08:00
Kassian Sun d4202897e1 [migration][util] handle nil slice without error log 2023-05-19 14:15:55 +08:00
Kassian Sun 6cceb8af26 [migration] add back module.go 2023-05-19 09:46:52 +08:00
sunjiacheng cc2fd546cf Merge pull request '[comparison] add info APIs' (#92) from feature/comparison into master 2023-05-19 09:22:22 +08:00
Kassian Sun 7620a76ef7 [migration] cleanup unused code 2023-05-18 22:27:20 +08:00
Kassian Sun b95b1ff703 [comparison] add info APIs
- add comparison task info & by index info API
- update comparison task permission control
- unify migration task progress calculation
- cluster migration/comparison set start time
- add split task utilities
- clear index migration/comparison state before running
2023-05-18 17:06:34 +08:00
Kassian Sun 5825bd0f71 [migration] split pipeline code, clear labels for each type 2023-05-17 19:11:03 +08:00
silenceqi 4474ab7fc4 Merge pull request '[comparison] initial implementation' (#90) from feature/comparison into master 2023-05-17 18:09:27 +08:00
Kassian Sun d0706f460d [migration] handle dump_hash/index_diff pending_stop 2023-05-17 17:43:44 +08:00
Kassian Sun 8d27425fc0 [migration] fix GetChildTasks 2023-05-17 16:58:38 +08:00
Kassian Sun 556a3d49d8 [migration] extract UpdateStoppedChildTasksToReady 2023-05-17 16:44:27 +08:00
Kassian Sun 7e79c509b2 [comparison] initial implementation
- handle new task types: cluster_comparison, index_comparison
- handle new pipeline tasks: dump_hash, index_diff
- split common task APIs
- add cluster_comparison task creation API
- optimize & clean migration codes
2023-05-17 15:43:34 +08:00
silenceqi 79bf42c775 Merge pull request 'update alerting initialization template' (#89) from initialization_tpl into master 2023-05-17 12:25:22 +08:00
liugq 4c949e350a update alerting initialization template 2023-05-17 12:22:01 +08:00
silenceqi d76b2295b4 Merge pull request 'support refer env variables in alert template' (#88) from alert_env_support into master 2023-05-17 12:19:12 +08:00
liugq ba9fbd94bb support refer env variables in alert template 2023-05-17 12:14:51 +08:00
silenceqi 32f22205eb Merge pull request 'fix no index,node metadata after console setup' (#87) from fix_metadata into master 2023-05-17 12:04:24 +08:00
liugq d1ef70d8d1 fix no index,node metadata after console setup 2023-05-17 12:03:31 +08:00
silenceqi 4b21008c4b Merge pull request '[migration][pipeline] filter duplicated logs' (#86) from fix/migration into master 2023-05-16 14:43:09 +08:00
Kassian Sun e8a0b43fba [migration][pipeline] filter duplicated logs 2023-05-16 14:34:47 +08:00
silenceqi 25f951c298 Merge pull request '[migration] split cluster_migration' (#85) from feature/migration into master 2023-05-16 14:15:37 +08:00
Kassian Sun 9f48efe45c [migration] split cluster_migration 2023-05-16 12:13:39 +08:00
silenceqi d6a21fabed Merge pull request '[migration] split scheduler/index_migration' (#84) from feature/migration into master 2023-05-16 12:10:18 +08:00
Kassian Sun ba409072c8 [migration] split scheduler/index_migration 2023-05-16 11:09:00 +08:00
silenceqi 38d2a746f2 Merge pull request '[migration] mark task as stopped if pipeline not found' (#83) from fix/migration into master 2023-05-15 14:42:35 +08:00
Kassian Sun 205744cd44 [migration] mark task as stopped if pipeline not found 2023-05-15 14:37:55 +08:00
silenceqi 4a269acf22 move topn api from framework to console (#82)
move topn api from framework to console

Co-authored-by: liugq <silenceqi@hotmail.com>
2023-05-10 23:33:35 +08:00
silenceqi d67d92274f Merge pull request 'fixed dashboard mapping' (#81) from refactor_dashboard into master 2023-05-08 16:34:06 +08:00
liugq c8b9adfdf1 fixed dashboard mapping 2023-05-08 16:33:28 +08:00
silenceqi 1ee1fa9337 Merge pull request 'move insight model from framework to console' (#80) from refactor_dashboard into master 2023-05-08 16:26:03 +08:00
liugq c37380c009 move insight model from framework to console 2023-05-08 16:23:36 +08:00
medcl 2f7439c233 remove Jenkinsfile-centos-docker 2023-05-06 16:42:17 +08:00
liugq d14da43df9 Merge branch 'master' of ssh://git.infini.ltd:64221/infini/console 2023-05-06 14:54:00 +08:00
liugq 75b912426b add websocket proxy 2023-05-06 14:53:07 +08:00
medcl f3f1e45ac3 manually enable setup in console 2023-05-05 14:17:09 +08:00
silenceqi 62b5b94c56 Merge pull request '[migration] get es configs dynamically before creating pipeline' (#79) from feature/migration into master 2023-04-28 16:20:08 +08:00
Kassian Sun 7c375a8d73 [migration] get es configs dynamically before creating pipeline 2023-04-28 16:13:30 +08:00
liugq 9b3005e005 add refresh index api 2023-04-24 19:41:43 +08:00
silenceqi 9be1f412de Merge pull request '[migration] scroll/bulk support manually retry' (#78) from feature/migration into master 2023-04-24 17:27:41 +08:00
Kassian Sun 17a5ad6daa [migration] scroll pipeline only check last run pipeline log 2023-04-24 16:57:16 +08:00
Kassian Sun d1e947f826 [migration] check finished pipeline logs by updated time 2023-04-24 16:52:51 +08:00
Kassian Sun 99cf8b769f [migration] check STOPPED logs after pending_stop 2023-04-24 16:31:44 +08:00
Kassian Sun cbfe890982 [migration] scroll/bulk support manually retry 2023-04-24 15:58:51 +08:00
liugq 00c48bf9d5 Merge branch 'master' of ssh://git.infini.ltd:64221/infini/console 2023-04-24 14:38:04 +08:00
liugq 0ac40751cd return pipeline task info 2023-04-24 14:37:57 +08:00