Commit Graph

361 Commits

Author SHA1 Message Date
liugq cc25b07439 insight support terms top by sorted sub metric 2023-07-03 16:09:22 +08:00
liugq d660255c36 fix wrong group value when terms agg on boolean field 2023-06-28 18:12:18 +08:00
medcl 36c7fb13d5 update username 2023-06-28 15:39:49 +08:00
liugq cf4d96b5e1 adapter template func map_label to lookup 2023-06-27 16:46:35 +08:00
liugq b65cd42d86 throw resolve map_label error 2023-06-25 10:26:19 +08:00
liugq 1fe5ace58d optimize map label api 2023-06-19 07:21:22 +08:00
liugq 32ed24cee0 add render label template api 2023-06-16 17:30:11 +08:00
Kassian Sun bd69c89780 [task_manager] fix auto start 2023-06-16 08:22:45 +08:00
liugq 8cc4049b0c insight and alert rule metric support transform cluster id to cluster name 2023-06-14 18:21:41 +08:00
Kassian Sun ea47e02a27 [comparison] continue compare if doc count unmatch 2023-06-13 17:12:22 +08:00
liugq edab287f40 adjust the grouping structure 2023-06-12 17:09:20 +08:00
medcl 083e481bc6 Merge branch 'master' of ssh://git.infini.ltd:64221/infini/console 2023-06-08 22:54:43 +08:00
medcl a58d15721b handle license and apply locally 2023-06-08 22:54:39 +08:00
Kassian Sun 355b6d3a9c [migration] don't skip bulk error check if count unmatch 2023-06-08 14:14:05 +08:00
medcl 9f90e49ae4 add license apply proxy api 2023-06-08 13:22:25 +08:00
liugq df4de53d29 auto detect time agg location 2023-06-08 12:53:14 +08:00
liugq 282ff24669 fix agg key convert to string error 2023-06-08 11:01:51 +08:00
liugq ce14d82406 get metric data with root agg timestamp 2023-06-08 10:43:30 +08:00
liugq 4a3961ab1f fix adding cluster_uuid 2023-06-07 21:05:59 +08:00
liugq be2787db97 fix formula notwork when there is only one metric items 2023-06-07 16:06:44 +08:00
Kassian Sun 523a6eeb37 [task_manager] rename from migration, do final cleanups 2023-06-06 10:25:34 +08:00
Kassian Sun 4d60f7c174 [migration] info api returns repeat in labels 2023-06-06 10:02:36 +08:00
Kassian Sun 68b054783b [migration] don't send notification for repeating child tasks 2023-06-05 17:45:19 +08:00
Kassian Sun 5af5b2142e [migration] fix task doc stats 2023-06-05 17:09:42 +08:00
sunjiacheng 0f0794aca7 [migration] support repeating task & incremental index (#108)
[migration] return error info for comparison/migration task

[migration] list api returns running_children

[migration] add pause/resume and repeating info

mark invalid repeat as done

[migration] fix doc count

revert unneeded changes

cleanup marshals & unmarshals

update apis

v2, unify repeat & incremental configuration

[migration] support repeating task & incremental index

Co-authored-by: Kassian Sun <kassiansun@outlook.com>
Co-authored-by: silenceqi <silenceqi@infini.ltd>
Co-authored-by: liugq <silenceqi@hotmail.com>
Co-authored-by: hardy <luohf@infinilabs.com>
2023-06-05 16:21:00 +08:00
Kassian Sun 155cb4cfbe [migration] clear child tasks before split task 2023-06-01 06:10:19 +08:00
Kassian Sun 09ba88c411 [migration] get instance from scheduler, initialize instance automatically 2023-05-30 11:41:53 +08:00
Kassian Sun dd98ba7dff [migration] don't filter out non-running pipeline task 2023-05-26 16:03:07 +08:00
medcl 241c9f57fb sleep when no message was found in queue 2023-05-26 12:02:39 +08:00
Kassian Sun d98ea04037 [comparison] info API update progress calculation 2023-05-25 10:07:43 +08:00
liugq 8d5e7e8a6b fix empty cluster_uuid 2023-05-23 15:15:56 +08:00
Kassian Sun 1789d74ece [migration] add option to skip scroll/bulk count check 2023-05-19 19:15:11 +08:00
Kassian Sun 5000deefa9 [migration] fix missing partition for running sub tasks 2023-05-19 19:12:37 +08:00
Kassian Sun 86c8615537 [comparison] always clean queue after task ended 2023-05-19 18:35:04 +08:00
Kassian Sun a00bc59d6b [migration] pipeline_task use execution_instance_id from labels 2023-05-19 15:31:42 +08:00
Kassian Sun be09c69212 [comparison] fill execution_instance_id for pipeline tasks 2023-05-19 15:25:32 +08:00
Kassian Sun 02243264e8 [comparison] merge source/target dump partitions 2023-05-19 14:42:23 +08:00
Kassian Sun d4202897e1 [migration][util] handle nil slice without error log 2023-05-19 14:15:55 +08:00
Kassian Sun 6cceb8af26 [migration] add back module.go 2023-05-19 09:46:52 +08:00
Kassian Sun 7620a76ef7 [migration] cleanup unused code 2023-05-18 22:27:20 +08:00
Kassian Sun b95b1ff703 [comparison] add info APIs
- add comparison task info & by index info API
- update comparison task permission control
- unify migration task progress calculation
- cluster migration/comparison set start time
- add split task utilities
- clear index migration/comparison state before running
2023-05-18 17:06:34 +08:00
Kassian Sun 5825bd0f71 [migration] split pipeline code, clear labels for each type 2023-05-17 19:11:03 +08:00
Kassian Sun d0706f460d [migration] handle dump_hash/index_diff pending_stop 2023-05-17 17:43:44 +08:00
Kassian Sun 8d27425fc0 [migration] fix GetChildTasks 2023-05-17 16:58:38 +08:00
Kassian Sun 556a3d49d8 [migration] extract UpdateStoppedChildTasksToReady 2023-05-17 16:44:27 +08:00
Kassian Sun 7e79c509b2 [comparison] initial implementation
- handle new task types: cluster_comparison, index_comparison
- handle new pipeline tasks: dump_hash, index_diff
- split common task APIs
- add cluster_comparison task creation API
- optimize & clean migration codes
2023-05-17 15:43:34 +08:00
liugq d1ef70d8d1 fix no index,node metadata after console setup 2023-05-17 12:03:31 +08:00
Kassian Sun e8a0b43fba [migration][pipeline] filter duplicated logs 2023-05-16 14:34:47 +08:00
Kassian Sun 9f48efe45c [migration] split cluster_migration 2023-05-16 12:13:39 +08:00
Kassian Sun ba409072c8 [migration] split scheduler/index_migration 2023-05-16 11:09:00 +08:00