4ffd8de0a2
fake commit (uncomplete)
2023-07-21 16:17:16 +08:00
4801650cd5
set pipeline to finish state when there is no tasks handled
2023-07-20 18:48:28 +08:00
f1cb35e57e
clear call pipeline module
2023-07-20 12:26:58 +08:00
a5e036d62a
add email server api
2023-07-12 16:28:31 +08:00
63cacee1a7
add email channel
2023-07-12 14:55:42 +08:00
518028fbdb
validate metric sort
2023-07-05 10:51:49 +08:00
e3ce446f4b
Merge branch 'master' into metric_sort
2023-07-04 10:46:29 +08:00
c385f58d66
filter insight api index privilege
2023-07-03 18:54:38 +08:00
cc25b07439
insight support terms top by sorted sub metric
2023-07-03 16:09:22 +08:00
d660255c36
fix wrong group value when terms agg on boolean field
2023-06-28 18:12:18 +08:00
36c7fb13d5
update username
2023-06-28 15:39:49 +08:00
cf4d96b5e1
adapter template func map_label to lookup
2023-06-27 16:46:35 +08:00
b65cd42d86
throw resolve map_label error
2023-06-25 10:26:19 +08:00
1fe5ace58d
optimize map label api
2023-06-19 07:21:22 +08:00
32ed24cee0
add render label template api
2023-06-16 17:30:11 +08:00
bd69c89780
[task_manager] fix auto start
2023-06-16 08:22:45 +08:00
8cc4049b0c
insight and alert rule metric support transform cluster id to cluster name
2023-06-14 18:21:41 +08:00
ea47e02a27
[comparison] continue compare if doc count unmatch
2023-06-13 17:12:22 +08:00
edab287f40
adjust the grouping structure
2023-06-12 17:09:20 +08:00
083e481bc6
Merge branch 'master' of ssh://git.infini.ltd:64221/infini/console
2023-06-08 22:54:43 +08:00
a58d15721b
handle license and apply locally
2023-06-08 22:54:39 +08:00
355b6d3a9c
[migration] don't skip bulk error check if count unmatch
2023-06-08 14:14:05 +08:00
9f90e49ae4
add license apply proxy api
2023-06-08 13:22:25 +08:00
df4de53d29
auto detect time agg location
2023-06-08 12:53:14 +08:00
282ff24669
fix agg key convert to string error
2023-06-08 11:01:51 +08:00
ce14d82406
get metric data with root agg timestamp
2023-06-08 10:43:30 +08:00
4a3961ab1f
fix adding cluster_uuid
2023-06-07 21:05:59 +08:00
be2787db97
fix formula notwork when there is only one metric items
2023-06-07 16:06:44 +08:00
523a6eeb37
[task_manager] rename from migration, do final cleanups
2023-06-06 10:25:34 +08:00
4d60f7c174
[migration] info api returns repeat in labels
2023-06-06 10:02:36 +08:00
68b054783b
[migration] don't send notification for repeating child tasks
2023-06-05 17:45:19 +08:00
5af5b2142e
[migration] fix task doc stats
2023-06-05 17:09:42 +08:00
0f0794aca7
[migration] support repeating task & incremental index ( #108 )
...
[migration] return error info for comparison/migration task
[migration] list api returns running_children
[migration] add pause/resume and repeating info
mark invalid repeat as done
[migration] fix doc count
revert unneeded changes
cleanup marshals & unmarshals
update apis
v2, unify repeat & incremental configuration
[migration] support repeating task & incremental index
Co-authored-by: Kassian Sun <kassiansun@outlook.com>
Co-authored-by: silenceqi <silenceqi@infini.ltd>
Co-authored-by: liugq <silenceqi@hotmail.com>
Co-authored-by: hardy <luohf@infinilabs.com>
2023-06-05 16:21:00 +08:00
155cb4cfbe
[migration] clear child tasks before split task
2023-06-01 06:10:19 +08:00
09ba88c411
[migration] get instance from scheduler, initialize instance automatically
2023-05-30 11:41:53 +08:00
dd98ba7dff
[migration] don't filter out non-running pipeline task
2023-05-26 16:03:07 +08:00
241c9f57fb
sleep when no message was found in queue
2023-05-26 12:02:39 +08:00
d98ea04037
[comparison] info API update progress calculation
2023-05-25 10:07:43 +08:00
8d5e7e8a6b
fix empty cluster_uuid
2023-05-23 15:15:56 +08:00
1789d74ece
[migration] add option to skip scroll/bulk count check
2023-05-19 19:15:11 +08:00
5000deefa9
[migration] fix missing partition for running sub tasks
2023-05-19 19:12:37 +08:00
86c8615537
[comparison] always clean queue after task ended
2023-05-19 18:35:04 +08:00
a00bc59d6b
[migration] pipeline_task use execution_instance_id from labels
2023-05-19 15:31:42 +08:00
be09c69212
[comparison] fill execution_instance_id for pipeline tasks
2023-05-19 15:25:32 +08:00
02243264e8
[comparison] merge source/target dump partitions
2023-05-19 14:42:23 +08:00
d4202897e1
[migration][util] handle nil slice without error log
2023-05-19 14:15:55 +08:00
6cceb8af26
[migration] add back module.go
2023-05-19 09:46:52 +08:00
7620a76ef7
[migration] cleanup unused code
2023-05-18 22:27:20 +08:00
b95b1ff703
[comparison] add info APIs
...
- add comparison task info & by index info API
- update comparison task permission control
- unify migration task progress calculation
- cluster migration/comparison set start time
- add split task utilities
- clear index migration/comparison state before running
2023-05-18 17:06:34 +08:00
5825bd0f71
[migration] split pipeline code, clear labels for each type
2023-05-17 19:11:03 +08:00
d0706f460d
[migration] handle dump_hash/index_diff pending_stop
2023-05-17 17:43:44 +08:00
8d27425fc0
[migration] fix GetChildTasks
2023-05-17 16:58:38 +08:00
556a3d49d8
[migration] extract UpdateStoppedChildTasksToReady
2023-05-17 16:44:27 +08:00
7e79c509b2
[comparison] initial implementation
...
- handle new task types: cluster_comparison, index_comparison
- handle new pipeline tasks: dump_hash, index_diff
- split common task APIs
- add cluster_comparison task creation API
- optimize & clean migration codes
2023-05-17 15:43:34 +08:00
d1ef70d8d1
fix no index,node metadata after console setup
2023-05-17 12:03:31 +08:00
e8a0b43fba
[migration][pipeline] filter duplicated logs
2023-05-16 14:34:47 +08:00
9f48efe45c
[migration] split cluster_migration
2023-05-16 12:13:39 +08:00
ba409072c8
[migration] split scheduler/index_migration
2023-05-16 11:09:00 +08:00
38d2a746f2
Merge pull request '[migration] mark task as stopped if pipeline not found' ( #83 ) from fix/migration into master
2023-05-15 14:42:35 +08:00
205744cd44
[migration] mark task as stopped if pipeline not found
2023-05-15 14:37:55 +08:00
4a269acf22
move topn api from framework to console ( #82 )
...
move topn api from framework to console
Co-authored-by: liugq <silenceqi@hotmail.com>
2023-05-10 23:33:35 +08:00
c37380c009
move insight model from framework to console
2023-05-08 16:23:36 +08:00
75b912426b
add websocket proxy
2023-05-06 14:53:07 +08:00
7c375a8d73
[migration] get es configs dynamically before creating pipeline
2023-04-28 16:13:30 +08:00
9b3005e005
add refresh index api
2023-04-24 19:41:43 +08:00
17a5ad6daa
[migration] scroll pipeline only check last run pipeline log
2023-04-24 16:57:16 +08:00
d1e947f826
[migration] check finished pipeline logs by updated time
2023-04-24 16:52:51 +08:00
99cf8b769f
[migration] check STOPPED logs after pending_stop
2023-04-24 16:31:44 +08:00
cbfe890982
[migration] scroll/bulk support manually retry
2023-04-24 15:58:51 +08:00
00c48bf9d5
Merge branch 'master' of ssh://git.infini.ltd:64221/infini/console
2023-04-24 14:38:04 +08:00
0ac40751cd
return pipeline task info
2023-04-24 14:37:57 +08:00
b1d3e67954
[migration] index migration skip retrying scroll if possible
2023-04-24 14:22:40 +08:00
06554054af
[migration] remove default sleep, schedule by task type & status
2023-04-24 14:19:39 +08:00
20498e2e76
[migration] tune cleaning gateway error logs
2023-04-22 15:36:47 +08:00
da908cebfb
[migration] fix missing return
2023-04-22 15:23:55 +08:00
b263c480c7
[migration] add back instance init error check
2023-04-22 15:02:05 +08:00
28a6c55671
[migration] refresh instance state after major task stopped
2023-04-22 14:48:53 +08:00
c1ed375813
[migration] print instance task limit in debug level
2023-04-21 18:28:41 +08:00
651c86feff
[migration] batch task by task type
2023-04-21 18:21:01 +08:00
5ad2e042a9
[migration] remove unused log ( #71 )
...
[migration] remove unused log
Co-authored-by: Kassian Sun <kassiansun@outlook.com>
2023-04-21 16:02:13 +08:00
52ff99af0c
[migration] use different error message for old-version tasks
2023-04-20 17:44:45 +08:00
e27a51f884
[migration] fix wrong pending_stop notification
2023-04-20 17:44:45 +08:00
c691bbc607
[migration] move disk queue clean up to index_migration level
2023-04-20 17:44:45 +08:00
ae9134afd5
[migration] fail cluster migration if docs count unmatch
2023-04-20 17:44:45 +08:00
57e1fb0844
[migration] optimize major task progress calculation
2023-04-20 17:44:45 +08:00
1f95d4af48
[migration] fix major task state handling
2023-04-20 17:44:45 +08:00
1bca4335f1
[migration] fix progress when index task is running
2023-04-20 17:44:45 +08:00
7d675ba3d1
[migration] optimize scroll/bulk error handling and status resetting
2023-04-20 17:44:45 +08:00
c89c8616b1
[migration] clean all business_id checks
2023-04-20 17:44:45 +08:00
d37649faa2
[migration] update code review issues
2023-04-20 17:44:45 +08:00
527c3c9e46
[migration] delete ready1 state
2023-04-20 17:44:45 +08:00
7472052d90
[migration] optimze bulk error message
2023-04-20 17:44:45 +08:00
cd85d21ef0
[migration] split es_scroll/bulk_indexing pipeline task
2023-04-20 17:44:44 +08:00
dd68300ab2
layout search support filtering with param is_fixed
2023-04-20 10:49:24 +08:00
1634640134
[migration] fix partion query nil check
2023-04-19 11:34:01 +08:00
ff219a211b
[migration] fix query_string json field name
2023-04-19 10:33:16 +08:00
c6b9f30277
update mapping with specify type
2023-04-18 18:16:27 +08:00
c32d6b76a1
adding api of delete data migration task
2023-04-18 15:53:07 +08:00
f18a2bc054
Merge branch 'master' into init_indices
2023-04-17 13:57:49 +08:00
eced674817
[migration] cleanup unused target config
2023-04-17 12:41:34 +08:00
liugq
medcl
Kassian Sun
sunjiacheng
silenceqi