liugq
3de262f026
handle create email server with manual input auth info
2023-07-31 16:40:58 +08:00
liugq
c17a734b17
add get auth info
2023-07-31 15:46:41 +08:00
liugq
0965256ecc
use credential to store email server auth info
2023-07-31 15:12:58 +08:00
liugq
fcf0179335
default to enabled channel of old rule data
2023-07-28 18:16:46 +08:00
liugq
d42c05c8fb
adapter old alert rule data struct
2023-07-28 17:06:07 +08:00
liugq
ce98378a7c
test email server with old password when password is empty and username equals
2023-07-28 16:02:54 +08:00
liugq
3709f5683d
remove auth.password in email server search api
2023-07-28 11:43:46 +08:00
liugq
a53344871c
Merge branch 'master' into alert_optimize
2023-07-27 18:06:59 +08:00
liugq
b447cc953e
fix calc percent of migration task
2023-07-27 18:03:33 +08:00
liugq
7217c3c636
update overview api
2023-07-26 18:46:06 +08:00
liugq
d6d1013e0a
add test api to send channel message
2023-07-26 17:54:42 +08:00
liugq
5f2569d999
check whether email server referenced by channel
2023-07-26 16:41:15 +08:00
liugq
4223bd052d
refresh email server pipeline when config change
2023-07-26 15:16:16 +08:00
liugq
d08c430356
init email server pipeline when start
2023-07-26 15:15:08 +08:00
liugq
7f36831998
support reference channel
2023-07-25 10:55:17 +08:00
medcl
ad05f229af
refactoring processors, simplicity queue consumation
2023-07-21 18:52:01 +08:00
liugq
35b5706767
support single email service with multi email server
2023-07-21 18:24:39 +08:00
liugq
4ffd8de0a2
fake commit (uncomplete)
2023-07-21 16:17:16 +08:00
liugq
4801650cd5
set pipeline to finish state when there is no tasks handled
2023-07-20 18:48:28 +08:00
liugq
f1cb35e57e
clear call pipeline module
2023-07-20 12:26:58 +08:00
liugq
a5e036d62a
add email server api
2023-07-12 16:28:31 +08:00
liugq
63cacee1a7
add email channel
2023-07-12 14:55:42 +08:00
liugq
518028fbdb
validate metric sort
2023-07-05 10:51:49 +08:00
liugq
e3ce446f4b
Merge branch 'master' into metric_sort
2023-07-04 10:46:29 +08:00
liugq
c385f58d66
filter insight api index privilege
2023-07-03 18:54:38 +08:00
liugq
cc25b07439
insight support terms top by sorted sub metric
2023-07-03 16:09:22 +08:00
liugq
d660255c36
fix wrong group value when terms agg on boolean field
2023-06-28 18:12:18 +08:00
medcl
36c7fb13d5
update username
2023-06-28 15:39:49 +08:00
liugq
cf4d96b5e1
adapter template func map_label to lookup
2023-06-27 16:46:35 +08:00
liugq
b65cd42d86
throw resolve map_label error
2023-06-25 10:26:19 +08:00
liugq
1fe5ace58d
optimize map label api
2023-06-19 07:21:22 +08:00
liugq
32ed24cee0
add render label template api
2023-06-16 17:30:11 +08:00
Kassian Sun
bd69c89780
[task_manager] fix auto start
2023-06-16 08:22:45 +08:00
liugq
8cc4049b0c
insight and alert rule metric support transform cluster id to cluster name
2023-06-14 18:21:41 +08:00
Kassian Sun
ea47e02a27
[comparison] continue compare if doc count unmatch
2023-06-13 17:12:22 +08:00
liugq
edab287f40
adjust the grouping structure
2023-06-12 17:09:20 +08:00
medcl
083e481bc6
Merge branch 'master' of ssh://git.infini.ltd:64221/infini/console
2023-06-08 22:54:43 +08:00
medcl
a58d15721b
handle license and apply locally
2023-06-08 22:54:39 +08:00
Kassian Sun
355b6d3a9c
[migration] don't skip bulk error check if count unmatch
2023-06-08 14:14:05 +08:00
medcl
9f90e49ae4
add license apply proxy api
2023-06-08 13:22:25 +08:00
liugq
df4de53d29
auto detect time agg location
2023-06-08 12:53:14 +08:00
liugq
282ff24669
fix agg key convert to string error
2023-06-08 11:01:51 +08:00
liugq
ce14d82406
get metric data with root agg timestamp
2023-06-08 10:43:30 +08:00
liugq
4a3961ab1f
fix adding cluster_uuid
2023-06-07 21:05:59 +08:00
liugq
be2787db97
fix formula notwork when there is only one metric items
2023-06-07 16:06:44 +08:00
Kassian Sun
523a6eeb37
[task_manager] rename from migration, do final cleanups
2023-06-06 10:25:34 +08:00
Kassian Sun
4d60f7c174
[migration] info api returns repeat in labels
2023-06-06 10:02:36 +08:00
Kassian Sun
68b054783b
[migration] don't send notification for repeating child tasks
2023-06-05 17:45:19 +08:00
Kassian Sun
5af5b2142e
[migration] fix task doc stats
2023-06-05 17:09:42 +08:00
sunjiacheng
0f0794aca7
[migration] support repeating task & incremental index ( #108 )
...
[migration] return error info for comparison/migration task
[migration] list api returns running_children
[migration] add pause/resume and repeating info
mark invalid repeat as done
[migration] fix doc count
revert unneeded changes
cleanup marshals & unmarshals
update apis
v2, unify repeat & incremental configuration
[migration] support repeating task & incremental index
Co-authored-by: Kassian Sun <kassiansun@outlook.com>
Co-authored-by: silenceqi <silenceqi@infini.ltd>
Co-authored-by: liugq <silenceqi@hotmail.com>
Co-authored-by: hardy <luohf@infinilabs.com>
2023-06-05 16:21:00 +08:00
Kassian Sun
155cb4cfbe
[migration] clear child tasks before split task
2023-06-01 06:10:19 +08:00
Kassian Sun
09ba88c411
[migration] get instance from scheduler, initialize instance automatically
2023-05-30 11:41:53 +08:00
Kassian Sun
dd98ba7dff
[migration] don't filter out non-running pipeline task
2023-05-26 16:03:07 +08:00
medcl
241c9f57fb
sleep when no message was found in queue
2023-05-26 12:02:39 +08:00
Kassian Sun
d98ea04037
[comparison] info API update progress calculation
2023-05-25 10:07:43 +08:00
liugq
8d5e7e8a6b
fix empty cluster_uuid
2023-05-23 15:15:56 +08:00
Kassian Sun
1789d74ece
[migration] add option to skip scroll/bulk count check
2023-05-19 19:15:11 +08:00
Kassian Sun
5000deefa9
[migration] fix missing partition for running sub tasks
2023-05-19 19:12:37 +08:00
Kassian Sun
86c8615537
[comparison] always clean queue after task ended
2023-05-19 18:35:04 +08:00
Kassian Sun
a00bc59d6b
[migration] pipeline_task use execution_instance_id from labels
2023-05-19 15:31:42 +08:00
Kassian Sun
be09c69212
[comparison] fill execution_instance_id for pipeline tasks
2023-05-19 15:25:32 +08:00
Kassian Sun
02243264e8
[comparison] merge source/target dump partitions
2023-05-19 14:42:23 +08:00
Kassian Sun
d4202897e1
[migration][util] handle nil slice without error log
2023-05-19 14:15:55 +08:00
Kassian Sun
6cceb8af26
[migration] add back module.go
2023-05-19 09:46:52 +08:00
Kassian Sun
7620a76ef7
[migration] cleanup unused code
2023-05-18 22:27:20 +08:00
Kassian Sun
b95b1ff703
[comparison] add info APIs
...
- add comparison task info & by index info API
- update comparison task permission control
- unify migration task progress calculation
- cluster migration/comparison set start time
- add split task utilities
- clear index migration/comparison state before running
2023-05-18 17:06:34 +08:00
Kassian Sun
5825bd0f71
[migration] split pipeline code, clear labels for each type
2023-05-17 19:11:03 +08:00
Kassian Sun
d0706f460d
[migration] handle dump_hash/index_diff pending_stop
2023-05-17 17:43:44 +08:00
Kassian Sun
8d27425fc0
[migration] fix GetChildTasks
2023-05-17 16:58:38 +08:00
Kassian Sun
556a3d49d8
[migration] extract UpdateStoppedChildTasksToReady
2023-05-17 16:44:27 +08:00
Kassian Sun
7e79c509b2
[comparison] initial implementation
...
- handle new task types: cluster_comparison, index_comparison
- handle new pipeline tasks: dump_hash, index_diff
- split common task APIs
- add cluster_comparison task creation API
- optimize & clean migration codes
2023-05-17 15:43:34 +08:00
liugq
d1ef70d8d1
fix no index,node metadata after console setup
2023-05-17 12:03:31 +08:00
Kassian Sun
e8a0b43fba
[migration][pipeline] filter duplicated logs
2023-05-16 14:34:47 +08:00
Kassian Sun
9f48efe45c
[migration] split cluster_migration
2023-05-16 12:13:39 +08:00
Kassian Sun
ba409072c8
[migration] split scheduler/index_migration
2023-05-16 11:09:00 +08:00
silenceqi
38d2a746f2
Merge pull request '[migration] mark task as stopped if pipeline not found' ( #83 ) from fix/migration into master
2023-05-15 14:42:35 +08:00
Kassian Sun
205744cd44
[migration] mark task as stopped if pipeline not found
2023-05-15 14:37:55 +08:00
silenceqi
4a269acf22
move topn api from framework to console ( #82 )
...
move topn api from framework to console
Co-authored-by: liugq <silenceqi@hotmail.com>
2023-05-10 23:33:35 +08:00
liugq
c37380c009
move insight model from framework to console
2023-05-08 16:23:36 +08:00
liugq
75b912426b
add websocket proxy
2023-05-06 14:53:07 +08:00
Kassian Sun
7c375a8d73
[migration] get es configs dynamically before creating pipeline
2023-04-28 16:13:30 +08:00
liugq
9b3005e005
add refresh index api
2023-04-24 19:41:43 +08:00
Kassian Sun
17a5ad6daa
[migration] scroll pipeline only check last run pipeline log
2023-04-24 16:57:16 +08:00
Kassian Sun
d1e947f826
[migration] check finished pipeline logs by updated time
2023-04-24 16:52:51 +08:00
Kassian Sun
99cf8b769f
[migration] check STOPPED logs after pending_stop
2023-04-24 16:31:44 +08:00
Kassian Sun
cbfe890982
[migration] scroll/bulk support manually retry
2023-04-24 15:58:51 +08:00
liugq
00c48bf9d5
Merge branch 'master' of ssh://git.infini.ltd:64221/infini/console
2023-04-24 14:38:04 +08:00
liugq
0ac40751cd
return pipeline task info
2023-04-24 14:37:57 +08:00
Kassian Sun
b1d3e67954
[migration] index migration skip retrying scroll if possible
2023-04-24 14:22:40 +08:00
Kassian Sun
06554054af
[migration] remove default sleep, schedule by task type & status
2023-04-24 14:19:39 +08:00
Kassian Sun
20498e2e76
[migration] tune cleaning gateway error logs
2023-04-22 15:36:47 +08:00
Kassian Sun
da908cebfb
[migration] fix missing return
2023-04-22 15:23:55 +08:00
Kassian Sun
b263c480c7
[migration] add back instance init error check
2023-04-22 15:02:05 +08:00
Kassian Sun
28a6c55671
[migration] refresh instance state after major task stopped
2023-04-22 14:48:53 +08:00
Kassian Sun
c1ed375813
[migration] print instance task limit in debug level
2023-04-21 18:28:41 +08:00
Kassian Sun
651c86feff
[migration] batch task by task type
2023-04-21 18:21:01 +08:00
sunjiacheng
5ad2e042a9
[migration] remove unused log ( #71 )
...
[migration] remove unused log
Co-authored-by: Kassian Sun <kassiansun@outlook.com>
2023-04-21 16:02:13 +08:00
Kassian Sun
52ff99af0c
[migration] use different error message for old-version tasks
2023-04-20 17:44:45 +08:00
Kassian Sun
e27a51f884
[migration] fix wrong pending_stop notification
2023-04-20 17:44:45 +08:00
Kassian Sun
c691bbc607
[migration] move disk queue clean up to index_migration level
2023-04-20 17:44:45 +08:00