77a2b9f9ad
Merge pull request 'update overview api' ( #134 ) from overview into master
2023-08-01 10:00:49 +08:00
c99fce0ae6
fix get auth info
2023-07-31 17:31:40 +08:00
3de262f026
handle create email server with manual input auth info
2023-07-31 16:40:58 +08:00
c17a734b17
add get auth info
2023-07-31 15:46:41 +08:00
0965256ecc
use credential to store email server auth info
2023-07-31 15:12:58 +08:00
fcf0179335
default to enabled channel of old rule data
2023-07-28 18:16:46 +08:00
d42c05c8fb
adapter old alert rule data struct
2023-07-28 17:06:07 +08:00
ce98378a7c
test email server with old password when password is empty and username equals
2023-07-28 16:02:54 +08:00
3709f5683d
remove auth.password in email server search api
2023-07-28 11:43:46 +08:00
a53344871c
Merge branch 'master' into alert_optimize
2023-07-27 18:06:59 +08:00
b447cc953e
fix calc percent of migration task
2023-07-27 18:03:33 +08:00
7217c3c636
update overview api
2023-07-26 18:46:06 +08:00
d6d1013e0a
add test api to send channel message
2023-07-26 17:54:42 +08:00
5f2569d999
check whether email server referenced by channel
2023-07-26 16:41:15 +08:00
4223bd052d
refresh email server pipeline when config change
2023-07-26 15:16:16 +08:00
d08c430356
init email server pipeline when start
2023-07-26 15:15:08 +08:00
7f36831998
support reference channel
2023-07-25 10:55:17 +08:00
ad05f229af
refactoring processors, simplicity queue consumation
2023-07-21 18:52:01 +08:00
35b5706767
support single email service with multi email server
2023-07-21 18:24:39 +08:00
4ffd8de0a2
fake commit (uncomplete)
2023-07-21 16:17:16 +08:00
4801650cd5
set pipeline to finish state when there is no tasks handled
2023-07-20 18:48:28 +08:00
f1cb35e57e
clear call pipeline module
2023-07-20 12:26:58 +08:00
a5e036d62a
add email server api
2023-07-12 16:28:31 +08:00
63cacee1a7
add email channel
2023-07-12 14:55:42 +08:00
518028fbdb
validate metric sort
2023-07-05 10:51:49 +08:00
e3ce446f4b
Merge branch 'master' into metric_sort
2023-07-04 10:46:29 +08:00
c385f58d66
filter insight api index privilege
2023-07-03 18:54:38 +08:00
cc25b07439
insight support terms top by sorted sub metric
2023-07-03 16:09:22 +08:00
d660255c36
fix wrong group value when terms agg on boolean field
2023-06-28 18:12:18 +08:00
36c7fb13d5
update username
2023-06-28 15:39:49 +08:00
cf4d96b5e1
adapter template func map_label to lookup
2023-06-27 16:46:35 +08:00
b65cd42d86
throw resolve map_label error
2023-06-25 10:26:19 +08:00
1fe5ace58d
optimize map label api
2023-06-19 07:21:22 +08:00
32ed24cee0
add render label template api
2023-06-16 17:30:11 +08:00
bd69c89780
[task_manager] fix auto start
2023-06-16 08:22:45 +08:00
8cc4049b0c
insight and alert rule metric support transform cluster id to cluster name
2023-06-14 18:21:41 +08:00
ea47e02a27
[comparison] continue compare if doc count unmatch
2023-06-13 17:12:22 +08:00
edab287f40
adjust the grouping structure
2023-06-12 17:09:20 +08:00
083e481bc6
Merge branch 'master' of ssh://git.infini.ltd:64221/infini/console
2023-06-08 22:54:43 +08:00
a58d15721b
handle license and apply locally
2023-06-08 22:54:39 +08:00
355b6d3a9c
[migration] don't skip bulk error check if count unmatch
2023-06-08 14:14:05 +08:00
9f90e49ae4
add license apply proxy api
2023-06-08 13:22:25 +08:00
df4de53d29
auto detect time agg location
2023-06-08 12:53:14 +08:00
282ff24669
fix agg key convert to string error
2023-06-08 11:01:51 +08:00
ce14d82406
get metric data with root agg timestamp
2023-06-08 10:43:30 +08:00
4a3961ab1f
fix adding cluster_uuid
2023-06-07 21:05:59 +08:00
be2787db97
fix formula notwork when there is only one metric items
2023-06-07 16:06:44 +08:00
523a6eeb37
[task_manager] rename from migration, do final cleanups
2023-06-06 10:25:34 +08:00
4d60f7c174
[migration] info api returns repeat in labels
2023-06-06 10:02:36 +08:00
68b054783b
[migration] don't send notification for repeating child tasks
2023-06-05 17:45:19 +08:00
5af5b2142e
[migration] fix task doc stats
2023-06-05 17:09:42 +08:00
0f0794aca7
[migration] support repeating task & incremental index ( #108 )
...
[migration] return error info for comparison/migration task
[migration] list api returns running_children
[migration] add pause/resume and repeating info
mark invalid repeat as done
[migration] fix doc count
revert unneeded changes
cleanup marshals & unmarshals
update apis
v2, unify repeat & incremental configuration
[migration] support repeating task & incremental index
Co-authored-by: Kassian Sun <kassiansun@outlook.com>
Co-authored-by: silenceqi <silenceqi@infini.ltd>
Co-authored-by: liugq <silenceqi@hotmail.com>
Co-authored-by: hardy <luohf@infinilabs.com>
2023-06-05 16:21:00 +08:00
155cb4cfbe
[migration] clear child tasks before split task
2023-06-01 06:10:19 +08:00
09ba88c411
[migration] get instance from scheduler, initialize instance automatically
2023-05-30 11:41:53 +08:00
dd98ba7dff
[migration] don't filter out non-running pipeline task
2023-05-26 16:03:07 +08:00
241c9f57fb
sleep when no message was found in queue
2023-05-26 12:02:39 +08:00
d98ea04037
[comparison] info API update progress calculation
2023-05-25 10:07:43 +08:00
8d5e7e8a6b
fix empty cluster_uuid
2023-05-23 15:15:56 +08:00
1789d74ece
[migration] add option to skip scroll/bulk count check
2023-05-19 19:15:11 +08:00
5000deefa9
[migration] fix missing partition for running sub tasks
2023-05-19 19:12:37 +08:00
86c8615537
[comparison] always clean queue after task ended
2023-05-19 18:35:04 +08:00
a00bc59d6b
[migration] pipeline_task use execution_instance_id from labels
2023-05-19 15:31:42 +08:00
be09c69212
[comparison] fill execution_instance_id for pipeline tasks
2023-05-19 15:25:32 +08:00
02243264e8
[comparison] merge source/target dump partitions
2023-05-19 14:42:23 +08:00
d4202897e1
[migration][util] handle nil slice without error log
2023-05-19 14:15:55 +08:00
6cceb8af26
[migration] add back module.go
2023-05-19 09:46:52 +08:00
7620a76ef7
[migration] cleanup unused code
2023-05-18 22:27:20 +08:00
b95b1ff703
[comparison] add info APIs
...
- add comparison task info & by index info API
- update comparison task permission control
- unify migration task progress calculation
- cluster migration/comparison set start time
- add split task utilities
- clear index migration/comparison state before running
2023-05-18 17:06:34 +08:00
5825bd0f71
[migration] split pipeline code, clear labels for each type
2023-05-17 19:11:03 +08:00
d0706f460d
[migration] handle dump_hash/index_diff pending_stop
2023-05-17 17:43:44 +08:00
8d27425fc0
[migration] fix GetChildTasks
2023-05-17 16:58:38 +08:00
556a3d49d8
[migration] extract UpdateStoppedChildTasksToReady
2023-05-17 16:44:27 +08:00
7e79c509b2
[comparison] initial implementation
...
- handle new task types: cluster_comparison, index_comparison
- handle new pipeline tasks: dump_hash, index_diff
- split common task APIs
- add cluster_comparison task creation API
- optimize & clean migration codes
2023-05-17 15:43:34 +08:00
d1ef70d8d1
fix no index,node metadata after console setup
2023-05-17 12:03:31 +08:00
e8a0b43fba
[migration][pipeline] filter duplicated logs
2023-05-16 14:34:47 +08:00
9f48efe45c
[migration] split cluster_migration
2023-05-16 12:13:39 +08:00
ba409072c8
[migration] split scheduler/index_migration
2023-05-16 11:09:00 +08:00
38d2a746f2
Merge pull request '[migration] mark task as stopped if pipeline not found' ( #83 ) from fix/migration into master
2023-05-15 14:42:35 +08:00
205744cd44
[migration] mark task as stopped if pipeline not found
2023-05-15 14:37:55 +08:00
4a269acf22
move topn api from framework to console ( #82 )
...
move topn api from framework to console
Co-authored-by: liugq <silenceqi@hotmail.com>
2023-05-10 23:33:35 +08:00
c37380c009
move insight model from framework to console
2023-05-08 16:23:36 +08:00
75b912426b
add websocket proxy
2023-05-06 14:53:07 +08:00
7c375a8d73
[migration] get es configs dynamically before creating pipeline
2023-04-28 16:13:30 +08:00
9b3005e005
add refresh index api
2023-04-24 19:41:43 +08:00
17a5ad6daa
[migration] scroll pipeline only check last run pipeline log
2023-04-24 16:57:16 +08:00
d1e947f826
[migration] check finished pipeline logs by updated time
2023-04-24 16:52:51 +08:00
99cf8b769f
[migration] check STOPPED logs after pending_stop
2023-04-24 16:31:44 +08:00
cbfe890982
[migration] scroll/bulk support manually retry
2023-04-24 15:58:51 +08:00
00c48bf9d5
Merge branch 'master' of ssh://git.infini.ltd:64221/infini/console
2023-04-24 14:38:04 +08:00
0ac40751cd
return pipeline task info
2023-04-24 14:37:57 +08:00
b1d3e67954
[migration] index migration skip retrying scroll if possible
2023-04-24 14:22:40 +08:00
06554054af
[migration] remove default sleep, schedule by task type & status
2023-04-24 14:19:39 +08:00
20498e2e76
[migration] tune cleaning gateway error logs
2023-04-22 15:36:47 +08:00
da908cebfb
[migration] fix missing return
2023-04-22 15:23:55 +08:00
b263c480c7
[migration] add back instance init error check
2023-04-22 15:02:05 +08:00
28a6c55671
[migration] refresh instance state after major task stopped
2023-04-22 14:48:53 +08:00
c1ed375813
[migration] print instance task limit in debug level
2023-04-21 18:28:41 +08:00
651c86feff
[migration] batch task by task type
2023-04-21 18:21:01 +08:00
5ad2e042a9
[migration] remove unused log ( #71 )
...
[migration] remove unused log
Co-authored-by: Kassian Sun <kassiansun@outlook.com>
2023-04-21 16:02:13 +08:00
52ff99af0c
[migration] use different error message for old-version tasks
2023-04-20 17:44:45 +08:00
e27a51f884
[migration] fix wrong pending_stop notification
2023-04-20 17:44:45 +08:00
c691bbc607
[migration] move disk queue clean up to index_migration level
2023-04-20 17:44:45 +08:00
ae9134afd5
[migration] fail cluster migration if docs count unmatch
2023-04-20 17:44:45 +08:00
57e1fb0844
[migration] optimize major task progress calculation
2023-04-20 17:44:45 +08:00
1f95d4af48
[migration] fix major task state handling
2023-04-20 17:44:45 +08:00
1bca4335f1
[migration] fix progress when index task is running
2023-04-20 17:44:45 +08:00
7d675ba3d1
[migration] optimize scroll/bulk error handling and status resetting
2023-04-20 17:44:45 +08:00
c89c8616b1
[migration] clean all business_id checks
2023-04-20 17:44:45 +08:00
d37649faa2
[migration] update code review issues
2023-04-20 17:44:45 +08:00
527c3c9e46
[migration] delete ready1 state
2023-04-20 17:44:45 +08:00
7472052d90
[migration] optimze bulk error message
2023-04-20 17:44:45 +08:00
cd85d21ef0
[migration] split es_scroll/bulk_indexing pipeline task
2023-04-20 17:44:44 +08:00
dd68300ab2
layout search support filtering with param is_fixed
2023-04-20 10:49:24 +08:00
1634640134
[migration] fix partion query nil check
2023-04-19 11:34:01 +08:00
ff219a211b
[migration] fix query_string json field name
2023-04-19 10:33:16 +08:00
c6b9f30277
update mapping with specify type
2023-04-18 18:16:27 +08:00
c32d6b76a1
adding api of delete data migration task
2023-04-18 15:53:07 +08:00
f18a2bc054
Merge branch 'master' into init_indices
2023-04-17 13:57:49 +08:00
eced674817
[migration] cleanup unused target config
2023-04-17 12:41:34 +08:00
81c9df8ef4
[migration] fix index source modification
2023-04-17 12:33:23 +08:00
896adad58b
fix conflicts
2023-04-17 10:27:17 +08:00
b61d0b1593
add index init api
2023-04-17 10:15:44 +08:00
c73c44724d
[migration] index_migration & pipeline define struct
2023-04-14 11:30:16 +08:00
db6d33f22b
[migration] always try to clean disk queues
2023-04-12 10:05:51 +08:00
dc606e457d
[migration] fix bulk_indexing counting logic ( #60 )
...
[migration] fix bulk_indexing counting logic
Co-authored-by: Kassian Sun <kassiansun@outlook.com>
2023-04-11 15:58:24 +08:00
4b12d372f1
[migration] task log copy task labels
2023-04-11 08:30:59 +08:00
4eb742d47e
format log message of migration task
2023-04-10 18:21:27 +08:00
b5218b8516
add compress settings of migration
2023-04-10 14:17:18 +08:00
e8f9c83245
optimize notification api
2023-04-06 21:07:29 +08:00
3fafe39b0d
add alerting notification
2023-04-06 16:16:44 +08:00
c8cd0b80a4
Merge branch 'master' of ssh://git.infini.ltd:64221/infini/console
2023-04-06 12:04:12 +08:00
db1c7322f1
update migration notifaction link url
2023-04-06 12:04:07 +08:00
8c623870e3
[notification] support search by keyword
2023-04-06 11:02:34 +08:00
b16ff4e888
[migration] track user actions in task logging
2023-04-04 16:18:13 +08:00
87d28c9cfc
[migration] fix pending_stop checking logic
2023-04-04 16:02:31 +08:00
400bd2d002
[notification] update _search defaults, fix /read ( #53 )
...
[notification] update _search defaults, fix /read
Co-authored-by: Kassian Sun <kassiansun@outlook.com>
2023-04-04 14:49:56 +08:00
061b528309
Merge branch 'master' of ssh://git.infini.ltd:64221/infini/console
2023-04-04 11:57:38 +08:00
be533cd609
add resource_id
2023-04-04 11:57:30 +08:00
bae99585c1
Merge pull request '[notification] update enum & list API' ( #52 ) from feature/notification into master
2023-04-04 10:24:42 +08:00
c3a1d418d5
[notification] update enum & list API
2023-04-04 10:18:45 +08:00
d5d46de854
[migration] improve pending_stop & es error handling
2023-04-03 20:25:45 +08:00
b31bb6c090
[migration] update logging logic
2023-04-03 20:25:07 +08:00
97f5b958b3
[notification] /read add types param
2023-04-03 18:45:34 +08:00
272f29403d
fix getting alerting rule 404
2023-04-03 18:05:27 +08:00
abe7acf177
add privilege control of migration
2023-04-03 11:57:06 +08:00
b29dc9ca0f
[migration] check status before start/stop task
2023-04-03 10:04:16 +08:00
f9f60b23e7
[notification] update API endpoint
2023-04-02 15:27:51 +08:00
8fddcdaf09
[notification] add /notification/read, add message_type ( #47 )
...
[notification] add /notification/read, add message_type
Co-authored-by: Kassian Sun <kassiansun@outlook.com>
2023-04-02 15:02:30 +08:00
55ac534b02
[api] add list notification api ( #35 )
...
[api] add list notification api
Co-authored-by: Kassian Sun <kassiansun@outlook.com>
Co-authored-by: liugq <silenceqi@hotmail.com>
Co-authored-by: medcl <m@medcl.net>
Co-authored-by: silenceqi <silenceqi@infini.ltd>
2023-04-01 18:52:02 +08:00
1a645a655a
support cardinality agg
2023-04-01 12:25:06 +08:00
silenceqi
liugq
medcl
Kassian Sun
sunjiacheng
silenceqi