Commit Graph

298 Commits

Author SHA1 Message Date
Kassian Sun b1d3e67954 [migration] index migration skip retrying scroll if possible 2023-04-24 14:22:40 +08:00
Kassian Sun 06554054af [migration] remove default sleep, schedule by task type & status 2023-04-24 14:19:39 +08:00
Kassian Sun 20498e2e76 [migration] tune cleaning gateway error logs 2023-04-22 15:36:47 +08:00
Kassian Sun da908cebfb [migration] fix missing return 2023-04-22 15:23:55 +08:00
Kassian Sun b263c480c7 [migration] add back instance init error check 2023-04-22 15:02:05 +08:00
Kassian Sun 28a6c55671 [migration] refresh instance state after major task stopped 2023-04-22 14:48:53 +08:00
Kassian Sun c1ed375813 [migration] print instance task limit in debug level 2023-04-21 18:28:41 +08:00
Kassian Sun 651c86feff [migration] batch task by task type 2023-04-21 18:21:01 +08:00
sunjiacheng 5ad2e042a9 [migration] remove unused log (#71)
[migration] remove unused log

Co-authored-by: Kassian Sun <kassiansun@outlook.com>
2023-04-21 16:02:13 +08:00
Kassian Sun 52ff99af0c [migration] use different error message for old-version tasks 2023-04-20 17:44:45 +08:00
Kassian Sun e27a51f884 [migration] fix wrong pending_stop notification 2023-04-20 17:44:45 +08:00
Kassian Sun c691bbc607 [migration] move disk queue clean up to index_migration level 2023-04-20 17:44:45 +08:00
Kassian Sun ae9134afd5 [migration] fail cluster migration if docs count unmatch 2023-04-20 17:44:45 +08:00
Kassian Sun 57e1fb0844 [migration] optimize major task progress calculation 2023-04-20 17:44:45 +08:00
Kassian Sun 1f95d4af48 [migration] fix major task state handling 2023-04-20 17:44:45 +08:00
Kassian Sun 1bca4335f1 [migration] fix progress when index task is running 2023-04-20 17:44:45 +08:00
Kassian Sun 7d675ba3d1 [migration] optimize scroll/bulk error handling and status resetting 2023-04-20 17:44:45 +08:00
Kassian Sun c89c8616b1 [migration] clean all business_id checks 2023-04-20 17:44:45 +08:00
Kassian Sun d37649faa2 [migration] update code review issues 2023-04-20 17:44:45 +08:00
Kassian Sun 527c3c9e46 [migration] delete ready1 state 2023-04-20 17:44:45 +08:00
Kassian Sun 7472052d90 [migration] optimze bulk error message 2023-04-20 17:44:45 +08:00
Kassian Sun cd85d21ef0 [migration] split es_scroll/bulk_indexing pipeline task 2023-04-20 17:44:44 +08:00
liugq dd68300ab2 layout search support filtering with param is_fixed 2023-04-20 10:49:24 +08:00
Kassian Sun 1634640134 [migration] fix partion query nil check 2023-04-19 11:34:01 +08:00
Kassian Sun ff219a211b [migration] fix query_string json field name 2023-04-19 10:33:16 +08:00
liugq c6b9f30277 update mapping with specify type 2023-04-18 18:16:27 +08:00
liugq c32d6b76a1 adding api of delete data migration task 2023-04-18 15:53:07 +08:00
liugq f18a2bc054 Merge branch 'master' into init_indices 2023-04-17 13:57:49 +08:00
Kassian Sun eced674817 [migration] cleanup unused target config 2023-04-17 12:41:34 +08:00
Kassian Sun 81c9df8ef4 [migration] fix index source modification 2023-04-17 12:33:23 +08:00
liugq 896adad58b fix conflicts 2023-04-17 10:27:17 +08:00
liugq b61d0b1593 add index init api 2023-04-17 10:15:44 +08:00
Kassian Sun c73c44724d [migration] index_migration & pipeline define struct 2023-04-14 11:30:16 +08:00
Kassian Sun db6d33f22b [migration] always try to clean disk queues 2023-04-12 10:05:51 +08:00
sunjiacheng dc606e457d [migration] fix bulk_indexing counting logic (#60)
[migration] fix bulk_indexing counting logic

Co-authored-by: Kassian Sun <kassiansun@outlook.com>
2023-04-11 15:58:24 +08:00
Kassian Sun 4b12d372f1 [migration] task log copy task labels 2023-04-11 08:30:59 +08:00
liugq 4eb742d47e format log message of migration task 2023-04-10 18:21:27 +08:00
liugq b5218b8516 add compress settings of migration 2023-04-10 14:17:18 +08:00
liugq e8f9c83245 optimize notification api 2023-04-06 21:07:29 +08:00
liugq 3fafe39b0d add alerting notification 2023-04-06 16:16:44 +08:00
liugq c8cd0b80a4 Merge branch 'master' of ssh://git.infini.ltd:64221/infini/console 2023-04-06 12:04:12 +08:00
liugq db1c7322f1 update migration notifaction link url 2023-04-06 12:04:07 +08:00
Kassian Sun 8c623870e3 [notification] support search by keyword 2023-04-06 11:02:34 +08:00
Kassian Sun b16ff4e888 [migration] track user actions in task logging 2023-04-04 16:18:13 +08:00
Kassian Sun 87d28c9cfc [migration] fix pending_stop checking logic 2023-04-04 16:02:31 +08:00
sunjiacheng 400bd2d002 [notification] update _search defaults, fix /read (#53)
[notification] update _search defaults, fix /read

Co-authored-by: Kassian Sun <kassiansun@outlook.com>
2023-04-04 14:49:56 +08:00
liugq 061b528309 Merge branch 'master' of ssh://git.infini.ltd:64221/infini/console 2023-04-04 11:57:38 +08:00
liugq be533cd609 add resource_id 2023-04-04 11:57:30 +08:00
silenceqi bae99585c1 Merge pull request '[notification] update enum & list API' (#52) from feature/notification into master 2023-04-04 10:24:42 +08:00
Kassian Sun c3a1d418d5 [notification] update enum & list API 2023-04-04 10:18:45 +08:00