1789d74ece
[migration] add option to skip scroll/bulk count check
2023-05-19 19:15:11 +08:00
5000deefa9
[migration] fix missing partition for running sub tasks
2023-05-19 19:12:37 +08:00
86c8615537
[comparison] always clean queue after task ended
2023-05-19 18:35:04 +08:00
a00bc59d6b
[migration] pipeline_task use execution_instance_id from labels
2023-05-19 15:31:42 +08:00
be09c69212
[comparison] fill execution_instance_id for pipeline tasks
2023-05-19 15:25:32 +08:00
02243264e8
[comparison] merge source/target dump partitions
2023-05-19 14:42:23 +08:00
d4202897e1
[migration][util] handle nil slice without error log
2023-05-19 14:15:55 +08:00
6cceb8af26
[migration] add back module.go
2023-05-19 09:46:52 +08:00
7620a76ef7
[migration] cleanup unused code
2023-05-18 22:27:20 +08:00
b95b1ff703
[comparison] add info APIs
...
- add comparison task info & by index info API
- update comparison task permission control
- unify migration task progress calculation
- cluster migration/comparison set start time
- add split task utilities
- clear index migration/comparison state before running
2023-05-18 17:06:34 +08:00
5825bd0f71
[migration] split pipeline code, clear labels for each type
2023-05-17 19:11:03 +08:00
d0706f460d
[migration] handle dump_hash/index_diff pending_stop
2023-05-17 17:43:44 +08:00
8d27425fc0
[migration] fix GetChildTasks
2023-05-17 16:58:38 +08:00
556a3d49d8
[migration] extract UpdateStoppedChildTasksToReady
2023-05-17 16:44:27 +08:00
7e79c509b2
[comparison] initial implementation
...
- handle new task types: cluster_comparison, index_comparison
- handle new pipeline tasks: dump_hash, index_diff
- split common task APIs
- add cluster_comparison task creation API
- optimize & clean migration codes
2023-05-17 15:43:34 +08:00
e8a0b43fba
[migration][pipeline] filter duplicated logs
2023-05-16 14:34:47 +08:00
9f48efe45c
[migration] split cluster_migration
2023-05-16 12:13:39 +08:00
ba409072c8
[migration] split scheduler/index_migration
2023-05-16 11:09:00 +08:00
205744cd44
[migration] mark task as stopped if pipeline not found
2023-05-15 14:37:55 +08:00
7c375a8d73
[migration] get es configs dynamically before creating pipeline
2023-04-28 16:13:30 +08:00
9b3005e005
add refresh index api
2023-04-24 19:41:43 +08:00
17a5ad6daa
[migration] scroll pipeline only check last run pipeline log
2023-04-24 16:57:16 +08:00
d1e947f826
[migration] check finished pipeline logs by updated time
2023-04-24 16:52:51 +08:00
99cf8b769f
[migration] check STOPPED logs after pending_stop
2023-04-24 16:31:44 +08:00
cbfe890982
[migration] scroll/bulk support manually retry
2023-04-24 15:58:51 +08:00
00c48bf9d5
Merge branch 'master' of ssh://git.infini.ltd:64221/infini/console
2023-04-24 14:38:04 +08:00
0ac40751cd
return pipeline task info
2023-04-24 14:37:57 +08:00
b1d3e67954
[migration] index migration skip retrying scroll if possible
2023-04-24 14:22:40 +08:00
06554054af
[migration] remove default sleep, schedule by task type & status
2023-04-24 14:19:39 +08:00
20498e2e76
[migration] tune cleaning gateway error logs
2023-04-22 15:36:47 +08:00
da908cebfb
[migration] fix missing return
2023-04-22 15:23:55 +08:00
b263c480c7
[migration] add back instance init error check
2023-04-22 15:02:05 +08:00
28a6c55671
[migration] refresh instance state after major task stopped
2023-04-22 14:48:53 +08:00
c1ed375813
[migration] print instance task limit in debug level
2023-04-21 18:28:41 +08:00
651c86feff
[migration] batch task by task type
2023-04-21 18:21:01 +08:00
5ad2e042a9
[migration] remove unused log ( #71 )
...
[migration] remove unused log
Co-authored-by: Kassian Sun <kassiansun@outlook.com>
2023-04-21 16:02:13 +08:00
52ff99af0c
[migration] use different error message for old-version tasks
2023-04-20 17:44:45 +08:00
e27a51f884
[migration] fix wrong pending_stop notification
2023-04-20 17:44:45 +08:00
c691bbc607
[migration] move disk queue clean up to index_migration level
2023-04-20 17:44:45 +08:00
ae9134afd5
[migration] fail cluster migration if docs count unmatch
2023-04-20 17:44:45 +08:00
57e1fb0844
[migration] optimize major task progress calculation
2023-04-20 17:44:45 +08:00
1f95d4af48
[migration] fix major task state handling
2023-04-20 17:44:45 +08:00
1bca4335f1
[migration] fix progress when index task is running
2023-04-20 17:44:45 +08:00
7d675ba3d1
[migration] optimize scroll/bulk error handling and status resetting
2023-04-20 17:44:45 +08:00
c89c8616b1
[migration] clean all business_id checks
2023-04-20 17:44:45 +08:00
d37649faa2
[migration] update code review issues
2023-04-20 17:44:45 +08:00
527c3c9e46
[migration] delete ready1 state
2023-04-20 17:44:45 +08:00
7472052d90
[migration] optimze bulk error message
2023-04-20 17:44:45 +08:00
cd85d21ef0
[migration] split es_scroll/bulk_indexing pipeline task
2023-04-20 17:44:44 +08:00
1634640134
[migration] fix partion query nil check
2023-04-19 11:34:01 +08:00
Kassian Sun
liugq
sunjiacheng