4. Inspired by Google Vizier(A Service for Black-Box Optimization)
[D. Golovin, B. Solnik et al. 2017]
● Googleが社内のBorg(Kubernetesの前身)前提に作ったシステムを参考
● 様々なタスクのハイパーパラメータチューニングを共通化
Katib
10. How to use
Katib ManagerClient
Call GRPC APIs
• Create Study
• GetSuggestions
• RunTrials
• GetMetrics
K8s API Server
ハイパーパラメータを埋め込んだ学
習用のPodを生成
Get Logs
12. サポートされているアルゴリズム
• Suggestion
• Random
• Grid
• HyperBand [L. Li, K. Jamieson et al.]
• Bayesian Optimization [E. Brochu, V. Cora et al.]
• EarlyStopping
• MedianStopping [D. Golovin, B. Solnik et al.]
16. Katib Manager
Suggestion
Service
EarlyStopping
Service
Katib DB
MySQL
Create/Get Resources
• Study
• Trial
• Worker
• ServiceParameter
K8S API Server
GetSuggestions
GetShouldStopWorkers
Run/Stop Worker
Get Metrics
ModelDB
Save/Get Model
Get/Create/Run Resouces
• Study
• Trial
• Worker
• ServiceParameter
APIs
Katib API: Interface for clients
Internal API: Interface for Internal service