Interim Report on Human-Guided Adaptive Hyperparameter Optimization with Multi-Fidelity Sprints

Michael Kamfonas

This case study applies a phased hyperparameter optimization process to compare multitask natural language model variants that utilize multiphase learning rate scheduling and optim…