Using Small Proxy Datasets to Accelerate Hyperparameter Search

Sam Shleifer, Eric Prokop

One of the biggest bottlenecks in a machine learning workflow is waiting for models to train. Depending on the available computing resources, it can take days to weeks to train a n…