48 citations · 101 across the 4 of their papers we have counts for
3 papers · 1 filter
Synthetic Petri Dish: A Novel Surrogate Model for Rapid Architecture Search
Aditya Rawal, Joel Lehman, Felipe Petroski Such +2
Neural Architecture Search (NAS) explores a large space of architectural motifs -- a compute-intensive process that often involves ground-truth evaluation of each motif by instanti…
Generative Teaching Networks: Accelerating Neural Architecture Search by Learning to Generate Synthetic Training Data
Felipe Petroski Such, Aditya Rawal, Joel Lehman +2
This paper investigates the intriguing question of whether we can create learning algorithms that automatically generate training data, learning environments, and curricula in orde…
First-Order Preconditioning via Hypergradient Descent
Ted Moskovitz, Rui Wang, Janice Lan +4
Standard gradient descent methods are susceptible to a range of issues that can impede training, such as high correlations and different scaling in parameter space.These difficulti…