270 citations · 862 across the 16 of their papers we have counts for
Showing 2017Show all
2 papers · 1 filter
cs.LG2017★ 28 cited
Hyperparameter Optimization: A Spectral Approach
Elad Hazan, Adam Klivans, Yang Yuan
We give a simple, fast algorithm for hyperparameter optimization inspired by techniques from the analysis of Boolean functions. We focus on the high-dimensional regime where the ca…
cs.LG2017★ 270 cited
Convergence Analysis of Two-layer Neural Networks with ReLU Activation
Yuanzhi Li, Yang Yuan
In recent years, stochastic gradient descent (SGD) based techniques has become the standard tools for training neural networks. However, formal theoretical understanding of why SGD…