28 citations · 203 across the 35 of their papers we have counts for
Showing 2018 · stat.MLShow all
2 papers · 2 filters
stat.ML2018
Robust Implicit Backpropagation
Francois Fagan, Garud Iyengar
Arguably the biggest challenge in applying neural networks is tuning the hyperparameters, in particular the learning rate. The sensitivity to the learning rate is due to the relian…
stat.ML2018★ 8 cited
Unbiased scalable softmax optimization
Francois Fagan, Garud Iyengar
Recent neural network and language models rely on softmax distributions with an extremely large number of categories. Since calculating the softmax normalizing constant in this con…