24 citations · 36 across the 6 of their papers we have counts for
Showing stat.MLShow all
3 papers · 1 filter
stat.ML2018
Robust Implicit Backpropagation
Francois Fagan, Garud Iyengar
Arguably the biggest challenge in applying neural networks is tuning the hyperparameters, in particular the learning rate. The sensitivity to the learning rate is due to the relian…
stat.ML2018★ 8 cited
Unbiased scalable softmax optimization
Francois Fagan, Garud Iyengar
Recent neural network and language models rely on softmax distributions with an extremely large number of categories. Since calculating the softmax normalizing constant in this con…
stat.ML2016
Fast nonlinear embeddings via structured matrices
Krzysztof Choromanski, Francois Fagan
We present a new paradigm for speeding up randomized computations of several frequently used functions in machine learning. In particular, our paradigm can be applied for improving…