264 citations · 649 across the 9 of their papers we have counts for
Showing 2018Show all
2 papers · 1 filter
cs.LG2018
Stochastic natural gradient descent draws posterior samples in function space
Samuel L. Smith, Daniel Duckworth, Semon Rezchikov +2
Recent work has argued that stochastic gradient descent can approximate the Bayesian uncertainty in model parameters near local minima. In this work we develop a similar correspond…
cs.AI2018
Decoding Decoders: Finding Optimal Representation Spaces for Unsupervised Similarity Tasks
Vitalii Zhelezniak, Dan Busbridge, April Shen +2
Experimental evidence indicates that simple models outperform complex deep networks on many unsupervised similarity tasks. We provide a simple yet rigorous explanation for this beh…