356 citations · 498 across the 14 of their papers we have counts for
Showing 2018Show all
2 papers · 1 filter
cs.LG2018
The Importance of Generation Order in Language Modeling
Nicolas Ford, Daniel Duckworth, Mohammad Norouzi +1
Neural language models are a critical component of state-of-the-art systems for machine translation, summarization, audio transcription, and other tasks. These language models are…
cs.LG2018★ 2 cited
Stochastic natural gradient descent draws posterior samples in function space
Samuel L. Smith, Daniel Duckworth, Semon Rezchikov +2
Recent work has argued that stochastic gradient descent can approximate the Bayesian uncertainty in model parameters near local minima. In this work we develop a similar correspond…