54k citations · 58.7k across the 46 of their papers we have counts for
4 papers · 1 filter
AdaScale SGD: A User-Friendly Algorithm for Distributed Training
Tyler B. Johnson, Pulkit Agrawal, Haijie Gu +1
When using large-batch training to speed up stochastic gradient descent, learning rates must adapt to new batch sizes in order to maximize speed-ups and preserve model quality. Re-…
Set Distribution Networks: a Generative Model for Sets of Images
Shuangfei Zhai, Walter Talbott, Miguel Angel Bautista +2
Images with shared characteristics naturally form sets. For example, in a face verification benchmark, images of the same identity form sets. For generative models, the standard wa…
Equivariant Neural Rendering
Emilien Dupont, Miguel Angel Bautista, Alex Colburn +4
We propose a framework for learning neural scene representations directly from images, without 3D supervision. Our key insight is that 3D structure can be imposed by ensuring that…
Beyond Accuracy: Behavioral Testing of NLP models with CheckList
Marco Tulio Ribeiro, Tongshuang Wu, Carlos Guestrin +1
Although measuring held-out accuracy has been the primary approach to evaluate generalization, it often overestimates the performance of NLP models, while alternative approaches fo…