2.1k citations · 2.4k across the 9 of their papers we have counts for
Showing 2019Show all
2 papers · 1 filter
cs.CL2019
Big Bidirectional Insertion Representations for Documents
Lala Li, William Chan
The Insertion Transformer is well suited for long form text generation due to its parallel generation capabilities, requiring generation steps to generate tokens.…
cs.LG2019★ 14 cited
Which Algorithmic Choices Matter at Which Batch Sizes? Insights From a Noisy Quadratic Model
Guodong Zhang, Lala Li, Zachary Nado +5
Increasing the batch size is a popular way to speed up neural network training, but beyond some critical batch size, larger batch sizes yield diminishing returns. In this work, we…