552 citations · 816 across the 123 of their papers we have counts for
Showing 2019Show all
2 papers · 1 filter
cs.CL2019★ 3 cited
Neural Machine Translation with 4-Bit Precision and Beyond
Alham Fikri Aji, Kenneth Heafield
Neural Machine Translation (NMT) is resource intensive. We design a quantization procedure to compress NMT models better for devices with limited hardware capability. Because most…
cs.CL2019★ 2 cited
Making Asynchronous Stochastic Gradient Descent Work for Transformers
Alham Fikri Aji, Kenneth Heafield
Asynchronous stochastic gradient descent (SGD) is attractive from a speed perspective because workers do not wait for synchronization. However, the Transformer model converges poor…