552 citations · 1.1k across the 34 of their papers we have counts for
Showing 2019 · cs.CLShow all
2 papers · 2 filters
cs.CL2019★ 3 cited
Neural Machine Translation with 4-Bit Precision and Beyond
Alham Fikri Aji, Kenneth Heafield
Neural Machine Translation (NMT) is resource intensive. We design a quantization procedure to compress NMT models better for devices with limited hardware capability. Because most…
cs.CL2019★ 2 cited
Making Asynchronous Stochastic Gradient Descent Work for Transformers
Alham Fikri Aji, Kenneth Heafield
Asynchronous stochastic gradient descent (SGD) is attractive from a speed perspective because workers do not wait for synchronization. However, the Transformer model converges poor…