147 citations · 589 across the 17 of their papers we have counts for
Showing 2020Show all
2 papers · 1 filter
cs.CL2020★ 14 cited
SAC: Accelerating and Structuring Self-Attention via Sparse Adaptive Connection
Xiaoya Li, Yuxian Meng, Mingxin Zhou +3
While the self-attention mechanism has been widely used in a wide variety of tasks, it has the unfortunate property of a quadratic cost with respect to the input length, which make…
cs.CL2020★ 10 cited
LAVA NAT: A Non-Autoregressive Translation Model with Look-Around Decoding and Vocabulary Attention
Xiaoya Li, Yuxian Meng, Arianna Yuan +2
Non-autoregressive translation (NAT) models generate multiple tokens in one forward pass and is highly efficient at inference stage compared with autoregressive translation (AT) me…