21 citations · 25 across the 6 of their papers we have counts for
Showing cs.CLShow all
2 papers · 1 filter
cs.CL2021
Predicting Attention Sparsity in Transformers
Marcos Treviso, António Góis, Patrick Fernandes +2
Transformers' quadratic complexity with respect to the input sequence length has motivated a body of work on efficient sparse approximations to softmax. An alternative path, used b…
cs.CL2020★ 2 cited
Learning Non-Monotonic Automatic Post-Editing of Translations from Human Orderings
António Góis, Kyunghyun Cho, André Martins
Recent research in neural machine translation has explored flexible generation orders, as an alternative to left-to-right generation. However, training non-monotonic models brings…