activity
20182022
most citedPay Less Attention with Lightweight and Dynamic Convolutions

318 citations · 1.1k across the 21 of their papers we have counts for

collaborators

34 papers

cs.CL20222 cited

Generating Full Length Wikipedia Biographies: The Impact of Gender Bias on the Retrieval-Based Generation of Women Biographies

Angela Fan, Claire Gardent

Generating factual, long-form text such as Wikipedia articles raises three key challenges: how to gather relevant evidence, how to structure information into well-formed text, and…

cs.IR20224 cited

Reasoning over Public and Private Data in Retrieval-Based Systems

Simran Arora, Patrick Lewis, Angela Fan +2

Users and organizations are generating ever-increasing amounts of private data from a wide range of sources. Incorporating private data is important to personalize open-domain appl…

cs.CL2021

Tricks for Training Sparse Translation Models

Dheeru Dua, Shruti Bhosale, Vedanuj Goswami +3

Multi-task learning with an unbalanced data distribution skews model learning towards high resource tasks, especially when model capacity is fixed and fully shared across all tasks…

cs.CL20212 cited

Alternative Input Signals Ease Transfer in Multilingual Machine Translation

Simeng Sun, Angela Fan, James Cross +4

Recent work in multilingual machine translation (MMT) has focused on the potential of positive transfer between languages, particularly cases where higher-resourced languages can b…

cs.CL20219 cited

Facebook AI WMT21 News Translation Task Submission

Chau Tran, Shruti Bhosale, James Cross +3

We describe Facebook's multilingual model submission to the WMT2021 shared task on news translation. We participate in 14 language directions: English to and from Czech, German, Ha…

cs.LG20215 cited

Not All Memories are Created Equal: Learning to Forget by Expiring

Sainbayar Sukhbaatar, Da Ju, Spencer Poff +4

Attention mechanisms have shown promising results in sequence modeling tasks that require long-term memory. Recent work investigated mechanisms to reduce the computational cost of…