2.7k citations · 2.9k across the 29 of their papers we have counts for
4 papers · 1 filter
Efficient Large Scale Language Modeling with Mixtures of Experts
Mikel Artetxe, Shruti Bhosale, Naman Goyal +21
Mixture of Experts layers (MoEs) enable efficient scaling of language models through conditional computation. This paper presents a detailed empirical study of how autoregressive M…
Few-shot Learning with Multilingual Language Models
Xi Victoria Lin, Todor Mihaylov, Mikel Artetxe +18
Large-scale generative language models such as GPT-3 are competitive few-shot learners. While these models are known to be able to jointly represent many different languages, their…
SUper Team at SemEval-2016 Task 3: Building a feature-rich system for community question answering
Tsvetomila Mihaylova, Pepa Gencheva, Martin Boyanov +9
We present the system we built for participating in SemEval-2016 Task 3 on Community Question Answering. We achieved the best results on subtask C, and strong results on subtasks A…
Exposing Paid Opinion Manipulation Trolls
Todor Mihaylov, Ivan Koychev, Georgi Georgiev +1
Recently, Web forums have been invaded by opinion manipulation trolls. Some trolls try to influence the other users driven by their own convictions, while in other cases they can b…