14 citations · 28 across the 3 of their papers we have counts for
3 papers
cs.CL2021★ 14 cited
Efficient Large Scale Language Modeling with Mixtures of Experts
Mikel Artetxe, Shruti Bhosale, Naman Goyal +21
Mixture of Experts layers (MoEs) enable efficient scaling of language models through conditional computation. This paper presents a detailed empirical study of how autoregressive M…
cs.CL2020★ 1 cited
General Purpose Text Embeddings from Pre-trained Language Models for Scalable Inference
Jingfei Du, Myle Ott, Haoran Li +2
The state of the art on many NLP tasks is currently achieved by large pre-trained language models, which require a considerable amount of computation. We explore a setting where ma…
cs.CL2020★ 13 cited
Keyphrase Extraction with Span-based Feature Representations
Funan Mu, Zhenting Yu, LiFeng Wang +7
Keyphrases are capable of providing semantic metadata characterizing documents and producing an overview of the content of a document. Since keyphrase extraction is able to facilit…