128 citations · 290 across the 17 of their papers we have counts for
5 papers · 1 filter
Efficient Large Scale Language Modeling with Mixtures of Experts
Mikel Artetxe, Shruti Bhosale, Naman Goyal +21
Mixture of Experts layers (MoEs) enable efficient scaling of language models through conditional computation. This paper presents a detailed empirical study of how autoregressive M…
Do Language Models Have Beliefs? Methods for Detecting, Updating, and Visualizing Model Beliefs
Peter Hase, Mona Diab, Asli Celikyilmaz +5
Do language models have beliefs about the world? Dennett (1995) famously argues that even thermostats have beliefs, on the view that a belief is simply an informational state decou…
AnswerSumm: A Manually-Curated Dataset and Pipeline for Answer Summarization
Alexander R. Fabbri, Xiaojian Wu, Srini Iyer +2
Community Question Answering (CQA) fora such as Stack Overflow and Yahoo! Answers contain a rich resource of answers to a wide range of community-based questions. Each question thr…
EASE: Extractive-Abstractive Summarization with Explanations
Haoran Li, Arash Einolghozati, Srinivasan Iyer +4
Current abstractive summarization systems outperform their extractive counterparts, but their widespread adoption is inhibited by the inherent lack of interpretability. To achieve…
Multi-Perspective Abstractive Answer Summarization
Alexander R. Fabbri, Xiaojian Wu, Srini Iyer +1
Community Question Answering (CQA) forums such as Stack Overflow and Yahoo! Answers contain a rich resource of answers to a wide range of questions. Each question thread can receiv…