activity
20162023
most citedLlama 2: Open Foundation and Fine-Tuned Chat Models

2.7k citations · 6.8k across the 39 of their papers we have counts for

collaborators
Showing 2019Show all

10 papers · 1 filter

cs.AI2019★ 3 cited

Generating Interactive Worlds with Text

Angela Fan, Jack Urbanek, Pratik Ringshia +8

Procedurally generating cohesive and interesting game environments is challenging and time-consuming. In order for the relationships between the game elements to be natural, common…

cs.CL2019

Queens are Powerful too: Mitigating Gender Bias in Dialogue Generation

Emily Dinan, Angela Fan, Adina Williams +3

Models often easily learn biases present in the training data, and their predictions directly reflect this bias. We analyze gender bias in dialogue data, and examine how this bias…

cs.CL2019★ 3 cited

Using Local Knowledge Graph Construction to Scale Seq2Seq Models to Multi-Document Inputs

Angela Fan, Claire Gardent, Chloe Braud +1

Query-based open-domain NLP tasks require information synthesis from long and diverse web results. Current approaches extractively select portions of web text as input to Sequence-…

cs.LG2019★ 273 cited

Reducing Transformer Depth on Demand with Structured Dropout

Angela Fan, Edouard Grave, Armand Joulin

Overparameterized transformer networks have obtained state of the art results in various natural language processing tasks, such as machine translation, language modeling, and ques…

cs.CL2019★ 14 cited

ELI5: Long Form Question Answering

Angela Fan, Yacine Jernite, Ethan Perez +3

We introduce the first large-scale corpus for long-form question answering, a task requiring elaborate and in-depth answers to open-ended questions. The dataset comprises 270K thre…

cs.CL2019★ 2 cited

GLOSS: Generative Latent Optimization of Sentence Representations

Sidak Pal Singh, Angela Fan, Michael Auli

We propose a method to learn unsupervised sentence representations in a non-compositional manner based on Generative Latent Optimization. Our approach does not impose any assumptio…

cs.CL2019★ 163 cited

fairseq: A Fast, Extensible Toolkit for Sequence Modeling

Myle Ott, Sergey Edunov, Alexei Baevski +5

fairseq is an open-source sequence modeling toolkit that allows researchers and developers to train custom models for translation, summarization, language modeling, and other text…

cs.CL2019

Learning to Speak and Act in a Fantasy Text Adventure Game

Jack Urbanek, Angela Fan, Siddharth Karamcheti +7

We introduce a large scale crowdsourced text adventure game as a research platform for studying grounded dialogue. In it, agents can perceive, emote, and act whilst conducting dial…

cs.CL2019★ 318 cited

Pay Less Attention with Lightweight and Dynamic Convolutions

Felix Wu, Angela Fan, Alexei Baevski +2

Self-attention is a useful mechanism to build generative models for language and images. It determines the importance of context elements by comparing each element to the current t…

cs.CL2019★ 17 cited

Strategies for Structuring Story Generation

Angela Fan, Mike Lewis, Yann Dauphin

Writers generally rely on plans or sketches to write long stories, but most current language models generate word by word from left to right. We explore coarse-to-fine models for c…