2.3k citations · 4.7k across the 88 of their papers we have counts for
7 papers · 2 filters
Causal Distillation for Language Models
Zhengxuan Wu, Atticus Geiger, Josh Rozner +5
Distillation efforts have led to language models that are more compact and efficient without serious drops in performance. The standard approach to distillation trains a student mo…
Open-domain clarification question generation without question examples
Julia White, Gabriel Poesia, Robert Hawkins +2
An overarching goal of natural language processing is to enable machines to communicate seamlessly with humans. However, natural language can be ambiguous or unclear. In cases of u…
Calibrate your listeners! Robust communication-based training for pragmatic speakers
Rose E. Wang, Julia White, Jesse Mu +1
To be good conversational partners, natural language processing (NLP) systems should be trained to produce contextually useful utterances. Prior work has investigated training NLP…
Learning to solve complex tasks by growing knowledge culturally across generations
Michael Henry Tessler, Jason Madeano, Pedro A. Tsividis +3
Knowledge built culturally across generations allows humans to learn far more than an individual could glean from their own experience in a lifetime. Cultural knowledge in turn res…
Emergent Communication of Generalizations
Jesse Mu, Noah Goodman
To build agents that can collaborate effectively with others, recent research has trained artificial agents to communicate with each other in Lewis-style referential games. However…
Concadia: Towards Image-Based Text Generation with a Purpose
Elisa Kreiss, Fei Fang, Noah D. Goodman +1
Current deep learning models often achieve excellent results on benchmark image-to-text datasets but fail to generate texts that are useful in practice. We argue that to close this…
From partners to populations: A hierarchical Bayesian account of coordination and convention
Robert D. Hawkins, Michael Franke, Michael C. Frank +4
Languages are powerful solutions to coordination problems: they provide stable, shared expectations about how the words we say correspond to the beliefs and intentions in our heads…