137 citations · 181 across the 16 of their papers we have counts for
9 papers · 1 filter
Where Does the Signal Live? A Web Data Recipe for Medical Encoder Pretraining
Bofeng Huang, Jacques Sun, Diane Bouchacourt +2
Web data curation has been widely studied for decoder Large Language Model (LLM) pretraining. Encoders for dense-terminology domains such as medicine, by contrast, are pretrained o…
Compositionality and Generalization in Emergent Languages
Rahma Chaabouni, Eugene Kharitonov, Diane Bouchacourt +2
Natural language allows us to refer to novel composite concepts by combining expressions denoting their parts according to systematic rules, a property known as \emph{compositional…
A Benchmark for Systematic Generalization in Grounded Language Understanding
Laura Ruis, Jacob Andreas, Marco Baroni +2
Humans easily interpret expressions that describe unfamiliar situations composed from familiar parts ("greet the pink brontosaurus by the ferris wheel"). Modern neural networks, by…
Focus on What's Informative and Ignore What's not: Communication Strategies in a Referential Game
Roberto Dessì, Diane Bouchacourt, Davide Crepaldi +1
Research in multi-agent cooperation has shown that artificial agents are able to learn to play a simple referential game while developing a shared lexicon. This lexicon is not easy…
Mastering emergent language: learning to guide in simulated navigation
Mathijs Mul, Diane Bouchacourt, Elia Bruni
To cooperate with humans effectively, virtual agents need to be able to understand and execute language instructions. A typical setup to achieve this is with a scripted teacher whi…
EGG: a toolkit for research on Emergence of lanGuage in Games
Eugene Kharitonov, Rahma Chaabouni, Diane Bouchacourt +1
There is renewed interest in simulating language emergence among deep neural agents that communicate to jointly solve a task, spurred by the practical aim to develop language-enabl…