4 papers · 1 filter
Which one is banana man? Evaluating vision-language models in multi-turn pragmatic interpretation
Alvin Wei Ming Tan, Ben Prystawski, Veronica Boyce
Flexible adaptation to context and shared pragmatic intuitions contribute to smooth human conversation. Iterated reference games---in which players repeatedly pick out novel refere…
Baby Scale: Investigating Models Trained on Individual Children's Language Input
Steven Y. Feng, Alvin W. M. Tan, Michael C. Frank
Modern language models (LMs) must be trained on many orders of magnitude more words of training data than human children receive before they begin to produce useful behavior. Asses…
Context informs pragmatic interpretation in vision-language models
Alvin Wei Ming Tan, Ben Prystawski, Veronica Boyce +1
Iterated reference games - in which players repeatedly pick out novel referents using language - present a test case for agents' ability to perform context-sensitive pragmatic reas…
DevBench: A multimodal developmental benchmark for language learning
Alvin Wei Ming Tan, Sunny Yu, Bria Long +5
How (dis)similar are the learning trajectories of vision-language models and children? Recent modeling work has attempted to understand the gap between models' and humans' data eff…