71 citations · 130 across the 8 of their papers we have counts for
9 papers
Perception Test: A Diagnostic Benchmark for Multimodal Video Models
Viorica Pătrăucean, Lucas Smaira, Ankush Gupta +21
We propose a novel multimodal video benchmark - the Perception Test - to evaluate the perception and reasoning skills of pre-trained multimodal models (e.g. Flamingo, SeViLA, or GP…
Melting Pot 2.0
John P. Agapiou, Alexander Sasha Vezhnevets, Edgar A. Duéñez-Guzmán +14
Multi-agent artificial intelligence research promises a path to develop intelligent technologies that are more human-like and more human-compatible than those produced by "solipsis…
HCMD-zero: Learning Value Aligned Mechanisms from Data
Jan Balaguer, Raphael Koster, Ari Weinstein +4
Artificial learning agents are mediating a larger and larger number of interactions among humans, firms, and organizations, and the intersection between mechanism design and machin…
Role of Human-AI Interaction in Selective Prediction
Elizabeth Bondi, Raphael Koster, Hannah Sheahan +5
Recent work has shown the potential benefit of selective prediction systems that can learn to defer to a human when the predictions of the AI are unreliable, particularly to improv…
Scalable Evaluation of Multi-Agent Reinforcement Learning with Melting Pot
Joel Z. Leibo, Edgar Duéñez-Guzmán, Alexander Sasha Vezhnevets +7
Existing evaluation suites for multi-agent reinforcement learning (MARL) do not assess generalization to novel situations as their primary objective (unlike supervised-learning ben…
A learning agent that acquires social norms from public sanctions in decentralized multi-agent settings
Eugene Vinitsky, Raphael Köster, John P. Agapiou +3
Society is characterized by the presence of a variety of social norms: collective patterns of sanctioning that can prevent miscoordination and free-riding. Inspired by this, we aim…
A multi-agent reinforcement learning model of reputation and cooperation in human groups
Kevin R. McKee, Edward Hughes, Tina O. Zhu +7
Collective action demands that individuals efficiently coordinate how much, where, and when to cooperate. Laboratory experiments have extensively explored the first part of this pr…
Model-free conventions in multi-agent reinforcement learning with heterogeneous preferences
Raphael Köster, Kevin R. McKee, Richard Everett +7
Game theoretic views of convention generally rest on notions of common knowledge and hyper-rational models of individual behavior. However, decades of work in behavioral economics…
Inequity aversion improves cooperation in intertemporal social dilemmas
Edward Hughes, Joel Z. Leibo, Matthew G. Phillips +9
Groups of humans are often able to find ways to cooperate with one another in complex, temporally extended social dilemmas. Models based on behavioral economics are only able to ex…