20 citations · 27 across the 5 of their papers we have counts for
3 papers · 1 filter
Distinguishing Performance From Competence in Evaluations of Humanlike Abstract Reasoning
Claas Beger, Ryan Yi, Shuhao Fu +5
AI reasoning models have exceeded human performance on the ARC-AGI-1 benchmark, but does that mean state-of-the-art models have the underlying competence (humanlike abstract reason…
Comparing Humans, GPT-4, and GPT-4V On Abstraction and Reasoning Tasks
Melanie Mitchell, Alessandro B. Palmarini, Arseny Moskvichev
We explore the abstract reasoning abilities of text-only and multimodal versions of GPT-4, using the ConceptARC benchmark [10], which is designed to evaluate robust understanding a…
Reinforcement Communication Learning in Different Social Network Structures
Marina Dubova, Arseny Moskvichev, Robert Goldstone
Social network structure is one of the key determinants of human language evolution. Previous work has shown that the network of social interactions shapes decentralized learning i…