1 citations · 2 across the 11 of their papers we have counts for
4 papers · 1 filter
PotARCin: Multi-Dimensional Evaluation of Skill Acquisition in Abstract Reasoning Tasks
Claas Beger, Ryan Yi, Melanie Mitchell
The Abstraction and Reasoning Corpus (ARC) has become a prominent benchmark for evaluating general abstract reasoning and fluid intelligence in AI models. Yet standard ARC evaluati…
Implicit Rule Induction with Test-Time Task Embeddings in ARC-like Tasks
Adrien Deliège, Claas Beger, Marc Van Droogenbroeck +1
The Abstraction and Reasoning Corpus and related benchmarks evaluate whether AI models can solve novel reasoning tasks, but often leave unclear whether success reflects inference o…
Distinguishing Performance From Competence in Evaluations of Humanlike Abstract Reasoning
Claas Beger, Ryan Yi, Shuhao Fu +5
AI reasoning models have exceeded human performance on the ARC-AGI-1 benchmark, but does that mean state-of-the-art models have the underlying competence (humanlike abstract reason…
A Neuroscience-Inspired Dual-Process Model of Compositional Generalization
Alex Noviello, Claas Beger, Jacob Groner +2
Deep learning models struggle with systematic compositional generalization, a hallmark of human cognition. We propose \textsc{Mirage}, a neuro-inspired dual-process model that offe…