4 papers
ARCTraj: A Dataset and Benchmark of Human Reasoning Trajectories for Abstract Problem Solving
Sejin Kim, Hayan Choi, Seokki Lee +1
We present ARCTraj, a dataset and methodological framework for modeling human reasoning through complex visual tasks in the Abstraction and Reasoning Corpus (ARC). While ARC has in…
Can AI agents understand spoken conversations about data visualizations in online meetings?
Rizul Sharma, Tianyu Jiang, Seokki Lee +1
In this short paper, we present work evaluating an AI agent's understanding of spoken conversations about data visualizations in an online meeting scenario. There is growing intere…
Abductive Symbolic Solver on Abstraction and Reasoning Corpus
Mintaek Lim, Seokki Lee, Liyew Woletemaryam Abitew +1
This paper addresses the challenge of enhancing artificial intelligence reasoning capabilities, focusing on logicality within the Abstraction and Reasoning Corpus (ARC). Humans sol…
Reasoning Abilities of Large Language Models: In-Depth Analysis on the Abstraction and Reasoning Corpus
Seungpil Lee, Woochang Sim, Donghyeon Shin +6
The existing methods for evaluating the inference abilities of Large Language Models (LLMs) have been predominantly results-centric, making it challenging to assess the inference p…