collaborators

1 paper

cs.CL2024

In Case You Missed It: ARC 'Challenge' Is Not That Challenging

Łukasz Borchmann

ARC Challenge appears more difficult than ARC Easy for modern LLMs primarily due to an evaluation setup that prevents direct comparison of answer choices rather than inherent compl…