Do LLMs and Humans Find the Same Questions Difficult? A Case Study on Japanese Quiz Answering

Naoya Sugiura, Kosuke Yamada, Yasuhiro Ogawa +2

LLMs have achieved performance that surpasses humans in many NLP tasks. However, it remains unclear whether problems that are difficult for humans are also difficult for LLMs. This…