Cascaded Information Disclosure for Generalized Evaluation of Problem Solving Capabilities

Yunxiang Yan, Tomohiro Sawada, Kartik Goyal

While question-answering~(QA) benchmark performance is an automatic and scalable method to compare LLMs, it is an indirect method of evaluating their underlying problem-solving cap…