ChemPro: A Progressive Chemistry Benchmark for Large Language Models

Aaditya Baranwal, Shruti Vyas

We introduce ChemPro, a progressive benchmark with 4100 natural language question-answer pairs in Chemistry, across 4 coherent sections of difficulty designed to assess the profici…