Beyond Benchmark Accuracy: A Diagnostic Test for LLM Chemical Prediction

Yanyi Su, Yu Zeng, Hongshuai Wang +3

LLMs have achieved strong performance on chemical prediction benchmarks. However, existing evaluation methods typically provide target entity identity information directly, making…