SciCode-Verified: How Benchmark Defects Underestimated the Scientific-Coding Ability of Language Models

Sihan Hu, Lyuhan Huang, Youjin Deng +1

SciCode is the standard measure of the scientific-coding ability of language models: research-level problems that demand both frontier scientific theory and its implementation as w…