Are LLMs Ready for Scientific Discovery? A Capability-Oriented Benchmark for AI Scientists

Chuhan Shi, Xiaoquan Ren, Sicheng Song +3

Existing benchmarks for scientific data analysis evaluate LLMs primarily on code execution or workflow completion, overlooking that scientific analysis serves to support distinct t…