4 papers
X2SBench: an open benchmark for evaluating crystal structure determination from powder diffraction
Zhiyuan Gao, Juncheng Xiao, Shuchen Pu +7
Progress towards practical powder X-ray diffraction (PXRD) structure determination requires evaluation beyond small crystals and idealized patterns. X2SBench combines 152,587 simul…
Deep Research in Physical Sciences: A Multi-Agent Framework and Comprehensive Benchmark
Yigeng Jiang, Tengchao Yang, Taoyong Cui +25
Deep research agents are Large Language Model (LLM)-based systems designed for autonomous, multi-step scientific reasoning, and they hold immense potential for accelerating researc…
Chem-R: Learning to Reason as a Chemist
Weida Wang, Benteng Chen, Di Zhang +14
Although large language models (LLMs) have significant potential to advance chemical discovery, current LLMs lack core chemical knowledge, produce unreliable reasoning trajectories…
CMPhysBench: A Benchmark for Evaluating Large Language Models in Condensed Matter Physics
Weida Wang, Dongchen Huang, Jiatong Li +32
We introduce CMPhysBench, designed to assess the proficiency of Large Language Models (LLMs) in Condensed Matter Physics, as a novel Benchmark. CMPhysBench is composed of more than…