2 papers
cs.AI2026
CompMat-Bench: Benchmarking AI Agents for Computational Materials Science
Chenmu Zhang, Levi Felix, Jun-Jie Zhang +6
Evaluating AI agents on scientific research tasks is constrained by the time and resources required for the underlying experiments or calculations. In computational materials resea…
cs.AI2025
The Metacognitive Bottleneck: Japanese Riddles Reveal Fundamental Limits of Machine Insight and Self-Evaluation in Reasoning AI
Masaharu Mizumoto, Dat Nguyen, Zhiheng Han +3
Benchmark saturation and training-data contamination increasingly obscure whether reported gains in large language models (LLMs) reflect genuine advances in reasoning or familiarit…