2 papers
cs.LG2025
CMT-Benchmark: A Benchmark for Condensed Matter Theory Built by Expert Researchers
Haining Pan, James V. Roggeveen, Erez Berg +16
Large language models (LLMs) have shown remarkable progress in coding and math problem-solving, but evaluation on advanced research-level problems in hard sciences remains scarce.…
cond-mat.dis-nn2024
Geometric Dynamics of Signal Propagation Predict Trainability of Transformers
Aditya Cowsik, Tamra Nebabu, Xiao-Liang Qi +1
We investigate forward signal propagation and gradient back propagation in deep, randomly initialized transformers, yielding simple necessary and sufficient conditions on initializ…