2 papers
cond-mat.stat-mech2025
Diffusion cascade in a model of interacting random walkers
Abhishek Raj, Paolo Glorioso, Sarang Gopalakrishnan +1
We consider the relaxation of finite-wavevector density waves in a facilitated classical lattice gas. Linear hydrodynamics predicts that such perturbations should relax exponential…
cs.CL2025
The Unreasonable Ineffectiveness of the Deeper Layers
Andrey Gromov, Kushal Tirumala, Hassan Shapourian +2
How is knowledge stored in an LLM's weights? We study this via layer pruning: if removing a certain layer does not affect model performance in common question-answering benchmarks,…