3 papers
cond-mat.dis-nn2025
Unified Description of Learning Dynamics in the Soft Committee Machine from Finite to Ultra-Wide Regimes
Assem Afanah, Bernd Rosenow
We study the learning dynamics of the soft committee machine (SCM) with Rectified Linear Unit (ReLU) activation using a statistical-mechanics approach within the annealed approxima…
cond-mat.quant-gas2025
Berezinskii-Kosterlitz-Thouless Renormalization Group Flow at a Quantum Phase Transition
Matthias Thamm, Harini Radhakrishnan, Hatem Barghathi +4
We present a controlled numerical study of the Berezinskii-Kosterlitz-Thouless (BKT) transition in the one-dimensional Bose-Hubbard model at unit filling, providing evidence of the…
cs.LG2024
Small Singular Values Matter: A Random Matrix Analysis of Transformer Models
Max Staats, Matthias Thamm, Bernd Rosenow
This work analyzes singular-value spectra of weight matrices in pretrained transformer models to understand how information is stored at both ends of the spectrum. Using Random Mat…