Showing cs.LGShow all
3 papers · 1 filter
cs.LG2026
Power-Law Correlations Without Apparent Temperature-Tuned Criticality in Fixed-Tree Hierarchical Languages
Marcel Kühn, Bernd Rosenow
Sampling temperature can substantially reshape autoregressive generation, but it is unclear when temperature changes in long-range correlations reflect a genuine phase transition r…
cs.LG2026
Explaining Near-Zero Hessian Eigenvalues Through Approximate Symmetries in Neural Networks
Marcel Kühn, Bernd Rosenow
The Hessian of the training loss governs the local geometry of the loss landscape, yet despite existing explanations for its largest eigenvalues, the origin of the vast multitude o…
cs.LG2026
A Boundary-Layer Mechanism for One-Third Scaling in Online Softmax Classification
Marcel Kühn, Yoon Thelge, Bernd Rosenow
Hard-label classification is usually trained with smooth surrogate losses such as softmax cross-entropy. We isolate a mechanism by which this mismatch between smooth surrogate and…