2 papers
cs.LG2026
Fisher Rank Inflation: A Spectral Signature of Memorization under Label Noise
Satwik Bathula, Anand A. Joshi
Deep networks trained with label noise often learn clean structure before memorizing corrupted labels. We show that this transition leaves a spectral signature in the centered scat…
cs.LG2026
Gating Enables Curvature: A Geometric Expressivity Gap in Attention
Satwik Bathula, Anand A. Joshi
Multiplicative gating is widely used in neural architectures and has recently been applied to attention layers to improve performance and training stability in large language model…