Showing 2026Show all
2 papers · 1 filter
cs.LG2026
When a Flatness Proxy Is Not a Function: Robustness Certificates and Training Interventions
Vicente Opazo, Jose Calatayud-Mateu, Cristobal Rojas +1
A valid curvature upper bound need not justify either a robustness certificate or an intervention on an intrinsic predictor property. We demonstrate this distinction for a last-lay…
cs.LG2026
Positional versus Symbolic Attention Heads: Learning Dynamics, RoPE Geometry, and Length Generalization
Felipe Urrutia, Juan José Alegría, Cinthia Sanchez Macias +3
Transformer-based language models are widespread in today's society. As such, understanding the mechanisms by which they solve structured tasks and predicting how they may behave i…