A Training-Time Diagnostic for Generalization via the Log-Alignment Ratio

Ali Shehper, Ashish Vaswani

We study the log-alignment ratio (LAR), a measure of parameter-activation alignment, introduced in parameterization theory. We reformulate it as the overlap between a weight spectr…