OrthoGrad Improves Neural Calibration

C. Evans Hedges

We study $\perp$Grad, a geometry-aware modification to gradient-based optimization that constrains descent directions to address overconfidence, a key limitation of standard optimi…