Fisher8: Stabilizing Neural Heteroscedastic Regression via Output-Layer Fisher Geometry

Sumedh Vemuganti, Nickvash Kani

Training neural networks to jointly predict mean and uncertainty estimates from noisy observations can be unstable, prompting a series of independent stabilization efforts. We argu…