Interleaved Noise Injection Improves Clean, Corrupted, and OOD Performance

Matt L. Wiemann, Peter Melchior, Andrew K. Saydjari

Noise injection is a well-known technique in stochastic optimization. We report its surprising effectiveness with an interleaved (on-off-on-off...) rather than the usual monotonic…