Strong convexity-guided hyper-parameter optimization for flatter losses

Rahul Yedida, Snehanshu Saha

We propose a novel white-box approach to hyper-parameter optimization. Motivated by recent work establishing a relationship between flat minima and generalization, we first establi…