Exactly Tight Information-Theoretic Generalization Error Bound for the Quadratic Gaussian Problem

Ruida Zhou, Chao Tian, Tie Liu

We provide a new information-theoretic generalization error bound that is exactly tight (i.e., matching even the constant) for the canonical quadratic Gaussian (location) problem.…