A Lower Bound on the Relative Entropy with Respect to a Symmetric Probability
arXiv:1407.0836
Abstract
Let and be two probability measures on which are not the Dirac mass at . We denote by the relative entropy of with respect to . We prove that, if is symmetric and has a finite first moment, then \[ H(μ|ρ)\geq \frac{\displaystyle{(\int_{\mathbb{R}}z\,dμ(z))^2}}{\displaystyle{2\int_{\mathbb{R}}z^2\,dμ(z)}}\,,\] with equality if and only if .