paper

Tight bound on relative entropy by entropy difference

arXiv:1304.0036 · doi:10.1109/TIT.2014.2387822

Abstract

We prove a lower bound on the relative entropy between two finite-dimensional states in terms of their entropy difference and the dimension of the underlying space. The inequality is tight in the sense that equality can be attained for any prescribed value of the entropy difference, both for quantum and classical systems. We outline implications for information theory and thermodynamics, such as a necessary condition for a process to be close to thermodynamic reversibility, or an easily computable lower bound on the classical channel capacity. Furthermore, we derive a tight upper bound, uniform for all states of a given dimension, on the variance of the surprisal, whose thermodynamic meaning is that of heat capacity.

v2: 27 pages, 1 figure, gap in proof of Theorem 1 fixed, other minor changes, references updated; v3: 27 pages, 1 figure, small changes and improvements, one-column version of published paper

References in corpus (5)

Cited by in corpus (21)