Finite-Temperature de Bruijn Identities: Fisher Information as the Spectral Gap of Blahut--Arimoto Dynamics
arXiv:2606.03813
Abstract
We uncover a finite-temperature extension of de Bruijn's identity -- the classical relation connecting differential entropy and Fisher information. Our framework is the spectral theory of Blahut--Arimoto (BA) dynamics, recently developed by Wang~\cite{Wang2026} for the analysis of rate-distortion optimization. The central observation is elementary yet profound: for Gaussian sources, the spectral gap $\lam$ of the BA relaxation kernel $\G$ satisfies $\lam = 1/(2βσ^2)$~\cite{Wang2026}, while the Fisher information of the source is . Hence \[ {\lam = \frac{J}{2β}} \] for all inverse temperatures . This identifies the BA spectral gap as a \emph{finite-temperature regularization of Fisher information}. From this observation we derive an exact finite-temperature de Bruijn identity: \[ \frac{\partial F_β}{\partial σ^2} = \frac{1}{2βσ^2} = \lam, \] where is the BA free energy. This identity holds for all finite without any limit procedure. The classical de Bruijn identity follows as the exact consequence . The significance is structural: classical de Bruijn is not an isolated fact about Gaussian convolutions, but the shadow of a one-parameter family of exact identities living in the spectral geometry of rate-distortion optimization. We discuss implications for the entropy power inequality, the -dissipation structure of BA dynamics, and the geometric unification of information inequalities.