Existence and Continuity of Differential Entropy for a Class of Distributions

Abstract

In this paper, we identify a class of absolutely continuous probability distributions, and show that the differential entropy is uniformly convergent over this space under the metric of total variation distance. One of the advantages of this class is that the requirements could be readily verified for a given distribution.

4 pages

References in corpus (2)

• On entropy for mixtures of discrete and continuous variables
• On Reverse Pinsker Inequalities

Cited by in corpus (6)

• From Classical to Quantum: Uniform Continuity Bounds on Entropies in Infinite Dimensions
• Close-to-optimal continuity bound for the von Neumann entropy and other quasi-classical applications of the Alicki-Fannes-Winter technique
• Correlation measures of a quantum state and information characteristics of a quantum channel
• Entropic Compressibility of Lévy Processes
• Towards Verified Stochastic Variational Inference for Probabilistic Programs
• How Compressible are Innovation Processes?