Entropy and thinning of discrete random variables
arXiv:1510.05390 · doi:10.1007/978-1-4939-7005-6_2
Abstract
We describe five types of results concerning information and concentration of discrete random variables, and relationships between them, motivated by their counterparts in the continuous case. The results we consider are information theoretic approaches to Poisson approximation, the maximum entropy property of the Poisson distribution, discrete concentration (Poincaré and logarithmic Sobolev) inequalities, monotonicity of entropy and concavity of entropy in the Shepp--Olkin regime.
arXiv commentDraft for Proceedings of IMA theme year in Discrete Structures
References in corpus (24)
- Generalized Entropy Power Inequalities and Monotonicity Properties of Information
- Ricci curvature of finite Markov chains via convexity of the entropy
- Fisher Information inequalities and the Central Limit Theorem
- Log-concavity and the maximum entropy property of the Poisson distribution
- Forward and Reverse Entropy Power Inequalities in Convex Geometry
- Rate of convergence and Edgeworth-type expansion in the entropic central limit theorem
- Entropy and the Law of Small Numbers
- Log-concavity, ultra-log-concavity, and a maximum entropy property of discrete compound Poisson measures
- Sharp Bounds on the Entropy of the Poisson Law and Related Quantities
- Compound Poisson Approximation via Information Functionals
- Thinning, Entropy and the Law of Thin Numbers
- Monotonicity, thinning and discrete versions of the Entropy Power Inequality
- Binomial-Poisson entropic inequalities and the M/M/ queue
- Iterated sequences and the geometry of zeros
- A discrete log-Sobolev inequality under a Bakry-Emery type condition
- Monotonic Convergence in an Information-Theoretic Law of Small Numbers
- A proof of the Shepp-Olkin entropy concavity conjecture
- Concavity of entropy under thinning
- Discrete versions of the transport equation and the Shepp-Olkin conjecture
- Entropy power inequality for a family of discrete random variables
- A natural derivative on [0,n] and a binomial Poincaré inequality
- A de Bruijn identity for symmetric stable laws
- Fisher information and convergence to stable laws
- Local Pinsker inequalities via Stein's discrete density approach