154 citations · 1.3k across the 48 of their papers we have counts for
17 papers · 1 filter
A Quantitative Entropy Power Inequality for Dependent Random Vectors
Mokshay Madiman, James Melbourne, Cyril Roberto
The entropy power inequality for independent random vectors is a foundational result of information theory, with deep connections to probability and geometric functional analysis.…
The entropic doubling constant and robustness of Gaussian codebooks for additive-noise channels
Lampros Gavalakis, Ioannis Kontoyiannis, Mokshay Madiman
Entropy comparison inequalities are obtained for the differential entropy of the sum of two independent random vectors , when one is replaced by a Gaussian. For ident…
Conditional Rényi entropy and the relationships between Rényi capacities
Gautam Aishwarya, Mokshay Madiman
The analogues of Arimoto's definition of conditional Rényi entropy and Rényi mutual information are explored for abstract alphabets. These quantities, although dependent on the ref…
Two remarks on generalized entropy power inequalities
Mokshay Madiman, Piotr Nayar, Tomasz Tkocz
This note contributes to the understanding of generalized entropy power inequalities. Our main goal is to construct a counter-example regarding monotonicity and entropy comparison…
Sharp moment-entropy inequalities and capacity bounds for log-concave distributions
Mokshay Madiman, Piotr Nayar, Tomasz Tkocz
We show that the uniform distribution minimizes entropy among all one-dimensional symmetric log-concave distributions with fixed variance, as well as various generalizations of thi…
The Differential Entropy of Mixtures: New Bounds and Applications
James Melbourne, Saurav Talukdar, Shreyas Bhaban +2
Mixture distributions are extensively used as a modeling tool in diverse areas from machine learning to communications engineering to physics, and obtaining bounds on the entropy o…