316 citations · 661 across the 65 of their papers we have counts for
4 papers · 1 filter
High-Dimensional Smoothed Entropy Estimation via Dimensionality Reduction
Kristjan Greenewald, Brian Kingsbury, Yuancheng Yu
We study the problem of overcoming exponential sample complexity in differential entropy estimation under Gaussian convolutions. Specifically, we consider the estimation of the dif…
Minimum-Entropy Coupling Approximation Guarantees Beyond the Majorization Barrier
Spencer Compton, Dmitriy Katz, Benjamin Qi +2
Given a set of discrete probability distributions, the minimum entropy coupling is the minimum entropy joint distribution that has the input distributions as its marginals. This ha…
k-Sliced Mutual Information: A Quantitative Study of Scalability with Dimension
Ziv Goldfeld, Kristjan Greenewald, Theshani Nuradha +1
Sliced mutual information (SMI) is defined as an average of mutual information (MI) terms between one-dimensional random projections of the random variables. It serves as a surroga…
Ensemble Estimation of Information Divergence
Kevin R. Moon, Kumar Sricharan, Kristjan Greenewald +1
Recent work has focused on the problem of nonparametric estimation of information divergence functionals. Many existing approaches are restrictive in their assumptions on the densi…