Maximally Informative Statistics

David R. Wolf, Edward I. George

In this paper we propose a Bayesian, information theoretic approach to dimensionality reduction. The approach is formulated as a variational principle on mutual information, and se…