2.5k citations · 2.5k across the 8 of their papers we have counts for
Showing 2000Show all
2 papers · 1 filter
physics.data-an2000
Information theory and learning: a physical approach
Ilya Nemenman
We try to establish a unified information theoretic approach to learning and to explore some of its applications. First, we define {\em predictive information} as the mutual inform…
cond-mat2000
Occam factors and model-independent Bayesian learning of continuous distributions
Ilya Nemenman, William Bialek
Learning of a smooth but nonparametric probability density can be regularized using methods of Quantum Field Theory. We implement a field theoretic prior numerically, test its effi…