2.5k citations · 2.5k across the 6 of their papers we have counts for
Showing physics.data-anShow all
2 papers · 1 filter
physics.data-an2001
Entropy and inference, revisited
Ilya Nemenman, Fariel Shafee, William Bialek
We study properties of popular near-uniform (Dirichlet) priors for learning undersampled probability distributions on discrete nonmetric spaces and show that they lead to disastrou…
physics.data-an2000
Information theory and learning: a physical approach
Ilya Nemenman
We try to establish a unified information theoretic approach to learning and to explore some of its applications. First, we define {\em predictive information} as the mutual inform…