2.5k citations · 4.7k across the 86 of their papers we have counts for
Showing 2000 · physics.data-anShow all
2 papers · 2 filters
physics.data-an2000★ 14 cited
Information theory and learning: a physical approach
Ilya Nemenman
We try to establish a unified information theoretic approach to learning and to explore some of its applications. First, we define {\em predictive information} as the mutual inform…
physics.data-an2000★ 2 cited
Predictability, complexity and learning
William Bialek, Ilya Nemenman, Naftali Tishby
We define {\em predictive information} as the mutual information between the past and the future of a time series. Three qualitatively different behaviors are fo…