Entropy and information in neural spike trains: Progress on the sampling problem

Ilya Nemenman, William Bialek, Rob de Ruyter van Steveninck

The major problem in information theoretic analysis of neural responses and other biological data is the reliable estimation of entropy--like quantities from small samples. We appl…