Low probability states, data statistics, and entropy estimation

Damián G. Hernández, Ahmed Roman, Ilya Nemenman

A fundamental problem in analysis of complex systems is getting a reliable estimate of entropy of their probability distributions over the state space. This is difficult because un…