Computing Entropy Rate Of Symbol Sources & A Distribution-free Limit Theorem

Ishanu Chattopadhyay, Hod Lipson

Entropy rate of sequential data-streams naturally quantifies the complexity of the generative process. Thus entropy rate fluctuations could be used as a tool to recognize dynamical…