Large deviations for empirical entropies of Gibbsian sources

J. -R. Chazottes, D. Gabrielli

The entropy of an ergodic finite-alphabet process can be computed from a single typical sample path x_1^n using the entropy of the k-block empirical probability and letting k grow…