Entropy and Compression: A simple proof of an inequality of Khinchin-Ornstein-Shields

Riccardo Aragona, Francesca Marzi, Filippo Mignosi +1

This paper concerns the folklore statement that ``entropy is a lower bound for compression''. More precisely we derive from the entropy theorem a simple proof of a pointwise inequa…