Does the Data Processing Inequality Reflect Practice? On the Utility of Low-Level Tasks

Roy Turgeman, Tom Tirer

The data processing inequality is an information-theoretic principle stating that the information content of a signal cannot be increased by processing the observations. In particu…