A Tight Upper Bound on Mutual Information

Michal Hledík, Thomas R. Sokolowski, Gašper Tkačik

We derive a tight lower bound on equivocation (conditional entropy), or equivalently a tight upper bound on mutual information between a signal variable and channel outputs. The bo…