Wasserstein continuity of entropy and outer bounds for interference channels

Abstract

It is shown that under suitable regularity conditions, differential entropy is a Lipschitz functional on the space of distributions on $n$-dimensional Euclidean space with respect to the quadratic Wasserstein distance. Under similar conditions, (discrete) Shannon entropy is shown to be Lipschitz continuous in distributions over the product space with respect to Ornstein's $\bar{d}$-distance (Wasserstein distance corresponding to the Hamming distance). These results together with Talagrand's and Marton's transportation-information inequalities allow one to replace the unknown multi-user interference with its i.i.d. approximations. As an application, a new outer bound for the two-user Gaussian interference channel is proved, which, in particular, settles the "missing corner point" problem of Costa (1985).

Cited by in corpus (4)

• Codewords With Memory Improve Achievable Rate Regions of the Memoryless Gaussian Interference Channel
• A Beta-Beta Achievability Bound with Applications
• A Lower Bound on the Entropy Rate for a Large Class of Stationary Processes and its Relation to the Hyperplane Conjecture
• The Capacity of Mixed and One-Sided Gaussian Interference Channels