Information Equals Amortized Communication
arXiv:1106.3595
Abstract
We show how to efficiently simulate the sending of a message M to a receiver who has partial information about the message, so that the expected number of bits communicated in the simulation is close to the amount of additional information that the message reveals to the receiver. This is a generalization and strengthening of the Slepian-Wolf theorem, which shows how to carry out such a simulation with low amortized communication in the case that M is a deterministic function of X. A caveat is that our simulation is interactive. As a consequence, we prove that the internal information cost (namely the information revealed to the parties) involved in computing any relation or function using a two party interactive protocol is exactly equal to the amortized communication complexity of computing independent copies of the same relation or function. We also show that the only way to prove a strong direct sum theorem for randomized communication complexity is by solving a particular variant of the pointer jumping problem that we define. Our work implies that a strong direct sum theorem for communication complexity holds if and only if efficient compression of communication protocols is possible.
References in corpus (1)
Cited by in corpus (16)
- Lower bounds on information complexity via zero-communication protocols and applications
- A generalized quantum Slepian-Wolf
- Lower Bounds on the Oracle Complexity of Nonsmooth Convex Optimization via Information Theory
- Quantum Information Complexity and Amortized Communication
- (1+eps)-approximate Sparse Recovery
- Tension Bounds for Information Complexity
- The information cost of quantum memoryless protocols
- Direct Sum Theorem for Bounded Round Quantum Communication Complexity
- Tight Bounds for Set Disjointness in the Message Passing Model
- Complement-Free Couples Must Communicate: A Hardness Result for Two-Player Combinatorial Auctions
- Information Causality, Szemerédi-Trotter and Algebraic Variants of CHSH
- Information Complexity and the Quest for Interactive Compression (A Survey)
- Rényi Information Complexity and an Information Theoretic Characterization of the Partition Bound
- Tight Space-Approximation Tradeoff for the Multi-Pass Streaming Set Cover Problem
- On Slepian--Wolf Theorem with Interaction
- Simulating Noisy Channel Interaction