On the Dispersions of Three Network Information Theory Problems
arXiv:1201.3901 · doi:10.1109/TIT.2013.2291231
Abstract
We analyze the dispersions of distributed lossless source coding (the Slepian-Wolf problem), the multiple-access channel and the asymmetric broadcast channel. For the two-encoder Slepian-Wolf problem, we introduce a quantity known as the entropy dispersion matrix, which is analogous to the scalar dispersions that have gained interest recently. We prove a global dispersion result that can be expressed in terms of this entropy dispersion matrix and provides intuition on the approximate rate losses at a given blocklength and error probability. To gain better intuition about the rate at which the non-asymptotic rate region converges to the Slepian-Wolf boundary, we define and characterize two operational dispersions: the local dispersion and the weighted sum-rate dispersion. The former represents the rate of convergence to a point on the Slepian-Wolf boundary while the latter represents the fastest rate for which a weighted sum of the two rates converges to its asymptotic fundamental limit. Interestingly, when we approach either of the two corner points, the local dispersion is characterized not by a univariate Gaussian but a bivariate one as well as a subset of off-diagonal elements of the aforementioned entropy dispersion matrix. Finally, we demonstrate the versatility of our achievability proof technique by providing inner bounds for the multiple-access channel and the asymmetric broadcast channel in terms of dispersion matrices. All our proofs are unified a so-called vector rate redundancy theorem which is proved using the multidimensional Berry-Esseen theorem.
Accepted to the IEEE Transactions on Information Theory
References in corpus (1)
Cited by in corpus (35)
- Second-Order Coding Rates for Channels with State
- Fundamental Finite Key Limits for One-Way Information Reconciliation in Quantum Key Distribution
- Gaussian Multiple and Random Access in the Finite Blocklength Regime
- Non-Asymptotic Classical Data Compression with Quantum Side Information
- A Finite-Blocklength Perspective on Gaussian Multi-Access Channels
- Random Access Channel Coding in the Finite Blocklength Regime
- Second-Order Region for Gray-Wyner Network
- Second-Order Asymptotics for the Gaussian MAC with Degraded Message Sets
- Statistical Tools and Methodologies for Ultrareliable Low-Latency Communications -- A Tutorial
- On Finite Blocklength Lossy Source Coding
- A Proof of the Strong Converse Theorem for Gaussian Multiple Access Channels
- Lossless Source Coding in the Point-to-Point, Multiple Access, and Random Access Scenarios
- A Technique for Deriving One-Shot Achievability Results in Network Information Theory
- Non-Asymptotic and Second-Order Achievability Bounds for Coding With Side-Information
- Distributed Quantization Networks
- A unified approach to source and message compression
- The Dispersion of the Gauss-Markov Source
- Finite-Block-Length Analysis in Classical and Quantum Information Theory
- Finite-size analysis of prepare-and-measure and decoy-state QKD via entropy accumulation
- Fixed Error Asymptotics For Erasure and List Decoding
- Equivocations, Exponents and Second-Order Coding Rates under Various Rényi Information Measures
- First- and Second-Order Hypothesis Testing for Mixed Memoryless Sources with General Mixture
- Nonstationary Gauss-Markov Processes: Parameter Estimation and Dispersion
- An Information-Spectrum Approach to Weak Variable-Length Source Coding with Side-Information
- Zero-Error Communication over Adversarial MACs
- On the Dispersions of the Gel'fand-Pinsker Channel and Dirty Paper Coding
- On Error Exponents and Moderate Deviations for Lossless Streaming Compression of Correlated Sources
- Second-Order and Moderate Deviation Asymptotics for Successive Refinement
- On the compression of messages in the multi-party setting
- A Case Where Interference Does Not Affect The Channel Dispersion
- Interactive Communication for Data Exchange
- Sharp Second-Order Pointwise Asymptotics for Lossless Compression with Side Information
- On Dispersions of Discrete Memoryless Channels with Noncausal State Information at the Encoder
- Second-Order Asymptotics for the Discrete Memoryless MAC with Degraded Message Sets
- Finite-Blocklength and Error-Exponent Analyses for LDPC Codes in Point-to-Point and Multiple Access Communication