Operational Interpretation of Renyi Information Measures via Composite Hypothesis Testing Against Product and Markov Distributions
arXiv:1511.04874 · doi:10.1109/TIT.2017.2776900
Abstract
We revisit the problem of asymmetric binary hypothesis testing against a composite alternative hypothesis. We introduce a general framework to treat such problems when the alternative hypothesis adheres to certain axioms. In this case we find the threshold rate, the optimal error and strong converse exponents (at large deviations from the threshold) and the second order asymptotics (at small deviations from the threshold). We apply our results to find operational interpretations of various Renyi information measures. In case the alternative hypothesis is comprised of bipartite product distributions, we find that the optimal error and strong converse exponents are determined by variations of Renyi mutual information. In case the alternative hypothesis consists of tripartite distributions satisfying the Markov property, we find that the optimal exponents are determined by variations of Renyi conditional mutual information. In either case the relevant notion of Renyi mutual information depends on the precise choice of the alternative hypothesis. As such, our work also strengthens the view that different definitions of Renyi mutual information, conditional entropy and conditional mutual information are adequate depending on the context in which the measures are used.
arXiv commentpublished version
References in corpus (23)
- Rényi Divergence and Kullback-Leibler Divergence
- Information Spectrum Approach to Second-Order Coding Rate in Channel Coding
- Quantum conditional mutual information and approximate Markov chains
- Exponential decreasing rate of leaked information in universal random privacy amplification
- Quantum hypothesis testing and the operational interpretation of the quantum Renyi relative entropies
- An Information-Spectrum Approach to Classical and Quantum Hypothesis Testing for Simple Hypotheses
- Correlation Detection and an Operational Interpretation of the Renyi Mutual Information
- Secure Multiplex Coding with Dependent and Non-Uniform Multiple Messages
- A Tight Upper Bound for the Third-Order Asymptotics for Most Discrete Memoryless Channels
- Relating different quantum generalizations of the conditional Renyi entropy
- Renyi generalizations of the conditional quantum mutual information
- The Converse Part of The Theorem for Quantum Hoeffding Bound
- Tight exponential analysis of universally composable privacy amplification and its applications
- Encoding Tasks and Rényi Entropy
- Universal coding for classical-quantum channel
- Universal and Composite Hypothesis Testing via Mismatched Divergence
- Uniform Random Number Generation from Markov Chains: Non-Asymptotic and Asymptotic Analyses
- Universal approximation of multi-copy states and universal quantum lossless data compression
- Two approaches to obtain the strong converse exponent of quantum hypothesis testing for general sequences of quantum states
- Universal channel coding for general output alphabet
- Equivocations, Exponents and Second-Order Coding Rates under Various Rényi Information Measures
- Converses for Secret Key Agreement and Secure Computing
- Reliability and Secrecy Functions of the Wiretap Channel under Cost Constraint
Cited by in corpus (22)
- Secure Multiplex Coding with Dependent and Non-Uniform Multiple Messages
- Generalization Bounds via Information Density and Conditional Information Density
- On a gap in the proof of the generalised quantum Stein's lemma and its consequences for the reversibility of quantum resources
- On Composite Quantum Hypothesis Testing
- Coding for Positive Rate in the Source Model Key Agreement Problem
- Conditional Decoupling of Quantum Information
- Two Measures of Dependence
- Characterisation of quantum betting tasks in terms of Arimoto mutual information
- Postselected quantum hypothesis testing
- Secure communication over fully quantum Gel'fand-Pinsker wiretap channel
- Ensemble Estimation of Generalized Mutual Information with Applications to Genomics
- Universal channel coding for general output alphabet
- Conditional Rényi entropy and the relationships between Rényi capacities
- Decomposition Rules for Quantum Rényi Mutual Information with an Application to Information Exclusion Relations
- Equivocations, Exponents and Second-Order Coding Rates under Various Rényi Information Measures
- Black Box Work Extraction and Composite Hypothesis Testing
- Non-Adaptive Coding for Two-Way Wiretap Channel with or without Cost Constraints
- Regularized Estimation of Information via High Dimensional Canonical Correlation Analysis
- On conditional Sibson's -Mutual Information
- Universal tester for multiple independence testing and classical-quantum arbitrarily varying multiple access channel
- Rényi divergence inequalities via interpolation, with applications to generalised entropic uncertainty relations
- On Conditional -Information and its Application to Side-Channel Analysis