Entropy and Information Causality in General Probabilistic Theories

Abstract

We investigate the concept of entropy in probabilistic theories more general than quantum mechanics, with particular reference to the notion of information causality recently proposed by Pawlowski et. al. (arXiv:0905.2992). We consider two entropic quantities, which we term measurement and mixing entropy. In classical and quantum theory, they are equal, being given by the Shannon and von Neumann entropies respectively; in general, however, they are very different. In particular, while measurement entropy is easily seen to be concave, mixing entropy need not be. In fact, as we show, mixing entropy is not concave whenever the state space is a non-simplicial polytope. Thus, the condition that measurement and mixing entropies coincide is a strong constraint on possible theories. We call theories with this property monoentropic. Measurement entropy is subadditive, but not in general strongly subadditive. Equivalently, if we define the mutual information between two systems A and B by the usual formula I(A:B) = H(A) + H(B) - H(AB) where H denotes the measurement entropy and AB is a non-signaling composite of A and B, then it can happen that I(A:BC) < I(A:B). This is relevant to information causality in the sense of Pawlowski et al.: we show that any monoentropic non-signaling theory in which measurement entropy is strongly subadditive, and also satisfies a version of the Holevo bound, is informationally causal, and on the other hand we observe that Popescu-Rohrlich boxes, which violate information causality, also violate strong subadditivity. We also explore the interplay between measurement and mixing entropy and various natural conditions on theories that arise in quantum axiomatics.

20 pages

References in corpus (3)

• A generalized no-broadcasting theorem
• Towards Quantum Gravity: A Framework for Probabilistic Theories with Non-Fixed Causal Structure
• Entropy in general physical theories

Cited by in corpus (66)

• Information-Theoretic Implications of Quantum Causal Structures
• Generalized Probability Theories: What determines the structure of quantum theory?
• Existence of an information unit as a postulate of quantum theory
• Entropy in general physical theories
• Generalized Probabilistic Theories Without the No-Restriction Hypothesis
• Comparing the degrees of incompatibility inherent in probabilistic physical theories
• Laws of Nature as Constraints
• Entanglement and thermodynamics in general probabilistic theories
• Information causality from an entropic and a probabilistic perspective
• A violation of the uncertainty principle implies a violation of the second law of thermodynamics
• Thermodynamics and the structure of quantum theory
• Strong Complementarity and Non-locality in Categorical Quantum Mechanics
• Dimension of physical systems, information processing, and thermodynamics
• Three-dimensionality of space and the quantum bit: an information-theoretic approach
• Bridging the gap between general probabilistic theories and the device-independent framework for nonlocality and contextuality
• Accessible fragments of generalized probabilistic theories, cone equivalence, and applications to witnessing nonclassicality
• Operational axioms for diagonalizing states
• Entropic nonsignaling correlations
• Discord and non-classicality in probabilistic theories
• Contextuality of general probabilistic theories
• Entropy, majorization and thermodynamics in general probabilistic theories
• Unifying typical entanglement and coin tossing: on randomization in probabilistic theories
• Analysing causal structures with entropy
• Classical theories with entanglement
• Tsirelson's bound from a Generalised Data Processing Inequality
• Quantum information as a non-Kolmogorovian generalization of Shannon's theory
• Indistinguishability of causal relations from limited marginals
• Classification of all alternatives to the Born rule in terms of informational properties
• On defining the Hamiltonian beyond quantum theory
• Dense Coding with Locality Restriction for Decoder: Quantum Encoders vs. Super-Quantum Encoders
• Entropies in General Probabilistic Theories and its Application to Holevo Bound
• Information Content of Systems as a Physical Principle
• Quantum information causality
• Analysing causal structures in generalised probabilistic theories
• Perfect Discrimination in Approximate Quantum Theory of General Probabilistic Theories
• Hyperdense coding and superadditivity of classical capacities in hypersphere theories
• Hiding Ignorance Using High Dimensions
• Universal structure of objective states in all fundamental causal theories
• The chain rule implies Tsirelson's bound: an approach from generalized mutual information
• Computational tools for solving a marginal problem with applications in Bell non-locality and causal modeling
• How dynamics constrains probabilities in general probabilistic theories
• Von Neumann's information engine without the spectral theorem
• Generalized probabilities in statistical theories
• Entropy of mixing exists only for classical and quantum-like theories among the regular polygon theories
• Measurement entropy in Generalized Non-Signalling Theory cannot detect bipartite non-locality
• The black hole information problem beyond quantum theory
• Shannon theory beyond quantum: information content of a source
• Estimation independence as an axiom for quantum uncertainty
• Qubit from the classical collision entropy
• Entropic Uncertainty Relations in a Class of Generalized Probabilistic Theories
• Quantum collapse rules from the maximum relative entropy principle
• Simulating all multipartite non-signalling channels via quasiprobabilistic mixtures of local channels in generalised probabilistic theories
• Extending Resource Monotones using Kan Extensions
• Compositional Thermostatics
• Shannon theory for quantum systems and beyond: information compression for fermions
• Categorical Equivalences from State-Effect Adjunctions
• Dichotomy between Deterministic and Probabilistic Models in Countably Additive Effectus Theory
• Entropic and operational characterizations of dynamic quantum resources
• A hierarchy in Majorana non-abelian tests and hidden variable models
• Spacetime symmetries and the qubit Bloch ball: a physical derivation of finite dimensional quantum theory and the number of spatial dimensions
• Scott Continuity in Generalized Probabilistic Theories
• Information causality beyond the random access code model
• Information transfer in generalized probabilistic theories based on weak repeatability
• Uncertainty principle certifies genuine source of intrinsic randomness
• Which entropy for general physical theories?
• One-shot and asymptotic classical capacity in general physical theories