Properties of Classical and Quantum Jensen-Shannon Divergence
arXiv:0806.4472 · doi:10.1103/PhysRevA.79.052311
Abstract
Jensen-Shannon divergence (JD) is a symmetrized and smoothed version of the most important divergence measure of information theory, Kullback divergence. As opposed to Kullback divergence it determines in a very direct way a metric; indeed, it is the square of a metric. We consider a family of divergence measures (JD_alpha for alpha>0), the Jensen divergences of order alpha, which generalize JD as JD_1=JD. Using a result of Schoenberg, we prove that JD_alpha is the square of a metric for alpha lies in the interval (0,2], and that the resulting metric space of probability distributions can be isometrically embedded in a real Hilbert space. Quantum Jensen-Shannon divergence (QJD) is a symmetrized and smoothed version of quantum relative entropy and can be extended to a family of quantum Jensen divergences of order alpha (QJD_alpha). We strengthen results by Lamberti et al. by proving that for qubits and pure states, QJD_alpha^1/2 is a metric space which can be isometrically embedded in a real Hilbert space when alpha lies in the interval (0,2]. In analogy with Burbea and Rao's generalization of JD, we also define general QJD by associating a Jensen-type quantity to any weighted family of states. Appropriate interpretations of quantities introduced are discussed and bounds are derived in terms of the total variation and trace distance.
13 pages, LaTeX, expanded contents, added references and corrected typos
References in corpus (8)
- Jensen-Shannon divergence as a measure of distinguishability between mixed quantum states
- On the metric character of the quantum Jensen-Shannon divergence
- The Capacity of Quantum Channel with General Signal States
- Operationally Invariant Measure of the Distance between Quantum States by Complementary Measurements
- Wootters' distance revisited: a new distinguishability criterium
- Interaction in Quantum Communication
- Indeterminate-length quantum coding
- Nonextensive Generalizations of the Jensen-Shannon Divergence
Cited by in corpus (58)
- Layer aggregation and reducibility of multilayer interconnected networks
- MuxViz: A Tool for Multilayer Analysis and Visualization of Networks
- On a generalization of the Jensen-Shannon divergence and the JS-symmetrization of distances relying on abstract means
- Distribution of quantum coherence in multipartite systems
- Mediated Semi-Quantum Key Distribution
- Spectral entropies as information-theoretic tools for complex network comparison
- Work fluctuations in slow processes: quantum signatures and optimal control
- Distance between quantum states in presence of initial qubit-environment correlations: a comparative study
- Advantage distillation for device-independent quantum key distribution
- Universal bounds for the Holevo quantity, coherent information \\ and the Jensen-Shannon divergence
- Domain Adaptation with Conditional Distribution Matching and Generalized Label Shift
- Security of device-independent quantum key distribution protocols: a review
- Quantum Skew Divergence
- Quantum coherence of planar spin models with Dzyaloshinsky-Moriya interaction
- The metric property of the quantum Jensen-Shannon divergence
- Distinguishability of generic quantum states
- Computing secure key rates for quantum key distribution with untrusted devices
- Similarity of symbol frequency distributions with heavy tails
- Basis-independent quantum coherence and its distribution
- A Genuine Multipartite Bell Inequality for Device-independent Conference Key Agreement
- Jensen divergence based on Fisher's information
- Entropic bounds on information backflow
- Quantum walks with sequential aperiodic jumps
- Quantum Monge-Kantorovich problem and transport distance between density matrices
- Generalized Entropies and the Similarity of Texts
- Entropic and trace distance based measures of non-Markovianity
- Influence of Stark-shift on quantum coherence and non-classical correlations for two two-level atoms interacting with a single-mode cavity field
- Unsupervised Neural Domain Adaptation for Document Image Binarization
- Quantum Rényi and -divergences from integral representations
- Information theoretic network approach to socioeconomic correlations
- Extracting directed information flow networks: an application to genetics and semantics
- The Differential Entropy of Mixtures: New Bounds and Applications
- Universal quantum uncertainty relations between non-ergodicity and loss of information
- Natural Metric for Quantum Information Theory
- Tight Bounds for Symmetric Divergence Measures and a Refined Bound for Lossless Source Coding
- Multipartite entanglement, quantum coherence, and quantum criticality in triangular and Sierpiński fractal lattices
- Spectral density of mixtures of random density matrices for qubits
- Semiclassical Husimi distributions for non-Hermitian quantum systems
- Challenges in certifying quantum teleportation: moving beyond conventional fidelity benchmark
- Jensen-Shannon Divergence and Non-linear Quantum Dynamics
- Quantifying the Dissimilarity of Texts
- On the metric property of quantum Wasserstein divergences
- Purification-based metric to measure the distance between quantum states and processes
- Transmission distance in the space of quantum channels
- Lightcone Bounds for Quantum Circuit Mapping via Uncomplexity
- Thermal coherence of the Heisenberg model with Dzyaloshinsky-Moriya interactions in an inhomogenous external field
- Document Similarity from Vector Space Densities
- Fast Incremental von Neumann Graph Entropy Computation: Theory, Algorithm, and Applications
- Quantum Chernoff divergence in advantage distillation for quantum key distribution and device-independent quantum key distribution
- Unified scheme for correlations using linear relative entropy
- Conceptual capacity and effective complexity of neural networks
- Quantum state testing beyond the polarizing regime and quantum triangular discrimination
- Perturbative distinguishability of black hole microstates from AdS/CFT correspondence
- Quantum speed limits based on Jensen-Shannon and Jeffreys divergences for general physical processes
- Jointly convex quantum Jensen divergences
- Some features of the state-space trajectories followed by robust entangled four-qubit states during decoherence
- Topological mixture estimation
- Universal growth of social groups: empirical analysis and modeling