Occam's Quantum Razor: How Quantum Mechanics can reduce the complexity of classical models

Abstract

Mathematical models are an essential component of quantitative science. They generate predictions about the future, based on information available in the present. In the spirit of Occam's razor, simpler is better; should two models make identical predictions, the one that requires less input is preferred. Yet, for almost all stochastic processes, even the provably optimal classical models waste information. The amount of input information they demand exceeds the amount of predictive information they output. We systematically construct quantum models that break this classical bound, and show that the system of minimal entropy that simulates such processes must necessarily feature quantum dynamics. This indicates that many observed phenomena could be significantly simpler than classically possible should quantum effects be involved.

6 pages, 3 figures, revised version with improved exposition and figures, for publication in Nature Communications

Cited by in corpus (80)

• Characterizing Nonclassical Correlations via Local Quantum Uncertainty
• Quantum Boltzmann Machine
• Opportunities and challenges for quantum-assisted machine learning in near-term quantum computers
• Kochen-Specker Contextuality
• Quantum stochastic processes and quantum non-Markovian phenomena
• Quantum-Assisted Learning of Hardware-Embedded Probabilistic Graphical Models
• The Structure of Quantum Stochastic Processes with Finite Markov Order
• A practical, unitary simulator for non-Markovian complex processes
• Experimental quantum processing enhancement in modelling stochastic processes
• Extreme dimensionality reduction with quantum modelling
• A Closed-Form Shave from Occam's Quantum Razor: Exact Results for Quantum Compression
• Optimal stochastic modelling with unitary quantum dynamics
• Thermodynamics of complexity and pattern manipulation
• Using quantum theory to reduce the complexity of input-output processes
• Extreme Quantum Advantage for Rare-Event Sampling
• Superior memory efficiency of quantum devices for the simulation of continuous-time stochastic processes
• Unbounded memory advantage in stochastic simulation using quantum mechanics
• General anesthesia reduces complexity and temporal asymmetry of the informational structures derived from neural recordings in Drosophila
• The classical-quantum divergence of complexity in modelling spin chains
• Towards Quantifying Complexity with Quantum Mechanics
• Matrix Product States for Quantum Stochastic Modelling
• Causal Asymmetry in a Quantum World
• Interfering trajectories in experimental quantum-enhanced stochastic simulation
• Information-theoretic bound on the energy cost of stochastic simulation
• Quantum learning of classical stochastic processes: The Completely-Positive Realization Problem
• Witnessing quantum resource conversion within deterministic quantum computation using one pure superconducting qubit
• Memory compression and thermal efficiency of quantum implementations of non-deterministic hidden Markov models
• Entanglement-based quantum deep learning
• Strong and Weak Optimizations in Classical and Quantum Models of Stochastic Processes
• Single-shot quantum memory advantage in the simulation of stochastic processes
• Quantum-enhanced least-square support vector machine: simplified quantum algorithm and sparse solutions
• Memory-efficient tracking of complex temporal and symbolic dynamics with quantum simulators
• Quantum adaptive agents with efficient long-term memories
• Thermal Efficiency of Quantum Memory Compression
• Quantum Uncertainty Principles for Measurements with Interventions
• Implementing quantum dimensionality reduction for non-Markovian stochastic simulation
• Robust inference of memory structure for efficient quantum modelling of stochastic processes
• Fraudulent White Noise: Flat power spectra belie arbitrarily complex processes
• Thermodynamics of Random Number Generation
• An Experimental Quantum Bernoulli Factory
• Theoretical investigations of an information geometric approach to complexity
• Quantum Causal Unravelling
• Simulating extremal temporal correlations
• Measuring quantumness via anticommutators
• Quantum coarse-graining for extreme dimension reduction in modelling stochastic temporal dynamics
• Measurement-Induced Randomness and Structure in Controlled Qubit Processes
• Quantum Predictive Filtering
• Accuracy vs Memory Advantage in the Quantum Simulation of Stochastic Processes
• Measures of distinguishability between stochastic processes
• Ultimate limit on time signal generation
• The Markov Memory for Generating Rare Events
• Capturing long-range memory structures with tree-geometry process tensors
• Thermodynamically-Efficient Local Computation and the Inefficiency of Quantum Memory Compression
• Equality conditions for internal entropies of certain classical and quantum models
• Provable superior accuracy in machine learned quantum models
• Quantum-embeddable stochastic matrices
• Extreme Quantum Advantage when Simulating Strongly Coupled Classical Systems
• Ockham's razor and the interpretations of quantum mechanics
• Embedding memory-efficient stochastic simulators as quantum trajectories
• Surveying structural complexity in quantum many-body systems
• Open quantum systems are harder to track than open classical systems
• Quantum theory in finite dimension cannot explain every general process with finite memory
• Deterministic steady-state subradiance within a single-excitation basis
• Quantum Statistical Complexity Measure as a Signalling of Correlation Transitions
• Symmetries and physically realizable ensembles for open quantum systems
• Quantum-inspired identification of complex cellular automata
• Error-tolerant witnessing of divergences in classical and quantum statistical complexity
• Quantum Reservoir Computing for Realized Volatility Forecasting
• The Origins of Computational Mechanics: A Brief Intellectual History and Several Clarifications
• Enhancing quantum models of stochastic processes with error mitigation
• Information geometric complexity of entropic motion on curved statistical manifolds
• Boosting on the shoulders of giants in quantum device calibration
• Strict advantage of complex quantum theory in a communication task
• The fundamental thermodynamic bounds on finite models
• Optimizing Quantum Models of Classical Channels: The reverse Holevo problem
• Predictive complexity of quantum subsystems
• The Ambiguity of Simplicity
• Ideal stochastic process modeling with post-quantum quasiprobabilistic theories
• Quantum-inspired memory-enhanced stochastic algorithms
• Quantum Dimension Reduction of Hidden Markov Models