Generalization in quantum machine learning from few training data

Abstract

Modern quantum machine learning (QML) methods involve variationally optimizing a parameterized quantum circuit on a training data set, and subsequently making predictions on a testing data set (i.e., generalizing). In this work, we provide a comprehensive study of generalization performance in QML after training on a limited number $N$ of training data points. We show that the generalization error of a quantum machine learning model with $T$ trainable gates scales at worst as $\sqrt{T/N}$. When only $K\ll T$ gates have undergone substantial change in the optimization process, we prove that the generalization error improves to $\sqrt{K/N}$. Our results imply that the compiling of unitaries into a polynomial number of native gates, a crucial application for the quantum computing industry that typically uses exponential-size training data, can be sped up significantly. We also show that classification of quantum states across a phase transition with a quantum convolutional neural network requires only a very small training data set. Other potential applications include learning quantum error correcting codes or quantum dynamical simulation. Our work injects new hope into the field of QML, as good generalization is guaranteed from few training data.

14+26 pages, 4+1 figures

References in corpus (49)

• Variational Quantum Algorithms
• Noisy intermediate-scale quantum (NISQ) algorithms
• An introduction to quantum machine learning
• The power of quantum neural networks
• Classical simulation of infinite-size quantum lattice systems in one spatial dimension
• Noise-Induced Barren Plateaus in Variational Quantum Algorithms
• Learning phase transitions by confusion
• The effect of data encoding on the expressive power of variational quantum machine learning models
• Classical simulation of infinite-size quantum lattice systems in two spatial dimensions
• The quest for a Quantum Neural Network
• Connecting ansatz expressibility to gradient magnitudes and barren plateaus
• A rigorous and robust quantum speed-up in supervised machine learning
• Hybrid quantum-classical algorithms and quantum error mitigation
• Absence of Barren Plateaus in Quantum Convolutional Neural Networks
• Resource-Aware Quantum Programming with General Recursion and Quantum Control
• Information-theoretic bounds on quantum advantage in machine learning
• Provably efficient machine learning for quantum many-body problems
• Effect of barren plateaus on gradient-free optimization
• Concrete Categorical Model of a Quantum Circuit Description Language with Measurement
• Diagnosing Barren Plateaus with Tools from Quantum Optimal Control
• One-Dimensional Symmetry Protected Topological Phases and their Transitions
• Trainability of Dissipative Perceptron-Based Quantum Neural Networks
• Theory of overparametrization in quantum neural networks
• Generalization in Quantum Machine Learning: a Quantum Information Perspective
• Large gradients via correlation in random parameterized quantum circuits
• Entanglement Devised Barren Plateau Mitigation
• Barren plateaus preclude learning scramblers
• Higher Order Derivatives of Quantum Neural Networks with Barren Plateaus
• Efficient measure for the expressivity of variational quantum algorithms
• On barren plateaus and cost function locality in variational quantum algorithms
• Machine learning of noise-resilient quantum circuits
• Quantum Algorithmic Measurement
• Towards understanding the power of quantum kernels in the NISQ era
• Representation Learning via Quantum Neural Tangent Kernels
• Efficient classical simulation of the semi-classical Quantum Fourier Transform
• Concentration for random product formulas
• Reformulation of the No-Free-Lunch Theorem for Entangled Data Sets
• Robust Quantum Error Correction via Convex Optimization
• Structured Near-Optimal Channel-Adapted Quantum Error Correction
• On the statistical complexity of quantum circuits
• Variational Hamiltonian Diagonalization for Dynamical Quantum Simulation
• Quantum Error Correction via Convex Optimization
• Variational Quantum Anomaly Detection: Unsupervised mapping of phase diagrams on a physical quantum computer
• Long-time simulations with high fidelity on quantum hardware
• Pseudo-dimension of quantum circuits
• Entangled Datasets for Quantum Machine Learning
• Experimental Quantum Learning of a Spectral Decomposition
• Unsupervised mapping of phase diagrams of 2D systems from infinite projected entangled-pair states via deep anomaly detection
• Rademacher complexity of noisy quantum circuits

Cited by in corpus (129)

• Challenges and Opportunities in Quantum Machine Learning
• Quantum advantage in learning from experiments
• Quantum circuit architecture search for variational quantum algorithms
• Exploiting symmetry in variational quantum machine learning
• Theory for Equivariant Quantum Neural Networks
• Quantum Machine Learning: from physics to software engineering
• Theoretical Guarantees for Permutation-Equivariant Quantum Neural Networks
• Towards quantum enhanced adversarial robustness in machine learning
• Does provable absence of barren plateaus imply classical simulability?
• Understanding quantum machine learning also requires rethinking generalization
• Out-of-distribution generalization for learning quantum dynamics
• On the practical usefulness of the Hardware Efficient Ansatz
• Subtleties in the trainability of quantum machine learning models
• Benchmarking Adversarially Robust Quantum Machine Learning at Scale
• Quantum algorithms applied to satellite mission planning for Earth observation
• Machine Learning for Anomaly Detection in Particle Physics
• Analytic theory for the dynamics of wide quantum neural networks
• Generalization despite overfitting in quantum machine learning models
• Quantum phase detection generalisation from marginal quantum neural network models
• Benchmarking simulated and physical quantum processing units using quantum and hybrid algorithms
• Hybrid quantum ResNet for car classification and its hyperparameter optimization
• Quantum Machine Learning in Drug Discovery: Applications in Academia and Pharmaceutical Industries
• Quantum anomaly detection in the latent space of proton collision events at the LHC
• ResQNets: A Residual Approach for Mitigating Barren Plateaus in Quantum Neural Networks
• Pseudomagic Quantum States
• Tensor networks for quantum machine learning
• Applying QNLP to sentiment analysis in finance
• Overfitting in quantum machine learning and entangling dropout
• Towards quantum computing for clinical trial design and optimization: A perspective on new opportunities and challenges
• Dynamical simulation via quantum machine learning with provable generalization
• Quantum utility -- definition and assessment of a practical quantum advantage
• A semi-agnostic ansatz with variable structure for quantum machine learning
• Variational Quantum Approximate Support Vector Machine with Inference Transfer
• Learning quantum states and unitaries of bounded gate complexity
• Parallel Hybrid Networks: an interplay between quantum and classical neural networks
• Variational quantum one-class classifier
• How quantum computing can enhance biomarker discovery
• Learning Quantum Processes and Hamiltonians via the Pauli Transfer Matrix
• Reduction of finite sampling noise in quantum neural networks
• Resource Saving via Ensemble Techniques for Quantum Neural Networks
• Complexity of quantum circuits via sensitivity, magic, and coherence
• Generalization of Quantum Machine Learning Models Using Quantum Fisher Information Metric
• Quantum Convolutional Neural Networks are Effectively Classically Simulable
• Numerical evidence against advantage with quantum fidelity kernels on classical data
• Enabling Large-Scale and High-Precision Fluid Simulations on Near-Term Quantum Computers
• A General Approach to Dropout in Quantum Neural Networks
• Dequantizing quantum machine learning models using tensor networks
• Explaining Quantum Circuits with Shapley Values: Towards Explainable Quantum Machine Learning
• Machine learning on quantum experimental data toward solving quantum many-body problems
• Optimal quantum dataset for learning a unitary transformation
• Transition Role of Entangled Data in Quantum Machine Learning
• Approximately Equivariant Quantum Neural Network for $p4m$ Group Symmetries in Images
• Quantum Vision Transformers for Quark-Gluon Classification
• Statistical Complexity of Quantum Learning
• Randomness-enhanced expressivity of quantum neural networks
• What can we learn from quantum convolutional neural networks?
• QFactor: A Domain-Specific Optimizer for Quantum Circuit Instantiation
• Exploring Unsupervised Anomaly Detection with Quantum Boltzmann Machines in Fraud Detection
• A Quantum Kernel Learning Approach to Acoustic Modeling for Spoken Command Recognition
• Expressivity of Variational Quantum Machine Learning on the Boolean Cube
• When Federated Learning Meets Quantum Computing: Survey and Research Opportunities
• Opportunities and challenges of quantum computing for climate modelling
• Hybrid quantum learning with data re-uploading on a small-scale superconducting quantum simulator
• Optimizing Quantum Convolutional Neural Network Architectures for Arbitrary Data Dimension
• The role of data embedding in equivariant quantum convolutional neural networks
• Forecasting steam mass flow in power plants using the parallel hybrid network
• Guided-SPSA: Simultaneous Perturbation Stochastic Approximation assisted by the Parameter Shift Rule
• Quantum-machine-assisted Drug Discovery
• Generalization Error Bound for Quantum Machine Learning in NISQ Era -- A Survey
• Satellite image classification with neural quantum kernels
• Exploring ab initio machine synthesis of quantum circuits
• Error-tolerant quantum convolutional neural networks for symmetry-protected topological phases
• Guided Quantum Compression for High Dimensional Data Classification
• Hybrid quantum-classical unsupervised data clustering based on the self-organizing feature map
• Quantum Supervised Learning
• Quantum Kernel Learning for Small Dataset Modeling in Semiconductor Fabrication: Application to Ohmic Contact
• Distributed quantum machine learning via classical communication
• Variational Quantum Circuit Design for Quantum Reinforcement Learning on Continuous Environments
• Application of quantum-inspired generative models to small molecular datasets
• The power and limitations of learning quantum dynamics incoherently
• Quantum neural compressive sensing for ghost imaging
• Optimisation-free Classification and Density Estimation with Quantum Circuits
• Error-mitigated photonic quantum circuit Born machine
• Alz-QNet: A Quantum Regression Network for Studying Alzheimer's Gene Interactions
• Quantum Kerr Learning
• Robust Quantum Reservoir Computing for Molecular Property Prediction
• Characterizing out-of-distribution generalization of neural networks: application to the disordered Su-Schrieffer-Heeger model
• Single-shot quantum machine learning
• Quantum contextual bandits and recommender systems for quantum data
• High-fidelity dimer excitations using quantum hardware
• Optimal lower bounds for Quantum Learning via Information Theory
• Uncovering Quantum Many-body Scars with Quantum Machine Learning
• QuForge: A Library for Qudits Simulation
• Deep Circuit Compression for Quantum Dynamics via Tensor Networks
• Exploiting subspace constraints and ab initio variational methods for quantum chemistry
• Ground state-based quantum feature maps
• Supervised Learning Guarantee for Quantum AdaBoost
• BCQQ: Batch-Constraint Quantum Q-Learning with Cyclic Data Re-uploading
• Model-based Offline Quantum Reinforcement Learning
• Parallel-in-time quantum simulation via Page and Wootters quantum time
• Permutation-equivariant quantum convolutional neural networks
• Transfer Learning Analysis of Variational Quantum Circuits
• Data-Dependent Generalization Bounds for Parameterized Quantum Models Under Noise
• Quantum Convolutional Neural Network for Phase Recognition in Two Dimensions
• Application of Quantum Pre-Processing Filter for Binary Image Classification with Small Samples
• Method for noise-induced regularization in quantum neural networks
• Learning Fourier series with parametrized quantum circuits
• Generalization Bounds in Hybrid Quantum-Classical Machine Learning Models
• Conditional Generative Models for Learning Stochastic Processes
• Nearly query-optimal classical shadow estimation of unitary channels
• Benchmarking Quantum Convolutional Neural Networks for Signal Classification in Simulated Gamma-Ray Burst Detection
• Out-of-distribution generalisation for learning quantum channels with low-energy coherent states
• High-Accuracy Temporal Prediction via Experimental Quantum Reservoir Computing in Correlated Spins
• Integrated Encoding and Quantization to Enhance Quanvolutional Neural Networks
• Harnessing a 256-qubit Neutral Atom Simulator for Graph Classification
• Quantum Bayesian Networks for Machine Learning in Oil-Spill Detection
• Quantum Patch-Based Autoencoder for Anomaly Segmentation
• Empirical Power of Quantum Encoding Methods for Binary Classification
• Guided Graph Compression for Quantum Graph Neural Networks
• Quantum Phase Recognition via Quantum Attention Mechanism
• Quantum Machine Learning for Climate Modelling
• Transfer entropy and O-information to detect grokking in tensor network multi-class classification problems
• Measuring Incompatible Observables with Quantum Neural Networks
• Disentangling quantum autoencoder
• Quantum phase classification via partial tomography-based quantum hypothesis testing
• Learning complexity gradually in quantum machine learning models
• Hybrid quantum recurrent neural network for remaining useful life prediction of turbofan engines
• Trainable Quantum Neural Network for Multiclass Image Classification with the Power of Pre-trained Tree Tensor Networks
• Vortex Detection from Quantum Data