Beyond Barren Plateaus: Quantum Variational Algorithms Are Swamped With Traps
arXiv:2205.05786 · doi:10.1038/s41467-022-35364-5
Abstract
One of the most important properties of classical neural networks is how surprisingly trainable they are, though their training algorithms typically rely on optimizing complicated, nonconvex loss functions. Previous results have shown that unlike the case in classical neural networks, variational quantum models are often not trainable. The most studied phenomenon is the onset of barren plateaus in the training landscape of these quantum models, typically when the models are very deep. This focus on barren plateaus has made the phenomenon almost synonymous with the trainability of quantum models. Here, we show that barren plateaus are only a part of the story. We prove that a wide class of variational quantum models -- which are shallow, and exhibit no barren plateaus -- have only a superpolynomially small fraction of local minima within any constant energy from the global minimum, rendering these models untrainable if no good initial guess of the optimal parameters is known. We also study the trainability of variational quantum algorithms from a statistical query framework, and show that noisy optimization of a wide variety of quantum models is impossible with a sub-exponential number of queries. Finally, we numerically confirm our results on a variety of problem instances. Though we exclude a wide variety of quantum algorithms here, we give reason for optimism for certain classes of variational algorithms and discuss potential ways forward in showing the practical utility of such algorithms.
46 pages, 12 figures
References in corpus (2)
Cited by in corpus (129)
- Barren Plateaus in Variational Quantum Computing
- Quantum Computing for High-Energy Physics: State of the Art and Challenges. Summary of the QC4HEP Working Group
- A Lie Algebraic Theory of Barren Plateaus for Deep Parameterized Quantum Circuits
- Review of Distributed Quantum Computing. From single QPU to High Performance Quantum Computing
- Theory for Equivariant Quantum Neural Networks
- Quantum Vision Transformers
- Theoretical Guarantees for Permutation-Equivariant Quantum Neural Networks
- Does provable absence of barren plateaus imply classical simulability?
- Avoiding barren plateaus via transferability of smooth solutions in Hamiltonian Variational Ansatz
- The Adjoint Is All You Need: Characterizing Barren Plateaus in Quantum Ansätze
- Synergy Between Quantum Circuits and Tensor Networks: Short-cutting the Race to Practical Quantum Advantage
- Quantum algorithm for ground state energy estimation using circuit depth with exponentially improved dependence on precision
- Quantum Machine Learning for Digital Health? A Systematic Review
- Towards large-scale quantum optimization solvers with few qubits
- Artificial Intelligence for Quantum Computing
- Absence of barren plateaus in finite local-depth circuits with long-range entanglement
- Quantifying the effect of gate errors on variational quantum eigensolvers for quantum chemistry
- Trainability Enhancement of Parameterized Quantum Circuits via Reduced-Domain Parameter Initialization
- An Expressive Ansatz for Low-Depth Quantum Approximate Optimisation
- Interpretable Quantum Advantage in Neural Sequence Learning
- Efficient classical algorithms for simulating symmetric quantum systems
- A single -gate makes distribution learning hard
- Entanglement entropy production in Quantum Neural Networks
- Fourier expansion in variational quantum algorithms
- Variational quantum simulation: a case study for understanding warm starts
- On the Sample Complexity of Quantum Boltzmann Machine Learning
- Retrieving information from a black hole using quantum machine learning
- Efficient variational synthesis of quantum circuits with coherent multi-start optimization
- Learning shallow quantum circuits
- Tight and Efficient Gradient Bounds for Parameterized Quantum Circuits
- Efficient estimation of trainability for variational quantum circuits
- Neural network encoded variational quantum algorithms
- Quantum Convolutional Neural Networks are Effectively Classically Simulable
- Lie-algebraic classical simulations for quantum computing
- Using Differential Evolution to avoid local minima in Variational Quantum Algorithms
- Classical Splitting of Parametrized Quantum Circuits
- Variational Quantum Simulation of Partial Differential Equations: Applications in Colloidal Transport
- Isometric tensor network optimization for extensive Hamiltonians is free of barren plateaus
- Networked Quantum Services
- An exponentially-growing family of universal quantum circuits
- Computing exact moments of local random quantum circuits via tensor networks
- Scalable Quantum Simulations of Scattering in Scalar Field Theory on 120 Qubits
- Symmetry breaking in geometric quantum machine learning in the presence of noise
- QChemistry: A quantum computation platform for quantum chemistry
- What can we learn from quantum convolutional neural networks?
- Trainability and Expressivity of Hamming-Weight Preserving Quantum Circuits for Machine Learning
- VQC-Based Reinforcement Learning with Data Re-uploading: Performance and Trainability
- EHA: Entanglement-variational Hardware-efficient Ansatz for Eigensolvers
- Dynamic-ADAPT-QAOA: An algorithm with shallow and noise-resilient circuits
- Improving the speed of variational quantum algorithms for quantum error correction
- Spin coupling is all you need: Encoding strong electron correlation in molecules on quantum computers
- Algorithmic Shadow Spectroscopy
- Hybrid quantum learning with data re-uploading on a small-scale superconducting quantum simulator
- Constrained and Vanishing Expressivity of Quantum Fourier Models
- Dissipative variational quantum algorithms for Gibbs state preparation
- Beyond MP2 initialization for unitary coupled cluster quantum circuits
- Large-scale simulations of Floquet physics on near-term quantum computers
- Trainability Barriers in Low-Depth QAOA Landscapes
- Layering and subpool exploration for adaptive Variational Quantum Eigensolvers: Reducing circuit depth, runtime, and susceptibility to noise
- Satellite image classification with neural quantum kernels
- Generalization Error Bound for Quantum Machine Learning in NISQ Era -- A Survey
- Early Fault-Tolerant Quantum Algorithms in Practice: Application to Ground-State Energy Estimation
- Splitting and Parallelizing of Quantum Convolutional Neural Networks for Learning Translationally Symmetric Data
- Energy-dependent barren plateau in bosonic variational quantum circuits
- Quantum Eigenvector Continuation for Chemistry Applications
- Resource frugal optimizer for quantum machine learning
- Image Classification with Rotation-Invariant Variational Quantum Circuits
- Barren plateaus are swamped with traps
- Unveiling quantum phase transitions from traps in variational quantum algorithms
- Variational quantum computing for quantum simulation: principles, implementations, and challenges
- Variational Quantum Circuit Design for Quantum Reinforcement Learning on Continuous Environments
- Hybrid Ground-State Quantum Algorithms based on Neural Schrödinger Forging
- Analyzing the quantum approximate optimization algorithm: ansätze, symmetries, and Lie algebras
- Practicality of quantum adiabatic algorithm for chemistry applications
- Gradients and frequency profiles of quantum re-uploading models
- The Wasserstein distance of order 1 for quantum spin systems on infinite lattices
- Fast gradient-free optimization of excitations in variational quantum eigensolvers
- Random Natural Gradient
- Bounds on the ground state energy of quantum -spin Hamiltonians
- MLQAOA: Graph Learning Accelerated Hybrid Quantum-Classical Multilevel QAOA
- SHARC-VQE: Simplified Hamiltonian Approach with Refinement and Correction enabled Variational Quantum Eigensolver for Molecular Simulation
- A Quantum Annealing Protocol to Solve the Nuclear Shell Model
- Scalability Challenges in Variational Quantum Optimization under Stochastic Noise
- Quantum computing quantum Monte Carlo algorithm
- Energy Landscape Plummeting in Variational Quantum Eigensolver: Subspace Optimization, Non-iterative Corrections and Generator-informed Initialization for Improved Quantum Efficiency
- QSlack: A slack-variable approach for variational quantum semi-definite programming
- Backpropagation scaling in parameterised quantum circuits
- Hamiltonian-based graph-state ansatz for variational quantum algorithms
- Channel Attention for Quantum Convolutional Neural Networks
- Supervised Learning Guarantee for Quantum AdaBoost
- On the average-case complexity of learning output distributions of quantum circuits
- Deep Circuit Compression for Quantum Dynamics via Tensor Networks
- Learning quantum states prepared by shallow circuits in polynomial time
- Pitfalls when tackling the exponential concentration of parameterized quantum models
- Perturbative gadgets for gate-based quantum computing: Non-recursive constructions without subspace restrictions
- Learning Fourier series with parametrized quantum circuits
- Trained quantum neural networks are Gaussian processes
- Exponential distillation of dominant eigenproperties
- Benchmarking Variational Quantum Algorithms for Combinatorial Optimization in Practice
- Regularizing quantum loss landscapes by noise injection
- Adiabatic quantum computing with parameterized quantum circuits
- Quantum Approximation Optimization Algorithm for the Trellis based Viterbi Decoding of Classical Error Correcting Codes
- A Universal Quantum Computer From Relativistic Motion
- Quantum Curriculum Learning
- Generative flow-based warm start of the variational quantum eigensolver
- Exploiting many-body localization for scalable variational quantum simulation
- Dynamical transition in controllable quantum neural networks with large depth
- A coherent approach to quantum-classical optimization
- The Dual Role of Low-Weight Pauli Propagation: A Flawed Simulator but a Powerful Initializer for Variational Quantum Algorithms
- Making the cut: two methods for breaking down a quantum algorithm
- Efficient Estimation and Sequential Optimization of Cost Functions in Variational Quantum Algorithms
- Efficient Online Quantum Circuit Learning with No Upfront Training
- Quantum natural gradient with thermal-state initialization
- Quantum Glassiness From Efficient Learning
- An Empirical Study of Quantum Dynamics as a Ground State Problem with Neural Quantum States
- Variational decision diagrams for quantum-inspired machine learning applications
- Improving the trainability of VQE on NISQ computers for solving portfolio optimization using convex interpolation
- Disentangling quantum autoencoder
- Schmidt quantum compressor
- Learning Variational Quantum Circuit Parameters with Classical Artificial Intelligence for Quantum Phase Transition Detection
- Investigating layer-selective transfer learning of QAOA parameters for Max-Cut problem
- Learning complexity gradually in quantum machine learning models
- Learning Feedback Mechanisms for Measurement-Based Variational Quantum State Preparation
- Exploiting biased noise in variational quantum models
- Pulse engineering via projection of response functions
- Quantum reservoir computing in Jaynes-Cummings models: Nonlinear memory and time-series prediction
- Double-bracket quantum algorithms for high-fidelity ground state preparation
- Quantum Encoding of Structured Data with Matrix Product States
- Trainable Quantum Neural Network for Multiclass Image Classification with the Power of Pre-trained Tree Tensor Networks