Trainability of Dissipative Perceptron-Based Quantum Neural Networks

Abstract

Several architectures have been proposed for quantum neural networks (QNNs), with the goal of efficiently performing machine learning tasks on quantum data. Rigorous scaling results are urgently needed for specific QNN constructions to understand which, if any, will be trainable at a large scale. Here, we analyze the gradient scaling (and hence the trainability) for a recently proposed architecture that we called dissipative QNNs (DQNNs), where the input qubits of each layer are discarded at the layer's output. We find that DQNNs can exhibit barren plateaus, i.e., gradients that vanish exponentially in the number of qubits. Moreover, we provide quantitative bounds on the scaling of the gradient for DQNNs under different conditions, such as different cost functions and circuit depths, and show that trainability is not always guaranteed.

arXiv comment5 + 21 pages, 3+2 figures, final version accepted for publication in Physical Review Letters

References in corpus (48)

• Quantum Computing in the NISQ era and beyond
• Quantum Machine Learning
• A variational eigenvalue solver on a quantum processor
• Hardware-efficient Variational Quantum Eigensolver for Small Molecules and Quantum Magnets
• Supervised learning with quantum enhanced feature spaces
• Barren plateaus in quantum neural network training landscapes
• The theory of variational hybrid quantum-classical algorithms
• Quantum Circuit Learning
• Quantum Convolutional Neural Networks
• Predicting Many Properties of a Quantum System from Very Few Measurements
• Cost Function Dependent Barren Plateaus in Shallow Parametrized Quantum Circuits
• Evaluating analytic gradients on quantum hardware
• The power of quantum neural networks
• Noise-Induced Barren Plateaus in Variational Quantum Algorithms
• Efficient Learning for Deep Quantum Neural Networks
• Exact and Approximate Unitary 2-Designs: Constructions and Applications
• The quest for a Quantum Neural Network
• Quantum machine learning: a classical perspective
• Quantum autoencoders for efficient compression of quantum data
• Quantum Natural Gradient
• Theory of variational quantum simulation
• Continuous-variable quantum neural networks
• An initialization strategy for addressing barren plateaus in parametrized quantum circuits
• Quantum-assisted quantum compiling
• Absence of Barren Plateaus in Quantum Convolutional Neural Networks
• Local random quantum circuits are approximate polynomial-designs
• The Expressive Power of Parameterized Quantum Circuits
• An Artificial Neuron Implemented on an Actual Quantum Processor
• Variational quantum algorithms for discovering Hamiltonian spectra
• Hybrid quantum-classical approach to correlated materials
• Variational Fast Forwarding for Quantum Simulation Beyond the Coherence Time
• Variational Quantum State Diagonalization
• Noise Resilience of Variational Quantum Compiling
• Variational algorithms for linear algebra
• Large gradients via correlation in random parameterized quantum circuits
• Entanglement Devised Barren Plateau Mitigation
• Quantum autoencoders to denoise quantum data
• An Adaptive Optimizer for Measurement-Frugal Variational Algorithms
• Variational Quantum Fidelity Estimation
• Quantum Neural Network States: A Brief Review of Methods and Applications
• Unitary quantum perceptron as efficient universal approximator
• Analyzing the barren plateau phenomenon in training quantum neural networks with the ZX-calculus
• Symbolic integration with respect to the Haar measure on the unitary group
• Reformulation of the No-Free-Lunch Theorem for Entangled Data Sets
• Variational Consistent Histories as a Hybrid Algorithm for Quantum Foundations
• Reinforcement Learning for Digital Quantum Simulation
• A Quantum Model for Autonomous Learning Automata
• RTNI - A symbolic integrator for Haar-random tensor networks

Cited by in corpus (87)

• Cost Function Dependent Barren Plateaus in Shallow Parametrized Quantum Circuits
• The Variational Quantum Eigensolver: a review of methods and best practices
• Challenges and Opportunities in Quantum Machine Learning
• Generalization in quantum machine learning from few training data
• Diagnosing Barren Plateaus with Tools from Quantum Optimal Control
• Barren Plateaus in Variational Quantum Computing
• Quantum Computing for High-Energy Physics: State of the Art and Challenges. Summary of the QC4HEP Working Group
• Theory of overparametrization in quantum neural networks
• Group-Invariant Quantum Machine Learning
• Equivalence of quantum barren plateaus to cost concentration and narrow gorges
• A Lie Algebraic Theory of Barren Plateaus for Deep Parameterized Quantum Circuits
• Variational Quantum State Eigensolver
• Higher Order Derivatives of Quantum Neural Networks with Barren Plateaus
• Quantum computing models for artificial neural networks
• Theory for Equivariant Quantum Neural Networks
• Quantum Methods for Neural Networks and Application to Medical Image Classification
• A comprehensive review of Quantum Machine Learning: from NISQ to Fault Tolerance
• Theoretical Guarantees for Permutation-Equivariant Quantum Neural Networks
• Layer VQE: A Variational Approach for Combinatorial Optimization on Noisy Quantum Computers
• Does provable absence of barren plateaus imply classical simulability?
• Understanding quantum machine learning also requires rethinking generalization
• Quantum Neural Network for Quantum Neural Computing
• On the practical usefulness of the Hardware Efficient Ansatz
• Variational Quantum Singular Value Decomposition
• Learning quantum data with the quantum Earth Mover's distance
• Subtleties in the trainability of quantum machine learning models
• Reformulation of the No-Free-Lunch Theorem for Entangled Data Sets
• Analytic theory for the dynamics of wide quantum neural networks
• Building spatial symmetries into parameterized quantum circuits for faster training
• The Presence and Absence of Barren Plateaus in Tensor-network Based Machine Learning
• Quantum Machine Learning for Finance
• Toward Trainability of Quantum Neural Networks
• Trainability barriers and opportunities in quantum generative modeling
• Quantum Phase Recognition via Quantum Kernel Methods
• Quantum Error Correction with Quantum Autoencoders
• Medical image classification via quantum neural networks
• Trainability Enhancement of Parameterized Quantum Circuits via Reduced-Domain Parameter Initialization
• Variational Quantum Classifiers Through the Lens of the Hessian
• Dynamical simulation via quantum machine learning with provable generalization
• A semi-agnostic ansatz with variable structure for quantum machine learning
• Non-trivial symmetries in quantum landscapes and their resilience to quantum noise
• Noisy intermediate-scale quantum algorithm for semidefinite programming
• Generalized Quantum Assisted Simulator
• Quantum Mixed State Compiling
• On fundamental aspects of quantum extreme learning machines
• Quantum Capsule Networks
• Variational quantum simulation: a case study for understanding warm starts
• Retrieving information from a black hole using quantum machine learning
• Learning shallow quantum circuits
• Tight and Efficient Gradient Bounds for Parameterized Quantum Circuits
• Training variational quantum algorithms with random gate activation
• The Quantum Path Kernel: a Generalized Quantum Neural Tangent Kernel for Deep Quantum Machine Learning
• Variational quantum algorithm for unconstrained black box binary optimization: Application to feature selection
• Efficient estimation of trainability for variational quantum circuits
• Inference-Based Quantum Sensing
• Isometric tensor network optimization for extensive Hamiltonians is free of barren plateaus
• The Unified Effect of Data Encoding, Ansatz Expressibility and Entanglement on the Trainability of HQNNs
• GSQAS: Graph Self-supervised Quantum Architecture Search
• Quantum algorithms for scientific computing
• Effects of quantum resources on the statistical complexity of quantum circuits
• Barren plateaus from learning scramblers with local cost functions
• Variational quantum state discriminator for supervised machine learning
• Mitigated barren plateaus in the time-nonlocal optimization of analog quantum-algorithm protocols
• Application of deep quantum neural networks to finance
• Using (1 + 1)D Quantum Cellular Automata for Exploring Collective Effects in Large Scale Quantum Neural Networks
• Resource frugal optimizer for quantum machine learning
• Barren plateaus are swamped with traps
• Absence of barren plateaus and scaling of gradients in the energy optimization of isometric tensor network states
• Adaptive shot allocation for fast convergence in variational quantum algorithms
• Quantum kernel learning Model constructed with small data
• Dissipative quantum many-body dynamics in (1+1)D quantum cellular automata and quantum neural networks
• Machine-Learning Insights into the Entanglement-trainability Correlation of Parameterized Quantum Circuits
• Efficient quantum-enhanced classical simulation for patches of quantum landscapes
• Quantum Extremal Learning
• Quadratic Quantum Speedup for Perceptron Training
• Non-linear classification capability of quantum neural networks due to emergent quantum metastability
• Learning Fourier series with parametrized quantum circuits
• Pitfalls when tackling the exponential concentration of parameterized quantum models
• Quantum Generative Training Using Rényi Divergences
• The Accuracy vs. Sampling Overhead Trade-off in Quantum Error Mitigation Using Monte Carlo-Based Channel Inversion
• Quantum Hopfield Model with Dilute Memories
• Batched Line Search Strategy for Navigating through Barren Plateaus in Quantum Circuit Training
• A general approach to quantum integration of cross sections in high-energy physics
• Adaptive Quantum Generative Training using an Unbounded Loss Function
• On quantum neural networks
• Encoding strongly-correlated many-boson wavefunctions on a photonic quantum computer: application to the attractive Bose-Hubbard model
• Mitigating Noise-Induced Gradient Vanishing in Variational Quantum Algorithm Training