Theoretical Guarantees for Permutation-Equivariant Quantum Neural Networks

Abstract

Despite the great promise of quantum machine learning models, there are several challenges one must overcome before unlocking their full potential. For instance, models based on quantum neural networks (QNNs) can suffer from excessive local minima and barren plateaus in their training landscapes. Recently, the nascent field of geometric quantum machine learning (GQML) has emerged as a potential solution to some of those issues. The key insight of GQML is that one should design architectures, such as equivariant QNNs, encoding the symmetries of the problem at hand. Here, we focus on problems with permutation symmetry (i.e., the group of symmetry $S_n$), and show how to build $S_n$-equivariant QNNs. We provide an analytical study of their performance, proving that they do not suffer from barren plateaus, quickly reach overparametrization, and generalize well from small amounts of data. To verify our results, we perform numerical simulations for a graph state classification task. Our work provides the first theoretical guarantees for equivariant QNNs, thus indicating the extreme power and potential of GQML.

arXiv comment15+21 pages, 5 + 5 figures. Prior generalization bounds replaced with more general theorem. Comments added about hardness of simulation and narrow gorges

References in corpus (83)

• Quantum entanglement
• Quantum Machine Learning
• A variational eigenvalue solver on a quantum processor
• Variational Quantum Algorithms
• Hardware-efficient Variational Quantum Eigensolver for Small Molecules and Quantum Magnets
• Supervised learning with quantum enhanced feature spaces
• Barren plateaus in quantum neural network training landscapes
• Noisy intermediate-scale quantum (NISQ) algorithms
• Measurement-based quantum computation with cluster states
• Quantum Convolutional Neural Networks
• An introduction to quantum machine learning
• Cost Function Dependent Barren Plateaus in Shallow Parametrized Quantum Circuits
• Multi-party entanglement in graph states
• The power of quantum neural networks
• Expressibility and entangling capability of parameterized quantum circuits for hybrid quantum-classical algorithms
• Noise-Induced Barren Plateaus in Variational Quantum Algorithms
• From the Quantum Approximate Optimization Algorithm to a Quantum Alternating Operator Ansatz
• Challenges and Opportunities in Quantum Machine Learning
• Data re-uploading for a universal quantum classifier
• Connecting ansatz expressibility to gradient magnitudes and barren plateaus
• Demonstration of the trapped-ion quantum-CCD computer architecture
• Tensor field networks: Rotation- and translation-equivariant neural networks for 3D point clouds
• Quantum generative adversarial networks
• Generalization in quantum machine learning from few training data
• SchNet: A continuous-filter convolutional neural network for modeling quantum interactions
• Training variational quantum algorithms is NP-hard
• qubit-ADAPT-VQE: An adaptive algorithm for constructing hardware-efficient ansatze on a quantum processor
• An initialization strategy for addressing barren plateaus in parametrized quantum circuits
• A generative modeling approach for benchmarking and training shallow quantum circuits
• Absence of Barren Plateaus in Quantum Convolutional Neural Networks
• Layerwise learning for quantum neural networks
• Distributed quantum sensing in a continuous variable entangled network
• Entanglement-Enhanced Optical Atomic Clock
• Learning the quantum algorithm for state overlap
• Provably efficient machine learning for quantum many-body problems
• Exploring entanglement and optimization within the Hamiltonian Variational Ansatz
• Beyond Barren Plateaus: Quantum Variational Algorithms Are Swamped With Traps
• Diagnosing Barren Plateaus with Tools from Quantum Optimal Control
• Unsupervised Machine Learning on a Hybrid Quantum Computer
• Optimal metrology with programmable quantum sensors
• Quantum agents in the Gym: a variational quantum algorithm for deep Q-learning
• Exploiting symmetry in variational quantum machine learning
• Experimental quantum speed-up in reinforcement learning agents
• Trainability of Dissipative Perceptron-Based Quantum Neural Networks
• Theory of overparametrization in quantum neural networks
• Group-Invariant Quantum Machine Learning
• Generalization in Quantum Machine Learning: a Quantum Information Perspective
• Equivalence of quantum barren plateaus to cost concentration and narrow gorges
• Entanglement Devised Barren Plateau Mitigation
• Variational Quantum State Eigensolver
• Barren plateaus preclude learning scramblers
• Higher Order Derivatives of Quantum Neural Networks with Barren Plateaus
• Avoiding barren plateaus using classical shadows
• Efficient measure for the expressivity of variational quantum algorithms
• Fisher Information in Noisy Intermediate-Scale Quantum Applications
• On barren plateaus and cost function locality in variational quantum algorithms
• Sampling using $SU(N)$ gauge equivariant flows
• Expressibility of the alternating layered ansatz for quantum computation
• Efficient Arbitrary Simultaneously Entangling Gates on a trapped-ion quantum computer
• ADAPT-VQE is insensitive to rough parameter landscapes and barren plateaus
• Symmetry Principles in Quantum Systems Theory
• Representation Learning via Quantum Neural Tangent Kernels
• Out-of-distribution generalization for learning quantum dynamics
• Computable and operationally meaningful multipartite entanglement measures
• Lorentz Group Equivariant Neural Network for Particle Physics
• Subtleties in the trainability of quantum machine learning models
• Avoiding barren plateaus via transferability of smooth solutions in Hamiltonian Variational Ansatz
• Analytic theory for the dynamics of wide quantum neural networks
• Building spatial symmetries into parameterized quantum circuits for faster training
• The Presence and Absence of Barren Plateaus in Tensor-network Based Machine Learning
• Speeding up Learning Quantum States through Group Equivariant Convolutional Quantum Ansätze
• Avoiding Barren Plateaus with Classical Deep Neural Networks
• Mitigating Barren Plateaus with Transfer-learning-inspired Parameter Initializations
• Non-trivial symmetries in quantum landscapes and their resilience to quantum noise
• Representation Theory for Geometric Quantum Machine Learning
• Efficient classical algorithms for simulating symmetric quantum systems
• Exploiting Landscape Geometry to Enhance Quantum Optimal Control
• Quantum Computational Phase Transition in Combinatorial Problems
• Controllability of Symmetric Spin Networks
• Inference-Based Quantum Sensing
• FLIP: A flexible initializer for arbitrarily-sized parametrized quantum circuits
• Navigating on Quantum Control Solution Subspaces
• Symmetry Group Equivariant Architectures for Physics

Cited by in corpus (53)

• Barren Plateaus in Variational Quantum Computing
• A Lie Algebraic Theory of Barren Plateaus for Deep Parameterized Quantum Circuits
• Theory for Equivariant Quantum Neural Networks
• Does provable absence of barren plateaus imply classical simulability?
• Understanding quantum machine learning also requires rethinking generalization
• On the practical usefulness of the Hardware Efficient Ansatz
• Trainability barriers and opportunities in quantum generative modeling
• Provably Trainable Rotationally Equivariant Quantum Machine Learning
• Towards quantum computing for clinical trial design and optimization: A perspective on new opportunities and challenges
• Classification of dynamical Lie algebras for translation-invariant 2-local spin systems in one dimension
• Drastic Circuit Depth Reductions with Preserved Adversarial Robustness by Approximate Encoding for Quantum Machine Learning
• Tight and Efficient Gradient Bounds for Parameterized Quantum Circuits
• Effects of noise on the overparametrization of quantum neural networks
• Generalization of Quantum Machine Learning Models Using Quantum Fisher Information Metric
• Quantum Convolutional Neural Networks are Effectively Classically Simulable
• Lie-algebraic classical simulations for quantum computing
• Symmetry breaking in geometric quantum machine learning in the presence of noise
• On the universality of $S_n$-equivariant $k$-body gates
• VQC-Based Reinforcement Learning with Data Re-uploading: Performance and Trainability
• Non-Unitary Quantum Machine Learning
• The role of data embedding in equivariant quantum convolutional neural networks
• Reinforcement learning-based architecture search for quantum machine learning
• Splitting and Parallelizing of Quantum Convolutional Neural Networks for Learning Translationally Symmetric Data
• Symmetry-invariant quantum machine learning force fields
• Unitary Designs of Symmetric Local Random Circuits
• Variational-quantum-eigensolver-inspired optimization for spin-chain work extraction
• Image Classification with Rotation-Invariant Variational Quantum Circuits
• Adversarial Robustness Guarantees for Quantum Classifiers
• The power and limitations of learning quantum dynamics incoherently
• Variational quantum computing for quantum simulation: principles, implementations, and challenges
• SnCQA: A hardware-efficient equivariant quantum convolutional circuit architecture
• Analyzing the quantum approximate optimization algorithm: ansätze, symmetries, and Lie algebras
• Gradients and frequency profiles of quantum re-uploading models
• Trade-off between Gradient Measurement Efficiency and Expressivity in Deep Quantum Neural Networks
• All you need is spin: SU(2) equivariant variational quantum circuits based on spin networks
• Permutation-equivariant quantum convolutional neural networks
• Backpropagation scaling in parameterised quantum circuits
• High-fidelity dimer excitations using quantum hardware
• Pitfalls when tackling the exponential concentration of parameterized quantum models
• Architectures and random properties of symplectic quantum circuits
• Measurement-based quantum machine learning
• Towards Improved Quantum Machine Learning for Molecular Force Fields
• A quantum tug of war between randomness and symmetries on homogeneous spaces
• Analyzing the free states of one quantum resource theory as resource states of another
• Quantum Active Learning
• Efficient Online Quantum Circuit Learning with No Upfront Training
• Scaling of symmetry-restricted quantum circuits
• Quantum-Enhanced Neural Exchange-Correlation Functionals
• Learning complexity gradually in quantum machine learning models
• Equivalence between exponential concentration in quantum machine learning kernels and barren plateaus in variational algorithms
• LArTPC hit-based topology classification with quantum machine learning and symmetry
• TabularQGAN: A quantum generative model for tabular data synthesis
• Data Efficient Prediction of excited-state properties using Quantum Neural Networks