Estimating the gradient and higher-order derivatives on quantum hardware

Abstract

For a large class of variational quantum circuits, we show how arbitrary-order derivatives can be analytically evaluated in terms of simple parameter-shift rules, i.e., by running the same circuit with different shifts of the parameters. As particular cases, we obtain parameter-shift rules for the Hessian of an expectation value and for the metric tensor of a variational state, both of which can be efficiently used to analytically implement second-order optimization algorithms on a quantum computer. We also consider the impact of statistical noise by studying the mean squared error of different derivative estimators. In the second part of this work, some of the theoretical techniques for evaluating quantum derivatives are applied to their typical use case: the implementation of quantum optimizers. We find that the performance of different estimators and optimizers is intertwined with the values of different hyperparameters, such as a step size or a number of shots. Our findings are supported by several numerical and hardware experiments, including an experimental estimation of the Hessian of a simple variational circuit and an implementation of the Newton optimizer.

arXiv commentSource code for the numerics in this paper can be found at https://github.com/XanaduAI/derivatives-of-variational-circuits (v2) updated Fubini-Study metric definition and corrected typo in resulting equations

References in corpus (27)

• A variational eigenvalue solver on a quantum processor
• Hardware-efficient Variational Quantum Eigensolver for Small Molecules and Quantum Magnets
• Barren plateaus in quantum neural network training landscapes
• The theory of variational hybrid quantum-classical algorithms
• A Quantum Approximate Optimization Algorithm
• Quantum Circuit Learning
• Parameterized quantum circuits as machine learning models
• Evaluating analytic gradients on quantum hardware
• Circuit-centric quantum classifiers
• Expressibility and entangling capability of parameterized quantum circuits for hybrid quantum-classical algorithms
• Quantum Fisher information matrix and multiparameter estimation
• Variational ansatz-based quantum simulation of imaginary time evolution
• Quantum Natural Gradient
• Continuous-variable quantum neural networks
• Hybrid Quantum-Classical Approach to Quantum Optimal Control
• Opportunities and challenges for quantum-assisted machine learning in near-term quantum computers
• PennyLane: Automatic differentiation of hybrid quantum-classical computations
• Stochastic gradient descent for hybrid quantum-classical optimization
• Avoiding local minima in variational quantum eigensolvers with the natural gradient optimizer
• Methodology for replacing indirect measurements with direct measurements
• Yao.jl: Extensible, Efficient Framework for Quantum Algorithm Design
• An Adaptive Optimizer for Measurement-Frugal Variational Algorithms
• Gradients of parameterized quantum gates using the parameter-shift rule and gate decomposition
• Theory of analytical energy derivatives for the variational quantum eigensolver
• Measurement cost of metric-aware variational quantum algorithms
• Operator Sampling for Shot-frugal Optimization in Variational Algorithms
• Quantum Geometric Tensor (Fubini-Study Metric) in Simple Quantum System: A pedagogical Introduction

Cited by in corpus (72)

• Variational Quantum Algorithms
• Training variational quantum algorithms is NP-hard
• General parameter-shift rules for quantum gradients
• Is quantum advantage the right goal for quantum machine learning?
• Solving nonlinear differential equations with differentiable quantum circuits
• Capacity and quantum geometry of parametrized quantum circuits
• Higher Order Derivatives of Quantum Neural Networks with Barren Plateaus
• Filtering variational quantum algorithms for combinatorial optimization
• Adaptive Variational Quantum Dynamics Simulations
• Fisher Information in Noisy Intermediate-Scale Quantum Applications
• An efficient quantum algorithm for the time evolution of parameterized circuits
• Scalable measures of magic resource for quantum computers
• Simultaneous Perturbation Stochastic Approximation of the Quantum Fisher Information
• Quantum Machine Learning: from physics to software engineering
• Recent advances for quantum classifiers
• Adaptive Variational Quantum Imaginary Time Evolution Approach for Ground State Preparation
• Analyzing the barren plateau phenomenon in training quantum neural networks with the ZX-calculus
• Universal quantum circuits for quantum chemistry
• Multicore Quantum Computing
• Analytic gradients in variational quantum algorithms: Algebraic extensions of the parameter-shift rule to general unitary transformations
• Generalized quantum circuit differentiation rules
• Quantum Neural Network Classifiers: A Tutorial
• Analytical nonadiabatic couplings and gradients within the state-averaged orbital-optimized variational quantum eigensolver
• Non-trivial symmetries in quantum landscapes and their resilience to quantum noise
• Training variational quantum circuits with CoVaR: covariance root finding with classical shadows
• Optimal training of variational quantum algorithms without barren plateaus
• Variational quantum algorithm for unconstrained black box binary optimization: Application to feature selection
• Generalization of Quantum Machine Learning Models Using Quantum Fisher Information Metric
• Comparative study of adaptive variational quantum eigensolvers for multi-orbital impurity models
• Here comes the SU(N): multivariate quantum gates and gradients
• Quantum Quantile Mechanics: Solving Stochastic Differential Equations for Generating Time-Series
• Hessian-based toolbox for reliable and interpretable machine learning in physics
• FLIP: A flexible initializer for arbitrarily-sized parametrized quantum circuits
• Quantum Chemistry Calculations using Energy Derivatives on Quantum Computers
• Single-component gradient rules for variational quantum algorithms
• Adaptive projected variational quantum dynamics
• Measurement-induced entanglement phase transitions in variational quantum circuits
• Stochastic approach for quantum metrology with generic Hamiltonians
• Multi-variable integration with a variational quantum circuit
• Characterization of a Transmon Qubit in a 3D Cavity for Quantum Machine Learning and Photon Counting
• Accelerating quantum imaginary-time evolution with random measurements
• Performance of Particle Tracking Using a Quantum Graph Neural Network
• Experimental quantum natural gradient optimization in photonics
• Information flow in parameterized quantum circuits
• Practical quantum simulation of small-scale non-Hermitian dynamics
• Local, Expressive, Quantum-Number-Preserving VQE Ansatze for Fermionic Systems
• Quantum gradient evaluation through quantum non-demolition measurements
• Random Natural Gradient
• Analytical Ground- and Excited-State Gradients for Molecular Electronic Structure Theory from Hybrid Quantum/Classical Methods
• Using gradient-based algorithms to determine ground state energies on a quantum computer
• Quantum techniques for eigenvalue problems
• SpinQ Gemini: a desktop quantum computer for education and research
• Universal noise-precision relations in variational quantum algorithms
• Iteration Complexity of Variational Quantum Algorithms
• Quantum computing fidelity susceptibility using automatic differentiation
• Quantum Natural Gradient with Geodesic Corrections for Small Shallow Quantum Circuits
• Sequence of penalties method to study excited states using VQE
• Noise-aware variational eigensolvers: a dissipative route for lattice gauge theories
• Estimation of Quantum Fisher Information via Stein's Identity in Variational Quantum Algorithms
• Probing many-body Bell correlation depth with superconducting qubits
• Addition and Differentiation of ZX-diagrams
• Optimized numerical gradient and Hessian estimation for variational quantum algorithms
• Adiabatic quantum computing with parameterized quantum circuits
• Modified Conjugate Quantum Natural Gradient
• Hybrid Quantum Classical Graph Neural Networks for Particle Track Reconstruction
• Determining probability density functions with adiabatic quantum computing
• Efficient Estimation and Sequential Optimization of Cost Functions in Variational Quantum Algorithms
• Robustness of optimized numerical estimation schemes for noisy variational quantum algorithms
• Extended parameter shift rules with minimal derivative variance for parameterized quantum circuits
• Interpolation-based coordinate descent method for parameterized quantum circuits
• Mode connectivity in the QCBM loss landscape
• Optimizing Quantum Variational Circuits with Deep Reinforcement Learning