Density Matrix Emulation of Quantum Recurrent Neural Networks for Multivariate Time Series Prediction

Abstract

Quantum Recurrent Neural Networks (QRNNs) are robust candidates for modelling and predicting future values in multivariate time series. However, the effective implementation of some QRNN models is limited by the need for mid-circuit measurements. Those increase the requirements for quantum hardware, which in the current NISQ era does not allow reliable computations. Emulation arises as the main near-term alternative to explore the potential of QRNNs, but existing quantum emulators are not dedicated to circuits with multiple intermediate measurements. In this context, we design a specific emulation method that relies on density matrix formalism. Using a compact tensor notation, we provide the mathematical formulation of the operator-sum representation involved. This allows us to show how the present and past information from a time series is transmitted through the circuit, and how to reduce the computational cost in every time step of the emulated network. In addition, we derive the analytical gradient and the Hessian of the network outputs with respect to its trainable parameters, which are needed when the outputs have stochastic noise due to hardware errors and a finite number of circuit shots (sampling). We finally test the presented methods using a hardware-efficient ansatz and four diverse datasets that include univariate and multivariate time series, with and without sampling noise. In addition, we compare the model with other existing quantum and classical approaches. Our results show how QRNNs can be trained with numerical and analytical gradients to make accurate predictions of future values by capturing non-trivial patterns of input series with different complexities.

19 pages, 8 figures

References in corpus (20)

• Deep Learning in Neural Networks: An Overview
• Quantum Machine Learning
• Variational Quantum Algorithms
• Barren plateaus in quantum neural network training landscapes
• A Quantum Engineer's Guide to Superconducting Qubits
• Quantum Circuit Learning
• Parameterized quantum circuits as machine learning models
• Cost Function Dependent Barren Plateaus in Shallow Parametrized Quantum Circuits
• Evaluating analytic gradients on quantum hardware
• The effect of data encoding on the expressive power of variational quantum machine learning models
• Data re-uploading for a universal quantum classifier
• Methodology for replacing indirect measurements with direct measurements
• Low-depth gradient measurements can improve convergence in variational hybrid quantum-classical algorithms
• Time Series Quantum Reservoir Computing with Weak and Projective Measurements
• Learning temporal data with variational quantum recurrent neural network
• Characterizing the loss landscape of variational quantum circuits
• Quantum Brain: A Recurrent Quantum Neural Network Model to Describe Eye Tracking of Moving Targets
• Path sampling of recurrent neural networks by incorporating known physics
• Multidimensional Fourier series with quantum circuits
• Rapid training of quantum recurrent neural networks

Cited by in corpus (2)

• Review of Distributed Quantum Computing. From single QPU to High Performance Quantum Computing
• Networked Quantum Services