Alleviating Barren Plateaus in Parameterized Quantum Machine Learning Circuits: Investigating Advanced Parameter Initialization Strategies

Abstract

Parameterized quantum circuits (PQCs) have emerged as a foundational element in the development and applications of quantum algorithms. However, when initialized with random parameter values, PQCs often exhibit barren plateaus (BP). These plateaus, characterized by vanishing gradients with an increasing number of qubits, hinder optimization in quantum algorithms. In this paper, we analyze the impact of state-of-the-art parameter initialization strategies from classical machine learning in random PQCs from the aspect of BP phenomenon. Our investigation encompasses a spectrum of initialization techniques, including random, Xavier (both normal and uniform variants), He, LeCun, and Orthogonal methods. Empirical assessment reveals a pronounced reduction in variance decay of gradients across all these methodologies compared to the randomly initialized PQCs. Specifically, the Xavier initialization technique outperforms the rest, showing a 62\% improvement in variance decay compared to the random initialization. The He, Lecun, and orthogonal methods also display improvements, with respective enhancements of 32\%, 28\%, and 26\%. This compellingly suggests that the adoption of these existing initialization techniques holds the potential to significantly amplify the training efficacy of Quantum Neural Networks (QNNs), a subclass of PQCs. Demonstrating this effect, we employ the identified techniques to train QNNs for learning the identity function, effectively mitigating the adverse effects of BPs. The training performance, ranked from the best to the worst, aligns with the variance decay enhancement as outlined above. This paper underscores the role of tailored parameter initialization in mitigating the BP problem and eventually enhancing the training dynamics of QNNs.

References in corpus (18)

• Quantum Computing in the NISQ era and beyond
• Supplementary information for "Quantum supremacy using a programmable superconducting processor"
• Quantum Machine Learning
• Quantum computational advantage using photons
• Barren plateaus in quantum neural network training landscapes
• Noisy intermediate-scale quantum (NISQ) algorithms
• Strong quantum computational advantage using a superconducting quantum processor
• Parameterized quantum circuits as machine learning models
• Cost Function Dependent Barren Plateaus in Shallow Parametrized Quantum Circuits
• An initialization strategy for addressing barren plateaus in parametrized quantum circuits
• Quantum Error Correction: An Introductory Guide
• Layerwise learning for quantum neural networks
• Hierarchical quantum classifiers
• Avoiding local minima in variational quantum eigensolvers with the natural gradient optimizer
• Universal discriminative quantum neural networks
• ResQNets: A Residual Approach for Mitigating Barren Plateaus in Quantum Neural Networks
• Improving the speed of variational quantum algorithms for quantum error correction
• Towards Advantages of Parameterized Quantum Pulses

Cited by in corpus (6)

• Barren Plateaus in Variational Quantum Computing
• FedQNN: Federated Learning using Quantum Neural Networks
• Quantum Kernel Methods under Scrutiny: A Benchmarking Study
• Next-Generation Quantum Neural Networks: Enhancing Efficiency, Security, and Privacy
• Investigating the Effect of Noise on the Training Performance of Hybrid Quantum Neural Networks
• ResQuNNs: Towards Enabling Deep Learning in Quantum Convolution Neural Networks