On Optimizing Hyperparameters for Quantum Neural Networks

Abstract

The increasing capabilities of Machine Learning (ML) models go hand in hand with an immense amount of data and computational power required for training. Therefore, training is usually outsourced into HPC facilities, where we have started to experience limits in scaling conventional HPC hardware, as theorized by Moore's law. Despite heavy parallelization and optimization efforts, current state-of-the-art ML models require weeks for training, which is associated with an enormous $C{O}_2$ footprint. Quantum Computing, and specifically Quantum Machine Learning (QML), can offer significant theoretical speed-ups and enhanced expressive power. However, training QML models requires tuning various hyperparameters, which is a nontrivial task and suboptimal choices can highly affect the trainability and performance of the models. In this study, we identify the most impactful hyperparameters and collect data about the performance of QML models. We compare different configurations and provide researchers with performance data and concrete suggestions for hyperparameter selection.

References in corpus (19)

• Quantum Computing in the NISQ era and beyond
• Variational Quantum Algorithms
• Supervised learning with quantum enhanced feature spaces
• Barren plateaus in quantum neural network training landscapes
• Cost Function Dependent Barren Plateaus in Shallow Parametrized Quantum Circuits
• From the Quantum Approximate Optimization Algorithm to a Quantum Alternating Operator Ansatz
• The effect of data encoding on the expressive power of variational quantum machine learning models
• Data re-uploading for a universal quantum classifier
• Connecting ansatz expressibility to gradient magnitudes and barren plateaus
• An initialization strategy for addressing barren plateaus in parametrized quantum circuits
• Exploring entanglement and optimization within the Hamiltonian Variational Ansatz
• Is quantum advantage the right goal for quantum machine learning?
• Benchmarking the Quantum Approximate Optimization Algorithm
• Performance comparison of optimization methods on variational quantum algorithms
• Hamiltonian variational ansatz without barren plateaus
• To quantum or not to quantum: towards algorithm selection in near-term quantum optimization
• A preprocessing perspective for quantum machine learning classification advantage using NISQ algorithms
• Hyperparameter Importance of Quantum Neural Networks Across Small Datasets
• Evaluating the Performance of Some Local Optimizers for Variational Quantum Classifiers