Hyperparameter Importance of Quantum Neural Networks Across Small Datasets
arXiv:2206.09992 · doi:10.1007/978-3-031-18840-4_3
Abstract
As restricted quantum computers are slowly becoming a reality, the search for meaningful first applications intensifies. In this domain, one of the more investigated approaches is the use of a special type of quantum circuit - a so-called quantum neural network -- to serve as a basis for a machine learning model. Roughly speaking, as the name suggests, a quantum neural network can play a similar role to a neural network. However, specifically for applications in machine learning contexts, very little is known about suitable circuit architectures, or model hyperparameters one should use to achieve good learning performance. In this work, we apply the functional ANOVA framework to quantum neural networks to analyze which of the hyperparameters were most influential for their predictive performance. We analyze one of the most typically used quantum neural network architectures. We then apply this to open-source datasets from the OpenML-CC18 classification benchmark whose number of features is small enough to fit on quantum hardware with less than qubits. Three main levels of importance were detected from the ranking of hyperparameters obtained with functional ANOVA. Our experiment both confirmed expected patterns and revealed new insights. For instance, setting well the learning rate is deemed the most critical hyperparameter in terms of marginal contribution on all datasets, whereas the particular choice of entangling gates used is considered the least important except on one dataset. This work introduces new methodologies to study quantum machine learning models and provides new insights toward quantum model selection.
arXiv commentSubmitted to Discovery Science 2022
References in corpus (26)
- Adam: A Method for Stochastic Optimization
- Quantum Computing in the NISQ era and beyond
- Hardware-efficient Variational Quantum Eigensolver for Small Molecules and Quantum Magnets
- Supervised learning with quantum enhanced feature spaces
- A Quantum Approximate Optimization Algorithm
- Quantum Circuit Learning
- Parameterized quantum circuits as machine learning models
- Expressibility and entangling capability of parameterized quantum circuits for hybrid quantum-classical algorithms
- The effect of data encoding on the expressive power of variational quantum machine learning models
- Quantum optimization using variational algorithms on near-term quantum devices
- Data re-uploading for a universal quantum classifier
- A rigorous and robust quantum speed-up in supervised machine learning
- Quantum Generative Adversarial Networks for Learning and Loading Random Distributions
- Differentiable Learning of Quantum Circuit Born Machine
- Is quantum advantage the right goal for quantum machine learning?
- Hyperparameter Importance Across Datasets
- Quantum agents in the Gym: a variational quantum algorithm for deep Q-learning
- On the Quantum versus Classical Learnability of Discrete Distributions
- Quantum Machine Learning Framework for Virtual Screening in Drug Discovery: a Prospective Quantum Advantage
- QuantumNAT: Quantum Noise-Aware Training with Noise Injection, Quantization and Normalization
- To quantum or not to quantum: towards algorithm selection in near-term quantum optimization
- QOC: Quantum On-Chip Training with Parameter Shift and Gradient Pruning
- High Dimensional Quantum Machine Learning With Small Quantum Computers
- FLIP: A flexible initializer for arbitrarily-sized parametrized quantum circuits
- Binary classifiers for noisy datasets: a comparative study of existing quantum machine learning frameworks and some new approaches
- Unsupervised strategies for identifying optimal parameters in Quantum Approximate Optimization Algorithm