Training robust and generalizable quantum models
arXiv:2311.11871 · doi:10.1103/PhysRevResearch.6.043326
Abstract
Adversarial robustness and generalization are both crucial properties of reliable machine learning models. In this paper, we study these properties in the context of quantum machine learning based on Lipschitz bounds. We derive parameter-dependent Lipschitz bounds for quantum models with trainable encoding, showing that the norm of the data encoding has a crucial impact on the robustness against data perturbations. Further, we derive a bound on the generalization error which explicitly involves the parameters of the data encoding. Our theoretical findings give rise to a practical strategy for training robust and generalizable quantum models by regularizing the Lipschitz bound in the cost. Further, we show that, for fixed and non-trainable encodings, as those frequently employed in quantum machine learning, the Lipschitz bound cannot be influenced by tuning the parameters. Thus, trainable encodings are crucial for systematically adapting robustness and generalization during training. The practical implications of our theoretical findings are illustrated with numerical results.
References in corpus (10)
- Challenges and Opportunities in Quantum Machine Learning
- Quantum machine learning beyond kernel methods
- Experimental quantum adversarial learning with programmable superconducting qubits
- Towards quantum enhanced adversarial robustness in machine learning
- Understanding quantum machine learning also requires rethinking generalization
- Shadows of quantum machine learning
- Benchmarking Adversarially Robust Quantum Machine Learning at Scale
- Generalization despite overfitting in quantum machine learning models
- Let Quantum Neural Networks Choose Their Own Frequencies
- Robustness of quantum algorithms against coherent control errors
Cited by in corpus (6)
- Adversarial Robustness Guarantees for Quantum Classifiers
- Single-shot quantum machine learning
- Quantum Neural Networks in Practice: A Comparative Study with Classical Models from Standard Data Sets to Industrial Images
- QUACK: Quantum Aligned Centroid Kernel
- Detecting underdetermination in parameterized quantum circuits
- Hybrid quantum recurrent neural network for remaining useful life prediction of turbofan engines