Mean-field limit from general mixtures of experts to quantum neural networks

Abstract

In this work, we study the asymptotic behavior of Mixture of Experts (MoE) trained via gradient flow on supervised learning problems. Our main result establishes the propagation of chaos for a MoE as the number of experts diverges. We demonstrate that the corresponding empirical measure of their parameters is close to a probability measure that solves a nonlinear continuity equation, and we provide an explicit convergence rate that depends solely on the number of experts. We apply our results to a MoE generated by a quantum neural network.

References in corpus (11)

• Quantum Machine Learning
• Supervised learning with quantum enhanced feature spaces
• An introduction to quantum machine learning
• The effect of data encoding on the expressive power of variational quantum machine learning models
• A rigorous and robust quantum speed-up in supervised machine learning
• Wasserstein Distance based Deep Adversarial Transfer Learning for Intelligent Fault Diagnosis
• Learning quantum data with the quantum Earth Mover's distance
• Propagation of chaos: a review of models, methods and applications. II. Applications
• Trainability and Accuracy of Neural Networks: An Interacting Particle System Approach
• Trained quantum neural networks are Gaussian processes
• Quantitative convergence of trained quantum neural networks to a Gaussian process