Consensus-Based Optimization on Hypersurfaces: Well-Posedness and Mean-Field Limit

Abstract

We introduce a new stochastic differential model for global optimization of nonconvex functions on compact hypersurfaces. The model is inspired by the stochastic Kuramoto-Vicsek system and belongs to the class of Consensus-Based Optimization methods. In fact, particles move on the hypersurface driven by a drift towards an instantaneous consensus point, computed as a convex combination of the particle locations weighted by the cost function according to Laplace's principle. The consensus point represents an approximation to a global minimizer. The dynamics is further perturbed by a random vector field to favor exploration, whose variance is a function of the distance of the particles to the consensus point. In particular, as soon as the consensus is reached, then the stochastic component vanishes. In this paper, we study the well-posedness of the model and we derive rigorously its mean-field approximation for large particle limit.

References in corpus (1)

• Novel type of phase transition in a system of self-driven particles

Cited by in corpus (17)

• Propagation of chaos: a review of models, methods and applications. II. Applications
• On the Global Convergence of Particle Swarm Optimization Methods
• On the mean-field limit for the consensus-based optimization
• Consensus-Based Optimization Methods Converge Globally
• Consensus based optimization via jump-diffusion stochastic differential equations
• Binary interaction methods for high dimensional global optimization and machine learning
• Consensus-Based Optimization for Saddle Point Problems
• Leveraging Memory Effects and Gradient Information in Consensus-Based Optimization: On Global Convergence in Mean-Field Law
• Polarized consensus-based dynamics for optimization and sampling
• Mean-field limits for Consensus-Based Optimization and Sampling
• Consensus based optimization with memory effects: random selection and applications
• Self-interacting CBO: Existence, uniqueness, and long-time convergence
• Consensus-Based Optimization with Truncated Noise
• Regularising orientation estimation in Cryo-EM 3D map refinement through measure-based lifting over Riemannian manifolds
• MirrorCBO: A consensus-based optimization method in the spirit of mirror descent
• Micro-Macro Decomposition of Particle Swarm Optimization Methods
• Swarm-based optimization with jumps: a kinetic BGK framework and convergence analysis