Random Feature Models for Learning Interacting Dynamical Systems

Abstract

Particle dynamics and multi-agent systems provide accurate dynamical models for studying and forecasting the behavior of complex interacting systems. They often take the form of a high-dimensional system of differential equations parameterized by an interaction kernel that models the underlying attractive or repulsive forces between agents. We consider the problem of constructing a data-based approximation of the interacting forces directly from noisy observations of the paths of the agents in time. The learned interaction kernels are then used to predict the agents behavior over a longer time interval. The approximation developed in this work uses a randomized feature algorithm and a sparse randomized feature approach. Sparsity-promoting regression provides a mechanism for pruning the randomly generated features which was observed to be beneficial when one has limited data, in particular, leading to less overfitting than other approaches. In addition, imposing sparsity reduces the kernel evaluation cost which significantly lowers the simulation cost for forecasting the multi-agent systems. Our method is applied to various examples, including first-order systems with homogeneous and heterogeneous interactions, second order homogeneous systems, and a new sheep swarming system.

References in corpus (18)

• Discovering governing equations from data: Sparse identification of nonlinear dynamical systems
• Data-driven discovery of coordinates and governing equations
• Sparse identification of nonlinear dynamics for model predictive control in the low-data limit
• A new model for self-organized dynamics and its flocking behavior
• Weak SINDy For Partial Differential Equations
• Critical thresholds in flocking hydrodynamics\\with nonlocal alignment
• Dimensionality of Local Minimizers of the Interaction Energy
• Nonparametric inference of interaction laws in systems of agents from trajectory data
• Model selection for hybrid dynamical systems via sparse regression
• Phase Transitions in a kinetic flocking model of Cucker-Smale type
• SINDy-BVP: Sparse Identification of Nonlinear Dynamics for Boundary Value Problems
• Learning interaction kernels in heterogeneous systems of agents from multiple trajectories
• Generalization Bounds for Sparse Random Feature Expansions
• On the Equivalence between Kernel Quadrature Rules and Random Feature Expansions
• Flocking with short-range interactions
• HARFE: Hard-Ridge Random Feature Expansion
• Random Feature Models for Learning Interacting Dynamical Systems
• Learning interaction kernels in stochastic systems of interacting particles from multiple trajectories

Cited by in corpus (1)

• Random Feature Models for Learning Interacting Dynamical Systems