Constructing coarse-scale bifurcation diagrams from spatio-temporal observations of microscopic simulations: A parsimonious machine learning approach

Abstract

We address a three-tier data-driven approach to solve the inverse problem in complex systems modelling from spatio-temporal data produced by microscopic simulators using machine learning. In the first step, we exploit manifold learning and in particular parsimonious Diffusion Maps using leave-one-out cross-validation (LOOCV) to both identify the intrinsic dimension of the manifold where the emergent dynamics evolve and for feature selection over the parametric space. In the second step, based on the selected features, we learn the right-hand-side of the effective partial differential equations (PDEs) using two machine learning schemes, namely shallow Feedforward Neural Networks (FNNs) with two hidden layers and single-layer Random Projection Networks(RPNNs) which basis functions are constructed using an appropriate random sampling approach. Finally, based on the learned black-box PDE model, we construct the corresponding bifurcation diagram, thus exploiting the numerical bifurcation analysis toolkit. For our illustrations, we implemented the proposed method to construct the one-parameter bifurcation diagram of the 1D FitzHugh-Nagumo PDEs from data generated by $D1Q3$ Lattice Boltzmann simulations. The proposed method was quite effective in terms of numerical accuracy regarding the construction of the coarse-scale bifurcation diagram. Furthermore, the proposed RPNN scheme was $\sim$ 20 to 30 times less costly regarding the training phase than the traditional shallow FNNs, thus arising as a promising alternative to deep learning for solving the inverse problem for high-dimensional PDEs.

References in corpus (3)

• Hidden Physics Models: Machine Learning of Nonlinear Partial Differential Equations
• Inferring solutions of differential equations using noisy multi-fidelity data
• Global and Local Reduced Models for Interacting, Heterogeneous Agents

Cited by in corpus (11)

• Data-driven Control of Agent-based Models: an Equation/Variable-free Machine Learning Approach
• RandONet: Shallow-Networks with Random Projections for learning linear and nonlinear operators
• Data-driven modelling of brain activity using neural networks, Diffusion Maps, and the Koopman operator
• Slow Invariant Manifolds of Singularly Perturbed Systems via Physics-Informed Machine Learning
• GoRINNs: Godunov-Riemann Informed Neural Networks for Learning Hyperbolic Conservation Laws
• Physics-agnostic and Physics-infused machine learning for thin films flows: modeling, and predictions from small data
• A physics-informed neural network method for the approximation of slow invariant manifolds for the general class of stiff systems of ODEs
• Adaptive Uncertainty-Guided Model Selection for Data-Driven PDE Discovery
• Learning the Latent dynamics of Fluid flows from High-Fidelity Numerical Simulations using Parsimonious Diffusion Maps
• Fredholm Neural Networks
• Machine Learning for the identification of phase-transitions in interacting agent-based systems: a Desai-Zwanzig example