Coarse-scale PDEs from fine-scale observations via machine learning

Abstract

Complex spatiotemporal dynamics of physicochemical processes are often modeled at a microscopic level (through e.g. atomistic, agent-based or lattice models) based on first principles. Some of these processes can also be successfully modeled at the macroscopic level using e.g. partial differential equations (PDEs) describing the evolution of the right few macroscopic observables (e.g. concentration and momentum fields). Deriving good macroscopic descriptions (the so-called "closure problem") is often a time-consuming process requiring deep understanding/intuition about the system of interest. Recent developments in data science provide alternative ways to effectively extract/learn accurate macroscopic descriptions approximating the underlying microscopic observations. In this paper, we introduce a data-driven framework for the identification of unavailable coarse-scale PDEs from microscopic observations via machine learning algorithms. Specifically, using Gaussian Processes, Artificial Neural Networks, and/or Diffusion Maps, the proposed framework uncovers the relation between the relevant macroscopic space fields and their time evolution (the right-hand-side of the explicitly unavailable macroscopic PDE). Interestingly, several choices equally representative of the data can be discovered. The framework will be illustrated through the data-driven discovery of macroscopic, concentration-level PDEs resulting from a fine-scale, Lattice Boltzmann level model of a reaction/transport process. Once the coarse evolution law is identified, it can be simulated to produce long-term macroscopic predictions. Different features (pros as well as cons) of alternative machine learning algorithms for performing this task (Gaussian Processes and Artificial Neural Networks), are presented and discussed.

References in corpus (5)

• Hidden Physics Models: Machine Learning of Nonlinear Partial Differential Equations
• Machine Learning of Linear Differential Equations using Gaussian Processes
• Learning data driven discretizations for partial differential equations
• Manifold learning for parameter reduction
• Linking Gaussian Process regression with data-driven manifold embeddings for nonlinear data fusion

Cited by in corpus (29)

• Variational Onsager Neural Networks (VONNs): A thermodynamics-based variational learning strategy for non-equilibrium PDEs
• Constructing coarse-scale bifurcation diagrams from spatio-temporal observations of microscopic simulations: A parsimonious machine learning approach
• Non-intrusive reduced-order models for parametric partial differential equations via data-driven operator inference
• Linking Machine Learning with Multiscale Numerics: Data-Driven Discovery of Homogenized Equations
• Parsimonious Physics-Informed Random Projection Neural Networks for Initial-Value Problems of ODEs and index-1 DAEs
• A Framework Based on Symbolic Regression Coupled with eXtended Physics-Informed Neural Networks for Gray-Box Learning of Equations of Motion from Data
• Time Series Forecasting Using Manifold Learning
• Data-driven Control of Agent-based Models: an Equation/Variable-free Machine Learning Approach
• Continuification-based control of large multiagent systems in a ring
• Learning the temporal evolution of multivariate densities via normalizing flows
• RandONet: Shallow-Networks with Random Projections for learning linear and nonlinear operators
• Data-driven modelling of brain activity using neural networks, Diffusion Maps, and the Koopman operator
• Extracting Stochastic Governing Laws by Nonlocal Kramers-Moyal Formulas
• Machine learning based data-driven discovery of nonlinear phase-field dynamics
• Interface learning in fluid dynamics: statistical inference of closures within micro-macro coupling models
• Slow Invariant Manifolds of Singularly Perturbed Systems via Physics-Informed Machine Learning
• Physics-agnostic and Physics-infused machine learning for thin films flows: modeling, and predictions from small data
• GoRINNs: Godunov-Riemann Informed Neural Networks for Learning Hyperbolic Conservation Laws
• Explicit physics-informed neural networks for non-linear upscaling closure: the case of transport in tissues
• Extreme learning machine collocation for the numerical solution of elliptic PDEs with sharp gradients
• Black and Gray Box Learning of Amplitude Equations: Application to Phase Field Systems
• Adaptive Uncertainty-Guided Model Selection for Data-Driven PDE Discovery
• A physics-informed neural network method for the approximation of slow invariant manifolds for the general class of stiff systems of ODEs
• Global and Local Reduced Models for Interacting, Heterogeneous Agents
• Learning the Latent dynamics of Fluid flows from High-Fidelity Numerical Simulations using Parsimonious Diffusion Maps
• Particles to Partial Differential Equations Parsimoniously
• Fredholm Neural Networks
• Manifold learning for coarse-graining atomistic simulations: Application to amorphous solids
• Interface Retaining Coarsening of Multiphase Flows