Hierarchical deep learning-based adaptive time-stepping scheme for multiscale simulations

Abstract

Multiscale is a hallmark feature of complex nonlinear systems. While the simulation using the classical numerical methods is restricted by the local \textit{Taylor} series constraints, the multiscale techniques are often limited by finding heuristic closures. This study proposes a new method for simulating multiscale problems using deep neural networks. By leveraging the hierarchical learning of neural network time steppers, the method adapts time steps to approximate dynamical system flow maps across timescales. This approach achieves state-of-the-art performance in less computational time compared to fixed-step neural network solvers. The proposed method is demonstrated on several nonlinear dynamical systems, and source codes are provided for implementation. This method has the potential to benefit multiscale analysis of complex systems and encourage further investigation in this area.

References in corpus (20)

• Adam: A Method for Stochastic Optimization
• Discovering governing equations from data: Sparse identification of nonlinear dynamical systems
• Integrating Machine Learning and Multiscale Modeling: Perspectives, Challenges, and Opportunities in the Biological, Biomedical, and Behavioral Sciences
• Using Machine Learning to Replicate Chaotic Attractors and Calculate Lyapunov Exponents from Data
• Chaos as an Intermittently Forced Linear System
• Enhancing Computational Fluid Dynamics with Machine Learning
• VAMPnets: Deep learning of molecular kinetics
• Time-lagged autoencoders: Deep learning of slow collective variables for molecular kinetics
• Attractor Reconstruction by Machine Learning
• Data-Driven Forecasting of High-Dimensional Chaotic Systems with Long Short-Term Memory Networks
• Data Driven Governing Equations Approximation Using Deep Neural Networks
• Convolutional neural network and long short-term memory based reduced order surrogate for minimal turbulent channel flow
• Deep learning of dynamics and signal-noise decomposition with time-stepping constraints
• Discovery of Nonlinear Multiscale Systems: Sampling Strategies and Embeddings
• Non-intrusive and structure preserving multiscale integration of stiff ODEs, SDEs and Hamiltonian systems with hidden slow dynamics via flow averaging
• Optimized Sampling for Multiscale Dynamics
• Dynamic mode decomposition for multiscale nonlinear physics
• Time-series machine-learning error models for approximate solutions to parameterized dynamical systems
• Poincaré Maps for Multiscale Physics Discovery and Nonlinear Floquet Theory
• Sparse Identification of Slow Timescale Dynamics