A Deep Learning approach to Reduced Order Modelling of Parameter Dependent Partial Differential Equations

Abstract

Within the framework of parameter dependent PDEs, we develop a constructive approach based on Deep Neural Networks for the efficient approximation of the parameter-to-solution map. The research is motivated by the limitations and drawbacks of state-of-the-art algorithms, such as the Reduced Basis method, when addressing problems that show a slow decay in the Kolmogorov n-width. Our work is based on the use of deep autoencoders, which we employ for encoding and decoding a high fidelity approximation of the solution manifold. To provide guidelines for the design of deep autoencoders, we consider a nonlinear version of the Kolmogorov n-width over which we base the concept of a minimal latent dimension. We show that the latter is intimately related to the topological properties of the solution manifold, and we provide theoretical results with particular emphasis on second order elliptic PDEs, characterizing the minimal dimension and the approximation errors of the proposed approach. The theory presented is further supported by numerical experiments, where we compare the proposed approach with classical POD-Galerkin reduced order models. In particular, we consider parametrized advection-diffusion PDEs, and we test the methodology in the presence of strong transport fields, singular terms and stochastic coefficients.

arXiv commentWe have included an additional theoretical result where we provide error estimates for the proposed approach (see Theorem 5)

References in corpus (11)

• Deep Learning in Neural Networks: An Overview
• DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operators
• Bayesian Deep Convolutional Encoder-Decoder Networks for Surrogate Modeling and Uncertainty Quantification
• Neural Ordinary Differential Equations
• On the convergence of physics informed neural networks for linear second-order elliptic and parabolic type PDEs
• Nonlinear Approximation and (Deep) ReLU Networks
• Embedding and knotting of manifolds in Euclidean spaces
• Approximation Capabilities of Neural ODEs and Invertible Residual Networks
• POD-DL-ROM: enhancing deep learning-based reduced order models for nonlinear parametrized PDEs by proper orthogonal decomposition
• Minimum Width for Universal Approximation
• On parameter identification problems for elliptic boundary value problems in divergence form, Part I: An abstract framework

Cited by in corpus (8)

• Reduced order modeling of parametrized systems through autoencoders and SINDy approach: continuation of periodic solutions
• Reduced Order Modeling with Shallow Recurrent Decoder Networks
• Real-time optimal control of high-dimensional parametrized systems by deep learning-based reduced order models
• Latent feedback control of distributed systems in multiple scenarios through deep learning-based reduced order models
• Meta-Auto-Decoder: A Meta-Learning Based Reduced Order Model for Solving Parametric Partial Differential Equations
• Learning reduced order models from data for hyperbolic PDEs
• Projection-based model-order reduction via graph autoencoders suited for unstructured meshes
• Latent Dynamics Graph Convolutional Networks for model order reduction of parameterized time-dependent PDEs