Deep Learning in Deterministic Computational Mechanics

Abstract

The rapid growth of deep learning research, including within the field of computational mechanics, has resulted in an extensive and diverse body of literature. To help researchers identify key concepts and promising methodologies within this field, we provide an overview of deep learning in deterministic computational mechanics. Five main categories are identified and explored: simulation substitution, simulation enhancement, discretizations as neural networks, generative approaches, and deep reinforcement learning. This review focuses on deep learning methods rather than applications for computational mechanics, thereby enabling researchers to explore this field more effectively. As such, the review is not necessarily aimed at researchers with extensive knowledge of deep learning -- instead, the primary audience is researchers at the verge of entering this field or those who attempt to gain an overview of deep learning in computational mechanics. The discussed concepts are, therefore, explained as simple as possible.

References in corpus (142)

• Discovering governing equations from data: Sparse identification of nonlinear dynamical systems
• DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operators
• Machine Learning for Fluid Mechanics
• Deep Learning for Anomaly Detection: A Review
• Artificial Neural Networks for Solving Ordinary and Partial Differential Equations
• DGM: A deep learning algorithm for solving partial differential equations
• A Data-Driven Approximation of the Koopman Operator: Extending Dynamic Mode Decomposition
• Solving high-dimensional partial differential equations using deep learning
• Turbulence Modeling in the Age of Data
• Deep learning for universal linear embeddings of nonlinear dynamics
• Hidden Physics Models: Machine Learning of Nonlinear Partial Differential Equations
• Normalizing Flows: An Introduction and Review of Current Methods
• NSFnets (Navier-Stokes Flow nets): Physics-informed neural networks for the incompressible Navier-Stokes equations
• Adaptive activation functions accelerate convergence in deep and physics-informed neural networks
• Surrogate Modeling for Fluid Flows Based on Physics-Constrained Deep Learning Without Simulation Data
• Physics-Constrained Deep Learning for High-dimensional Surrogate Modeling and Uncertainty Quantification without Labeled Data
• Deep learning-based numerical methods for high-dimensional parabolic partial differential equations and backward stochastic differential equations
• Super-resolution reconstruction of turbulent flows with machine learning
• hp-VPINNs: Variational Physics-Informed Neural Networks With Domain Decomposition
• Informed Machine Learning -- A Taxonomy and Survey of Integrating Knowledge into Learning Systems
• A composite neural network that learns from multi-fidelity data: Application to function approximation and inverse PDE problems
• Gradient-enhanced physics-informed neural networks for forward and inverse PDE problems
• Physics-informed neural networks for inverse problems in nano-optics and metamaterials
• A unified deep artificial neural network approach to partial differential equations in complex geometries
• PPINN: Parareal Physics-Informed Neural Network for time-dependent PDEs
• Machine learning in cardiovascular flows modeling: Predicting arterial blood pressure from non-invasive 4D flow MRI data using physics-informed neural networks
• PhyGeoNet: Physics-Informed Geometry-Adaptive Convolutional Neural Networks for Solving Parameterized Steady-State PDEs on Irregular Domain
• Determinantal point processes for machine learning
• Deep Learning Methods for Reynolds-Averaged Navier-Stokes Simulations of Airfoil Flows
• Reconstruction of three-dimensional porous media using generative adversarial neural networks
• Artificial Neural Networks trained through Deep Reinforcement Learning discover control strategies for active flow control
• PDE-Net 2.0: Learning PDEs from Data with A Numeric-Symbolic Hybrid Deep Network
• Prediction of Aerodynamic Flow Fields Using Convolutional Neural Networks
• Learning data driven discretizations for partial differential equations
• Physics-Informed Multi-LSTM Networks for Metamodeling of Nonlinear Structures
• Deep Generative Design: Integration of Topology Optimization and Generative Models
• Extended dynamic mode decomposition with dictionary learning: a data-driven adaptive spectral decomposition of the Koopman operator
• Weak Adversarial Networks for High-dimensional Partial Differential Equations
• Physics-informed Neural Networks (PINNs) for Wave Propagation and Full Waveform Inversions
• SciANN: A Keras/Tensorflow wrapper for scientific computations and physics-informed deep learning using artificial neural networks
• A physics-informed variational DeepONet for predicting the crack path in brittle materials
• Thermodynamics-based Artificial Neural Networks for constitutive modeling
• Stable Architectures for Deep Neural Networks
• Deep-Learning Inversion of Seismic Data
• Wave Physics as an Analog Recurrent Neural Network
• CAN-PINN: A Fast Physics-Informed Neural Network Based on Coupled-Automatic-Numerical Differentiation Method
• Deep learning for determining a near-optimal topological design without any iteration
• Data-Driven Forecasting of High-Dimensional Chaotic Systems with Long Short-Term Memory Networks
• Flow over an espresso cup: Inferring 3D velocity and pressure fields from tomographic background oriented schlieren videos via physics-informed neural networks
• Modeling the Dynamics of PDE Systems with Physics-Constrained Deep Auto-Regressive Networks
• Efficient training of physics-informed neural networks via importance sampling
• A deep material network for multiscale topology learning and accelerated nonlinear modeling of heterogeneous materials
• Physics-Informed Neural Network for Modelling the Thermochemical Curing Process of Composite-Tool Systems During Manufacture
• Physics-informed graph neural Galerkin networks: A unified framework for solving PDE-governed forward and inverse problems
• Generating 3D structures from a 2D slice with GAN-based dimensionality expansion
• Machine learning based spatio-temporal super resolution reconstruction of turbulent flows
• Sub-grid modelling for two-dimensional turbulence using neural networks
• A new family of Constitutive Artificial Neural Networks towards automated model discovery
• A Physics Informed Neural Network for Time-Dependent Nonlinear and Higher Order Partial Differential Equations
• PhyCRNet: Physics-informed Convolutional-Recurrent Network for Solving Spatiotemporal PDEs
• Unsupervised discovery of interpretable hyperelastic constitutive laws
• Deep Fluids: A Generative Network for Parameterized Fluid Simulations
• Transfer learning based physics-informed neural networks for solving inverse problems in engineering structures under different loading scenarios
• Physics informed neural networks for continuum micromechanics
• Geometric deep learning for computational mechanics Part I: Anisotropic Hyperelasticity
• Local Extreme Learning Machines and Domain Decomposition for Solving Linear and Nonlinear Partial Differential Equations
• Data-assisted reduced-order modeling of extreme events in complex dynamical systems
• Topology optimization of 2D structures with nonlinearities using deep learning
• Accelerating Deep Reinforcement Learning strategies of Flow Control through a multi-environment approach
• DeepM&Mnet: Inferring the electroconvection multiphysics fields based on operator approximation by neural networks
• Exploring the 3D architectures of deep material network in data-driven multiscale mechanics
• On the use of Artificial Neural Networks in Topology Optimisation
• Stress Field Prediction in Cantilevered Structures Using Convolutional Neural Networks
• Learning Constitutive Relations from Indirect Observations Using Deep Neural Networks
• Integrating Deep Learning into CAD/CAE System: Generative Design and Evaluation of 3D Conceptual Wheel
• Multiscale modeling of inelastic materials with Thermodynamics-based Artificial Neural Networks (TANN)
• NN-EUCLID: deep-learning hyperelasticity without stress data
• Neural networks meet hyperelasticity: A guide to enforcing physics
• Automated discovery of generalized standard material models with EUCLID
• Physics-informed PointNet: A deep learning solver for steady-state incompressible flows and thermal fields on multiple sets of irregular geometries
• Data-driven discovery of PDEs in complex datasets
• Synchronised Swimming of Two Fish
• The Neural Particle Method -- An Updated Lagrangian Physics Informed Neural Network for Computational Fluid Dynamics
• Operator learning for predicting multiscale bubble growth dynamics
• Meta-modeling game for deriving theoretical-consistent, micro-structural-based traction-separation laws via deep reinforcement learning
• Discovering plasticity models without stress data
• Residual-based adaptivity for two-phase flow simulation in porous media using Physics-informed Neural Networks
• Generative Design by Reinforcement Learning: Enhancing the Diversity of Topology Optimization Designs
• FE${}^{\text{ANN}}$ $-$ An efficient data-driven multiscale approach based on physics-constrained neural networks and automated data mining
• Deep least-squares methods: an unsupervised learning-based numerical method for solving elliptic PDEs
• Accurate and Fast reconstruction of Porous Media from Extremely Limited Information Using Conditional Generative Adversarial Network
• Data-driven Tissue Mechanics with Polyconvex Neural Ordinary Differential Equations
• Interfacing Finite Elements with Deep Neural Operators for Fast Multiscale Modeling of Mechanics Problems
• Data-Driven Synthesis of Smoke Flows with CNN-based Feature Descriptors
• tempoGAN: A Temporally Coherent, Volumetric GAN for Super-resolution Fluid Flow
• IH-GAN: A Conditional Generative Model for Implicit Surface-Based Inverse Design of Cellular Structures
• Classifying vortex wakes using neural networks
• Denoising diffusion algorithm for inverse design of microstructures with fine-tuned nonlinear material properties
• FEA-Net: A Physics-guided Data-driven Model for Efficient Mechanical Response Prediction
• A Comparison of Neural Network Architectures for Data-Driven Reduced-Order Modeling
• Reduced order modeling of parametrized systems through autoencoders and SINDy approach: continuation of periodic solutions
• Deep learning-based reduced order models in cardiac electrophysiology
• Variational Physics Informed Neural Networks: the role of quadratures and test functions
• Integrated Finite Element Neural Network (I-FENN) for non-local continuum damage mechanics
• A comparative study on different neural network architectures to model inelasticity
• Constraint-Aware Neural Networks for Riemann Problems
• Recurrent Neural Networks (RNNs) with dimensionality reduction and break down in computational mechanics; application to multi-scale localization step
• Finite electro-elasticity with physics-augmented neural networks
• Graph neural networks for simulating crack coalescence and propagation in brittle materials
• Attention-Enhanced Neural Network Models for Turbulence Simulation
• Three-dimensional microstructure generation using generative adversarial neural networks in the context of continuum micromechanics
• ShipHullGAN: A generic parametric modeller for ship hull design using deep convolutional generative model
• HiDeNN-PGD: reduced-order hierarchical deep learning neural networks
• Automated identification of linear viscoelastic constitutive laws with EUCLID
• Deep energy method in topology optimization applications
• Data-driven anisotropic finite viscoelasticity using neural ordinary differential equations
• Simulating progressive intramural damage leading to aortic dissection using an operator-regression neural network
• Image-based material characterization of complex microarchitectured additively manufactured structures
• Predicting the Mechanical Properties of Biopolymer Gels Using Neural Networks Trained on Discrete Fiber Network Data
• Finite element interpolated neural networks for solving forward and inverse problems
• Numerical investigation of minimum drag profiles in laminar flow using deep learning surrogates
• On quadrature rules for solving Partial Differential Equations using Neural Networks
• MO-PaDGAN: Reparameterizing Engineering Designs for Augmented Multi-objective Optimization
• Deep learning for low frequency extrapolation of multicomponent data in elastic full waveform inversion
• RockGPT: Reconstructing three-dimensional digital rocks from single two-dimensional slice from the perspective of video generation
• On the Use of Neural Networks for Full Waveform Inversion
• An AI-Assisted Design Method for Topology Optimization Without Pre-Optimized Training Data
• Physics-Informed Neural Network Method for Parabolic Differential Equations with Sharply Perturbed Initial Conditions
• Quantitative reconstruction of defects in multi-layered bonded composites using fully convolutional network-based ultrasonic inversion
• Deep Recurrent Architectures for Seismic Tomography
• Numerical Approximation of Partial Differential Equations by a Variable Projection Method with Artificial Neural Networks
• Exponential Convergence of Deep Operator Networks for Elliptic Partial Differential Equations
• A deep learning driven pseudospectral PCE based FFT homogenization algorithm for complex microstructures
• Thermodynamics-informed neural networks for physically realistic mixed reality
• Application of machine learning to viscoplastic flow modeling
• GRIDS-Net: Inverse shape design and identification of scatterers via geometric regularization and physics-embedded deep learning
• A Multifidelity deep operator network approach to closure for multiscale systems
• Exponential ReLU Neural Network Approximation Rates for Point and Edge Singularities
• TopologyGAN: Topology Optimization Using Generative Adversarial Networks Based on Physical Fields Over the Initial Domain
• Transfer Learning Enhanced Full Waveform Inversion
• Two-scale analysis and design of spaceframes with complex additive manufactured nodes
• Automatic stabilization of finite-element simulations using neural networks and hierarchical matrices

Cited by in corpus (11)

• Combining physics-based and data-driven models: advancing the frontiers of research with Scientific Machine Learning
• Neural Networks for Generating Better Local Optima in Topology Optimization
• I-FENN with Temporal Convolutional Networks: expediting the load-history analysis of non-local gradient damage propagation
• Predictions of Transient Vector Solution Fields with Sequential Deep Operator Network
• Experimental Learning of a Hyperelastic Behavior with a Physics-Augmented Neural Network
• A hybrid electromechanical phase-field and deep learning framework for predicting fracture in dielectric nanocomposites
• Numerical simulation of transient heat conduction with moving heat source using Physics Informed Neural Networks
• Data Publishing in Mechanics and Dynamics: Challenges, Guidelines, and Examples from Engineering Design
• A Memory Efficient Adjoint Method to Enable Billion Parameter Optimization on a Single GPU in Dynamic Problems
• Enhancing material behavior discovery using embedding-oriented Physically-Guided Neural Networks with Internal Variables
• Trustworthy AI-based crack-tip segmentation using domain-guided explanations