Tensor-decomposition-based A Priori Surrogate (TAPS) modeling for ultra large-scale simulations

Abstract

A data-free, predictive scientific AI model, Tensor-decomposition-based A Priori Surrogate (TAPS), is proposed for tackling ultra large-scale engineering simulations with significant speedup, memory savings, and storage gain. TAPS can effectively obtain surrogate models for high-dimensional parametric problems with equivalent zetta-scale ($10^{21}$) degrees of freedom (DoFs). TAPS achieves this by directly obtaining reduced-order models through solving governing equations with multiple independent variables such as spatial coordinates, parameters, and time. The paper first introduces an AI-enhanced finite element-type interpolation function called convolution hierarchical deep-learning neural network (C-HiDeNN) with tensor decomposition (TD). Subsequently, the generalized space-parameter-time Galerkin weak form and the corresponding matrix form are derived. Through the choice of TAPS hyperparameters, an arbitrary convergence rate can be achieved. To show the capabilities of this framework, TAPS is then used to simulate a large-scale additive manufacturing process as an example and achieves around 1,370x speedup, 14.8x memory savings, and 955x storage gain compared to the finite difference method with $3.46$ billion spatial degrees of freedom (DoFs). As a result, the TAPS framework opens a new avenue for many challenging ultra large-scale engineering problems, such as additive manufacturing and integrated circuit design, among others.

References in corpus (8)

• hp-VPINNs: Variational Physics-Informed Neural Networks With Domain Decomposition
• KAN: Kolmogorov-Arnold Networks
• JAX-FEM: A differentiable GPU-accelerated 3D finite element solver for automatic inverse design and mechanistic data science
• Sora: A Review on Background, Technology, Limitations, and Opportunities of Large Vision Models
• Weak baselines and reporting biases lead to overoptimism in machine learning for fluid-related partial differential equations
• HiDeNN-PGD: reduced-order hierarchical deep learning neural networks
• Separable Physics-Informed Neural Networks
• Interpolating neural network: A novel unification of machine learning and interpolation theory

Cited by in corpus (3)

• Finite Element Neural Network Interpolation. Part I: Interpretable and Adaptive Discretization for Solving PDEs
• Finite Element Neural Network Interpolation. Part II: Hybridisation with the Proper Generalised Decomposition for non-linear surrogate modelling
• Neural semi-Lagrangian method for high-dimensional advection-diffusion problems