Machine Learning and Computational Mathematics

Abstract

Neural network-based machine learning is capable of approximating functions in very high dimension with unprecedented efficiency and accuracy. This has opened up many exciting new possibilities, not just in traditional areas of artificial intelligence, but also in scientific computing and computational science. At the same time, machine learning has also acquired the reputation of being a set of "black box" type of tricks, without fundamental principles. This has been a real obstacle for making further progress in machine learning. In this article, we try to address the following two very important questions: (1) How machine learning has already impacted and will further impact computational mathematics, scientific computing and computational science? (2) How computational mathematics, particularly numerical analysis, {can} impact machine learning? We describe some of the most important progress that has been made on these issues. Our hope is to put things into a perspective that will help to integrate machine learning with computational mathematics.

Cited by in corpus (6)

• Advances of Machine Learning in Materials Science: Ideas and Techniques
• Port-metriplectic neural networks: thermodynamics-informed machine learning of complex physical systems
• A Triumvirate of AI Driven Theoretical Discovery
• Neural Control of Discrete Weak Formulations: Galerkin, Least-Squares and Minimal-Residual Methods with Quasi-Optimal Weights
• Leveraging Interpolation Models and Error Bounds for Verifiable Scientific Machine Learning
• Generalization Error Analysis of Neural networks with Gradient Based Regularization