Understanding ML driven HPC: Applications and Infrastructure

Abstract

We recently outlined the vision of "Learning Everywhere" which captures the possibility and impact of how learning methods and traditional HPC methods can be coupled together. A primary driver of such coupling is the promise that Machine Learning (ML) will give major performance improvements for traditional HPC simulations. Motivated by this potential, the ML around HPC class of integration is of particular significance. In a related follow-up paper, we provided an initial taxonomy for integrating learning around HPC methods. In this paper, which is part of the Learning Everywhere series, we discuss "how" learning methods and HPC simulations are being integrated to enhance effective performance of computations. This paper identifies several modes --- substitution, assimilation, and control, in which learning methods integrate with HPC simulations and provide representative applications in each mode. This paper discusses some open research questions and we hope will motivate and clear the ground for MLaroundHPC benchmarks.

arXiv commentInvited talk to "Visionary Track" at IEEE eScience 2019. arXiv admin note: text overlap with arXiv:1806.04731 by other authors

References in corpus (12)

• Practical Bayesian Optimization of Machine Learning Algorithms
• DGM: A deep learning algorithm for solving partial differential equations
• ANI-1: An extensible neural network potential with DFT accuracy at force field computational cost
• Solving high-dimensional partial differential equations using deep learning
• Deep learning to represent sub-grid processes in climate models
• Physics Informed Deep Learning (Part I): Data-driven Solutions of Nonlinear Partial Differential Equations
• Less is more: sampling chemical space with active learning
• Deep UQ: Learning deep neural network surrogate models for high dimensional uncertainty quantification
• Molecular enhanced sampling with autoencoders: On-the-fly collective variable discovery and accelerated free energy landscape exploration
• iMapD: intrinsic Map Dynamics exploration for uncharted effective free energy landscapes
• Boltzmann Generators -- Sampling Equilibrium States of Many-Body Systems with Deep Learning
• Adaptive ensemble simulations of biomolecules