A Heterogeneous Parallel Non-von Neumann Architecture System for Accurate and Efficient Machine Learning Molecular Dynamics

Abstract

This paper proposes a special-purpose system to achieve high-accuracy and high-efficiency machine learning (ML) molecular dynamics (MD) calculations. The system consists of field programmable gate array (FPGA) and application specific integrated circuit (ASIC) working in heterogeneous parallelization. To be specific, a multiplication-less neural network (NN) is deployed on the non-von Neumann (NvN)-based ASIC (SilTerra 180 nm process) to evaluate atomic forces, which is the most computationally expensive part of MD. All other calculations of MD are done using FPGA (Xilinx XC7Z100). It is shown that, to achieve similar-level accuracy, the proposed NvN-based system based on low-end fabrication technologies (180 nm) is 1.6x faster and 10^2-10^3x more energy efficiency than state-of-the-art vN based MLMD using graphics processing units (GPUs) based on much more advanced technologies (12 nm), indicating superiority of the proposed NvN-based heterogeneous parallel architecture.

References in corpus (13)

• The SIESTA method for ab initio order-N materials simulation
• Efficient index handling of multidimensional periodic boundary conditions
• TensorFlow: A system for large-scale machine learning
• Deep Potential Molecular Dynamics: a scalable model with the accuracy of quantum mechanics
• DeePMD-kit: A deep learning package for many-body potential energy representation and molecular dynamics
• Binarized Neural Networks: Training Deep Neural Networks with Weights and Activations Constrained to +1 or -1
• Deep Learning with Limited Numerical Precision
• PACT: Parameterized Clipping Activation for Quantized Neural Networks
• Machine-learning based interatomic potential for amorphous carbon
• Fixed Point Quantization of Deep Convolutional Networks
• Neural Network Based in Silico Simulation of Combustion Reactions
• Hellman-Feynman operator sampling in Diffusion Monte Carlo calculations
• Size and Temperature Transferability of Direct and Local Deep Neural Networks for Atomic Forces