FPGAs-as-a-Service Toolkit (FaaST)

Abstract

Computing needs for high energy physics are already intensive and are expected to increase drastically in the coming years. In this context, heterogeneous computing, specifically as-a-service computing, has the potential for significant gains over traditional computing models. Although previous studies and packages in the field of heterogeneous computing have focused on GPUs as accelerators, FPGAs are an extremely promising option as well. A series of workflows are developed to establish the performance capabilities of FPGAs as a service. Multiple different devices and a range of algorithms for use in high energy physics are studied. For a small, dense network, the throughput can be improved by an order of magnitude with respect to GPUs as a service. For large convolutional networks, the throughput is found to be comparable to GPUs as a service. This work represents the first open-source FPGAs-as-a-service toolkit.

arXiv comment10 pages, 7 figures, to appear in proceedings of the 2020 IEEE/ACM International Workshop on Heterogeneous High-performance Reconfigurable Computing

References in corpus (7)

• TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems
• Caffe: Convolutional Architecture for Fast Feature Embedding
• Deep Learning using Rectified Linear Units (ReLU)
• Fast inference of deep neural networks in FPGAs for particle physics
• The Machine Learning Landscape of Top Taggers
• FPGA-accelerated machine learning inference as a service for particle physics computing
• HEPCloud, a New Paradigm for HEP Facilities: CMS Amazon Web Services Investigation

Cited by in corpus (3)

• Applications and Techniques for Fast Machine Learning in Science
• MLPF: Efficient machine-learned particle-flow reconstruction using graph neural networks
• Charged particle tracking via edge-classifying interaction networks