AI Accelerator Survey and Trends

Abstract

Over the past several years, new machine learning accelerators were being announced and released every month for a variety of applications from speech recognition, video object detection, assisted driving, and many data center applications. This paper updates the survey of AI accelerators and processors from past two years. This paper collects and summarizes the current commercial accelerators that have been publicly announced with peak performance and power consumption numbers. The performance and power values are plotted on a scatter graph, and a number of dimensions and observations from the trends on this plot are again discussed and analyzed. This year, we also compile a list of benchmarking performance results and compute the computational efficiency with respect to peak performance.

arXiv comment9 pages, 2 figures, IEEE High Performance Extreme Computing Conference 2021

References in corpus (6)

• An Analysis of Deep Neural Network Models for Practical Applications
• Convolutional Networks for Fast, Energy-Efficient Neuromorphic Computing
• Survey and Benchmarking of Machine Learning Accelerators
• Survey of Machine Learning Accelerators
• Deep Neural Network Approximation for Custom Hardware: Where We've Been, Where We're Going
• Epiphany-V: A 1024 processor 64-bit RISC System-On-Chip

Cited by in corpus (2)

• A Holistic Assessment of the Carbon Footprint of Noor, a Very Large Arabic Language Model
• The MIT Supercloud Workload Classification Challenge