Bosch Deep Learning Hardware Benchmark
arXiv:2008.10293
Abstract
The widespread use of Deep Learning (DL) applications in science and industry has created a large demand for efficient inference systems. This has resulted in a rapid increase of available Hardware Accelerators (HWAs) making comparison challenging and laborious. To address this, several DL hardware benchmarks have been proposed aiming at a comprehensive comparison for many models, tasks, and hardware platforms. Here, we present our DL hardware benchmark which has been specifically developed for inference on embedded HWAs and tasks required for autonomous driving. In addition to previous benchmarks, we propose a new granularity level to evaluate common submodules of DL models, a twofold benchmark procedure that accounts for hardware and model optimizations done by HWA manufacturers, and an extended set of performance indicators that can help to identify a mismatch between a HWA and the DL models used in our benchmark.
Presented in MLBench: Workshop on Benchmarking Machine Learning Workloads (https://sites.google.com/g.harvard.edu/mlbench/home)
References in corpus (7)
- Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
- MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications
- EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks
- Caffe: Convolutional Architecture for Fast Feature Embedding
- Fathom: Reference Workloads for Modern Deep Learning Methods
- MLPerf Training Benchmark
- Joint Attention in Autonomous Driving (JAAD)