Hidden costs for inference with deep network on embedded system devices

Chankyu Lee, Woohyun Choi, Sangwook Park

This study evaluates the inference performance of various deep learning models under an embedded system environment. In previous works, Multiply-Accumulate operation is typically u…