LETI: Latency Estimation Tool and Investigation of Neural Networks inference on Mobile GPU

Evgeny Ponomarev, Sergey Matveev, Ivan Oseledets

A lot of deep learning applications are desired to be run on mobile devices. Both accuracy and inference time are meaningful for a lot of them. While the number of FLOPs is usually…