DeepCache: Principled Cache for Mobile Deep Vision

Mengwei Xu, Mengze Zhu, Yunxin Liu +2

We present DeepCache, a principled cache design for deep learning inference in continuous mobile vision. DeepCache benefits model execution efficiency by exploiting temporal locali…