Boosting DNN Cold Inference on Edge Devices

Rongjie Yi, Ting Cao, Ao Zhou +3

DNNs are ubiquitous on edge devices nowadays. With its increasing importance and use cases, it's not likely to pack all DNNs into device memory and expect that each inference has b…