A Note on Latency Variability of Deep Neural Networks for Mobile Inference

Luting Yang, Bingqian Lu, Shaolei Ren

Running deep neural network (DNN) inference on mobile devices, i.e., mobile inference, has become a growing trend, making inference less dependent on network connections and keepin…