5 papers · 1 filter
Dynamic DNNs and Runtime Management for Efficient Inference on Mobile/Embedded Devices
Lei Xun, Jonathon Hare, Geoff V. Merrett
Deep neural network (DNN) inference is increasingly being executed on mobile and embedded platforms due to several key advantages in latency, privacy and always-on availability. Ho…
Fluid Dynamic DNNs for Reliable and Adaptive Distributed Inference on Edge Devices
Lei Xun, Mingyu Hu, Hengrui Zhao +3
Distributed inference is a popular approach for efficient DNN inference at the edge. However, traditional Static and Dynamic DNNs are not distribution-friendly, causing system reli…
Dynamic-OFA: Runtime DNN Architecture Switching for Performance Scaling on Heterogeneous Embedded Platforms
Wei Lou, Lei Xun, Amin Sabet +3
Mobile and embedded platforms are increasingly required to efficiently execute computationally demanding DNNs across heterogeneous processing elements. At runtime, the available ha…
Optimising Resource Management for Embedded Machine Learning
Lei Xun, Long Tran-Thanh, Bashir M Al-Hashimi +1
Machine learning inference is increasingly being executed locally on mobile and embedded platforms, due to the clear advantages in latency, privacy and connectivity. In this paper,…
Incremental Training and Group Convolution Pruning for Runtime DNN Performance Scaling on Heterogeneous Embedded Platforms
Lei Xun, Long Tran-Thanh, Bashir M Al-Hashimi +1
Inference for Deep Neural Networks is increasingly being executed locally on mobile and embedded platforms due to its advantages in latency, privacy and connectivity. Since modern…