Showing 2025Show all
3 papers · 1 filter
cs.DC2025
Joint Optimization of Offloading, Batching and DVFS for Multiuser Co-Inference
Yaodan Xu, Sheng Zhou, Zhisheng Niu
With the growing integration of artificial intelligence in mobile applications, a substantial number of deep neural network (DNN) inference requests are generated daily by mobile d…
cs.CV2025
Optimization of Layer Skipping and Frequency Scaling for Convolutional Neural Networks under Latency Constraint
Minh David Thao Chan, Ruoyu Zhao, Yukuan Jia +2
The energy consumption of Convolutional Neural Networks (CNNs) is a critical factor in deploying deep learning models on resource-limited equipment such as mobile devices and auton…
cs.DC2025
SMDP-Based Dynamic Batching for Improving Responsiveness and Energy Efficiency of Batch Services
Yaodan Xu, Sheng Zhou, Zhisheng Niu
For servers incorporating parallel computing resources, batching is a pivotal technique for providing efficient and economical services at scale. Parallel computing resources exhib…