Showing 2026Show all
2 papers · 1 filter
cs.AI2026
Joint Optimization of Memory and Computing Frequency for Energy-Efficient DNN Inference
Yunchu Han, Zhaojun Nan, Sheng Zhou +1
Deep neural network (DNN) inference on mobile devices often incurs high latency and energy consumption due to limited computing and memory resources. To enable energy-efficient DNN…
cs.IT2026
DiP-SD: Distributed Pipelined Speculative Decoding for Efficient LLM Inference at the Edge
Yaodan Xu, Sheng Zhou, Zhisheng Niu
Speculative decoding has emerged as a promising technique for large language model (LLM) inference by accelerating autoregressive decoding via draft-then-verify. This paper studies…