3 papers
cs.LG2026
Efficient On-Device Diffusion LLM Inference with Mobile NPU
Tuowei Wang, Yanfan Sun, Ju Ren
Diffusion large language models (dLLMs) accelerate generation by denoising multiple tokens in parallel, making them attractive for latency-sensitive mobile inference. However, repe…
cs.LG2026
Lever: Speculative LLM Inference on Smartphones
Tuowei Wang, Fengzu Li, Yanfan Sun +2
Large language models (LLMs) are increasingly needed for interactive mobile applications, but high-quality models exceed the limited DRAM available on smartphones. Flash storage ca…
cs.LG2025
HybriMoE: Hybrid CPU-GPU Scheduling and Cache Management for Efficient MoE Inference
Shuzhang Zhong, Yanfan Sun, Ling Liang +3
The Mixture of Experts (MoE) architecture has demonstrated significant advantages as it enables to increase the model capacity without a proportional increase in computation. Howev…