4 citations · 6 across the 10 of their papers we have counts for
4 papers · 1 filter
Efficient On-Device Diffusion LLM Inference with Mobile NPU
Tuowei Wang, Yanfan Sun, Ju Ren
Diffusion large language models (dLLMs) accelerate generation by denoising multiple tokens in parallel, making them attractive for latency-sensitive mobile inference. However, repe…
Lever: Speculative LLM Inference on Smartphones
Tuowei Wang, Fengzu Li, Yanfan Sun +2
Large language models (LLMs) are increasingly needed for interactive mobile applications, but high-quality models exceed the limited DRAM available on smartphones. Flash storage ca…
Mosaic: Cross-Modal Clustering for Efficient Video Understanding
Tuowei Wang, He Zhou, Chengru Song +2
Large vision-language models (VLMs) are enabling interactive video reasoning, giving rise to streaming long-video understanding. In this setting, frames arrive continuously, while…
Swarm: Co-Activation Aware KVCache Offloading Across Multiple SSDs
Tuowei Wang, Liyun Chu, Ruwen Fan +1
The key-value (KV) cache has become the dominant contributor to memory consumption in large language model (LLM) inference. Although offloading KVCache from GPU high-bandwidth memo…