4 citations · 6 across the 10 of their papers we have counts for
4 papers · 1 filter
Efficient On-Device Diffusion LLM Inference with Mobile NPU
Tuowei Wang, Yanfan Sun, Ju Ren
Diffusion large language models (dLLMs) accelerate generation by denoising multiple tokens in parallel, making them attractive for latency-sensitive mobile inference. However, repe…
Lever: Speculative LLM Inference on Smartphones
Tuowei Wang, Fengzu Li, Yanfan Sun +2
Large language models (LLMs) are increasingly needed for interactive mobile applications, but high-quality models exceed the limited DRAM available on smartphones. Flash storage ca…
Long Exposure: Accelerating Parameter-Efficient Fine-Tuning for LLMs under Shadowy Sparsity
Tuowei Wang, Kun Li, Zixu Hao +5
The adaptation of pre-trained large language models (LLMs) to diverse downstream tasks via fine-tuning is critical for numerous applications. However, the inefficiency of parameter…
Neuralink: Fast LLM Inference on Smartphones with Neuron Co-Activation Linking
Tuowei Wang, Ruwen Fan, Minxing Huang +6
Large Language Models (LLMs) have achieved remarkable success across various domains, yet deploying them on mobile devices remains an arduous challenge due to their extensive compu…