4 papers
When NPUs Are Not Always Faster: A Stage-Level Analysis of Mobile LLM Inference
Pu Li, Jiawen Qi, Qinyu Chen
Deploying large language models (LLMs) on mobile devices increasingly relies on heterogeneous execution, yet no prior study has systematically characterized NPU effectiveness at th…
Two-Stage Adaptation for Non-Normative Speech Recognition: Revisiting Speaker-Independent Initialization for Personalization
Shan Jiang, Jiawen Qi, Chuanbing Huo +2
Personalizing automatic speech recognition (ASR) systems for non-normative speech, such as dysarthric and aphasic speech, is challenging. While speaker-specific fine-tuning (SS-FT)…
Eye Gaze Tells You Where to Compute: Gaze-Driven Efficient VLMs
Qinyu Chen, Jiawen Qi
Vision-Language Models (VLMs) deliver impressive performance in understanding visual content with language instructions. However, redundancy in vision tokens results in the degener…
DeltaLLM: Delta-Key Sparse Attention for Edge LLMs
Jiawen Qi, Chang Gao, Jiayu Liu +2
On-device LLM inference is increasingly important for edge platforms but remains challenging due to high computational and memory demands and tight resource constraints. Modern app…