collaborators

5 papers

cs.AR2026

BitLLM: Efficient Low-Bit, Conversion-Hiding LLM Decoding on Mobile GPUs

Hangyu Zheng, Zhihao Shu, Kunxiong Zhu +4

The rapid scaling of large language models (LLMs) has unlocked remarkable capabilities across various domains. However, deploying LLMs on mobile devices remains challenging because…

cs.DC2026

EAServe: Encode-Aware Disaggregated Serving for Multimodal Large Language Models

Kunxiong Zhu, Zhihao Shu, Hangyu Zheng +4

Disaggregating the two stages, Prefill and Decode, onto separate GPU pools is now a standard optimization for (text-only) LLM serving. However, multimodal LLMs (MLLMs), which add a…

cs.LG2026

TierKV: Long-Context On-Device LLMs via Predictive Multi-Tier KV Caching

Zhihao Shu, Md Musfiqur Rahman Sanim, Jie Hu +4

Large language models (LLMs) are moving onto mobile devices for increasingly diverse workloads over text, images, video, and audio. These applications often require long contexts,…

cs.CV2026

Forget-It-All: Multi-Concept Machine Unlearning via Concept-Aware Neuron Masking

Kaiyuan Deng, Bo Hui, Gen Li +4

The widespread adoption of text-to-image (T2I) diffusion models has raised concerns about their potential to generate copyrighted, inappropriate, or sensitive imagery. As a practic…

cs.CV2024

Data Overfitting for On-Device Super-Resolution with Dynamic Algorithm and Compiler Co-Design

Gen Li, Zhihao Shu, Jie Ji +4

Deep neural networks (DNNs) are frequently employed in a variety of computer vision applications. Nowadays, an emerging trend in the current video distribution system is to take ad…