activity
20242026
most citedTransformer-Lite: High-efficiency Deployment of Large Language Models on Mobile Phone GPUs

1 citations · 1 across the 5 of their papers we have counts for

collaborators
Showing cs.LGShow all

1 paper · 1 filter

cs.LG2025

HMI: Hierarchical Knowledge Management for Efficient Multi-Tenant Inference in Pretrained Language Models

Jun Zhang, Jue Wang, Huan Li +6

The significant computational demands of pretrained language models (PLMs), which often require dedicated hardware, present a substantial challenge in serving them efficiently, esp…