most citedEfficient Deployment of Large Language Models on Resource-constrained Devices

3 citations · 3 across the 4 of their papers we have counts for

collaborators
Showing cs.DCShow all

1 paper · 1 filter

cs.DC2024

Collaborative Inference for Large Models with Task Offloading and Early Exiting

Zuan Xie, Yang Xu, Hongli Xu +2

In 5G smart cities, edge computing is employed to provide nearby computing services for end devices, and the large-scale models (e.g., GPT and LLaMA) can be deployed at the network…