Accuracy-Delay Trade-Off in LLM Offloading via Token-Level Uncertainty

Yumin Kim, Hyeonsu Lyu, Minjae Lee +1

Large language models (LLMs) offer significant potential for intelligent mobile services but are computationally intensive for resource-constrained devices. Mobile edge computing (…