Camel: Energy-Aware LLM Inference on Resource-Constrained Devices

Hao Xu, Long Peng, Shezheng Song +5

Most Large Language Models (LLMs) are currently deployed in the cloud, with users relying on internet connectivity for access. However, this paradigm faces challenges such as netwo…