HERA: Hybrid Edge-cloud Resource Allocation for Cost-Efficient AI Agents

Shiyi Liu, Haiying Shen, Shuai Che +2

In the realm of AI, large language models (LLMs) like GPT-4, central to the operation of AI agents, predominantly operate in the cloud, incurring high operational costs. With local…