From Cloud to Crowd: Democratizing LLM Service with Decentralized Edge Collaboration for RAG

Jiaxing Li, Hengzhi Wang, Feng Wang +5

The rapid advancement of large language models (LLMs) has increased demand for scalable and cost-effective deployment, especially for mobile and edge devices. Cloud-hosted LLMs are…