SWARM-LLM: Collaborative Inference for Edge-based Small Language Models

Mostafa Dahshan, Quazi Mamun, Tanmoy Debnath

Large language models (LLMs) provide strong performance across a wide range of tasks but are typically hosted on centralised cloud infrastructure, incurring significant bandwidth,…