SplitLLM: Collaborative Inference of LLMs for Model Placement and Throughput Optimization

Akrit Mudvari, Yuang Jiang, Leandros Tassiulas

Large language models (LLMs) have been a disruptive innovation in recent years, and they play a crucial role in our daily lives due to their ability to understand and generate huma…