Parallax: Efficient LLM Inference Service over Decentralized Environment

Chris Tong, Youhe Jiang, Gufeng Chen +6

Deploying a large language model (LLM) inference service remains costly because centralized serving depends on specialized GPU clusters and high-bandwidth interconnects in datacent…