MoLink: Distributed and Efficient Serving Framework for Large Models

Lewei Jin, Yongqi Chen, Kui Zhang +5

Large language models represent a groundbreaking shift in generative AI. Yet, these advances come with a significant challenge: the high cost of model serving. To mitigate these co…