Computron: Serving Distributed Deep Learning Models with Model Parallel Swapping

Daniel Zou, Xinchen Jin, Xueyang Yu +2

Many of the most performant deep learning models today in fields like language and image understanding are fine-tuned models that contain billions of parameters. In anticipation of…