Frenzy: A Memory-Aware Serverless LLM Training System for Heterogeneous GPU Clusters

Zihan Chang, Sheng Xiao, Shuibing He +3

Existing work only effective on a given number of GPUs, often neglecting the complexities involved in manually determining the specific types and quantities of GPUs needed, which c…