FlashBoot: Sub-Second Weight Loading for Large Models at Rack Scale

Issac Zhu, Hscos Zhang, Keith Jiang +3

Flagship Mixture-of-Experts (MoE) models are growing fast along two axes at once: total parameter count and the number of experts. In elastic deployment scenarios, many GPUs across…