Spatio-Temporal Parallelism for Diffusion Model Inference on Heterogeneous Multi-GPU Systems

Han Liang, Jiahui Zhou, Zicheng Zhou +2

The widespread adoption of diffusion models for image generation necessitates efficient parallel inference to manage their substantial computational overhead. However, current para…