TetriServe: Efficiently Serving Mixed DiT Workloads

Runyu Lu, Shiqi He, Wenxuan Tan +5

Diffusion Transformer (DiT) models excel at generating high-quality images through iterative denoising steps, but serving them under strict Service Level Objectives (SLOs) is chall…