TurboServe: Serving Streaming Video Generation Efficiently and Economically

Youhe Jiang, Haoxu Wang, Haotong Bao +5

Streaming video generation is emerging as a new serving workload in which users interact with long-lived sessions that generate video progressively, chunk by chunk. Unlike offline…