HADIS: A Hybrid Architecture for Query-Aware Diffusion Model Serving

Qizheng Yang, Tung-I Chen, Siyu Zhao +2

Query-aware model serving routes queries through cascades of increasing cost to balance quality and throughput. Existing cascade systems force all queries through the lightweight s…