8 citations · 9 across the 9 of their papers we have counts for
3 papers · 1 filter
HADIS: A Hybrid Architecture for Query-Aware Diffusion Model Serving
Qizheng Yang, Tung-I Chen, Siyu Zhao +2
Query-aware model serving routes queries through cascades of increasing cost to balance quality and throughput. Existing cascade systems force all queries through the lightweight s…
DiffServe: Efficiently Serving Text-to-Image Diffusion Models with Query-Aware Model Scaling
Sohaib Ahmad, Qizheng Yang, Haoliang Wang +2
Text-to-image generation using diffusion models has gained increasing popularity due to their ability to produce high-quality, realistic images based on text prompts. However, effi…
Loki: A System for Serving ML Inference Pipelines with Hardware and Accuracy Scaling
Sohaib Ahmad, Hui Guan, Ramesh K. Sitaraman
The rapid adoption of machine learning (ML) has underscored the importance of serving ML models with high throughput and resource efficiency. Traditional approaches to managing inc…