Prompt-Aware Scheduling for Efficient Text-to-Image Inferencing System

Shubham Agarwal, Saud Iqbal, Subrata Mitra

Traditional ML models utilize controlled approximations during high loads, employing faster, but less accurate models in a process called accuracy scaling. However, this method is…