25 citations · 26 across the 2 of their papers we have counts for
Showing cs.DCShow all
2 papers · 1 filter
cs.DC2024★ 1 cited
A Tale of Two Scales: Reconciling Horizontal and Vertical Scaling for Inference Serving Systems
Kamran Razavi, Mehran Salmani, Max Mühlhäuser +2
Inference serving is of great importance in deploying machine learning models in real-world applications, ensuring efficient processing and quick responses to inference requests. H…
cs.DC2023
IPA: Inference Pipeline Adaptation to Achieve High Accuracy and Cost-Efficiency
Saeid Ghafouri, Kamran Razavi, Mehran Salmani +5
Efficiently optimizing multi-model inference pipelines for fast, accurate, and cost-effective inference is a crucial challenge in machine learning production systems, given their t…