25 citations · 39 across the 7 of their papers we have counts for
Showing 2024Show all
2 papers · 1 filter
cs.DC2024★ 1 cited
A Tale of Two Scales: Reconciling Horizontal and Vertical Scaling for Inference Serving Systems
Kamran Razavi, Mehran Salmani, Max Mühlhäuser +2
Inference serving is of great importance in deploying machine learning models in real-world applications, ensuring efficient processing and quick responses to inference requests. H…
cs.DC2024★ 8 cited
Sponge: Inference Serving with Dynamic SLOs Using In-Place Vertical Scaling
Kamran Razavi, Saeid Ghafouri, Max Mühlhäuser +2
Mobile and IoT applications increasingly adopt deep learning inference to provide intelligence. Inference requests are typically sent to a cloud infrastructure over a wireless netw…