2 papers
cs.PF2026
Simulate Before You Scale: High-Fidelity LLM Inference Planning Without GPUs
Dipanwita Guhathakurta, Mert Toslali, Srinivasan Parthasarathy +6
Deploying large language model (LLM) inference at scale requires jointly selecting hardware layout, parallelism strategy, scheduling policy, admission control, and request routing…
cs.DC2018
Dependability in a Multi-tenant Multi-framework Deep Learning as-a-Service Platform
Scott Boag, Parijat Dube, Kaoutar El Maghraoui +7
Deep learning (DL), a form of machine learning, is becoming increasingly popular in several application domains. As a result, cloud-based Deep Learning as a Service (DLaaS) platfor…