4 papers
LLM Fine-Tuning Workloads: Characterization, Challenges, and Opportunities for Serverless AI
Radu Nicolae, Daniele Lotito, Alexandru Iosup
Serverless execution of Large Language Models (LLMs) is becoming important, reflecting their wide societal use. An increasingly present stage in LLM pipelines is fine-tuning, which…
Kavier: Exploring Performance, Sustainability, and Efficiency of LLM Ecosystems under Inference through Cache-Aware Discrete-Event Simulation
Radu Nicolae, Alexandru Iosup, Animesh Trivedi +1
Large Language Models (LLMs) are widely used by our increasingly digitalized society, but raise sustainability, performance, and financial concerns, especially as inference workloa…
OpenDT: Exploring Datacenter Performance and Sustainability with a Self-Calibrating Digital Twin -- Technical Report
Radu Nicolae, Jules van der Toorn, Stavriana Kraniti +2
Datacenters are the backbone of our digital society, but raise numerous operational challenges. We envision digital twins becoming primary instruments in datacenter operations, con…
M3SA: Exploring Datacenter Performance and Climate-Impact with Multi- and Meta-Model Simulation and Analysis
Radu Nicolae, Dante Niewenhuis, Sacheendra Talluri +1
Datacenters are vital to our digital society, but consume a considerable fraction of global electricity and demand is projected to increase. To improve their sustainability and per…