4 papers
Attention to Detail: Evaluating Energy, Performance, and Accuracy Trade-offs Across vLLM Configurations
Nada Zine, Tristan Coignion, Vincenzo Stoico +4
Large Language Models are reshaping how software is developed and maintained. They are typically deployed in production using inference engines such as vLLM, which can efficiently…
Static Metrics Are Insufficient: Predicting Java Method Energy Usage with Execution Time
Muhammad Imran, Vincenzo Stoico, Ivano Malavolta
The increasing energy demand of software systems is raising concerns about their environmental impact and associated costs. Reasoning on energy usage early in the development flow…
Sustainability Is Not Linear: Quantifying Performance, Energy, and Privacy Trade-offs in On-Device Intelligence
Eziyo Ehsani, Luca Giamattei, Ivano Malavolta +1
The migration of Large Language Models (LLMs) from cloud clusters to edge devices promises enhanced privacy and offline accessibility, but this transition encounters a harsh realit…
Generating Energy-Efficient Code via Large-Language Models -- Where are we now?
Radu Apsan, Vincenzo Stoico, Michel Albonico +3
Context. The rise of Large Language Models (LLMs) has led to their widespread adoption in development pipelines. Goal. We empirically assess the energy efficiency of Python code ge…