310 citations · 641 across the 20 of their papers we have counts for
7 papers · 1 filter
Towards Resource-Efficient LLMs: End-to-End Energy Accounting of Distillation Pipelines
Katherine Lambert, Sasha Luccioni
The rise in deployment of large language models has driven a surge in GPU demand and datacenter scaling, raising concerns about electricity use, grid stress, and the impacts of mod…
Understanding Efficiency: Quantization, Batching, and Serving Strategies in LLM Energy Use
Julien Delavande, Regis Pierrard, Sasha Luccioni
Large Language Models (LLMs) are increasingly deployed in production, contributing towards shifting the burden in terms of computational resources and energy demands from training…
Small Talk, Big Impact: The Energy Cost of Thanking AI
Julien Delavande, Regis Pierrard, Sasha Luccioni
Being polite is free - or is it? In this paper, we quantify the energy cost of seemingly innocuous messages such as ``thank you'' when interacting with large language models, often…
Video Killed the Energy Budget: Characterizing the Latency and Power Regimes of Open Text-to-Video Models
Julien Delavande, Regis Pierrard, Sasha Luccioni
Recent advances in text-to-video (T2V) generation have enabled the creation of high-fidelity, temporally coherent clips from natural language prompts. Yet these systems come with s…
The Responsible Foundation Model Development Cheatsheet: A Review of Tools & Resources
Shayne Longpre, Stella Biderman, Alon Albalak +20
Foundation model development attracts a rapidly expanding body of contributors, scientists, and applications. To help shape responsible development practices, we introduce the Foun…
Power Hungry Processing: Watts Driving the Cost of AI Deployment?
Alexandra Sasha Luccioni, Yacine Jernite, Emma Strubell
Recent years have seen a surge in the popularity of commercial AI products based on generative, multi-purpose AI systems promising a unified approach to building machine learning (…
Fair Diffusion: Instructing Text-to-Image Generation Models on Fairness
Felix Friedrich, Manuel Brack, Lukas Struppek +4
Generative AI models have recently achieved astonishing results in quality and are consequently employed in a fast-growing number of applications. However, since they are highly da…