works on
energy estimation 1gpu inference 1green ai 1hardware-aware modeling 1large language models 1

From the 1 of 4 linked papers with an AI index.

collaborators
Showing cs.LGShow all

1 paper · 1 filter

cs.LG2026

From Tokens to Watt-hours: Analytical Energy Estimation for LLM Inference on Modern GPUs

Tina Vartziotis, Rodopi Kosteli, Elli Vartziotis +5

The paper introduces an analytical, calibrated method to estimate the energy consumption of large language model inference on NVIDIA H100 GPUs without direct power measurements, se…