Energy Consumption Analysis of Discrete Diffusion and Autoregressive Language Models

Boris Ruf, Marcin Detyniecki

As Large Language Models (LLMs) continue to scale, their energy consumption during inference has become a critical concern. While Autoregressive (AR) models are the industry standa…