TUBE: Tangent Upper Bound on Evidence for Discrete Diffusion Language Models

Arseny Ivanov, Sergei Kholkin, Vladislav Gromadskii +3

Log-likelihood is a standard metric for evaluating generative models. Unfortunately, in contrast to autoregressive models (ARMs), discrete diffusion models generally do not admit e…