Estimating Probability Densities with Transformer and Denoising Diffusion

Henry W. Leung, Jo Bovy, Joshua S. Speagle

Transformers are often the go-to architecture to build foundation models that ingest a large amount of training data. But these models do not estimate the probability density distr…