4 papers · 1 filter
The Diffusion Encoder
Akhil Premkumar, Sarah Lucioni
We construct a new kind of encoder, leveraging the expressive power of diffusion models. In a traditional variational autoencoder, the encoder and decoder jointly negotiate a laten…
On the Separability of Information in Diffusion Models
Akhil Premkumar
Diffusion models transform noise into data by injecting information that was captured in their neural network during the training phase. In this paper, we ask: \textit{what} is thi…
Neural Entropy
Akhil Premkumar
We explore the connection between deep learning and information theory through the paradigm of diffusion models. A diffusion model converts noise into structured data by reinstatin…
Diffusion Density Estimators
Akhil Premkumar
We investigate the use of diffusion models as neural density estimators. The current approach to this problem involves converting the generative process to a smooth flow, known as…