4 papers
ELT: Elastic Looped Transformers for Visual Generation
Sahil Goyal, Swayam Agrawal, Gautham Govind Anil +3
We introduce Elastic Looped Transformers (ELT), a highly parameter-efficient class of visual generative models based on a recurrent transformer architecture. While conventional gen…
Fine-Tuning Diffusion Models via Intermediate Distribution Shaping
Gautham Govind Anil, Shaan Ul Haque, Nithish Kannen +3
Diffusion models are widely used for generative tasks across domains. Given a pre-trained diffusion model, it is often desirable to fine-tune it further either to correct for error…
Interleaved Gibbs Diffusion: Generating Discrete-Continuous Data with Implicit Constraints
Gautham Govind Anil, Sachin Yadav, Dheeraj Nagaraj +2
We introduce Interleaved Gibbs Diffusion (IGD), a novel generative modeling framework for discrete-continuous data, focusing on problems with important, implicit and unspecified co…
Infinite Width Limits of Self Supervised Neural Networks
Maximilian Fleissner, Gautham Govind Anil, Debarghya Ghoshdastidar
The NTK is a widely used tool in the theoretical analysis of deep learning, allowing us to look at supervised deep neural networks through the lenses of kernel regression. Recently…