Residual-Stream Burden Shapes Representation Learning in Diffusion Transformers

Tongtong Liang, Siqi Kou, Ziqiao Xi +6

In diffusion-based generation, a neural network can be trained to predict the clean data, the noise, or the velocity from a noisy input. These prediction targets are interconvertib…