442 citations · 1.6k across the 20 of their papers we have counts for
Showing 2026Show all
2 papers · 1 filter
cs.LG2026
Should We Skip Diffusion?
Yiping Ji, James Martens, Simon Lucey
Diffusion models learn semantic representations while generating images. In the Decoupled Diffusion Transformer (DDT), a condition encoder provides features that guide a velocity d…
cs.LG2026
Orthogonal Self-Attention
Leo Zhang, James Martens
Softmax Self-Attention (SSA) is a key component of Transformer architectures. However, when utilised within skipless architectures, which aim to improve representation learning, re…