1 citations · 1 across the 7 of their papers we have counts for
4 papers · 1 filter
Where Compute Matters: Heterogeneous Attention for Efficient Video Diffusion
Olga Zatsarynna, Denis Korzhenkov, Juergen Gall +2
Efficient video generation requires reducing the quadratic cost of self-attention over long spatio-temporal token sequences. Existing efficient-attention methods typically apply th…
SQuad: Sub-Quadratic Attention Distillation for Efficient Video Generation
Animesh Karnewar, Denis Korzhenkov, Amirhossein Habibian +1
Video Diffusion Transformers (DiTs) spend most of their compute inside the Self-Attention operation, whose cost grows quadratically, , with the number of latent t…
MobileWan: Closing the Quality Gap for Mobile Video Diffusion
Mohsen Ghafoorian, Denis Korzhenkov, Adil Karjauv +9
Recent advances in video diffusion have been driven by scaling transformer-based architectures to billions of parameters, substantially improving visual fidelity and motion coheren…
PyramidalWan: On Making Pretrained Video Model Pyramidal for Efficient Inference
Denis Korzhenkov, Adil Karjauv, Animesh Karnewar +2
Recently proposed pyramidal models decompose the conventional forward and backward diffusion processes into multiple stages operating at varying resolutions. These models handle in…