7 papers
SNM-VFI: Symmetric Nonlinear Motion-Guided Generative Video Frame Interpolation
Jisoo Jeong, Hong Cai, Jamie Menjay Lin +5
We propose Symmetric Nonlinear Motion-guided Generative Video Frame Interpolation (SNM-VFI), a training-free framework for motion-controllable generative video frame interpolation…
MobileWan: Closing the Quality Gap for Mobile Video Diffusion
Mohsen Ghafoorian, Denis Korzhenkov, Adil Karjauv +9
Recent advances in video diffusion have been driven by scaling transformer-based architectures to billions of parameters, substantially improving visual fidelity and motion coheren…
MAPLE: Latent Multi-Agent Play for End-to-End Autonomous Driving
Rajeev Yasarla, Deepti Hegde, Hsin-Pai Cheng +9
Vision-language-action (VLA) models are effective as end-to-end motion planners, but can be brittle when evaluated in closed-loop settings due to being trained under traditional im…
HLA: Hadamard Linear Attention
Hanno Ackermann, Hong Cai, Mohsen Ghafoorian +1
The attention mechanism is an important reason for the success of transformers. It relies on computing pairwise relations between tokens. To reduce the high computational cost of s…
Myosotis: structured computation for attention like layer
Evgenii Egorov, Hanno Ackermann, Markus Nagel +1
Attention layers apply a sequence-to-sequence mapping whose parameters depend on the pairwise interactions of the input elements. However, without any structural assumptions, memor…
Learning Optical Flow Field via Neural Ordinary Differential Equation
Leyla Mirvakhabova, Hong Cai, Jisoo Jeong +3
Recent works on optical flow estimation use neural networks to predict the flow field that maps positions of one image to positions of the other. These networks consist of a featur…
Planar Gaussian Splatting
Farhad G. Zanjani, Hong Cai, Hanno Ackermann +2
This paper presents Planar Gaussian Splatting (PGS), a novel neural rendering approach to learn the 3D geometry and parse the 3D planes of a scene, directly from multiple RGB image…