All modalities are equal, but video is more equal: Closing the Cross-Attention Gap in Joint Video Generation

Ohad Rahamim, Dvir Samuel, Idan Schwartz +1

Video is a rich representation of a physical event, capturing appearance, geometry, motion, and temporal evolution. Other modalities, such as 3D body motion or audio, encode narrow…