Visual Representation Matters: Exploiting Temporal Differences in Video-to-Audio Generation

Zehua Chen, Junyou Wang, Yuxuan Jiang +5

Video-to-audio (V2A) generation extends image-to-audio generation (I2A) by introducing consecutive frames that provide essential temporal cues for audio synthesis. However, existin…