works on
attention mechanisms 1audio synthesis 1cross-modal alignment 1latent space modeling 1video-to-audio generation 1

From the 1 of 1 linked paper with an AI index.

collaborators

1 paper

cs.MM2026

Precise Video-to-Audio Generation with Cross-Modal Alignment in Latent Space

Thanh V. T. Tran, Ngoc-Son Nguyen, Luong Tran +4

The paper introduces Flowley, an end‑to‑end model that generates synchronized audio directly from silent video using a novel progressive soft‑masked cross‑attention mechanism, and…