4 papers
StereoFoley: Object-Aware Stereo Audio Generation from Video
Tornike Karchkhadze, Kuan-Lin Chen, Mojtaba Heydari +4
We present StereoFoley, a video-to-audio generation framework that produces semantically aligned, temporally synchronized, and spatially accurate stereo sound at 48 kHz. While rece…
Ambisonics Super-Resolution Using A Waveform-Domain Neural Network
Ismael Nawfal, Symeon Delikaris Manias, Mehrez Souden +5
Ambisonics is a spatial audio format describing a sound field. First-order Ambisonics (FOA) is a popular format comprising only four channels. This limited channel count comes at t…
Rethinking Non-Negative Matrix Factorization with Implicit Neural Representations
Krishna Subramani, Paris Smaragdis, Takuya Higuchi +1
Non-negative Matrix Factorization (NMF) is a powerful technique for analyzing regularly-sampled data, i.e., data that can be stored in a matrix. For audio, this has led to numerous…
ImmerseDiffusion: A Generative Spatial Audio Latent Diffusion Model
Mojtaba Heydari, Mehrez Souden, Bruno Conejo +1
We introduce ImmerseDiffusion, an end-to-end generative audio model that produces 3D immersive soundscapes conditioned on the spatial, temporal, and environmental conditions of sou…