8 papers
Ambisonics Encoding of Room Impulse Responses using a Device-Agnostic Diffusion Model
Eloi Moliner, Christoph Hold, Juan Azcarreta Ortiz +5
We address the problem of encoding room impulse responses (RIRs) into high-order Ambisonics (HOA) representations from arbitrary and potentially insufficient or incomplete micropho…
Towards Localizing Conversation Partners using Head Motion
Payal Mohapatra, Calvin Murdock, Ali Aroudi +4
Many individuals struggle to understand conversation partners in noisy settings, particularly amid background speakers or due to hearing impairments. Emerging wearables like smartg…
Text-to-Stage: Spatial Layouts from Long-form Narratives
Jefferson Hernandez, Swarnadeep Saha, Chenxi Whitehouse +6
In this work, we probe the ability of a language model to demonstrate spatial reasoning from unstructured text, mimicking human capabilities and automating a process that benefits…
Scene-wide Acoustic Parameter Estimation
Ricardo Falcon-Perez, Ruohan Gao, Gregor Mueckl +2
For augmented (AR) and virtual reality (VR) applications, accurate estimates of the acoustic characteristics of a scene are critical for creating a sense of immersion. However, dir…
Towards Perception-Informed Latent HRTF Representations
You Zhang, Andrew Francl, Ruohan Gao +3
Personalized head-related transfer functions (HRTFs) are essential for ensuring a realistic auditory experience over headphones, because they take into account individual anatomica…
EgoAdapt: Adaptive Multisensory Distillation and Policy Learning for Efficient Egocentric Perception
Sanjoy Chowdhury, Subrata Biswas, Sayan Nag +7
Modern perception models, particularly those designed for multisensory egocentric tasks, have achieved remarkable performance but often come with substantial computational costs. T…