audio signal processing

DiffAU: Diffusion-Based Ambisonics Upscaling

arXiv:2510.00180

summary

The paper introduces DiffAU, a diffusion‑model‑based method that upscales first‑order Ambisonics recordings to third‑order Ambisonics, improving spatial resolution of 3D audio.

Abstract

Spatial audio enhances immersion by reproducing 3D sound fields, with Ambisonics offering a scalable format for this purpose. While first-order Ambisonics (FOA) notably facilitates hardware-efficient acquisition and storage of sound fields as compared to high-order Ambisonics (HOA), its low spatial resolution limits realism, highlighting the need for Ambisonics upscaling (AU) as an approach for increasing the order of Ambisonics signals. In this work we propose DiffAU, a cascaded AU method that leverages recent developments in diffusion models combined with novel adaptation to spatial audio to generate 3rd order Ambisonics from FOA. By learning data distributions, DiffAU provides a principled approach that rapidly and reliably reproduces HOA in various settings. Experiments in anechoic conditions with multiple speakers, show strong objective and perceptual performance.

Topics & keywords

#ambisonics#spatial audio#diffusion models#upscaling#machine learningdiffusion modelfirst-order ambisonicsthird-order ambisonicscascaded upscalingobjective evaluationperceptual performance
DiffAU: Diffusion-Based Ambisonics Upscaling · wovepaper