Showing eess.ASShow all
2 papers · 1 filter
eess.AS2025
AURA Score: A Metric For Holistic Audio Question Answering Evaluation
Satvik Dixit, Soham Deshmukh, Bhiksha Raj
Audio Question Answering (AQA) is a key task for evaluating Audio-Language Models (ALMs), yet assessing open-ended responses remains challenging. Existing metrics used for AQA such…
eess.AS2025
MMAU-Pro: A Challenging and Comprehensive Benchmark for Holistic Evaluation of Audio General Intelligence
Sonal Kumar, Å imon SedláÄek, Vaibhavi Lokegaonkar +31
Audio comprehension-including speech, non-speech sounds, and music-is essential for achieving human-level intelligence. Consequently, AI agents must demonstrate holistic audio unde…