AU-Harness: An Open-Source Toolkit for Efficient and Unified Evaluation of AUdio-LLMs

Hoang Nguyen, Sidharth Surapaneni, Akshay Kalkunte +9

Large Audio Language Models (LALMs) are rapidly advancing, but evaluating them remains challenging due to inefficient and nonstandardized toolkits that limit fair comparison and sy…