SURE-EVAL: A Systematic and Unified Agentic Framework for Reproducible Evaluation

Jing Peng, Junhao Du, Yixuan Wang +21

Audio and speech models are released rapidly, but reported scores often conflate model capability with deployment and evaluation choices. The same checkpoint can produce different…