2 papers
cs.SD2025
Evaluating Multimodal Large Language Models on Core Music Perception Tasks
Brandon James Carone, Iran R. Roman, Pablo Ripollés
Multimodal Large Language Models (LLMs) claim "musical understanding" via evaluations that conflate listening with score reading. We benchmark three SOTA LLMs (Gemini 2.5 Pro, Gemi…
cs.AI2025
The MUSE Benchmark: Probing Music Perception and Auditory Relational Reasoning in Audio LLMS
Brandon James Carone, Iran R. Roman, Pablo Ripollés
Multimodal Large Language Models (MLLMs) have demonstrated capabilities in audio understanding, but current evaluations may obscure fundamental weaknesses in relational reasoning.…