Hallucination Reduction for LLM-Based Audio Understanding via Multimodal Direct Preference Optimization

Bebe Cosgrove, Aaron Isidore Grace, Weiran Wang

Large Audio Language Models (LALMs) are prone to hallucinating and over-relying on text priors when simultaneously presented with audio and text inputs. To mitigate these hallucina…