4 papers
Do Speech Emphasis Models Generalize across Languages and Emotions?
Megan Wei, Deepali Aneja, Jiaqi Su +3
Prosodic emphasis varies across languages, emotions, and speaking styles, yet existing emphasis detection models are largely trained and evaluated on monolingual neutral read speec…
You May Speak Freely: Improving the Fine-Grained Visual Recognition Capabilities of Multimodal Large Language Models with Answer Extraction
Logan Lawrence, Oindrila Saha, Megan Wei +3
Despite the renewed interest in zero-shot visual classification due to the rise of Multimodal Large Language Models (MLLMs), the problem of evaluating free-form responses of auto-r…
Prevailing Research Areas for Music AI in the Era of Foundation Models
Megan Wei, Mateusz Modrzejewski, Aswin Sivaraman +1
Parallel to rapid advancements in foundation model research, the past few years have witnessed a surge in music AI applications. As AI-generated and AI-augmented music become incre…
Language-Informed Synthesis of Rational Agent Models for Grounded Theory-of-Mind Reasoning On-The-Fly
Lance Ying, Ryan Truong, Katherine M. Collins +6
Drawing real world social inferences usually requires taking into account information from multiple modalities. Language is a particularly powerful source of information in social…