18 citations · 19 across the 2 of their papers we have counts for
4 papers
Mitigating Response Delays in Free-Form Conversations with LLM-powered Intelligent Virtual Agents
Mykola Maslych, Mohammadreza Katebi, Christopher Lee +9
We investigated the challenges of mitigating response delays in free-form conversations with virtual agents powered by Large Language Models (LLMs) within Virtual Reality (VR). For…
A Culturally-diverse Multilingual Multimodal Video Benchmark & Model
Bhuiyan Sanjid Shafique, Ashmal Vayani, Muhammad Maaz +26
Large multimodal models (LMMs) have recently gained attention due to their effectiveness to understand and generate descriptions of visual content. Most existing LMMs are in Englis…
Takeaways from Applying LLM Capabilities to Multiple Conversational Avatars in a VR Pilot Study
Mykola Maslych, Christian Pumarada, Amirpouya Ghasemaghaei +1
We present a virtual reality (VR) environment featuring conversational avatars powered by a locally-deployed LLM, integrated with automatic speech recognition (ASR), text-to-speech…
All Languages Matter: Evaluating LMMs on Culturally Diverse 100 Languages
Ashmal Vayani, Dinura Dissanayake, Hasindri Watawana +66
Existing Large Multimodal Models (LMMs) generally focus on only a few regions and languages. As LMMs continue to improve, it is increasingly important to ensure they understand cul…