5 papers
LazySloth: Bounded LLM-based Lazy Tree Search for Fast Long Video Comprehension
Arka Mukherjee, Kaleen Shrestha, Larissa Zhu +1
Modern vision-language models (VLMs) have shown promising results in long-video understanding due to the rich semantic information they can capture. However, most methods focus on…
GeoAgent: Evaluating VLM Geolocalization Through Embodied Navigation
Arka Mukherjee, Soham Roy, Kartikeya Trivedi +1
Modern Vision-Language Models (VLMs) perform well above the human baseline in image geolocalization, a task critically important in disaster response, OSINT verification, and locat…
mmJEE-Eval: A Bilingual Multimodal Benchmark for Evaluating Scientific Reasoning in Vision-Language Models
Arka Mukherjee, Shreya Ghosh
Contemporary vision-language models (VLMs) perform well on existing multimodal reasoning benchmarks (78-85\% accuracy on MMMU, MathVista). Yet, these results fail to sufficiently d…
Toward Socially Aware Vision-Language Models: Evaluating Cultural Competence Through Multimodal Story Generation
Arka Mukherjee, Shreya Ghosh
As Vision-Language Models (VLMs) achieve widespread deployment across diverse cultural contexts, ensuring their cultural competence becomes critical for responsible AI systems. Whi…
UNITE-FND: Reframing Multimodal Fake News Detection through Unimodal Scene Translation
Arka Mukherjee, Shreya Ghosh
Multimodal fake news detection typically demands complex architectures and substantial computational resources, posing deployment challenges in real-world settings. We introduce UN…