5 papers
GeoAgent: Evaluating VLM Geolocalization Through Embodied Navigation
Arka Mukherjee, Soham Roy, Kartikeya Trivedi +1
Modern Vision-Language Models (VLMs) perform well above the human baseline in image geolocalization, a task critically important in disaster response, OSINT verification, and locat…
IntelliCode: A Multi-Agent LLM Tutoring System with Centralized Learner Modeling
Jones David, Shreya Ghosh
LLM-based tutors are typically single-turn assistants that lack persistent representations of learner knowledge, making it difficult to provide principled, transparent, and long-te…
mmJEE-Eval: A Bilingual Multimodal Benchmark for Evaluating Scientific Reasoning in Vision-Language Models
Arka Mukherjee, Shreya Ghosh
Contemporary vision-language models (VLMs) perform well on existing multimodal reasoning benchmarks (78-85\% accuracy on MMMU, MathVista). Yet, these results fail to sufficiently d…
Toward Socially Aware Vision-Language Models: Evaluating Cultural Competence Through Multimodal Story Generation
Arka Mukherjee, Shreya Ghosh
As Vision-Language Models (VLMs) achieve widespread deployment across diverse cultural contexts, ensuring their cultural competence becomes critical for responsible AI systems. Whi…
UNITE-FND: Reframing Multimodal Fake News Detection through Unimodal Scene Translation
Arka Mukherjee, Shreya Ghosh
Multimodal fake news detection typically demands complex architectures and substantial computational resources, posing deployment challenges in real-world settings. We introduce UN…