13 citations · 48 across the 17 of their papers we have counts for
17 papers
Beyond the Leaderboard: Design Lessons for Trustworthy Multimodal VQA
Sushant Gautam, Vajira Thambawita, Michael A. Riegler +2
Healthcare multimodal AI must combine visual and textual evidence while remaining reliable and interpretable. Using MediaEval Medico 2025 as a retrospective GI endoscopy case study…
When No Benchmark Exists: Validating Comparative LLM Safety Scoring Without Ground-Truth Labels
Sushant Gautam, Finn Schwall, Annika Willoch Olstad +6
Many deployments must compare candidate language models for safety before a labeled benchmark exists for the relevant language, sector, or regulatory regime. We formalize this sett…
The Moltbook Observatory Archive: an incremental dataset of agent-only social network activity
Sushant Gautam, Annika W. Olstad, Klas H. Pettersen +1
Moltbook is a social media platform in which posts and comments are authored exclusively by autonomous AI agents. We present the Moltbook Observatory Archive, an incremental datase…
VideoHEDGE: Entropy-Based Hallucination Detection for Video-VLMs via Semantic Clustering and Spatiotemporal Perturbations
Sushant Gautam, Cise Midoglu, Vajira Thambawita +2
Hallucinations in video-capable vision-language models (Video-VLMs) remain frequent and high-confidence, while existing uncertainty metrics often fail to align with correctness. We…
HEDGE: Hallucination Estimation via Dense Geometric Entropy for VQA with Vision-Language Models
Sushant Gautam, Michael A. Riegler, Pål Halvorsen
Vision-language models (VLMs) enable open-ended visual question answering but remain prone to hallucinations. We present HEDGE, a unified framework for hallucination detection that…
Medico 2025: Visual Question Answering for Gastrointestinal Imaging
Sushant Gautam, Vajira Thambawita, Michael Riegler +2
The Medico 2025 challenge addresses Visual Question Answering (VQA) for Gastrointestinal (GI) imaging, organized as part of the MediaEval task series. The challenge focuses on deve…
Kvasir-VQA-x1: A Multimodal Dataset for Medical Reasoning and Robust MedVQA in Gastrointestinal Endoscopy
Sushant Gautam, Michael A. Riegler, Pål Halvorsen
Medical Visual Question Answering (MedVQA) is a promising field for developing clinical decision support systems, yet progress is often limited by the available datasets, which can…
Point, Detect, Count: Multi-Task Medical Image Understanding with Instruction-Tuned Vision-Language Models
Sushant Gautam, Michael A. Riegler, Pål Halvorsen
We investigate fine-tuning Vision-Language Models (VLMs) for multi-task medical image understanding, focusing on detection, localization, and counting of findings in medical images…
SoccerChat: Integrating Multimodal Data for Enhanced Soccer Game Understanding
Sushant Gautam, Cise Midoglu, Vajira Thambawita +3
The integration of artificial intelligence in sports analytics has transformed soccer video understanding, enabling real-time, automated insights into complex game dynamics. Tradit…
Comparative Analysis of Audio Feature Extraction for Real-Time Talking Portrait Synthesis
Pegah Salehi, Sajad Amouei Sheshkal, Vajira Thambawita +5
This paper examines the integration of real-time talking-head generation for interviewer training, focusing on overcoming challenges in Audio Feature Extraction (AFE), which often…
Enhancing Structured-Data Retrieval with GraphRAG: Soccer Data Case Study
Zahra Sepasdar, Sushant Gautam, Cise Midoglu +2
Extracting meaningful insights from large and complex datasets poses significant challenges, particularly in ensuring the accuracy and relevance of retrieved information. Tradition…
Kvasir-VQA: A Text-Image Pair GI Tract Dataset
Sushant Gautam, Andrea Storås, Cise Midoglu +4
We introduce Kvasir-VQA, an extended dataset derived from the HyperKvasir and Kvasir-Instrument datasets, augmented with question-and-answer annotations to facilitate advanced mach…
PLayerTV: Advanced Player Tracking and Identification for Automatic Soccer Highlight Clips
Håkon Maric Solberg, Mehdi Houshmand Sarkhoosh, Sushant Gautam +3
In the rapidly evolving field of sports analytics, the automation of targeted video processing is a pivotal advancement. We propose PlayerTV, an innovative framework which harnesse…
Demo: Soccer Information Retrieval via Natural Queries using SoccerRAG
Aleksander Theo Strand, Sushant Gautam, Cise Midoglu +1
The rapid evolution of digital sports media necessitates sophisticated information retrieval systems that can efficiently parse extensive multimodal datasets. This paper demonstrat…
SoccerRAG: Multimodal Soccer Information Retrieval via Natural Queries
Aleksander Theo Strand, Sushant Gautam, Cise Midoglu +1
The rapid evolution of digital sports media necessitates sophisticated information retrieval systems that can efficiently parse extensive multimodal datasets. This paper introduces…
SoccerNet-Echoes: A Soccer Game Audio Commentary Dataset
Sushant Gautam, Mehdi Houshmand Sarkhoosh, Jan Held +7
The application of Automatic Speech Recognition (ASR) technology in soccer offers numerous opportunities for sports analytics. Specifically, extracting audio commentaries with ASR…
Soccer on Social Media
Mehdi Houshmand Sarkhoosh, Sayed Mohammad Majidi Dorcheh, Sushant Gautam +3
In the era of digitalization, social media has become an integral part of our lives, serving as a significant hub for individuals and businesses to share information, communicate,…