activity
20232026
most citedMedical Vision Language Pretraining: A survey

8 citations · 24 across the 27 of their papers we have counts for

collaborators

28 papers

cs.CV2026

Naming the Concepts Classifiers Rely On: Language-Anchored Decomposition for Faithful Explanation

Ahsan Habib Akash, Dipkamal Bhusal, Stacey Jones +3

Deep neural networks are widely deployed in high-stakes visual applications where interpretability is critical, yet existing explanations face a trade-off: post-hoc concept methods…

cs.CV2026

ProMoE-FL: Prototype-conditioned Mixture of Experts for Multimodal Federated Learning with Missing Modalities

Aavash Chhetri, Bibek Niroula, Eduard Vazquez +4

In this paper, we address the problem of multimodal federated learning with missing modality. Existing methods utilize an additional public dataset or perform naive feature synthes…

cs.CV2026

A Benchmark for Hallucination Detection in VLMs for Gastrointestinal Endoscopy

Aminu Lawal, Niyoj Oli, Sachin Acharya +3

Vision-language models (VLMs) are prone to hallucination, which remains a major barrier to their safe deployment in clinical practice. To date, most hallucination detection methods…

cs.LG2026

When Confidence Lacks Concepts: Interpretable OOD Detection via Representation Perturbations

Anju Chhetri, Pratik Shrestha, Ramesh Rana +3

Deep neural networks have achieved remarkable performance across medical imaging tasks, yet their tendency to overgeneralize under distributional shifts poses a major obstacle to s…

cs.LG2026

Two is better than one: A Collapse-free Multi-Reward RLIF Training Framework

Shourov Joarder, Diganta Sikdar, Ahsan Habib Akash +2

Reinforcement learning with verifiable rewards (RLVR) has substantially improved the reasoning ability of LLMs, but often depends on external supervision from human annotations or…

cs.LG2026

Investigating Trustworthiness of Nonparametric Deep Survival Models for Alzheimer's Disease Progression Analysis

Jacob Thrasher, Kaitlyn Heintzelman, Peter Martone +4

Alzheimer's Dementia (AD) is a progressive neurodegenerative disease marked by irreversible decline, making reliable modeling of its progression essential for effective patient car…

cs.LG2026

FedVG: Gradient-Guided Aggregation for Enhanced Federated Learning

Alina Devkota, Jacob Thrasher, Donald Adjeroh +2

Federated Learning (FL) enables collaborative model training across multiple clients without sharing their private data. However, data heterogeneity across clients leads to client…

cs.CV2026

Med-MMFL: A Multimodal Federated Learning Benchmark in Healthcare

Aavash Chhetri, Bibek Niroula, Pratik Shrestha +5

Federated learning (FL) enables collaborative model training across decentralized medical institutions while preserving data privacy. However, medical FL benchmarks remain scarce,…

cs.LG2025

Local K-Similarity Constraint for Federated Learning with Label Noise

Sanskar Amgain, Prashant Shrestha, Bidur Khanal +5

Federated learning on clients with noisy labels is a challenging problem, as such clients can infiltrate the global model, impacting the overall generalizability of the system. Exi…

cs.CV2025

Effect of Data Augmentation on Conformal Prediction for Diabetic Retinopathy

Rizwan Ahamed, Annahita Amireskandari, Joel Palko +3

The clinical deployment of deep learning models for high-stakes tasks such as diabetic retinopathy (DR) grading requires demonstrable reliability. While models achieve high accurac…

cs.CV2025

Addressing Bias in VLMs for Glaucoma Detection Without Protected Attribute Supervision

Ahsan Habib Akash, Greg Murray, Annahita Amireskandari +4

Vision-Language Models (VLMs) have achieved remarkable success on multimodal tasks such as image-text retrieval and zero-shot classification, yet they can exhibit demographic biase…

cs.CV2025

Hallucination-Aware Multimodal Benchmark for Gastrointestinal Image Analysis with Large Vision-Language Models

Bidur Khanal, Sandesh Pokhrel, Sanjay Bhandari +7

Vision-Language Models (VLMs) are becoming increasingly popular in the medical domain, bridging the gap between medical images and clinical language. Existing VLMs demonstrate an i…

cs.CV2025

NERO: Explainable Out-of-Distribution Detection with Neuron-level Relevance

Anju Chhetri, Jari Korhonen, Prashnna Gyawali +1

Ensuring reliability is paramount in deep learning, particularly within the domain of medical imaging, where diagnostic decisions often hinge on model outputs. The capacity to sepa…

cs.LG2025

Multimodal Federated Learning With Missing Modalities through Feature Imputation Network

Pranav Poudel, Aavash Chhetri, Prashnna Gyawali +2

Multimodal federated learning holds immense potential for collaboratively training models from multiple sources without sharing raw data, addressing both data scarcity and privacy…

eess.IV2025★ 3 cited

Surgical Vision World Model

Saurabh Koju, Saurav Bastola, Prashant Shrestha +4

Realistic and interactive surgical simulation has the potential to facilitate crucial applications, such as medical professional training and autonomous surgical agent training. In…

cs.CV2024

TTA-OOD: Test-time Augmentation for Improving Out-of-Distribution Detection in Gastrointestinal Vision

Sandesh Pokhrel, Sanjay Bhandari, Eduard Vazquez +3

Deep learning has significantly advanced the field of gastrointestinal vision, enhancing disease diagnosis capabilities. One major challenge in automating diagnosis within gastroin…

cs.CV2024

CAR-MFL: Cross-Modal Augmentation by Retrieval for Multimodal Federated Learning with Missing Modalities

Pranav Poudel, Prashant Shrestha, Sanskar Amgain +3

Multimodal AI has demonstrated superior performance over unimodal approaches by leveraging diverse data sources for more comprehensive analysis. However, applying this effectivenes…

cs.CV2024

TE-SSL: Time and Event-aware Self Supervised Learning for Alzheimer's Disease Progression Analysis

Jacob Thrasher, Alina Devkota, Ahmed Tafti +2

Alzheimer's Dementia (AD) represents one of the most pressing challenges in the field of neurodegenerative disorders, with its progression analysis being crucial for understanding…

cs.LG2024

Active Label Refinement for Robust Training of Imbalanced Medical Image Classification Tasks in the Presence of High Label Noise

Bidur Khanal, Tianhong Dai, Binod Bhattarai +1

The robustness of supervised deep learning-based medical image classification is significantly undermined by label noise. Although several methods have been proposed to enhance cla…

cs.CV2024★ 1 cited

Investigation of Federated Learning Algorithms for Retinal Optical Coherence Tomography Image Classification with Statistical Heterogeneity

Sanskar Amgain, Prashant Shrestha, Sophia Bano +5

Purpose: We apply federated learning to train an OCT image classifier simulating a realistic scenario with multiple clients and statistical heterogeneous data distribution where da…

eess.IV2024

How does self-supervised pretraining improve robustness against noisy labels across various medical image classification datasets?

Bidur Khanal, Binod Bhattarai, Bishesh Khanal +1

Noisy labels can significantly impact medical image classification, particularly in deep learning, by corrupting learned features. Self-supervised pretraining, which doesn't rely o…

cs.CV2023★ 8 cited

Medical Vision Language Pretraining: A survey

Prashant Shrestha, Sanskar Amgain, Bidur Khanal +2

Medical Vision Language Pretraining (VLP) has recently emerged as a promising solution to the scarcity of labeled data in the medical domain. By leveraging paired/unpaired vision a…

cs.CV2023

TextAug: Test time Text Augmentation for Multimodal Person Re-identification

Mulham Fawakherji, Eduard Vazquez, Pasquale Giampa +1

Multimodal Person Reidentification is gaining popularity in the research community due to its effectiveness compared to counter-part unimodal frameworks. However, the bottleneck fo…

cs.LG2023

Dimension Mixer: Group Mixing of Input Dimensions for Efficient Function Approximation

Suman Sapkota, Binod Bhattarai

The recent success of multiple neural architectures like CNNs, Transformers, and MLP-Mixers motivated us to look for similarities and differences between them. We found that these…