170 citations · 382 across the 18 of their papers we have counts for
10 papers · 1 filter
Trustworthy Few-Shot Transfer of Medical VLMs through Split Conformal Prediction
Julio Silva-Rodríguez, Ismail Ben Ayed, Jose Dolz
Medical vision-language models (VLMs) have demonstrated unprecedented transfer capabilities and are being increasingly adopted for data-efficient image classification. Despite its…
Few-Shot, Now for Real: Medical VLMs Adaptation without Balanced Sets or Validation
Julio Silva-Rodríguez, Fereshteh Shakeri, Houda Bahig +2
Vision-language models (VLMs) are gaining attention in medical image analysis. These are pre-trained on large, heterogeneous data sources, yielding rich and transferable representa…
Semantic Anchor Transport: Robust Test-Time Adaptation for Vision-Language Models
Shambhavi Mishra, Julio Silva-Rodriguez, Ismail Ben Ayed +2
Large pre-trained vision-language models (VLMs), such as CLIP, have shown unprecedented zero-shot performance across a wide range of tasks. Nevertheless, these models may be unreli…
Robust Calibration of Large Vision-Language Adapters
Balamurali Murugesan, Julio Silva-Rodriguez, Ismail Ben Ayed +1
This paper addresses the critical issue of miscalibration in CLIP-based model adaptation, particularly in the challenging scenario of out-of-distribution (OOD) samples, which has b…
Class and Region-Adaptive Constraints for Network Calibration
Balamurali Murugesan, Julio Silva-Rodriguez, Ismail Ben Ayed +1
In this work, we present a novel approach to calibrate segmentation networks that considers the inherent challenges posed by different categories and object regions. In particular,…
Exploring the Transferability of a Foundation Model for Fundus Images: Application to Hypertensive Retinopathy
Julio Silva-Rodriguez, Jihed Chelbi, Waziha Kabir +4
Using deep learning models pre-trained on Imagenet is the traditional solution for medical image classification to deal with data scarcity. Nevertheless, relevant literature suppor…
Attention to detail: inter-resolution knowledge distillation
Rocío del Amor, Julio Silva-Rodríguez, Adrián Colomer +1
The development of computer vision solutions for gigapixel images in digital pathology is hampered by significant computational limitations due to the large size of whole slide ima…
A Closer Look at the Few-Shot Adaptation of Large Vision-Language Models
Julio Silva-Rodríguez, Sina Hajimiri, Ismail Ben Ayed +1
Efficient transfer learning (ETL) is receiving increasing attention to adapt large pre-trained language-vision models on downstream tasks with a few labeled samples. While signific…
A Foundation Language-Image Model of the Retina (FLAIR): Encoding Expert Knowledge in Text Supervision
Julio Silva-Rodríguez, Hadi Chakor, Riadh Kobbi +2
Foundation vision-language models are currently transforming computer vision, and are on the rise in medical imaging fueled by their very promising generalization capabilities. How…
Gleason Grading of Histology Prostate Images through Semantic Segmentation via Residual U-Net
Amartya Kalapahar, Julio Silva-Rodríguez, Adrián Colomer +2
Worldwide, prostate cancer is one of the main cancers affecting men. The final diagnosis of prostate cancer is based on the visual detection of Gleason patterns in prostate biopsy…