6 papers · 1 filter
PRiSM: Prototype Regularization for Few-Shot VLMs
Ghassen Baklouti, Omprakash Chakraborty, Jose Dolz +1
Training-free few-shot adaptation methods have gained significant attention recently in the context of Vision-language Models (VLMs). Yet, current benchmarks rely on strong assumpt…
Quantile Adaptive Temperature Scaling for Confidence Calibration
Omprakash Chakraborty, Leo Fillioux, Ismail Ben Ayed +1
Deep neural networks often produce poorly calibrated confidence estimates, overstating their certainty even when predictions are incorrect. Temperature Scaling remains the most wid…
ORION: ORthonormal Text Encoding for Universal VLM AdaptatION
Omprakash Chakraborty, Jose Dolz, Ismail Ben Ayed
Vision language models (VLMs) have demonstrated remarkable generalization across diverse tasks, yet their performance remains constrained by the quality and geometry of the textual…
Information Maximization for Long-Tailed Semi-Supervised Domain Generalization
Leo Fillioux, Omprakash Chakraborty, Quentin Gopée +6
Semi-supervised domain generalization (SSDG) has recently emerged as an appealing alternative to tackle domain generalization when labeled data is scarce but unlabeled samples acro…
Locality-Attending Vision Transformer
Sina Hajimiri, Farzad Beizaee, Fereshteh Shakeri +3
Vision transformers have demonstrated remarkable success in classification by leveraging global self-attention to capture long-range dependencies. However, this same mechanism can…
Histopath-C: Towards Realistic Domain Shifts for Histopathology Vision-Language Adaptation
Mehrdad Noori, Gustavo Adolfo Vargas Hakim, David Osowiechi +6
Medical Vision-language models (VLMs) have shown remarkable performances in various medical imaging domains such as histo\-pathology by leveraging pre-trained, contrastive models t…