5 papers
PRiSM: Prototype Regularization for Few-Shot VLMs
Ghassen Baklouti, Omprakash Chakraborty, Jose Dolz +1
Training-free few-shot adaptation methods have gained significant attention recently in the context of Vision-language Models (VLMs). Yet, current benchmarks rely on strong assumpt…
Quantile Adaptive Temperature Scaling for Confidence Calibration
Omprakash Chakraborty, Leo Fillioux, Ismail Ben Ayed +1
Deep neural networks often produce poorly calibrated confidence estimates, overstating their certainty even when predictions are incorrect. Temperature Scaling remains the most wid…
ORION: ORthonormal Text Encoding for Universal VLM AdaptatION
Omprakash Chakraborty, Jose Dolz, Ismail Ben Ayed
Vision language models (VLMs) have demonstrated remarkable generalization across diverse tasks, yet their performance remains constrained by the quality and geometry of the textual…
Information Maximization for Long-Tailed Semi-Supervised Domain Generalization
Leo Fillioux, Omprakash Chakraborty, Quentin Gopée +6
Semi-supervised domain generalization (SSDG) has recently emerged as an appealing alternative to tackle domain generalization when labeled data is scarce but unlabeled samples acro…
SoC: Semantic Orthogonal Calibration for Test-Time Prompt Tuning
Leo Fillioux, Omprakash Chakraborty, Ismail Ben Ayed +4
With the increasing adoption of vision-language models (VLMs) in critical decision-making systems such as healthcare or autonomous driving, the calibration of their uncertainty est…