4 papers · 1 filter
Ranked from Within: Ranking Large Multimodal Models Without Labels
Weijie Tu, Weijian Deng, Dylan Campbell +4
Can the relative performance of a pre-trained large multimodal model (LMM) be predicted without access to labels? As LMMs proliferate, it becomes increasingly important to develop…
Toward a Holistic Evaluation of Robustness in CLIP Models
Weijie Tu, Weijian Deng, Tom Gedeon
Contrastive Language-Image Pre-training (CLIP) models have shown significant potential, particularly in zero-shot classification across diverse distribution shifts. Building on exi…
An Empirical Study Into What Matters for Calibrating Vision-Language Models
Weijie Tu, Weijian Deng, Dylan Campbell +2
Vision-Language Models (VLMs) have emerged as the dominant approach for zero-shot recognition, adept at handling diverse scenarios and significant distribution changes. However, th…
A Closer Look at the Robustness of Contrastive Language-Image Pre-Training (CLIP)
Weijie Tu, Weijian Deng, Tom Gedeon
Contrastive Language-Image Pre-training (CLIP) models have demonstrated remarkable generalization capabilities across multiple challenging distribution shifts. However, there is st…