10 papers
Human-AI Perceptual Alignment by Playing Hues and Cues
Nuria Alabau-Bosque, Jorge Vila-Tomás, Paula Daudén-Oliver +3
Evaluating the perceptual alignment between Contrastive Vision-Language Models (CVLMs) and humans is typically constrained by traditional benchmarks that overlook fine-grained sema…
Do Vision Encoders Exhibit Human-like Color Thresholds?
Engy Ehab, Pablo Hernández-Cámara, Nahla Belal +3
Understanding and characterizing human color perception is a longstanding research goal. One of the most traditional approaches is looking for the human color discrimination thresh…
On the dynamic evolution of CLIP texture-shape bias and its relationship to human alignment and model robustness
Pablo Hernández-Cámara, Jose Manuel Jaén-Lorites, Alexandra Gómez-Villa +3
Contrastive language-image models such as CLIP have demonstrated remarkable generalization capabilities. However, how their internal visual representations evolve during training a…
Contrast Sensitivity in Multimodal Large Language Models: A Psychophysics-Inspired Evaluation
Pablo Hernández-Cámara, Alexandra Gomez-Villa, Jose Manuel Jaén-Lorites +3
Understanding how Multimodal Large Language Models (MLLMs) process low-level visual features is critical for evaluating their perceptual abilities and has not been systematically c…
Color Names in Vision-Language Models
Alexandra Gomez-Villa, Pablo Hernández-Cámara, Muhammad Atif Butt +3
Color serves as a fundamental dimension of human visual perception and a primary means of communicating about objects and scenes. As vision-language models (VLMs) become increasing…
Hues and Cues: Human vs. CLIP
Nuria Alabau-Bosque, Jorge Vila-Tomás, Paula Daudén-Oliver +4
Playing games is inherently human, and a lot of games are created to challenge different human characteristics. However, these tasks are often left out when evaluating the human-li…