Prototypicality Bias Reveals Blindspots in Multimodal Evaluation Metrics

Subhadeep Roy, Gagan Bhatia, Steffen Eger

Automatic metrics are widely used to evaluate text-to-image models, often replacing human judgment in benchmarking, model selection, and large-scale data filtering. Yet they may re…