Updating CLIP to Prefer Descriptions Over Captions

Amir Zur, Elisa Kreiss, Karel D'Oosterlinck +2

Although CLIPScore is a powerful generic metric that captures the similarity between a text and an image, it fails to distinguish between a caption that is meant to complement the…