Interpreting Vision and Language Generative Models with Semantic Visual Priors

Michele Cafagna, Lina M. Rojas-Barahona, Kees van Deemter +1

When applied to Image-to-text models, interpretability methods often provide token-by-token explanations namely, they compute a visual explanation for each token of the generated s…