Multi-modal, Multi-task, Multi-criteria Automatic Evaluation with Vision Language Models

Masanari Ohi, Masahiro Kaneko, Naoaki Okazaki +1

Vision-language models (VLMs) have shown impressive abilities across a range of multi-modal tasks. However, existing metrics for evaluating the quality of text generated by VLMs ty…