Hierarchical Compression of Vision-Language Model Benchmarks

Hyunjong Ok, Seunggu Kang, Jaeho Lee

Thorough evaluation of vision-language models (VLMs) has become prohibitively expensive, as benchmarks span an ever-broader spectrum of capabilities and new models arrive at a rele…