Semantic Capability Acquisition and Specialization During Vision-Language Model Fine-Tuning

Suguru Onda, Matthew Bailey, Ryan Farrell

Fine-tuning vision-language models (VLMs) is typically evaluated at a single downstream checkpoint, obscuring whether a semantic capability was never acquired or emerged earlier an…