Showing cs.CVShow all
3 papers · 1 filter
cs.CV2024
The Inter-Intra Modal Measure: A Predictive Lens on Fine-Tuning Outcomes in Vision-Language Models
Laura Niss, Kevin Vogt-Lowell, Theodoros Tsiligkaridis
The fine-tuning of large vision-language foundation models remains an underexplored area, particularly regarding its impact on learning gains and catastrophic forgetting. Inspired…
cs.CV2024
Quantified Task Misalignment to Inform PEFT: An Exploration of Domain Generalization and Catastrophic Forgetting in CLIP
Laura Niss, Kevin Vogt-Lowell, Theodoros Tsiligkaridis
Foundations models are presented as generalists that often perform well over a myriad of tasks. Fine-tuning these models, even on limited data, provides an additional boost in task…
cs.CV2023
Robust Fine-Tuning of Vision-Language Models for Domain Generalization
Kevin Vogt-Lowell, Noah Lee, Theodoros Tsiligkaridis +1
Transfer learning enables the sharing of common knowledge among models for a variety of downstream tasks, but traditional methods suffer in limited training data settings and produ…