Understanding and Mitigating Overfitting in Prompt Tuning for Vision-Language Models

Chengcheng Ma, Yang Liu, Jiankang Deng +3

Pretrained vision-language models (VLMs) such as CLIP have shown impressive generalization capability in downstream vision tasks with appropriate text prompts. Instead of designing…