The Professor: Multi-Teacher Unsupervised Prompt Distillation for Vision-Language Models

Ahmad Algadhi, Ahmed Alzuhair, Omar Alkhulaif +1

Prompt distillation compresses large vision-language models (VLMs) such as CLIP into lightweight student models by matching teacher predictions on unlabeled domain images. PromptKD…