What Does Prompt Learning Change? -A Natural-Language Concept Analysis of Vision-Language Models

Ryo Kamiya, Hiroshi Kera, Kazuhiko Kawamoto

Prompt learning adapts vision-language models such as CLIP by optimizing continuous prompt vectors, but the learned prompts are difficult to interpret in natural language. We prese…