CARPRT: Class-Aware Zero-Shot Prompt Reweighting for Black-Box Vision-Language Models

Ruijiang Dong, Zesheng Ye, Jianzhong Qi +4

Pre-trained vision-language models (VLMs) enable zero-shot image classification by computing the similarity score between an image and textual descriptions, typically formed by ins…