DeAR: Fine-Grained VLM Adaptation by Decomposing Attention Head Roles

Yiming Ma, Hongkun Yang, Lionel Z. Wang +3

Prompt learning is a dominant paradigm for adapting pre-trained Vision-Language Models (VLMs) to downstream tasks. However, existing methods often rely on a simplistic, layer-centr…