Controlling Action-Head Co-Adaptation to VLM Representation Anisotropy

Ruijie Zhang, Jiayin Zheng, Yequan Zhao +8

Modern learning systems increasingly combine pretrained models with downstream heads. Despite the growing importance of such modular designs, how the downstream model co-adapts to…