Model Specific Task Similarity for Vision Language Model Selection via Layer Conductance

Wei Yang, Hong Xie, Tao Tan +3

While open sourced Vision-Language Models (VLMs) have proliferated, selecting the optimal pretrained model for a specific downstream task remains challenging. Exhaustive evaluation…