Interpreting ResNet-based CLIP via Neuron-Attention Decomposition

Edmund Bu, Yossi Gandelsman

We present a novel technique for interpreting the neurons in CLIP-ResNet by decomposing their contributions to the output into individual computation paths. More specifically, we a…