Exploring Concept Contribution Spatially: Hidden Layer Interpretation with Spatial Activation Concept Vector

Andong Wang, Wei-Ning Lee

To interpret deep learning models, one mainstream is to explore the learned concepts by networks. Testing with Concept Activation Vector (TCAV) presents a powerful tool to quantify…