Structuring Sparsity: Block-Sparse Featurizers Capture Visual Concept Manifolds

Thomas Fel, Matthew Kowal, Mozes Jacobs +22

What is the geometry of a visual percept? The most widely used protocols for decomposing neural network representations into interpretable parts treat concepts as isolated directio…