Abstraction Alignment: Comparing Model-Learned and Human-Encoded Conceptual Relationships

Angie Boggust, Hyemin Bang, Hendrik Strobelt +1

While interpretability methods identify a model's learned concepts, they overlook the relationships between concepts that make up its abstractions and inform its ability to general…