Order-sensitive Shapley Values for Evaluating Conceptual Soundness of NLP Models

Kaiji Lu, Anupam Datta

Previous works show that deep NLP models are not always conceptually sound: they do not always learn the correct linguistic concepts. Specifically, they can be insensitive to word…