Reliability, Faithfulness, and the Limits of Post-hoc Explanations of Opaque Scientific Models

Nick Oh, Helen Jin

Post-hoc explanation methods are routinely used to interpret scientific machine learning models, with the deliverable understood to be insight into the phenomenon the model has bee…