Model Reconstruction from Model Explanations

Smitha Milli, Ludwig Schmidt, Anca D. Dragan +1

We show through theory and experiment that gradient-based explanations of a model quickly reveal the model itself. Our results speak to a tension between the desire to keep a propr…