Auditing Visualizations: Transparency Methods Struggle to Detect Anomalous Behavior

Jean-Stanislas Denain, Jacob Steinhardt

Model visualizations provide information that outputs alone might miss. But can we trust that model visualizations reflect model behavior? For instance, can they diagnose abnormal…