Fooling SHAP with Output Shuffling Attacks

Jun Yuan, Aritra Dasgupta

Explainable AI~(XAI) methods such as SHAP can help discover feature attributions in black-box models. If the method reveals a significant attribution from a ``protected feature'' (…