Erased, but Not Gone: Output Forgetting Is Not True Forgetting

Teresa Pui Yee Yong, Win Kent Ong, Chee Seng Chan

Machine unlearning (MU) is commonly judged by output forgetting, such as low forget-set accuracy or reduced membership inference. But if output-level success can coexist with retra…