4 papers · 1 filter
Is your algorithm unlearning or untraining?
Eleni Triantafillou, Ahmed Imtiaz Humayun, Monica Ribero +3
As models are getting larger and are trained on increasing amounts of data, there has been an explosion of interest into how we can ``delete'' specific data points or behaviours fr…
Step-resolved data attribution for looped transformers
Georgios Kaissis, David Mildenberger, Juan Felipe Gomez +2
We study how individual training examples shape the internal computation of looped transformers, where a shared block is applied for recurrent iterations to enable latent reaso…
Counterfactual Influence as a Distributional Quantity
Matthieu Meeus, Igor Shilov, Georgios Kaissis +1
Machine learning models are known to memorize samples from their training data, raising concerns around privacy and generalization. Counterfactual self-influence is a popular metri…
Redirection for Erasing Memory (REM): Towards a universal unlearning method for corrupted data
Stefan Schoepf, Michael Curtis Mozer, Nicole Elyse Mitchell +4
Machine unlearning is studied for a multitude of tasks, but specialization of unlearning methods to particular tasks has made their systematic comparison challenging. To address th…