4 papers
GRACE:Gradient-guided Coreset Selection for LLM Unlearning
Praveen Bushipaka, Andrea D'Angelo, Lucia Passaro +1
Machine Unlearning methods for Large Language Models typically assume pre-specified forget and retain sets. In realistic settings, however, requests may provide only a few examples…
Standard vs. Modular Sampling: Best Practices for Reliable LLM Unlearning
Praveen Bushipaka, Lucia Passaro, Tommaso Cucinotta
A conventional LLM Unlearning setting consists of two subsets -"forget" and "retain", with the objectives of removing the undesired knowledge from the forget set while preserving t…
Embracing Diversity: A Multi-Perspective Approach with Soft Labels
Benedetta Muscato, Praveen Bushipaka, Gizem Gezici +3
Prior studies show that adopting the annotation diversity shaped by different backgrounds and life experiences and incorporating them into the model learning, i.e. multi-perspectiv…
Multi-Perspective Stance Detection
Benedetta Muscato, Praveen Bushipaka, Gizem Gezici +2
Subjective NLP tasks usually rely on human annotations provided by multiple annotators, whose judgments may vary due to their diverse backgrounds and life experiences. Traditional…