2 papers
cs.LG2026
Rethinking Dataset Distillation: Hard Truths about Soft Labels
Priyam Dey, Aditya Sahdev, Sunny Bhati +2
Despite the perceived success of large-scale dataset distillation (DD) methods, recent evidence finds that simple random image baselines perform on-par with state-of-theart DD meth…
cs.LG2025
A Granular Study of Safety Pretraining under Model Abliteration
Shashank Agnihotri, Jonas Jakubassa, Priyam Dey +4
Open-weight LLMs can be modified at inference time with simple activation edits, which raises a practical question for safety: do common safety interventions like refusal training…