1 citations · 2 across the 14 of their papers we have counts for
3 papers · 1 filter
What Shapes Emergent Misalignment? Insights from Training Dynamics, Model Priors, and Data
Yuchen Zhang, Anietta Weckauff, Diego Garcia-Olano +1
Emergent misalignment (EM) is a phenomenon in which models generalize with narrow fine-tuning, leading to broad (yet uneven) misalignment across evaluation questions. We study EM a…
Characterizing the Consistency of the Emergent Misalignment Persona
Anietta Weckauff, Yuchen Zhang, Maksym Andriushchenko
Fine-tuning large language models (LLMs) on narrowly misaligned data generalizes to broadly misaligned behavior, a phenomenon termed emergent misalignment (EM). While prior work ha…
Enhancing Transferability of Adversarial Attacks with GE-AdvGAN+: A Comprehensive Framework for Gradient Editing
Zhibo Jin, Jiayu Zhang, Zhiyu Zhu +4
Transferable adversarial attacks pose significant threats to deep neural networks, particularly in black-box scenarios where internal model information is inaccessible. Studying ad…