CircuitBreak: Pruning a Sparse Safety Circuit of Neurons

Jincheng Ying, Li Wenlin, Wencheng Yang +1

White-box neuron pruning has shown that refusal in large language models (LLMs) can depend on a small, removable set of feed-forward (FFN) channels. Existing attacks either need ca…