MBTSAD: Mitigating Backdoors in Language Models Based on Token Splitting and Attention Distillation

Yidong Ding, Jiafei Niu, Ping Yi

In recent years, attention-based models have excelled across various domains but remain vulnerable to backdoor attacks, often from downloading or fine-tuning on poisoned datasets.…