Scalable Knowledge Editing for Mixture-of-Experts LLMs via Tensor-Structured Updates

Roman Maksimov, Vladimir Aletov, Dmitry Bylinkin +3

Knowledge editing (KE) provides a lightweight alternative to repeated fine-tuning of LLMs. However, most existing KE methods target dense feed-forward layers, while modern LLMs inc…