One Mask to Rule Them All: On Hidden Facts after Editing and How to Find Them

Ali Holmov, Paul Youssef, Nandi Schoots +1

Knowledge editing methods such as ROME and MEMIT update factual associations in transformer models by modifying MLP weights. While evaluated mainly by output behavior, their intern…