Interpreting Transformers Through Attention Head Intervention

Mason Kadem, Rong Zheng

Neural networks are growing more capable on their own, but we do not understand their neural mechanisms. Understanding these mechanisms' decision-making processes, or mechanistic i…