Relational Knowledge Distillation Using Fine-tuned Function Vectors

Andrea Kang, Yingnian Wu, Hongjing Lu

Representing relations between concepts is a core prerequisite for intelligent systems to make sense of the world. Recent work using causal mediation analysis has shown that a smal…