Steering Language Models with Weight Arithmetic

Constanza Fierro, Fabien Roger

Providing high-quality feedback to Large Language Models (LLMs) on a diverse training distribution can be difficult and expensive, and providing feedback only on a narrow distribut…