Shared SFT Lessons Across Alignment, Model Organisms, and Toy Models

Anton de la Fuente, Arthur Conmy

The paper investigates whether lessons learned from supervised fine-tuning (SFT) in alignment training, model organisms, and toy models can be transferred across these domains, dem…