Shared SFT Lessons Across Alignment, Model Organisms, and Toy Models

Anton de la Fuente, Arthur Conmy

Alignment training, model organisms, and toy models are usually treated as separate research areas. But projects in all three frequently use supervised fine-tuning (SFT) to pursue…