Distributed Sparse Interventions in Language Models

Maximilian S. Ernst, Lorenz Linhardt, Aaron Peikert +1

Language models can perform a wide range of tasks at various levels of abstraction. They flexibly infer tasks from context, execute multiple tasks simultaneously, and select among…