Steered Generation via Gradient-Based Optimization on Sparse Query Features

Sumanta Bhattacharyya, Pedram Rooshenas

Latent steering exploits internal representations of Large Language Models (LLMs) to guide generation, yet interventions on dense states can entangle distinct semantic features. In…