Fluent dreaming for language models

T. Ben Thompson, Zygimantas Straznickas, Michael Sklar

Feature visualization, also known as "dreaming", offers insights into vision models by optimizing the inputs to maximize a neuron's activation or other internal component. However,…