Better Language Model Inversion by Compactly Representing Next-Token Distributions

Murtaza Nazir, Matthew Finlayson, John X. Morris +2

Language model inversion seeks to recover hidden prompts using only language model outputs. This capability has implications for security and accountability in language model deplo…