Logits of API-Protected LLMs Leak Proprietary Information

Matthew Finlayson, Xiang Ren, Swabha Swayamdipta

Large language model (LLM) providers often hide the architectural details and parameters of their proprietary models by restricting public access to a limited API. In this work we…