Categorical Prior Lock-in: Why In-Context Learning Fails for Structured Data

Antonio Pelusi, Stefano Braghin, Alberto Trombetta

Large language models (LLMs) are increasingly used as conditional generators for structured data, relying on in-context learning (ICL) to adapt to new distributions without paramet…