Parser Transitions Already Reveal Structural Responsibility: KV Persistence for Structured Generation

Linze Wu, Xinrui Chen

LLM agents use structured generation for JSON, SQL, and function calls. Constrained decoding ensures valid formats, but KV compression can discard history needed for correct functi…