Trie Automata for Constrained Decoding over Large Finite Sets

Xingzi Xu, Karim Bouyarmane

Large language models increasingly need to generate structured outputs that conform to predefined schemas, with one common constraint being selection from a finite set of valid str…