The Parser Already Knows: Lightweight Bias Correction in Constrained Decoding

Işıl Özgü, Yaoxuan Wu, Guy Van den Broeck +1

Grammar Constrained Decoding (GCD) forces Language Models (LMs) to produce syntactically valid outputs by masking out non-conforming tokens at each step. However, rigid masking dis…