Efficient and Asymptotically Unbiased Constrained Decoding for Large Language Models

Haotian Ye, Himanshu Jain, Chong You +4

In real-world applications of large language models, outputs are often required to be confined: selecting items from predefined product or document sets, generating phrases that co…