Improving Constrained Language Generation via Self-Distilled Twisted Sequential Monte Carlo

Sooyeon Kim, Giung Nam, Byoungwoo Park +1

Recent work has framed constrained text generation with autoregressive language models as a probabilistic inference problem. Among these, Zhao et al. (2024) introduced a promising…