Backtracking Improves Generation Safety

Yiming Zhang, Jianfeng Chi, Hailey Nguyen +4

Text generation has a fundamental limitation almost by definition: there is no taking back tokens that have been generated, even when they are clearly problematic. In the context o…