A mixed policy to improve performance of language models on math problems

Gang Chen

When to solve math problems, most language models take a sampling strategy to predict next word according conditional probabilities. In the math reasoning step, it may generate wro…