ToW: Thoughts of Words Improve Reasoning in Large Language Models

Zhikun Xu, Ming Shen, Jacob Dineen +6

We introduce thoughts of words (ToW), a novel training-time data-augmentation method for next-word prediction. ToW views next-word prediction as a core reasoning task and injects f…