Deep Thinking by Markov Chain of Continuous Thoughts

Jiayu Liu, Zhenya Huang, Xuan Yang +6

Transformer-based models can perform complicated reasoning by generating reasoning paths token by token. While effective, this approach often requires generating thousands of token…