Thinking Preference Optimization

Wang Yang, Hongye Jin, Jingfeng Yang +2

Supervised Fine-Tuning (SFT) has been a go-to and effective method for enhancing long chain-of-thought (CoT) reasoning in relatively small LLMs by fine-tuning them with long CoT re…