Feature Extraction and Steering for Enhanced Chain-of-Thought Reasoning in Language Models

Zihao Li, Xu Wang, Yuzhe Yang +3

Large Language Models (LLMs) demonstrate the ability to solve reasoning and mathematical problems using the Chain-of-Thought (CoT) technique. Expanding CoT length, as seen in model…