4 papers · 1 filter
Making Slow Thinking Faster: Compressing LLM Chain-of-Thought via Step Entropy
Zeju Li, Jianyuan Zhong, Ziyang Zheng +5
Large Language Models (LLMs) using Chain-of-Thought (CoT) prompting excel at complex reasoning but generate verbose thought processes with considerable redundancy, leading to incre…
Reasoning Scaffolding: Distilling the Flow of Thought from LLMs
Xiangyu Wen, Junhua Huang, Zeju Li +6
The prevailing approach to distilling reasoning from Large Language Models (LLMs)-behavioral cloning from textual rationales-is fundamentally limited. It teaches Small Language Mod…
Mathesis: Towards Formal Theorem Proving from Natural Languages
Yu Xuejun, Jianyuan Zhong, Zijin Feng +17
Recent advances in large language models show strong promise for formal reasoning. However, most LLM-based theorem provers have long been constrained by the need for expert-written…
Solve-Detect-Verify: Inference-Time Scaling with Flexible Generative Verifier
Jianyuan Zhong, Zeju Li, Zhijian Xu +3
Large Language Model (LLM) reasoning for complex tasks inherently involves a trade-off between solution accuracy and computational efficiency. The subsequent step of verification,…