1 citations · 2 across the 15 of their papers we have counts for
5 papers · 1 filter
TeacherGRPO: Closing the Capacity Gap in Reasoning Distillation via Teacher Alignment
Zhenyu Lei, Zihan Chen, Yaochen Zhu +5
Reasoning distillation from powerful teacher models to smaller students faces the Gap Curse: as teachers grow more sophisticated, their complex distributions increasingly diverge f…
Grounding Memory Summarization in Utility Intent
Zhenyu Lei, Mingjia Shi, Xingbo Fu +3
Existing summarizers for memory systems are typically optimized for human-facing criteria such as faithfulness, which misaligns with their true objective: preserving the evidence n…
Reforming the Mechanism: Editing Reasoning Patterns in LLMs with Circuit Reshaping
Zhenyu Lei, Qiong Wu, Jianxiong Dong +4
Large language models (LLMs) often exhibit flawed reasoning ability that undermines reliability. Existing approaches to improving reasoning typically treat it as a general and mono…
Learning from Diverse Reasoning Paths with Routing and Collaboration
Zhenyu Lei, Zhen Tan, Song Wang +4
Advances in large language models (LLMs) significantly enhance reasoning capabilities but their deployment is restricted in resource-constrained scenarios. Knowledge distillation a…
Harnessing Large Language Models for Disaster Management: A Survey
Zhenyu Lei, Yushun Dong, Weiyu Li +3
Large language models (LLMs) have revolutionized scientific research with their exceptional capabilities and transformed various fields. Among their practical applications, LLMs ha…