3 papers
cs.CL2026
When Compression Helps and When It Hurts: Condition-Aware Analysis of Chain-of-Thought Distillation
Siyang Lyu, Zhijing Sun, Xinghao Chen +3
Chain-of-Thought (CoT) distillation transfers multi-step reasoning from large reasoning models to smaller students, but verbose teacher traces inflate both training and inference c…
cs.IR2026
AutoDataset: A Lightweight System for Continuous Dataset Discovery and Search
Junzhe Yang, Xinghao Chen, Yunuo Liu +3
The continuous expansion of task-specific datasets has become a major driver of progress in machine learning. However, discovering newly released datasets remains difficult, as exi…
cs.CL2025
Unveiling the Key Factors for Distilling Chain-of-Thought Reasoning
Xinghao Chen, Zhijing Sun, Wenjin Guo +8
Large Language Models (LLMs) excel in reasoning tasks through Chain-of-Thought (CoT) prompting. However, CoT prompting greatly increases computational demands, which has prompted g…