Holistic Capability Preservation: Towards Compact Yet Comprehensive Reasoning Models

Ling Team, Caizhi Tang, Chilin Fu +15

This technical report presents Ring-Lite-Distill, a lightweight reasoning model derived from our open-source Mixture-of-Experts (MoE) Large Language Models (LLMs) Ling-Lite. This s…