Causal Distillation: Transferring Structured Explanations from Large to Compact Language Models

Aggrey Muhebwa, Khalid K. Osman

Large proprietary language models exhibit strong causal reasoning abilities that smaller open-source models struggle to replicate. We introduce a novel framework for distilling cau…