Improving In-Context Learning with Reasoning Distillation

Nafis Sadeq, Xin Xu, Zhouhang Xie +4

Language models rely on semantic priors to perform in-context learning, which leads to poor performance on tasks involving inductive reasoning. Instruction-tuning methods based on…