AIR: Post-training Data Selection for Reasoning via Attention Head Influence

Jinrui Liu, Jeff Wu, Xuanguang Pan +3

LLMs achieve remarkable multi-step reasoning capabilities, yet effectively transferring these skills via post-training distillation remains challenging. Existing data selection met…