DeGMatch: Target-Aware Reasoning Data Selection via Deconfounded Gradient Matching

Changho Lee, Janghoon Han, Rajdeep Mukherjee +4

Reasoning post-training on long trajectories has substantially improved the reasoning capabilities of large language models, but scaling such training to large datasets is increasi…