5 papers · 1 filter
Selecting Long-Horizon Trajectories for Reliable and Efficient Terminal-Agent Training
Cuong Dang, Hoang Anh Just, Ruoxi Jia
Terminal agents are commonly trained by imitating long teacher trajectories, yet how much of each trajectory to supervise remains unexplored. We study the \emph{supervision horizon…
Capacity-Dependent Effects of Data Selection for Reasoning
Cuong Dang, Hoang Anh Just, Ruoxi Jia
In reasoning supervised fine-tuning, candidate responses for the same instruction can differ substantially in how well they match the student's current distribution. Recent likelih…
Probing Knowledge Holes in Unlearned LLMs
Myeongseob Ko, Hoang Anh Just, Charles Fleming +2
Machine unlearning has emerged as a prevalent technical solution for selectively removing unwanted knowledge absorbed during pre-training, without requiring full retraining. While…
The Signal is in the Steps: Local Scoring for Reasoning Data Selection
Hoang Anh Just, Myeongseob Ko, Ruoxi Jia
Distilling long-form reasoning from teacher models into smaller students requires selecting which candidate solutions to train on. Recent work argues that one should select respons…
Injecting Measurement Information Yields a Fast and Noise-Robust Diffusion-Based Inverse Problem Solver
Jonathan Patsenker, Henry Li, Myeongseob Ko +2
Diffusion models have been firmly established as principled zero-shot solvers for linear and nonlinear inverse problems, owing to their powerful image prior and iterative sampling…