1 citations · 1 across the 10 of their papers we have counts for
4 papers · 1 filter
Does On-Policy Distillation Need to Complete Every Rollout?
Zhengxin Zhang, Maosen Tang, Ning Wang +6
On-policy distillation (OPD) transfers teacher knowledge to a student through feedback on student-generated rollouts, but generating complete rollouts and computing per-token teach…
Matryoshka Agent: Unfolding Sub-Agents for Long-Horizon Machine Learning Engineering
Rushi Qiang, Changhao Li, Haotian Sun +3
Machine learning engineering (MLE) tasks require long-horizon decision making over iterative solution debugging and refinement, under expensive and feedback-driven environment inte…
IMUG-Bench: Benchmarking Unified Multimodal Models on Interleaved Understanding and Generation
Lingyi Meng, Zecong Tang, Haoran Li +12
In recent years, unified multimodal models (UMMs) have emerged to support both understanding and generation within a single framework. Mastering dynamic, multi-turn interleaved ima…
Forward-Free Diffusion Language Models with BPTT-Free Looped Refinement
Haotian Sun, Rushi Qiang, Yuqian Zheng +1
Diffusion language models generate text through iterative denoising, offering a powerful alternative to autoregressive generation. However, discrete language spaces lack a natural…