7 papers
INTACT: Inducing Latent Reasoning on a Frozen Backbone
Kutay Tire, Atula Tejaswi, Haris Vikalo +1
Latent reasoning replaces natural-language chains of thought with compact continuous "soft-token" representations, reducing the number of intermediate tokens that must be decoded a…
Reward-Gated On-Policy Distillation
Mohammad Sadegh Akhondzadeh, Vijay Lingam, Atula Tejaswi +3
On-policy distillation is a powerful way to transfer reasoning ability from a strong teacher to a smaller student: the student samples trajectories from its own policy, and the tea…
OpenThoughts-Agent: Data Recipes for Agentic Models
Negin Raoof, Richard Zhuang, Marianna Nezhurina +47
Agentic language models dramatically expand the applications of AI yet little is publicly known about how to curate training data for broadly capable agents. Existing open efforts…
Walk fast but be careful: Understanding Parallel Sampling in Masked Diffusion
Vansh Bansal, Cho Cholyeon, Cholyeon Cho +3
In this paper, we use random walks on graphs as a verifiable sandbox for studying parallel sampling strategies in masked diffusion models (MDMs). We train an MDM on random walk sam…
Test-Time Speculation
Avinash Kumar, Sujay Sanghavi, Poulami Das
Speculative decoding accelerates LLM inference by using a fast draft model to generate tokens and a more accurate target model to verify them. Its performance depends on the $\text…
Entropy Aware Reward Guidance for Diffusion Language Model Alignment
Atula Tejaswi, Litu Rout, Constantine Caramanis +2
Reward guidance, also known as posterior sampling, is a popular method for test-time adaptation and post-training in continuous diffusion models. In this paper, we study reward gui…
MURPHY: Feedback-Aware GRPO with Retrospective Credit Assignment for Multi-Turn Code Generation
Chanakya Ekbote, Vijay Lingam, Sujay Sanghavi +4
Reinforcement Learning with Verifiable Rewards (RLVR) has become a standard recipe for post-training LLMs on reasoning tasks, with Group Relative Policy Optimization (GRPO) emergin…