4 papers · 1 filter
Projected Distillation: On Learning to Solve Hard Problems from Close, Correct Targets
Shripad V. Deshmukh, Christian Bock, Kangrui Ruan +4
On-policy learning is central to post-training: training on a model's own generations limits distribution shift and helps preserve existing capabilities. On hard problems, however,…
Convex-Concave Reinforcement Learning
Shripad V. Deshmukh, Yaswanth Chittepu, Dhawal Gupta +2
Policy learning drives many of the most consequential and heavily-invested applications of reinforcement learning today. Yet the core optimization problem it rests on (maximizing e…
Inverse Reinforcement Learning without an Optimal Demonstrator: A Feasible Reward Set Approach
Kihyun Kim, Shripad Deshmukh, Nikos Vlassis +1
Inverse reinforcement learning (IRL) typically assumes demonstrations from a single optimal demonstrator, but in many applications data come from multiple imperfect demonstrators w…
COSAC: Counterfactual Credit Assignment in Sequential Cooperative Teams
Shripad Deshmukh, Jayakumar Subramanian, Raghavendra Addanki +1
In cooperative teams where agents act in a fixed order and share a single team-level reward (multi-agent language systems, sequential robotic tasks), per-agent credit assignment is…