most citedBeyond Sight: Finetuning Generalist Robot Policies with Heterogeneous Sensors via Language Grounding

2 citations · 3 across the 3 of their papers we have counts for

collaborators

7 papers

cs.LG2025

What Really Matters in Matrix-Whitening Optimizers?

Kevin Frans, Pieter Abbeel, Sergey Levine

A range of recent optimizers have emerged that approximate the same "matrix-whitening" transformation in various ways. In this work, we systematically deconstruct such optimizers,…

cs.LG2025

Compute-Optimal Scaling for Value-Based Deep RL

Preston Fu, Oleh Rybkin, Zhiyuan Zhou +4

As models grow larger and training them becomes expensive, it becomes increasingly important to scale training recipes not just to larger models and more data, but to do so in a co…

cs.LG2025

A Stable Whitening Optimizer for Efficient Neural Network Training

Kevin Frans, Sergey Levine, Pieter Abbeel

In this work, we take an experimentally grounded look at neural network optimization. Building on the Shampoo family of algorithms, we identify and alleviate three key issues, resu…

cs.LG2025

Diffusion Guidance Is a Controllable Policy Improvement Operator

Kevin Frans, Seohong Park, Pieter Abbeel +1

At the core of reinforcement learning is the idea of learning beyond the performance in the data. However, scaling such systems has proven notoriously tricky. In contrast, techniqu…

cs.RO20251 cited

MuJoCo Playground

Kevin Zakka, Baruch Tabanpour, Qiayuan Liao +10

We introduce MuJoCo Playground, a fully open-source framework for robot learning built with MJX, with the express goal of streamlining simulation, training, and sim-to-real transfe…

cs.LG2025

Value-Based Deep RL Scales Predictably

Oleh Rybkin, Michal Nauman, Preston Fu +4

Scaling data and compute is critical to the success of modern ML. However, scaling demands predictability: we want methods to not only perform well with more compute or data, but a…