activity
20202026
most citedOn the Opportunities and Risks of Foundation Models

2.3k citations · 2.4k across the 19 of their papers we have counts for

collaborators

19 papers

cs.RO2026

CHORUS: Decentralized Multi-Embodiment Collaboration with One VLA Policy

Ria Doshi, Tian Gao, Annie Chen +2

Multi-robot collaboration allows robots to efficiently take on a wide range of tasks, from moving a couch through a doorway to assembling structures on a construction site. However…

cs.RO2025

Exploiting Policy Idling for Dexterous Manipulation

Annie S. Chen, Philemon Brakel, Antonia Bronars +7

Learning-based methods for dexterous manipulation have made notable progress in recent years. However, learned policies often still lack reliability and exhibit limited robustness…

cs.LG2025

Reinforcement Learning via Implicit Imitation Guidance

Perry Dong, Alec M. Lessing, Annie S. Chen +1

We study the problem of sample efficient reinforcement learning, where prior data such as demonstrations are provided for initialization in lieu of a dense reward signal. A natural…

cs.RO2025

Curating Demonstrations using Online Experience

Annie S. Chen, Alec M. Lessing, Yuejiang Liu +1

Many robot demonstration datasets contain heterogeneous demonstrations of varying quality. This heterogeneity may benefit policy pre-training, but can hinder robot performance when…

cs.LG2024

Calibrating Language Models with Adaptive Temperature Scaling

Johnathan Xie, Annie S. Chen, Yoonho Lee +2

The effectiveness of large language models (LLMs) is not only measured by their ability to generate accurate outputs but also by their calibration-how well their confidence scores…

cs.RO2024★ 2 cited

Commonsense Reasoning for Legged Robot Adaptation with Vision-Language Models

Annie S. Chen, Alec M. Lessing, Andy Tang +4

Legged robots are physically capable of navigating a diverse variety of environments and overcoming a wide range of obstructions. For example, in a search and rescue mission, a leg…

cs.LG2024★ 1 cited

Self-Guided Masked Autoencoders for Domain-Agnostic Self-Supervised Learning

Johnathan Xie, Yoonho Lee, Annie S. Chen +1

Self-supervised learning excels in learning representations from large amounts of unlabeled data, demonstrating success across multiple data modalities. Yet, extending self-supervi…

cs.LG2024★ 1 cited

RLVF: Learning from Verbal Feedback without Overgeneralization

Moritz Stephan, Alexander Khazatsky, Eric Mitchell +4

The diversity of contexts in which large language models (LLMs) are deployed requires the ability to modify or customize default model behaviors to incorporate nuanced requirements…

cs.LG2024★ 1 cited

AutoFT: Learning an Objective for Robust Fine-Tuning

Caroline Choi, Yoonho Lee, Annie Chen +3

Foundation models encode rich representations that can be adapted to downstream tasks by fine-tuning. However, fine-tuning a model on one data distribution often degrades performan…

cs.RO2023★ 2 cited

Adapt On-the-Go: Behavior Modulation for Single-Life Robot Deployment

Annie S. Chen, Govind Chada, Laura Smith +4

To succeed in the real world, robots must cope with situations that differ from those seen during training. We study the problem of adapting on-the-fly to such novel scenarios duri…

cs.LG2023

Confidence-Based Model Selection: When to Take Shortcuts for Subpopulation Shifts

Annie S. Chen, Yoonho Lee, Amrith Setlur +2

Effective machine learning models learn both robust features that directly determine the outcome of interest (e.g., an object with wheels is more likely to be a car), and shortcut…

cs.RO2023★ 5 cited

Language-Driven Representation Learning for Robotics

Siddharth Karamcheti, Suraj Nair, Annie S. Chen +4

Recent work in visual representation learning for robotics demonstrates the viability of learning from large video datasets of humans performing everyday tasks. Leveraging methods…

cs.LG2023

Project and Probe: Sample-Efficient Domain Adaptation by Interpolating Orthogonal Features

Annie S. Chen, Yoonho Lee, Amrith Setlur +2

Transfer learning with a small amount of target data is an effective and common approach to adapting a pre-trained model to distribution shifts. In some situations, target data lab…

cs.LG2022★ 3 cited

You Only Live Once: Single-Life Reinforcement Learning

Annie S. Chen, Archit Sharma, Sergey Levine +1

Reinforcement learning algorithms are typically designed to learn a performant policy that can repeatedly and autonomously complete a task, usually starting from scratch. However,…

cs.LG2022★ 47 cited

Surgical Fine-Tuning Improves Adaptation to Distribution Shifts

Yoonho Lee, Annie S. Chen, Fahim Tajwar +4

A common approach to transfer learning under distribution shift is to fine-tune the last few layers of a pre-trained model, preserving learned features while also adapting to the n…

cs.LG2021★ 2.3k cited

On the Opportunities and Risks of Foundation Models

Rishi Bommasani, Drew A. Hudson, Ehsan Adeli +111

AI is undergoing a paradigm shift with the rise of models (e.g., BERT, DALL-E, GPT-3) that are trained on broad data at scale and are adaptable to a wide range of downstream tasks.…

cs.LG2021★ 70 cited

Just Train Twice: Improving Group Robustness without Training Group Information

Evan Zheran Liu, Behzad Haghgoo, Annie S. Chen +5

Standard training via empirical risk minimization (ERM) can produce models that achieve high accuracy on average but low accuracy on certain groups, especially in the presence of s…

cs.RO2021

Learning Generalizable Robotic Reward Functions from "In-The-Wild" Human Videos

Annie S. Chen, Suraj Nair, Chelsea Finn

We are motivated by the goal of generalist robots that can complete a wide range of tasks across many environments. Critical to this is the robot's ability to acquire some metric o…

cs.RO2020★ 11 cited

Batch Exploration with Examples for Scalable Robotic Reinforcement Learning

Annie S. Chen, HyunJi Nam, Suraj Nair +1

Learning from diverse offline datasets is a promising path towards learning general purpose robotic agents. However, a core challenge in this paradigm lies in collecting large amou…