activity
20152026
most citedOn the Opportunities and Risks of Foundation Models

2.3k citations · 4.6k across the 26 of their papers we have counts for

collaborators

30 papers

cs.RO2026

EmbodiedSWE: Coding Agents for Long Horizon Dexterous Robotics

Haoxiang You, Zeyu Shen, Yilang Liu +16

We study coding agents for long-horizon, dexterous robotics and ask whether their solutions can provide scalable supervision for learning general robot policies. To test this, we d…

cs.LG2023★ 1 cited

Cheaply Evaluating Inference Efficiency Metrics for Autoregressive Transformer APIs

Deepak Narayanan, Keshav Santhanam, Peter Henderson +3

Large language models (LLMs) power many state-of-the-art systems in natural language processing. However, these models are extremely computationally expensive, even at inference ti…

cs.CL2022

Text Characterization Toolkit

Daniel Simig, Tianlu Wang, Verna Dankers +4

In NLP, models are usually evaluated by reporting single-number performance scores on a number of readily available benchmarks, without much deeper analysis. Here, we argue that -…

cs.RO2022★ 5 cited

Leveraging Large (Visual) Language Models for Robot 3D Scene Understanding

William Chen, Siyi Hu, Rajat Talak +1

Abstract semantic 3D scene understanding is a problem of critical importance in robotics. As robots still lack the common-sense knowledge about household objects and locations of a…

cs.LG2021★ 2.3k cited

On the Opportunities and Risks of Foundation Models

Rishi Bommasani, Drew A. Hudson, Ehsan Adeli +111

AI is undergoing a paradigm shift with the rise of models (e.g., BERT, DALL-E, GPT-3) that are trained on broad data at scale and are adaptable to a wide range of downstream tasks.…

cs.CL2021★ 14 cited

When Does Pretraining Help? Assessing Self-Supervised Learning for Law and the CaseHOLD Dataset

Lucia Zheng, Neel Guha, Brandon R. Anderson +2

While self-supervised learning has made rapid advances in natural language processing, it remains unclear when researchers should engage in resource-intensive domain-specific pretr…