activity
20202022
most citedOn the Opportunities and Risks of Foundation Models

2.3k citations · 3.6k across the 27 of their papers we have counts for

collaborators

29 papers

cs.CL2022★ 75 cited

Ask Me Anything: A simple strategy for prompting language models

Simran Arora, Avanika Narayan, Mayee F. Chen +6

Large language models (LLMs) transfer well to new tasks out-of-the-box simply given a natural language prompt that demonstrates how to perform the task and no additional training.…

cs.SE2022★ 2 cited

HAPI: A Large-scale Longitudinal Dataset of Commercial ML API Predictions

Lingjiao Chen, Zhihua Jin, Sabri Eyuboglu +3

Commercial ML APIs offered by providers such as Google, Amazon and Microsoft have dramatically simplified ML adoption in many applications. Numerous companies and academics pay to…

cs.AI2022★ 13 cited

LegalBench: Prototyping a Collaborative Benchmark for Legal Reasoning

Neel Guha, Daniel E. Ho, Julian Nyarko +1

Can foundation models be guided to execute tasks involving legal reasoning? We believe that building a benchmark to answer this question will require sustained collaborative effort…

cs.RO2022★ 5 cited

Leveraging Large (Visual) Language Models for Robot 3D Scene Understanding

William Chen, Siyi Hu, Rajat Talak +1

Abstract semantic 3D scene understanding is a problem of critical importance in robotics. As robots still lack the common-sense knowledge about household objects and locations of a…

cs.LG2022★ 12 cited

Contrastive Adapters for Foundation Model Group Robustness

Michael Zhang, Christopher Ré

While large pretrained foundation models (FMs) have shown remarkable zero-shot classification robustness to dataset-level distribution shifts, their robustness to subpopulation or…

cs.LG2022★ 463 cited

FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awareness

Tri Dao, Daniel Y. Fu, Stefano Ermon +2

Transformers are slow and memory-hungry on long sequences, since the time and memory complexity of self-attention are quadratic in sequence length. Approximate attention methods ha…