activity
20162025
most citedOn the Opportunities and Risks of Foundation Models

2.3k citations · 2.9k across the 24 of their papers we have counts for

collaborators
Showing cs.LGShow all

8 papers · 1 filter

cs.LG2025

Stronger Than You Think: Benchmarking Weak Supervision on Realistic Tasks

Tianyi Zhang, Linrong Cai, Jeffrey Li +4

Weak supervision (WS) is a popular approach for label-efficient learning, leveraging diverse sources of noisy but inexpensive weak labels to automatically annotate training data. D…

cs.LG2024

Archon: An Architecture Search Framework for Inference-Time Techniques

Jon Saad-Falcon, Adrian Gamarra Lafuente, Shlok Natarajan +8

Inference-time techniques, such as repeated sampling or iterative revisions, are emerging as powerful ways to enhance large-language models (LLMs) at test time. However, best pract…

cs.LG2024

Prospector Heads: Generalized Feature Attribution for Large Models & Data

Gautam Machiraju, Alexander Derry, Arjun Desai +6

Feature attribution, the ability to localize regions of the input data that are relevant for classification, is an important capability for ML models in scientific and biomedical d…

cs.LG2023★ 4 cited

Embroid: Unsupervised Prediction Smoothing Can Improve Few-Shot Classification

Neel Guha, Mayee F. Chen, Kush Bhatia +3

Recent work has shown that language models' (LMs) prompt-based learning capabilities make them well suited for automating data labeling in domains where manual annotation is expens…

cs.LG2021★ 2.3k cited

On the Opportunities and Risks of Foundation Models

Rishi Bommasani, Drew A. Hudson, Ehsan Adeli +111

AI is undergoing a paradigm shift with the rise of models (e.g., BERT, DALL-E, GPT-3) that are trained on broad data at scale and are adaptable to a wide range of downstream tasks.…

cs.LG2019★ 59 cited

Machine Learning for AC Optimal Power Flow

Neel Guha, Zhecheng Wang, Matt Wytock +1

We explore machine learning methods for AC Optimal Powerflow (ACOPF) - the task of optimizing power generation in a transmission network according while respecting physical and eng…

cs.LG2019★ 139 cited

One-Shot Federated Learning

Neel Guha, Ameet Talwalkar, Virginia Smith

We present one-shot federated learning, where a central server learns a global model over a network of federated devices in a single round of communication. Our approach - drawing…

cs.LG2018★ 2 cited

Model Aggregation via Good-Enough Model Spaces

Neel Guha, Virginia Smith

In many applications, the training data for a machine learning task is partitioned across multiple nodes, and aggregating this data may be infeasible due to communication, privacy,…