activity
20172024
most citedThe Pitfalls of Simplicity Bias in Neural Networks

86 citations · 97 across the 7 of their papers we have counts for

collaborators

7 papers

cs.LG2024★ 2 cited

ContextCite: Attributing Model Generation to Context

Benjamin Cohen-Wang, Harshay Shah, Kristian Georgiev +1

How do language models use information provided as context when generating a response? Can we infer whether a particular generated statement is actually grounded in the context, a…

cs.LG2024★ 2 cited

Decomposing and Editing Predictions by Modeling Model Computation

Harshay Shah, Andrew Ilyas, Aleksander Madry

How does the internal computation of a machine learning model transform inputs into predictions? In this paper, we introduce a task called component modeling that aims to address t…

cs.LG2022★ 5 cited

ModelDiff: A Framework for Comparing Learning Algorithms

Harshay Shah, Sung Min Park, Andrew Ilyas +1

We study the problem of (learning) algorithm comparison, where the goal is to find differences between models trained with two different learning algorithms. We begin by formalizin…

cs.LG2021★ 1 cited

Do Input Gradients Highlight Discriminative Features?

Harshay Shah, Prateek Jain, Praneeth Netrapalli

Post-hoc gradient-based interpretability methods [Simonyan et al., 2013, Smilkov et al., 2017] that provide instance-specific explanations of model predictions are often based on a…

cs.LG2020★ 86 cited

The Pitfalls of Simplicity Bias in Neural Networks

Harshay Shah, Kaustav Tamuly, Aditi Raghunathan +2

Several works have proposed Simplicity Bias (SB)---the tendency of standard training procedures such as Stochastic Gradient Descent (SGD) to find simple models---to justify why neu…

cs.LG2018

Number of Connected Components in a Graph: Estimation via Counting Patterns

Ashish Khetan, Harshay Shah, Sewoong Oh

Due to the limited resources and the scale of the graphs in modern datasets, we often get to observe a sampled subgraph of a larger original graph of interest, whether it is the wo…

cs.SI2017★ 1 cited

Growing Attributed Networks through Local Processes

Harshay Shah, Suhansanu Kumar, Hari Sundaram

This paper proposes an attributed network growth model. Despite the knowledge that individuals use limited resources to form connections to similar others, we lack an understanding…