activity
20192026
most citedBias In, Bias Out? Evaluating the Folk Wisdom

40 citations · 80 across the 12 of their papers we have counts for

collaborators
Showing 2024Show all

5 papers · 1 filter

econ.EM2024

Large Language Models: An Applied Econometric Framework

Jens Ludwig, Sendhil Mullainathan, Ashesh Rambachan

Large language models (LLMs) enable researchers to analyze text at unprecedented scale and minimal cost. Researchers can now revisit old questions and tackle novel ones with rich d…

econ.EM2024

Program Evaluation with Remotely Sensed Outcomes

Ashesh Rambachan, Rahul Singh, Davide Viviano

We study causal inference in experiments and quasi-experiments, where the economic outcome is imperfectly measured by a remotely sensed variable. The remotely sensed variable is lo…

cs.CL2024★ 6 cited

Do Large Language Models Perform the Way People Expect? Measuring the Human Generalization Function

Keyon Vafa, Ashesh Rambachan, Sendhil Mullainathan

What makes large language models (LLMs) impressive is also what makes them hard to evaluate: their diversity of uses. To evaluate these models, we must understand the purposes they…

cs.CL2024★ 7 cited

Evaluating the World Model Implicit in a Generative Model

Keyon Vafa, Justin Y. Chen, Ashesh Rambachan +2

Recent work suggests that large language models may implicitly learn world models. How should we assess this possibility? We formalize this question for the case where the underlyi…

econ.EM2024

From Predictive Algorithms to Automatic Generation of Anomalies

Sendhil Mullainathan, Ashesh Rambachan

How can we extract theoretical insights from machine learning algorithms? We take a familiar lesson: researchers often turn their intuitions into theoretical insights by constructi…