7 papers
Text as Causal Mediators: Research Design for Causal Estimates of Differential Treatment of Social Groups via Language Aspects
Katherine A. Keith, Douglas Rice, Brendan O'Connor
Using observed language to understand interpersonal interactions is important in high-stakes decision making. We propose a causal research design for observational (non-experimenta…
Corpus-Level Evaluation for Event QA: The IndiaPoliceEvents Corpus Covering the 2002 Gujarat Violence
Andrew Halterman, Katherine A. Keith, Sheikh Muhammad Sarwar +1
Automated event extraction in social science applications often requires corpus-level evaluations: for example, aggregating text predictions across metadata and unbiased estimates…
Uncertainty over Uncertainty: Investigating the Assumptions, Annotations, and Text Measurements of Economic Policy Uncertainty
Katherine A. Keith, Christoph Teichmann, Brendan O'Connor +1
Methods and applications are inextricably linked in science, and in particular in the domain of text-as-data. In this paper, we examine one such text-as-data application, an establ…
Text and Causal Inference: A Review of Using Text to Remove Confounding from Causal Estimates
Katherine A. Keith, David Jensen, Brendan O'Connor
Many applications of computational social science aim to infer causal conclusions from non-experimental data. Such observational data often contains confounders, variables that inf…
Modeling financial analysts' decision making via the pragmatics and semantics of earnings calls
Katherine A. Keith, Amanda Stent
Every fiscal quarter, companies hold earnings calls in which company executives respond to questions from analysts. After these calls, analysts often change their price target reco…
Monte Carlo Syntax Marginals for Exploring and Using Dependency Parses
Katherine A. Keith, Su Lin Blodgett, Brendan O'Connor
Dependency parsing research, which has made significant gains in recent years, typically focuses on improving the accuracy of single-tree predictions. However, ambiguity is inheren…