7 papers
Scalable Stewardship of an LLM-Assisted Clinical Benchmark with Physician Oversight
Junze Ye, Daniel Tawfik, Alex J. Goodell +3
Reference labels for machine-learning benchmarks are increasingly synthesized with LLM assistance, but their reliability remains underexamined. We audit MedCalc-Bench, a clinical b…
Validating Causal Message Passing Against Network-Aware Methods on Real Experiments
Albert Tan, Sadegh Shirani, James Nordlund +1
Estimating total treatment effects in the presence of network interference typically requires knowledge of the underlying interaction structure. However, in many practical settings…
On Evolution-Based Models for Experimentation Under Interference
Sadegh Shirani, Mohsen Bayati
Causal effect estimation in networked systems is central to data-driven decision making. In such settings, interventions on one unit can spill over to others, and in complex physic…
Simulating and Experimenting with Social Media Mobilization Using LLM Agents
Sadegh Shirani, Mohsen Bayati
Online social networks have transformed the ways in which political mobilization messages are disseminated, raising new questions about how peer influence operates at scale. Buildi…
Can We Validate Counterfactual Estimations in the Presence of General Network Interference?
Sadegh Shirani, Yuwei Luo, William Overman +2
Randomized experiments have become a cornerstone of evidence-based decision-making in contexts ranging from online platforms to public health. However, in experimental settings wit…
Higher-Order Causal Message Passing for Experimentation with Complex Interference
Mohsen Bayati, Yuwei Luo, William Overman +2
Accurate estimation of treatment effects is essential for decision-making across various scientific fields. This task, however, becomes challenging in areas like social sciences an…