452 citations · 1.4k across the 16 of their papers we have counts for
18 papers
ChatBench: From Static Benchmarks to Human-AI Evaluation
Serina Chang, Ashton Anderson, Jake M. Hofman
With the rapid adoption of LLM-based chatbots, there is a pressing need to evaluate what humans and LLMs can achieve together. However, standard benchmarks, such as MMLU, measure L…
Pre-registration for Predictive Modeling
Jake M. Hofman, Angelos Chatzimparmpas, Amit Sharma +2
Amid rising concerns of reproducibility and generalizability in predictive modeling, we explore the possibility and potential benefits of introducing pre-registration to the field.…
REFORMS: Reporting Standards for Machine Learning Based Science
Sayash Kapoor, Emily Cantrell, Kenny Peng +16
Machine learning (ML) methods are proliferating in scientific research. However, the adoption of these methods has been accompanied by failures of validity, reproducibility, and ge…
Comparing scalable strategies for generating numerical perspectives
Hancheng Cao, Sofia Eleni Spatharioti, Daniel G. Goldstein +1
Numerical perspectives help people understand extreme and unfamiliar numbers (e.g., $330 billion is about $1,000 per person in the United States). While research shows perspectiv…
In-class Data Analysis Replications: Teaching Students while Testing Science
Kristina Gligoric, Tiziano Piccardi, Jake Hofman +1
Science is facing a reproducibility crisis. Previous work has proposed incorporating data analysis replications into classrooms as a potential solution. However, despite the potent…
Comparing Traditional and LLM-based Search for Consumer Choice: A Randomized Experiment
Sofia Eleni Spatharioti, David M. Rothschild, Daniel G. Goldstein +1
Recent advances in the development of large language models are rapidly changing how online applications function. LLM-based search tools, for instance, offer a natural language in…