141 citations · 287 across the 8 of their papers we have counts for
3 papers · 1 filter
AI Agents That Matter
Sayash Kapoor, Benedikt Stroebl, Zachary S. Siegel +2
AI agents are an exciting new research direction, and agent development is driven by benchmarks. Our analysis of current agent benchmarks and evaluation practices reveals several s…
REFORMS: Reporting Standards for Machine Learning Based Science
Sayash Kapoor, Emily Cantrell, Kenny Peng +16
Machine learning (ML) methods are proliferating in scientific research. However, the adoption of these methods has been accompanied by failures of validity, reproducibility, and ge…
Leakage and the Reproducibility Crisis in ML-based Science
Sayash Kapoor, Arvind Narayanan
The use of machine learning (ML) methods for prediction and forecasting has become widespread across the quantitative sciences. However, there are many known methodological pitfall…