280 citations · 502 across the 3 of their papers we have counts for
3 papers
cs.SE2021★ 144 cited
Measuring Coding Challenge Competence With APPS
Dan Hendrycks, Steven Basart, Saurav Kadavath +8
While programming is one of the most broadly applicable skills in modern society, modern machine learning models still cannot code solutions to basic problems. Despite its importan…
cs.LG2021★ 280 cited
Measuring Mathematical Problem Solving With the MATH Dataset
Dan Hendrycks, Collin Burns, Saurav Kadavath +5
Many intellectual endeavors require mathematical problem solving, but this skill remains beyond the capabilities of computers. To measure this ability in machine learning models, w…
cs.LG2019★ 78 cited
Testing Robustness Against Unforeseen Adversaries
Max Kaufmann, Daniel Kang, Yi Sun +9
Adversarial robustness research primarily focuses on L_p perturbations, and most defenses are developed with identical training-time and test-time adversaries. However, in real-wor…