activity
20162026
most citedGaussian Error Linear Units (GELUs)

3.2k citations · 9.8k across the 51 of their papers we have counts for

collaborators
Showing 2019 · cs.LGShow all

7 papers · 2 filters

cs.LG2019★ 78 cited

Testing Robustness Against Unforeseen Adversaries

Max Kaufmann, Daniel Kang, Yi Sun +9

Adversarial robustness research primarily focuses on L_p perturbations, and most defenses are developed with identical training-time and test-time adversaries. However, in real-wor…

cs.LG2019★ 184 cited

Natural Adversarial Examples

Dan Hendrycks, Kevin Zhao, Steven Basart +2

We introduce two challenging datasets that reliably cause machine learning model performance to substantially degrade. The datasets are collected with a simple adversarial filtrati…

cs.LG2019★ 337 cited

Using Self-Supervised Learning Can Improve Model Robustness and Uncertainty

Dan Hendrycks, Mantas Mazeika, Saurav Kadavath +1

Self-supervision provides effective representations for downstream tasks without requiring labels. However, existing approaches lag behind fully supervised training and are often n…

cs.LG2019★ 25 cited

Transfer of Adversarial Robustness Between Perturbation Types

Daniel Kang, Yi Sun, Tom Brown +2

We study the transfer of adversarial robustness of deep neural networks between different perturbation types. While most work on adversarial examples has focused on and…

cs.LG2019★ 305 cited

Benchmarking Neural Network Robustness to Common Corruptions and Perturbations

Dan Hendrycks, Thomas Dietterich

In this paper we establish rigorous benchmarks for image classifier robustness. Our first benchmark, ImageNet-C, standardizes and expands the corruption robustness topic, while sho…

cs.LG2019★ 402 cited

Deep Anomaly Detection with Outlier Exposure

Dan Hendrycks, Mantas Mazeika, Thomas Dietterich

It is important to detect anomalous inputs when deploying machine learning systems. The use of larger and more complex inputs in deep learning magnifies the difficulty of distingui…

cs.LG2019★ 433 cited

Using Pre-Training Can Improve Model Robustness and Uncertainty

Dan Hendrycks, Kimin Lee, Mantas Mazeika

He et al. (2018) have called into question the utility of pre-training by showing that training from scratch can often yield similar performance to pre-training. We show that altho…