7 citations · 7 across the 1 of their papers we have counts for
4 papers
Nondeterminism and Instability in Neural Network Optimization
Cecilia Summers, Michael J. Dinneen
Nondeterminism in neural network optimization produces uncertainty in performance, making small improvements difficult to discern from run-to-run variability. While uncertainty can…
Improved Adversarial Robustness via Logit Regularization Methods
Cecilia Summers, Michael J. Dinneen
While great progress has been made at making neural networks effective across a wide range of visual tasks, most models are surprisingly vulnerable. This frailness takes the form o…
Four Things Everyone Should Know to Improve Batch Normalization
Cecilia Summers, Michael J. Dinneen
A key component of most neural network architectures is the use of normalization layers, such as Batch Normalization. Despite its common use and large utility in optimizing deep ar…
Improved Mixed-Example Data Augmentation
Cecilia Summers, Michael J. Dinneen
In order to reduce overfitting, neural networks are typically trained with data augmentation, the practice of artificially generating additional training data via label-preserving…