Optimizing Neural Networks through Activation Function Discovery and Automatic Weight Initialization

Garrett Bingham

Automated machine learning (AutoML) methods improve upon existing models by optimizing various aspects of their design. While present methods focus on hyperparameters and neural ne…