7 citations · 10 across the 5 of their papers we have counts for
Showing 2023 · cs.LGShow all
2 papers · 2 filters
cs.LG2023★ 1 cited
Optimizing Neural Networks through Activation Function Discovery and Automatic Weight Initialization
Garrett Bingham
Automated machine learning (AutoML) methods improve upon existing models by optimizing various aspects of their design. While present methods focus on hyperparameters and neural ne…
cs.LG2023★ 2 cited
Efficient Activation Function Optimization through Surrogate Modeling
Garrett Bingham, Risto Miikkulainen
Carefully designed activation functions can improve the performance of neural networks in many machine learning tasks. However, it is difficult for humans to construct optimal acti…