2 papers
cs.NE2024
Neural Optimizer Equation, Decay Function, and Learning Rate Schedule Joint Evolution
Brandon Morgan, Dean Hougen
A major contributor to the quality of a deep learning model is the selection of the optimizer. We propose a new dual-joint search space in the realm of neural optimizer search (NOS…
cs.NE2024
Evolving Loss Functions for Specific Image Augmentation Techniques
Brandon Morgan, Dean Hougen
Previous work in Neural Loss Function Search (NLFS) has shown a lack of correlation between smaller surrogate functions and large convolutional neural networks with massive regular…