2 papers
math.OC2024
Anisotropic Gaussian Smoothing for Gradient-based Optimization
Andrew Starnes, Guannan Zhang, Viktor Reshniak +1
This article introduces a novel family of optimization algorithms - Anisotropic Gaussian Smoothing Gradient Descent (AGS-GD), AGS-Stochastic Gradient Descent (AGS-SGD), and AGS-Ada…
math.OC2024
Improved Performance of Stochastic Gradients with Gaussian Smoothing
Andrew Starnes, Clayton Webster
This paper formalizes and analyzes Gaussian smoothing applied to two prominent optimization methods: Stochastic Gradient Descent (GSmoothSGD) and Adam (GSmoothAdam) in deep learnin…