Leveraging Continuously Differentiable Activation Functions for Learning in Quantized Noisy Environments

Vivswan Shah, Nathan Youngblood

Real-world analog systems intrinsically suffer from noise that can impede model convergence and accuracy on a variety of deep learning models. We demonstrate that differentiable ac…