Universal Smoothness via Bernstein Polynomials: A Constructive Approximation Approach for Activation Functions

Wentao Zhang, Yutong Zhang, Yifan Zhu +1

The efficacy of deep neural networks is heavily reliant on the design of non-linear activation functions, yet existing approaches often struggle to balance optimization stability w…