TESLA: Taylor Expansion of Sinusoidal Learnable Activations

Daehwa Ko, Jaehyeon Kim, Seunghyun Ham +1

The parity problem--deciding whether the number of ones in a binary vector is odd or even--remains challenging for standard neural networks due to linear inseparability and the nee…