Two-argument activation functions learn soft XOR operations like cortical neurons

Kijung Yoon, Emin Orhan, Juhyun Kim +1

Neurons in the brain are complex machines with distinct functional compartments that interact nonlinearly. In contrast, neurons in artificial neural networks abstract away this com…