3 papers
cs.CV2021
Max and Coincidence Neurons in Neural Networks
Albert Lee, Kang L. Wang
Network design has been a central topic in machine learning. Large amounts of effort have been devoted towards creating efficient architectures through manual exploration as well a…
cs.LG2021
Deep Unitary Convolutional Neural Networks
Hao-Yuan Chang, Kang L. Wang
Deep neural networks can suffer from the exploding and vanishing activation problem, in which the networks fail to train properly because the neural signals either amplify or atten…
cs.NE2018
Conditional Activation for Diverse Neurons in Heterogeneous Networks
Albert Lee, Bonnie Lam, Wenyuan Li +4
In this paper, we propose a new scheme for modelling the diverse behavior of neurons. We introduce the conditional activation, in which a neurons activation function is dynamically…