3 papers
cs.LG2021
Two-argument activation functions learn soft XOR operations like cortical neurons
Kijung Yoon, Emin Orhan, Juhyun Kim +1
Neurons in the brain are complex machines with distinct functional compartments that interact nonlinearly. In contrast, neurons in artificial neural networks abstract away this com…
cs.LG2018
Inference in Probabilistic Graphical Models by Graph Neural Networks
KiJung Yoon, Renjie Liao, Yuwen Xiong +5
A fundamental computation for statistical inference and accurate decision-making is to compute the marginal probabilities or most probable states of task-relevant variables. Probab…
cs.LG2018
Reviving and Improving Recurrent Back-Propagation
Renjie Liao, Yuwen Xiong, Ethan Fetaya +5
In this paper, we revisit the recurrent back-propagation (RBP) algorithm, discuss the conditions under which it applies as well as how to satisfy them in deep neural networks. We s…