5 citations · 5 across the 1 of their papers we have counts for
2 papers
cs.LG2019
Differential Equation Units: Learning Functional Forms of Activation Functions from Data
MohamadAli Torkamani, Shiv Shankar, Amirmohammad Rooshenas +1
Most deep neural networks use simple, fixed activation functions, such as sigmoids or rectified linear units, regardless of domain or network structure. We introduce differential e…
cs.LG2019★ 5 cited
Learning Compact Neural Networks Using Ordinary Differential Equations as Activation Functions
MohamadAli Torkamani, Phillip Wallis, Shiv Shankar +1
Most deep neural networks use simple, fixed activation functions, such as sigmoids or rectified linear units, regardless of domain or network structure. We introduce differential e…