337 citations · 369 across the 21 of their papers we have counts for
Showing 2019Show all
2 papers · 1 filter
cs.LG2019
Differential Equation Units: Learning Functional Forms of Activation Functions from Data
MohamadAli Torkamani, Shiv Shankar, Amirmohammad Rooshenas +1
Most deep neural networks use simple, fixed activation functions, such as sigmoids or rectified linear units, regardless of domain or network structure. We introduce differential e…
cs.LG2019★ 5 cited
Learning Compact Neural Networks Using Ordinary Differential Equations as Activation Functions
MohamadAli Torkamani, Phillip Wallis, Shiv Shankar +1
Most deep neural networks use simple, fixed activation functions, such as sigmoids or rectified linear units, regardless of domain or network structure. We introduce differential e…