240 citations · 314 across the 6 of their papers we have counts for
Showing 2020Show all
3 papers · 1 filter
cs.CV2020★ 10 cited
Activate or Not: Learning Customized Activation
Ningning Ma, Xiangyu Zhang, Ming Liu +1
We present a simple, effective, and general activation function we term ACON which learns to activate the neurons or not. Interestingly, we find Swish, the recent popular NAS-searc…
cs.CV2020★ 15 cited
Funnel Activation for Visual Recognition
Ningning Ma, Xiangyu Zhang, Jian Sun
We present a conceptually simple but effective funnel activation for image recognition tasks, called Funnel activation (FReLU), that extends ReLU and PReLU to a 2D activation by ad…
cs.CV2020★ 3 cited
WeightNet: Revisiting the Design Space of Weight Networks
Ningning Ma, Xiangyu Zhang, Jiawei Huang +1
We present a conceptually simple, flexible and effective framework for weight generating networks. Our approach is general that unifies two current distinct and extremely effective…