2.3k citations · 3.5k across the 28 of their papers we have counts for
Showing 2016Show all
2 papers · 1 filter
cs.LG2016★ 44 cited
Revise Saturated Activation Functions
Bing Xu, Ruitong Huang, Mu Li
In this paper, we revise two commonly used saturated functions, the logistic sigmoid and the hyperbolic tangent (tanh). We point out that, besides the well-known non-zero centered…
cs.CL2016★ 39 cited
Implicit Distortion and Fertility Models for Attention-based Encoder-Decoder NMT Model
Shi Feng, Shujie Liu, Mu Li +1
Neural machine translation has shown very promising results lately. Most NMT models follow the encoder-decoder framework. To make encoder-decoder models more flexible, attention me…