235 citations · 461 across the 9 of their papers we have counts for
4 papers · 1 filter
Sparse-softmax: A Simpler and Faster Alternative Softmax Transformation
Shaoshi Sun, Zhenyuan Zhang, BoCheng Huang +4
The softmax function is widely used in artificial neural networks for the multiclass classification problems, where the softmax transformation enforces the output to be positive an…
BioCopy: A Plug-And-Play Span Copy Mechanism in Seq2Seq Models
Yi Liu, Guoan Zhang, Puning Yu +2
Copy mechanisms explicitly obtain unchanged tokens from the source (input) sequence to generate the target (output) sequence under the neural seq2seq framework. However, most of th…
Efficient Speech Emotion Recognition Using Multi-Scale CNN and Attention
Zixuan Peng, Yu Lu, Shengfeng Pan +1
Emotion recognition from speech is a challenging task. Re-cent advances in deep learning have led bi-directional recur-rent neural network (Bi-RNN) and attention mechanism as astan…
RoFormer: Enhanced Transformer with Rotary Position Embedding
Jianlin Su, Yu Lu, Shengfeng Pan +3
Position encoding recently has shown effective in the transformer architecture. It enables valuable supervision for dependency modeling between elements at different positions of t…