235 citations · 461 across the 9 of their papers we have counts for
Showing 2021 · cs.CLShow all
2 papers · 2 filters
cs.CL2021
BioCopy: A Plug-And-Play Span Copy Mechanism in Seq2Seq Models
Yi Liu, Guoan Zhang, Puning Yu +2
Copy mechanisms explicitly obtain unchanged tokens from the source (input) sequence to generate the target (output) sequence under the neural seq2seq framework. However, most of th…
cs.CL2021★ 235 cited
RoFormer: Enhanced Transformer with Rotary Position Embedding
Jianlin Su, Yu Lu, Shengfeng Pan +3
Position encoding recently has shown effective in the transformer architecture. It enables valuable supervision for dependency modeling between elements at different positions of t…