most citedI-BERT: Inductive Generalization of Transformer to Arbitrary Context Lengths

2 citations · 2 across the 1 of their papers we have counts for

collaborators

1 paper

cs.LG2020★ 2 cited

I-BERT: Inductive Generalization of Transformer to Arbitrary Context Lengths

Hyoungwook Nam, Seung Byum Seo, Vikram Sharma Mailthody +2

Self-attention has emerged as a vital component of state-of-the-art sequence-to-sequence models for natural language processing in recent years, brought to the forefront by pre-tra…