91 citations · 137 across the 13 of their papers we have counts for
Showing 2020Show all
3 papers · 1 filter
cs.CL2020
Large Product Key Memory for Pretrained Language Models
Gyuwan Kim, Tae-Hwan Jung
Product key memory (PKM) proposed by Lample et al. (2019) enables to improve prediction accuracy by increasing model capacity efficiently with insignificant computational overhead.…
cs.CL2020★ 3 cited
ST-BERT: Cross-modal Language Model Pre-training For End-to-end Spoken Language Understanding
Minjeong Kim, Gyuwan Kim, Sang-Woo Lee +1
Language model pre-training has shown promising results in various downstream tasks. In this context, we introduce a cross-modal pre-trained language model, called Speech-Text BERT…
cs.CL2020★ 9 cited
Length-Adaptive Transformer: Train Once with Length Drop, Use Anytime with Search
Gyuwan Kim, Kyunghyun Cho
Despite transformers' impressive accuracy, their computational cost is often prohibitive to use with limited computational resources. Most previous approaches to improve inference…