13 citations · 26 across the 9 of their papers we have counts for
Showing cs.CLShow all
3 papers · 1 filter
cs.CL2022
Transkimmer: Transformer Learns to Layer-wise Skim
Yue Guan, Zhengyi Li, Jingwen Leng +2
Transformer architecture has become the de-facto model for many machine learning tasks from natural language processing and computer vision. As such, improving its computational ef…
cs.CL2021
Block-Skim: Efficient Question Answering for Transformer
Yue Guan, Zhengyi Li, Jingwen Leng +3
Transformer models have achieved promising results on natural language processing (NLP) tasks including extractive question answering (QA). Common Transformer encoders used in NLP…
cs.CL2020★ 2 cited
How Far Does BERT Look At:Distance-based Clustering and Analysis of BERTs Attention
Yue Guan, Jingwen Leng, Chao Li +2
Recent research on the multi-head attention mechanism, especially that in pre-trained models such as BERT, has shown us heuristics and clues in analyzing various aspects of the mec…