177 citations · 321 across the 24 of their papers we have counts for
3 papers · 1 filter
Detecting Gender Bias in Transformer-based Models: A Case Study on BERT
Bingbing Li, Hongwu Peng, Rajat Sainju +7
In this paper, we propose a novel gender bias detection method by utilizing attention map for transformer-based models. We 1) give an intuitive gender bias judgement method by comp…
Real-Time Execution of Large-scale Language Models on Mobile
Wei Niu, Zhenglun Kong, Geng Yuan +7
Pre-trained large-scale language models have increasingly demonstrated high accuracy on many natural language processing (NLP) tasks. However, the limited weight storage and comput…
Efficient Transformer-based Large Scale Language Representations using Hardware-friendly Block Structured Pruning
Bingbing Li, Zhenglun Kong, Tianyun Zhang +4
Pre-trained large-scale language models have increasingly demonstrated high accuracy on many natural language processing (NLP) tasks. However, the limited weight storage and comput…