activity
20192022
most citedTinyBERT: Distilling BERT for Natural Language Understanding

134 citations · 145 across the 8 of their papers we have counts for

collaborators

8 papers

cs.CV2022★ 3 cited

Efficient Image Captioning for Edge Devices

Ning Wang, Jiangrong Xie, Hang Luo +4

Recent years have witnessed the rapid progress of image captioning. However, the demands for large memory storage and heavy computational burden prevent these captioning models fro…

cs.CV2022★ 1 cited

Controllable Image Captioning via Prompting

Ning Wang, Jiahao Xie, Jihao Wu +2

Despite the remarkable progress of image captioning, existing captioners typically lack the controllable capability to generate desired image captions, e.g., describing the image i…

cs.CL2022

Text is no more Enough! A Benchmark for Profile-based Spoken Language Understanding

Xiao Xu, Libo Qin, Kaiji Chen +3

Current researches on spoken language understanding (SLU) heavily are limited to a simple setting: the plain text-based SLU that takes the user utterance as input and generates its…

cs.CL2021

DyLex: Incorporating Dynamic Lexicons into BERT for Sequence Labeling

Baojun Wang, Zhao Zhang, Kun Xu +7

Incorporating lexical knowledge into deep learning models has been proved to be very effective for sequence labeling tasks. However, previous works commonly have difficulty dealing…

cs.CL2021★ 5 cited

LightMBERT: A Simple Yet Effective Method for Multilingual BERT Distillation

Xiaoqi Jiao, Yichun Yin, Lifeng Shang +5

The multilingual pre-trained language models (e.g, mBERT, XLM and XLM-R) have shown impressive performance on cross-lingual natural language understanding tasks. However, these mod…

cs.CL2020★ 2 cited

Improving Task-Agnostic BERT Distillation with Layer Mapping Search

Xiaoqi Jiao, Huating Chang, Yichun Yin +6

Knowledge distillation (KD) which transfers the knowledge from a large teacher model to a small student model, has been widely used to compress the BERT model recently. Besides the…