activity
20172022
most citedKnowledge Distillation from Internal Representations

23 citations · 43 across the 7 of their papers we have counts for

collaborators

7 papers

cs.LG2022

PENTATRON: PErsonalized coNText-Aware Transformer for Retrieval-based cOnversational uNderstanding

Niranjan Uma Naresh, Ziyan Jiang, Ankit +4

Conversational understanding is an integral part of modern intelligent devices. In a large fraction of the global traffic from customers using smart digital assistants, frictions i…

cs.CL2021

Learning to Selectively Learn for Weakly-supervised Paraphrase Generation

Kaize Ding, Dingcheng Li, Alexander Hanbo Li +4

Paraphrase generation is a longstanding NLP task that has diverse applications for downstream NLP tasks. However, the effectiveness of existing efforts predominantly relies on larg…

cs.CL20201 cited

Pattern-aware Data Augmentation for Query Rewriting in Voice Assistant Systems

Yunmo Chen, Sixing Lu, Fan Yang +3

Query rewriting (QR) systems are widely used to reduce the friction caused by errors in a spoken language understanding pipeline. However, the underlying supervised models require…

cs.CL20204 cited

Pre-Training for Query Rewriting in A Spoken Language Understanding System

Zheng Chen, Xing Fan, Yuan Ling +2

Query rewriting (QR) is an increasingly important technique to reduce customer friction caused by errors in a spoken language understanding pipeline, where the errors originate fro…

cs.CL201923 cited

Knowledge Distillation from Internal Representations

Gustavo Aguilar, Yuan Ling, Yu Zhang +3

Knowledge distillation is typically conducted by training a small model (the student) to mimic a large and cumbersome model (the teacher). The idea is to compress the knowledge fro…

cs.CL20193 cited

End-to-end Anchored Speech Recognition

Yiming Wang, Xing Fan, I-Fan Chen +3

Voice-controlled house-hold devices, like Amazon Echo or Google Home, face the problem of performing speech recognition of device-directed speech in the presence of interfering bac…