2 papers
cs.CL2024
Towards Understanding and Improving Knowledge Distillation for Neural Machine Translation
Songming Zhang, Yunlong Liang, Shuaibo Wang +4
Knowledge distillation (KD) is a promising technique for model compression in neural machine translation. However, where the knowledge hides in KD is still not clear, which may hin…
cs.CL2024
Active Learning for Multilingual Fingerspelling Corpora
Shuai Wang, Eric Nalisnick
We apply active learning to help with data scarcity problems in sign languages. In particular, we perform a novel analysis of the effect of pre-training. Since many sign languages…