Showing cs.CLShow all
3 papers · 1 filter
cs.CL2024
Sentence-Level or Token-Level? A Comprehensive Study on Knowledge Distillation
Jingxuan Wei, Linzhuang Sun, Yichong Leng +3
Knowledge distillation, transferring knowledge from a teacher model to a student model, has emerged as a powerful technique in neural machine translation for compressing models or…
cs.CL2023
Unraveling Key Factors of Knowledge Distillation
Jingxuan Wei, Linzhuang Sun, Xu Tan +2
Knowledge distillation, a technique for model compression and performance enhancement, has gained significant traction in Neural Machine Translation (NMT). However, existing resear…
cs.CL2023
A Survey on Image-text Multimodal Models
Ruifeng Guo, Jingxuan Wei, Linzhuang Sun +7
With the significant advancements of Large Language Models (LLMs) in the field of Natural Language Processing (NLP), the development of image-text multimodal models has garnered wi…