5 citations · 5 across the 2 of their papers we have counts for
2 papers
cs.CL2024
Large Language Models Understand Layout
Weiming Li, Manni Duan, Dong An +1
Large language models (LLMs) demonstrate extraordinary abilities in a wide range of natural language processing (NLP) tasks. In this paper, we show that, beyond text understanding…
cs.CV2023★ 5 cited
Improving Knowledge Distillation via Regularizing Feature Norm and Direction
Yuzhu Wang, Lechao Cheng, Manni Duan +3
Knowledge distillation (KD) exploits a large well-trained model (i.e., teacher) to train a small student model on the same dataset for the same task. Treating teacher features as k…