19 citations · 68 across the 8 of their papers we have counts for
Showing 2021Show all
3 papers · 1 filter
cs.CL2021★ 19 cited
BROS: A Pre-trained Language Model Focusing on Text and Layout for Better Key Information Extraction from Documents
Teakgyu Hong, Donghyun Kim, Mingi Ji +3
Key information extraction (KIE) from document images requires understanding the contextual and spatial semantics of texts in two-dimensional (2D) space. Many recent studies try to…
cs.CV2021★ 16 cited
Refine Myself by Teaching Myself: Feature Refinement via Self-Knowledge Distillation
Mingi Ji, Seungjae Shin, Seunghyun Hwang +2
Knowledge distillation is a method of transferring the knowledge from a pretrained complex teacher model to a student model, so a smaller network can replace a large teacher networ…
cs.LG2021★ 9 cited
Show, Attend and Distill:Knowledge Distillation via Attention-based Feature Matching
Mingi Ji, Byeongho Heo, Sungrae Park
Knowledge distillation extracts general knowledge from a pre-trained teacher network and provides guidance to a target student network. Most studies manually tie intermediate featu…