7 citations · 15 across the 5 of their papers we have counts for
1 paper · 2 filters
Chen Zhang, Yang Yang, Qifan Wang +4
Recent studies have uncovered that language model distillation is less effective when facing a large capacity gap between the teacher and the student, and introduced teacher assist…