8 citations · 10 across the 10 of their papers we have counts for
Showing 2026Show all
2 papers · 1 filter
cs.LG2026
No Pain, More Gain: Iterative Merging for Effective Multi-Teacher On-Policy Distillation
Seonghyeon Kim, Chaeyun Jang, Noah Lee +2
Multi-teacher on-policy distillation (MOPD) combines independently developed domain teachers into a single student by distilling their predictions on student-generated samples. We…
cs.LG2026
Persona-Pruner: Sculpting Lightweight Models for Role-Playing
Jinsu Kim, Jihoon Tack, Noah Lee +1
Language Models (LMs) have shown remarkable potential as role-playing chatbots, delivering consistent, stylized interactions when given a specification of a character or user perso…