2 citations · 3 across the 8 of their papers we have counts for
1 paper · 1 filter
Xiwen Chen, Jingjing Wang, Wenhui Zhu +7
Black-box knowledge distillation for large language models presents a strict trade-off. Simple off-policy methods (e.g., sequence-level knowledge distillation) struggle to correct…