2 citations · 2 across the 2 of their papers we have counts for
2 papers
cs.CL2022★ 2 cited
Sparse Teachers Can Be Dense with Knowledge
Yi Yang, Chen Zhang, Dawei Song
Recent advances in distilling pretrained language models have discovered that, besides the expressiveness of knowledge, the student-friendliness should be taken into consideration…
cs.CL2022
Doge Tickets: Uncovering Domain-general Language Models by Playing Lottery Tickets
Yi Yang, Chen Zhang, Benyou Wang +1
Over-parameterized models, typically pretrained language models (LMs), have shown an appealing expressive power due to their small learning bias. However, the huge learning capacit…