11 citations · 13 across the 7 of their papers we have counts for
1 paper · 2 filters
Taero Kim, Hoyoon Byun, Youngjun Choi +2
Expanding pre-trained language models offers a practical way to increase capacity without training larger models from scratch. Depth Up-Scaling (DUS) does so by duplicating Transfo…