1 citations · 1 across the 4 of their papers we have counts for
1 paper · 1 filter
Juan Gabriel Kostelec, Qinghai Guo
Converting a pretrained Transformer into a more efficient hybrid model through distillation offers a promising approach to reducing inference costs. However, achieving high-quality…