activity
20222026
most citedSparse*BERT: Sparse Models Generalize To New tasks and Domains

4 citations · 6 across the 7 of their papers we have counts for

collaborators
Showing 2023Show all

1 paper · 1 filter

cs.CL2023

oBERTa: Improving Sparse Transfer Learning via improved initialization, distillation, and pruning regimes

Daniel Campos, Alexandre Marques, Mark Kurtz +1

In this paper, we introduce the range of oBERTa language models, an easy-to-use set of language models which allows Natural Language Processing (NLP) practitioners to obtain betwee…