4 citations · 4 across the 5 of their papers we have counts for
1 paper · 1 filter
Rian Touchent, Eric de la Clergerie
When adapting an encoder to a new domain, the standard approach is to continue training with Masked Language Modeling (MLM). We show that temporarily switching to Causal Language M…