activity
20172026
most citedRegularization of the Kernel Matrix via Covariance Matrix Shrinkage Estimation

3 citations · 6 across the 9 of their papers we have counts for

collaborators
Showing 2022Show all

1 paper · 1 filter

cs.CL2022

Multi-armed bandits for resource efficient, online optimization of language model pre-training: the use case of dynamic masking

Iñigo Urteaga, Moulay-Zaïdane Draïdia, Tomer Lancewicki +1

We design and evaluate a Bayesian optimization framework for resource efficient pre-training of Transformer-based language models (TLMs). TLM pre-training requires high computation…