activity
20132026
most citedModel soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference time

206 citations · 808 across the 40 of their papers we have counts for

collaborators
Showing 2022 · cs.CLShow all

1 paper · 2 filters

cs.CL2022

Scaling Laws Under the Microscope: Predicting Transformer Performance from Small Scale Experiments

Maor Ivgi, Yair Carmon, Jonathan Berant

Neural scaling laws define a predictable relationship between a model's parameter count and its performance after training in the form of a power law. However, most research to dat…