435 citations · 454 across the 26 of their papers we have counts for
Showing 2023 · cs.LGShow all
2 papers · 2 filters
cs.LG2023
Is Scaling Learned Optimizers Worth It? Evaluating The Value of VeLO's 4000 TPU Months
Fady Rezk, Antreas Antoniou, Henry Gouk +1
We analyze VeLO (versatile learned optimizer), the largest scale attempt to train a general purpose "foundational" optimizer to date. VeLO was trained on thousands of machine learn…
cs.LG2023
Evaluating the Evaluators: Are Current Few-Shot Learning Benchmarks Fit for Purpose?
Luísa Shimabucoro, Timothy Hospedales, Henry Gouk
Numerous benchmarks for Few-Shot Learning have been proposed in the last decade. However all of these benchmarks focus on performance averaged over many tasks, and the question of…