10 citations · 20 across the 4 of their papers we have counts for
Showing cs.LGShow all
2 papers · 1 filter
cs.LG2023
U-Clip: On-Average Unbiased Stochastic Gradient Clipping
Bryn Elesedy, Marcus Hutter
U-Clip is a simple amendment to gradient clipping that can be applied to any iterative gradient optimization algorithm. Like regular clipping, U-Clip involves using gradients that…
cs.LG2020★ 10 cited
Lottery Tickets in Linear Models: An Analysis of Iterative Magnitude Pruning
Bryn Elesedy, Varun Kanade, Yee Whye Teh
We analyse the pruning procedure behind the lottery ticket hypothesis arXiv:1803.03635v5, iterative magnitude pruning (IMP), when applied to linear models trained by gradient flow.…