collaborators

1 paper

cs.LG2023

U-Clip: On-Average Unbiased Stochastic Gradient Clipping

Bryn Elesedy, Marcus Hutter

U-Clip is a simple amendment to gradient clipping that can be applied to any iterative gradient optimization algorithm. Like regular clipping, U-Clip involves using gradients that…