121 citations · 179 across the 17 of their papers we have counts for
3 papers · 1 filter
AdaBelief Optimizer: Adapting Stepsizes by the Belief in Observed Gradients
Juntang Zhuang, Tommy Tang, Yifan Ding +4
Most popular optimizers for deep learning can be broadly categorized as adaptive methods (e.g. Adam) and accelerated schemes (e.g. stochastic gradient descent (SGD) with momentum).…
HetSeq: Distributed GPU Training on Heterogeneous Infrastructure
Yifan Ding, Nicholas Botzer, Tim Weninger
Modern deep learning systems like PyTorch and Tensorflow are able to train enormous models with billions (or trillions) of parameters on a distributed infrastructure. These systems…
Self-supervised learning for audio-visual speaker diarization
Yifan Ding, Yong Xu, Shi-Xiong Zhang +2
Speaker diarization, which is to find the speech segments of specific speakers, has been widely used in human-centered applications such as video conferences or human-computer inte…