507 citations · 672 across the 27 of their papers we have counts for
3 papers · 1 filter
Mixed-Precision Training for NLP and Speech Recognition with OpenSeq2Seq
Oleksii Kuchaiev, Boris Ginsburg, Igor Gitman +5
We present OpenSeq2Seq - a TensorFlow-based toolkit for training sequence-to-sequence models that features distributed and mixed-precision training. Benchmarks on machine translati…
Novel Prediction Techniques Based on Clusterwise Linear Regression
Igor Gitman, Jieshi Chen, Eric Lei +1
In this paper we explore different regression models based on Clusterwise Linear Regression (CLR). CLR aims to find the partition of the data into clusters, such that linear re…
Convergence Analysis of Gradient Descent Algorithms with Proportional Updates
Igor Gitman, Deepak Dilipkumar, Ben Parr
The rise of deep learning in recent years has brought with it increasingly clever optimization methods to deal with complex, non-linear loss functions. These methods are often desi…