299 citations · 810 across the 25 of their papers we have counts for
3 papers · 1 filter
SHARP: An Adaptable, Energy-Efficient Accelerator for Recurrent Neural Network
Reza Yazdani, Olatunji Ruwase, Minjia Zhang +3
The effectiveness of Recurrent Neural Networks (RNNs) for tasks such as Automatic Speech Recognition has fostered interest in RNN inference acceleration. Due to the recurrent natur…
AntMan: Sparse Low-Rank Compression to Accelerate RNN inference
Samyam Rajbhandari, Harsh Shrivastava, Yuxiong He
Wide adoption of complex RNN based models is hindered by their inference performance, cost and memory requirements. To address this issue, we develop AntMan, combining structured s…
ZeRO: Memory Optimizations Toward Training Trillion Parameter Models
Samyam Rajbhandari, Jeff Rasley, Olatunji Ruwase +1
Large deep learning models offer significant accuracy gains, but training billions to trillions of parameters is challenging. Existing solutions such as data and model parallelisms…