1 citations · 2 across the 4 of their papers we have counts for
4 papers
Asynchronous Decentralized Distributed Training of Acoustic Models
Xiaodong Cui, Wei Zhang, Abdullah Kayi +5
Large-scale distributed training of deep acoustic models plays an important role in today's high-performance automatic speech recognition (ASR). In this paper we investigate a vari…
Improving Efficiency in Large-Scale Decentralized Distributed Training
Wei Zhang, Xiaodong Cui, Abdullah Kayi +9
Decentralized Parallel SGD (D-PSGD) and its asynchronous variant Asynchronous Parallel SGD (AD-PSGD) is a family of distributed learning algorithms that have been demonstrated to p…
A Highly Efficient Distributed Deep Learning System For Automatic Speech Recognition
Wei Zhang, Xiaodong Cui, Ulrich Finkler +6
Modern Automatic Speech Recognition (ASR) systems rely on distributed deep learning to for quick training completion. To enable efficient distributed training, it is imperative tha…
Hardware Support for Address Mapping in PGAS Languages; a UPC Case Study
Olivier Serres, Abdullah Kayi, Ahmad Anbar +1
The Partitioned Global Address Space (PGAS) programming model strikes a balance between the locality-aware, but explicit, message-passing model and the easy-to-use, but locality-ag…