205 citations · 276 across the 7 of their papers we have counts for
4 papers · 1 filter
4-bit Quantization of LSTM-based Speech Recognition Models
Andrea Fasoli, Chia-Yu Chen, Mauricio Serrano +9
We investigate the impact of aggressive low-precision representations of weights and activations in two families of large LSTM-based architectures for Automatic Speech Recognition…
ScaleCom: Scalable Sparsified Gradient Compression for Communication-Efficient Distributed Training
Chia-Yu Chen, Jiamin Ni, Songtao Lu +8
Large-scale distributed training of Deep Neural Networks (DNNs) on state-of-the-art platforms is expected to be severely communication constrained. To overcome this limitation, num…
Improved Techniques for Quantizing Deep Networks with Adaptive Bit-Widths
Ximeng Sun, Rameswar Panda, Chun-Fu Chen +6
Quantizing deep networks with adaptive bit-widths is a promising technique for efficient inference across many devices and resource constraints. In contrast to static methods that…
A Comprehensive Survey on Hardware-Aware Neural Architecture Search
Hadjer Benmeziane, Kaoutar El Maghraoui, Hamza Ouarnoughi +3
Neural Architecture Search (NAS) methods have been growing in popularity. These techniques have been fundamental to automate and speed up the time consuming and error-prone process…