15 citations · 35 across the 27 of their papers we have counts for
3 papers · 1 filter
Mixed-Precision Quantization for Language Models: Techniques and Prospects
Mariam Rakka, Marios Fournarakis, Olga Krestinskaya +5
The rapid scaling of language models (LMs) has resulted in unprecedented computational, memory, and energy requirements, making their training and deployment increasingly unsustain…
Mixed-Precision Neural Networks: A Survey
Mariam Rakka, Mohammed E. Fouda, Pramod Khargonekar +1
Mixed-precision Deep Neural Networks achieve the energy efficiency and throughput needed for hardware deployment, particularly when the resources are limited, without sacrificing a…
BackLink: Supervised Local Training with Backward Links
Wenzhe Guo, Mohammed E Fouda, Ahmed M. Eltawil +1
Empowered by the backpropagation (BP) algorithm, deep neural networks have dominated the race in solving various cognitive tasks. The restricted training pattern in the standard BP…