80 citations · 136 across the 7 of their papers we have counts for
Showing cs.LGShow all
2 papers · 1 filter
cs.LG2022
Schrödinger's FP: Dynamic Adaptation of Floating-Point Containers for Deep Learning Training
Miloš Nikolić, Enrique Torres Sanchez, Jiahui Wang +5
The transfer of tensors from/to memory during neural network training dominates time and energy. To improve energy efficiency and performance, research has been exploring ways to u…
cs.LG2022★ 35 cited
Mokey: Enabling Narrow Fixed-Point Inference for Out-of-the-Box Floating-Point Transformer Models
Ali Hadi Zadeh, Mostafa Mahmoud, Ameer Abdelhadi +1
Increasingly larger and better Transformer models keep advancing state-of-the-art accuracy and capability for Natural Language Processing applications. These models demand more com…