9 citations · 9 across the 1 of their papers we have counts for
2 papers
cs.LG2023★ 9 cited
Microscaling Data Formats for Deep Learning
Bita Darvish Rouhani, Ritchie Zhao, Ankit More +30
Narrow bit-width data formats are key to reducing the computational and storage costs of modern deep learning applications. This paper evaluates Microscaling (MX) data formats that…
cs.LG2020
Training Large Neural Networks with Constant Memory using a New Execution Algorithm
Bharadwaj Pudipeddi, Maral Mesmakhosroshahi, Jinwen Xi +1
Widely popular transformer-based NLP models such as BERT and Turing-NLG have enormous capacity trending to billions of parameters. Current execution methods demand brute-force reso…