activity
20222026
most citedSparse*BERT: Sparse Models Generalize To New tasks and Domains

4 citations · 6 across the 7 of their papers we have counts for

collaborators
Showing 2024Show all

2 papers · 1 filter

cs.LG2024★ 2 cited

"Give Me BF16 or Give Me Death"? Accuracy-Performance Trade-Offs in LLM Quantization

Eldar Kurtic, Alexandre Marques, Shubhra Pandit +2

Quantization is a powerful tool for accelerating large language model (LLM) inference, but the accuracy-performance trade-offs across different formats remain unclear. In this pape…

cs.CL2024

Enabling High-Sparsity Foundational Llama Models with Efficient Pretraining and Deployment

Abhinav Agarwalla, Abhay Gupta, Alexandre Marques +9

Large language models (LLMs) have revolutionized Natural Language Processing (NLP), but their size creates computational bottlenecks. We introduce a novel approach to create accura…