100 citations · 126 across the 14 of their papers we have counts for
3 papers · 1 filter
Flashlight: PyTorch Compiler Extensions to Accelerate Attention Variants
Bozhi You, Irene Wang, Zelal Su Mustafaoglu +5
Attention is a fundamental building block of large language models (LLMs), so there have been many efforts to implement it efficiently. For example, FlashAttention leverages tiling…
How Many Parameters Does Your Task Really Need? Task Specific Pruning with LLM-Sieve
Waleed Reda, Abhinav Jangda, Krishna Chintalapudi
As Large Language Models (LLMs) are increasingly deployed for narrow tasks in resource-constrained settings, a central question arises: how much of an LLM is truly necessary for a…
MultiPL-E: A Scalable and Extensible Approach to Benchmarking Neural Code Generation
Federico Cassano, John Gouwar, Daniel Nguyen +10
Large language models have demonstrated the ability to generate both natural language and programming language text. Such models open up the possibility of multi-language code gene…