116 citations · 136 across the 9 of their papers we have counts for
3 papers · 1 filter
Flashlight: PyTorch Compiler Extensions to Accelerate Attention Variants
Bozhi You, Irene Wang, Zelal Su Mustafaoglu +5
Attention is a fundamental building block of large language models (LLMs), so there have been many efforts to implement it efficiently. For example, FlashAttention leverages tiling…
Distributed Training of Embeddings using Graph Analytics
Gurbinder Gill, Roshan Dathathri, Saeed Maleki +3
Many applications today, such as NLP, network analysis, and code analysis, rely on semantically embedding objects into low-dimensional fixed-length vectors. Such embeddings natural…
CHET: Compiler and Runtime for Homomorphic Evaluation of Tensor Programs
Roshan Dathathri, Olli Saarikivi, Hao Chen +5
Fully Homomorphic Encryption (FHE) refers to a set of encryption schemes that allow computations to be applied directly on encrypted data without requiring a secret key. This enabl…