109 citations · 616 across the 40 of their papers we have counts for
3 papers · 1 filter
DFModel: Design Space Optimization of Large-Scale Systems Exploiting Dataflow Mappings
Sho Ko, Nathan Zhang, Olivia Hsu +2
We propose DFModel, a modeling framework for mapping dataflow computation graphs onto large-scale systems. Mapping a workload to a system requires optimizing dataflow mappings at v…
SambaNova SN40L: Scaling the AI Memory Wall with Dataflow and Composition of Experts
Raghu Prabhakar, Ram Sivaramakrishnan, Darshan Gandhi +27
Monolithic large language models (LLMs) like GPT-4 have paved the way for modern generative AI applications. Training, serving, and maintaining monolithic LLMs at scale, however, r…
Implementing and Optimizing the Scaled Dot-Product Attention on Streaming Dataflow
Gina Sohn, Nathan Zhang, Kunle Olukotun
Transformer models serve as the backbone of many state-ofthe-art language models, and most use the scaled dot-product attention (SDPA) mechanism to capture relationships between to…