activity
20222025
most citedSpDISTAL: Compiling Distributed Sparse Tensor Computations

2 citations · 2 across the 9 of their papers we have counts for

collaborators

9 papers

cs.PL2025

Optimal Software Pipelining and Warp Specialization for Tensor Core GPUs

Rupanshu Soi, Rohan Yadav, Fredrik Kjolstad +4

GPU architectures have continued to grow in complexity, with recent incarnations introducing increasingly powerful fixed-function units for matrix multiplication and data movement…

cs.PL2025

On the Duality of Task and Actor Programming Models

Rohan Yadav, Joseph Guman, Sean Treichler +4

Programming models for distributed and heterogeneous machines are rapidly growing in popularity to meet the demands of modern workloads. Task and actor models are common choices th…

cs.DC2025

Mapple: A Domain-Specific Language for Mapping Distributed Programs

Anjiang Wei, Rohan Yadav, Hang Song +3

Optimizing parallel programs for distributed systems is a complex task, often requiring significant code modifications. Task-based programming systems improve modularity by separat…

cs.PL2025

Task-Based Tensor Computations on Modern GPUs

Rohan Yadav, Michael Garland, Alex Aiken +1

Domain-specific, fixed-function units are becoming increasingly common in modern processors. As the computational demands of applications evolve, the capabilities and programming i…

cs.LG2024

Improving Parallel Program Performance with LLM Optimizers via Agent-System Interfaces

Anjiang Wei, Allen Nie, Thiago S. F. X. Teixeira +4

Modern scientific discovery increasingly relies on high-performance computing for complex modeling and simulation. A key challenge in improving parallel program performance is effi…

cs.DC2024

Automatic Tracing in Task-Based Runtime Systems

Rohan Yadav, Michael Bauer, David Broman +3

Implicitly parallel task-based runtime systems often perform dynamic analysis to discover dependencies in and extract parallelism from sequential programs. Dependence analysis beco…

cs.DC2024

Composing Distributed Computations Through Task and Kernel Fusion

Rohan Yadav, Shiv Sundram, Wonchan Lee +4

We introduce Diffuse, a system that dynamically performs task and kernel fusion in distributed, task-based runtime systems. The key component of Diffuse is an intermediate represen…

cs.DC2024

Efficient Fault Tolerance for Pipelined Query Engines via Write-ahead Lineage

Ziheng Wang, Alex Aiken

Modern distributed pipelined query engines either do not support intra-query fault tolerance or employ high-overhead approaches such as persisting intermediate outputs or checkpoin…

cs.DC2022★ 2 cited

SpDISTAL: Compiling Distributed Sparse Tensor Computations

Rohan Yadav, Alex Aiken, Fredrik Kjolstad

We introduce SpDISTAL, a compiler for sparse tensor algebra that targets distributed systems. SpDISTAL combines separate descriptions of tensor algebra expressions, sparse data str…