activity
20182024
most citedRelay: A New IR for Machine Learning Frameworks

105 citations · 149 across the 6 of their papers we have counts for

collaborators

7 papers

cs.AR2024★ 4 cited

FPGA Technology Mapping Using Sketch-Guided Program Synthesis

Gus Henry Smith, Ben Kushigian, Vishal Canumalla +6

FPGA technology mapping is the process of implementing a hardware design expressed in high-level HDL (hardware design language) code using the low-level, architecture-specific prim…

cs.LG2023★ 12 cited

Relax: Composable Abstractions for End-to-End Dynamic Machine Learning

Ruihang Lai, Junru Shao, Siyuan Feng +16

Dynamic shape computations have become critical in modern machine learning workloads, especially in emerging large language models. The success of these models has driven the deman…

cs.AR2022

Application-Level Validation of Accelerator Designs Using a Formal Software/Hardware Interface

Bo-Yuan Huang, Steven Lyubomirsky, Yi Li +10

Ideally, accelerator development should be as easy as software development. Several recent design languages/tools are working toward this goal, but actually testing early designs o…

cs.PL2021★ 26 cited

Pure Tensor Program Rewriting via Access Patterns (Representation Pearl)

Gus Henry Smith, Andrew Liu, Steven Lyubomirsky +5

Tensor kernels in machine learning (ML) often correspond to pure mathematical expressions, making term rewriting an attractive strategy for optimization and mapping to specialized…

cs.LG2020★ 2 cited

Dynamic Tensor Rematerialization

Marisa Kirisame, Steven Lyubomirsky, Altan Haan +5

Checkpointing enables the training of deep learning models under restricted memory budgets by freeing intermediate activations from memory and recomputing them on demand. Current c…

cs.LG2019

Relay: A High-Level Compiler for Deep Learning

Jared Roesch, Steven Lyubomirsky, Marisa Kirisame +7

Frameworks for writing, compiling, and optimizing deep learning (DL) models have recently enabled progress in areas like computer vision and natural language processing. Extending…

cs.PL2018★ 105 cited

Relay: A New IR for Machine Learning Frameworks

Jared Roesch, Steven Lyubomirsky, Logan Weber +4

Machine learning powers diverse services in industry including search, translation, recommendation systems, and security. The scale and importance of these models require that they…