3 papers
cs.PL2025
A Performance Model for Warp Specialization Kernels
Zhengyang Liu, Vinod Grover
This paper presents a performance model tailored for warp specialization kernels, focusing on factors such as warp size, tilling size, input matrix size, memory bandwidth, and thre…
cs.DC2024
Scaling Deep Learning Training with MPMD Pipeline Parallelism
Anxhelo Xhebraj, Sean Lee, Hanfeng Chen +1
We present JaxPP, a system for efficiently scaling the training of large deep learning models with flexible pipeline parallelism. We introduce a seamless programming model that all…
cs.PL2024
Pattern Matching in AI Compilers and its Formalization (Extended Version)
Joseph W. Cutler, Alex Collins, Bin Fan +2
PyPM is a Python-based domain specific language (DSL) for building rewrite-based optimization passes on machine learning computation graphs. Users define individual optimizations b…