37 citations · 52 across the 6 of their papers we have counts for
4 papers · 1 filter
AttnFuse: A Composable DSL for Compiling Attentions to Fused GPU Kernels
Varun Kumar Dasoju, Tian Zhao
Modern AI systems are built on the Transformer architecture, whose core operation, attention, accounts for the majority of computation and memory cost. Researchers continually prop…
Hybrid JIT-CUDA Graph Optimization for Low-Latency Large Language Model Inference
Divakar Kumar Yadav, Tian Zhao
Large Language Models (LLMs) have achieved strong performance across natural language and multimodal tasks, yet their practical deployment remains constrained by inference latency…
Evaluating CUDA Tile for AI Workloads on Hopper and Blackwell GPUs
Divakar Kumar Yadav, Tian Zhao, Deepak Kumar
NVIDIA's CUDA Tile (CuTile) introduces a Python-based, tile-centric abstraction for GPU kernel development that aims to simplify programming while retaining Tensor Core and Tensor…
Analysis of DAWNBench, a Time-to-Accuracy Machine Learning Performance Benchmark
Cody Coleman, Daniel Kang, Deepak Narayanan +7
Researchers have proposed hardware, software, and algorithmic optimizations to improve the computational performance of deep learning. While some of these optimizations perform the…