Showing cs.DCShow all
3 papers · 1 filter
cs.DC2025
tritonBLAS: Triton-based Analytical Approach for GEMM Kernel Parameter Selection
Ryan Swann, Muhammad Osama, Xiaohu Guo +8
We present tritonBLAS, a fast and deterministic analytical model that uses architectural parameters like the cache hierarchy, and relative code and data placement to generate perfo…
cs.DC2025
Eliminating Multi-GPU Performance Taxes: A Systems Approach to Efficient Distributed LLMs
Octavian Alexandru Trifan, Karthik Sangaiah, Muhammad Awad +5
As large language models (LLMs) continue to scale, their workloads increasingly rely on distributed execution across multiple GPUs. However, the conventional bulk synchronous paral…
cs.DC2025
SwizzlePerf: Hardware-Aware LLMs for GPU Kernel Performance Optimization
Arya Tschand, Muhammad Awad, Ryan Swann +5
Large language models (LLMs) have shown progress in GPU kernel performance engineering using inefficient search-based methods that optimize around runtime. Any existing approach la…