How Much of a Real Workload Can LLM-Generated GPU Kernels Actually Reach?

Gaurav Agarwal, Ashish Garg, Isha Singhal

Language models can now write GPU kernels that outperform PyTorch. We evaluate five model configurations on KernelBench level 1 and find that a frontier model produces correct kern…