activity
20212026
most citedSpecInfer: Accelerating Generative Large Language Model Serving with Tree-based Speculative Inference and Verification

101 citations · 158 across the 12 of their papers we have counts for

collaborators
Showing 2026Show all

2 papers · 1 filter

cs.LG2026

FastKernels: Benchmarking GPU Kernel Generation in Production

Gabriele Oliaro, Yichao Fu, Jaeseong Lee +8

LLM-based agents for GPU kernel generation are advancing rapidly, but the benchmarks they optimize against evaluate kernels in isolation, with synthetic inputs and weak baselines,…

cs.DC2026

Event Tensor: A Unified Abstraction for Compiling Dynamic Megakernel

Hongyi Jin, Bohan Hou, Guanjie Wang +18

Modern GPU workloads, especially large language model (LLM) inference, suffer from kernel launch overheads and coarse synchronization that limit inter-kernel parallelism. Recent me…