Showing cs.LGShow all
2 papers · 1 filter
cs.LG2026
LLM-42: Enabling Determinism in LLM Inference with Verified Speculation
Raja Gond, Aditya K Kamath, Ramachandran Ramjee +1
In LLM inference, the same prompt may yield different outputs across different runs. At the system level, this non-determinism arises from floating-point non-associativity combined…
cs.LG2025
PyGraph: Robust Compiler Support for CUDA Graphs in PyTorch
Abhishek Ghosh, Ajay Nayak, Ashish Panwar +1
Machine learning (ML) workloads launch hundreds to thousands of short-running GPU kernels per iteration. With GPU compute throughput growing rapidly, CPU-side launch latency of ker…