Amplifying Latency and Cost of LLM Inference via Rowhammer Attack

Mrityunjay Shukla, Shubham Roy, Biswabandan Panda

Large language models (LLMs) achieve high inference efficiency using optimized GPU kernels generated by just-in-time (JIT) compilation frameworks such as Triton. Triton compiles GP…