6 citations · 6 across the 2 of their papers we have counts for
2 papers
cs.CL2025
LLM Inference Acceleration via Efficient Operation Fusion
Mahsa Salmani, Ilya Soloveychik
The rapid development of the Transformer-based Large Language Models (LLMs) in recent years has been closely linked to their ever-growing and already enormous sizes. Many LLMs cont…
cs.LG2024★ 6 cited
Keyformer: KV Cache Reduction through Key Tokens Selection for Efficient Generative Inference
Muhammad Adnan, Akhil Arunkumar, Gaurav Jain +3
Transformers have emerged as the underpinning architecture for Large Language Models (LLMs). In generative language models, the inference process involves two primary phases: promp…