FIRP: Faster LLM inference via future intermediate representation prediction

Pengfei Wu, Jiahao Liu, Zhuocheng Gong +5

Recent advancements in Large Language Models (LLMs) have shown remarkable performance across a wide range of tasks. Despite this, the auto-regressive nature of LLM decoding, which…