Cassandra: Enabling Reasoning LLMs at Edge via Self-Speculative Decoding

Soongyu Choi, Yuntae Kim, Muyoung Son +1

Speculative decoding has emerged as a promising lossless approach for accelerating Large Language Models (LLMs). As reasoning LLMs increasingly suffer from decode-stage overhead an…