CLLMs: Consistency Large Language Models

Siqi Kou, Lanxiang Hu, Zhezhi He +2

Parallel decoding methods such as Jacobi decoding show promise for more efficient LLM inference as it breaks the sequential nature of the LLM decoding process and transforms it int…