Hidden Decoding at Scale: Latent Computation Scaling for Large Language Models

Aiwei Liu, Cheng Shi, Chuhan Wu +44

Scaling Large Language Models (LLMs) has been driven mainly by enlarging the Transformer backbone, but for an already-strong model this requires another round of costly pretraining…