Enhancing Latent Computation in Transformers with Latent Tokens

Yuchang Sun, Yanxi Chen, Yaliang Li +1

Augmenting large language models (LLMs) with auxiliary tokens has emerged as a promising strategy for enhancing model performance. In this work, we introduce a lightweight method t…