KITE: KV-Invariant Transformer Expansion for Efficient Agentic LLM Scaling

Zhiheng Hu, Yixun Wei, Jian Zhou +8

Scaling a language model is not only a question of final quality: the architectural choice determines how much computation is spent during training, prompt processing, and autoregr…