MLAfication: Efficiently Enabling High-Fidelity MLA for Modern LLMs

Zile Wang, Zhide Xie, Tao Ji

Multi-Head Latent Attention (MLA) compresses the KV cache into a latent representation, reducing inference memory and bandwidth. Existing MHA2MLA/TransMLA methods do not support QK…