CoMem: Reusing Transformer Depth across Queries with Persistent Intermediate Residuals

Hanzuo Liu, Xuan Qi, Chunyu Liu +6

Repeated queries over shared documents repeatedly execute the same lower transformer layers. We introduce CoMem, which makes split depth j an explicit reusable-context axis: write…