Accelerating Cross-Model LLM Inference via Attention Map Reuse

Zhan Jin, Yuze Luo, Bin Cui +1

LLM-augmented data workflows often involve multiple heterogeneous models operating over substantial shared context, such as schemas, tool specifications, interaction history, and i…