Attn-GS: Attention-Guided Context Compression for Efficient Personalized LLMs

Shenglai Zeng, Tianqi Zheng, Chuan Tian +10

Personalizing large language models (LLMs) to individual users requires incorporating extensive interaction histories and profiles, but input token constraints make this impractica…