Clustering-driven Memory Compression for On-device Large Language Models

Ondrej Bohdal, Pramit Saha, Umberto Michieli +2

Large language models (LLMs) often rely on user-specific memories distilled from past interactions to enable personalized generation. A common practice is to concatenate these memo…