DeltaLLM: Delta-Key Sparse Attention for Edge LLMs

Jiawen Qi, Chang Gao, Jiayu Liu +2

On-device LLM inference is increasingly important for edge platforms but remains challenging due to high computational and memory demands and tight resource constraints. Modern app…