VoxZip: Semantic-Anchored Temporal KV Cache Compression for Long-Context Audio Inference

Wenxu Jia, Dongjie Fu, Xize Cheng +6

Recent advancements in Speech Large Language Models have demonstrated remarkable capabilities in understanding complex audio tasks. Despite this progress, their long-context infere…