Evaluating Zero-Shot Long-Context LLM Compression

Chenyu Wang, Yihan Wang, Kai Li

This study evaluates the effectiveness of zero-shot compression techniques on large language models (LLMs) under long-context. We identify the tendency for computational errors to…