MOOSComp: Improving Lightweight Long-Context Compressor via Mitigating Over-Smoothing and Incorporating Outlier Scores

Fengwei Zhou, Jiafei Song, Wenjin Jason Li +4

Recent advances in large language models have significantly improved their ability to process long-context input, but practical applications are challenged by increased inference t…