Systematic Evaluation of Optimization Techniques for Long-Context Language Models

Ammar Ahmed, Sheng Di, Franck Cappello +3

Large language models (LLMs) excel across diverse natural language processing tasks but face resource demands and limited context windows. Although techniques like pruning, quantiz…