2 papers
cs.DC2025
10Cache: Heterogeneous Resource-Aware Tensor Caching and Migration for LLM Training
Sabiha Afroz, Redwan Ibne Seraj Khan, Hadeel Albahar +2
Training large language models (LLMs) in the cloud faces growing memory bottlenecks due to the limited capacity and high cost of GPUs. While GPU memory offloading to CPU and NVMe h…
cs.CL2025
Systematic Evaluation of Optimization Techniques for Long-Context Language Models
Ammar Ahmed, Sheng Di, Franck Cappello +3
Large language models (LLMs) excel across diverse natural language processing tasks but face resource demands and limited context windows. Although techniques like pruning, quantiz…