2 papers
cs.LG2025
Adacc: An Adaptive Framework Unifying Compression and Activation Recomputation for LLM Training
Ping Chen, Zhuohong Deng, Ping Li +6
Training large language models (LLMs) is often constrained by GPU memory limitations. To alleviate memory pressure, activation recomputation and data compression have been proposed…
cs.DC2025
Optimizing Large Model Training through Overlapped Activation Recomputation
Ping Chen, Wenjie Zhang, Shuibing He +10
Large model training often uses recomputation to alleviate memory pressure and pipelines to exploit the parallelism of data, tensors, and devices. However, existing recomputation a…