2 citations · 2 across the 7 of their papers we have counts for
Showing cs.DCShow all
2 papers · 1 filter
cs.DC2026★ 2 cited
LLMTailor: A Layer-wise Tailoring Tool for Efficient Checkpointing of Large Language Models
Minqiu Sun, Xin Huang, Luanzheng Guo +3
Checkpointing is essential for fault tolerance in training large language models (LLMs). However, existing methods, regardless of their I/O strategies, periodically store the entir…
cs.DC2026
Scrutinizing Variables for Checkpoint Using Automatic Differentiation
Xin Huang, Weiping Zhang, Shiman Meng +4
Checkpoint/Restart (C/R) saves the running state of the programs periodically, which consumes considerable system resources. We observe that not every piece of data is involved in…